The Second Prototype

Having settled on DI instead of FTIR for the time being, I went ahead and built a bigger, but still fairly small prototype table that i could use to develop the software (as opposed to a full-size one, since i dont have that much room in my office. The full size will come later when I have the software working well, and have written a few apps for it).

So, here is the second prototype (sans camera, i haven’t mounted it in there yet, but it goes just in front of the mirror. I had it sitting on some books for the testing I have done up to this point, i took it out to take IR photos of single malt scotch for my previous post, and I forgot to put it back in for these, so you will have to use your imagination)

dsc_2055.jpg
The Table is only 640mm high, and fits under my desk. I may even put wheels on it to make it easier to move out of the way when I am not using it.

dsc_2058.jpg

The surface is just tracing paper, and the plexiglass is cut to fit one sheet exactly.

dsc_2057.jpg

The plexi is actually two layers of 3mm (since it was easily purchased form the local hardware store). I haven’t yet got around to buying a new sheet of 6mm or better. The double layer works fine for DI, i dont think it would work very well for FTIR tho. If you press hard, there is still a bit of bowing in the center, I dont really recommend the double layer, but it works if you dont have a single sheet of the right thickness.

dsc_2050.jpg

dsc_2049.jpg

The two IR illuminators, 840nm, which is just in the right range for the fire-i camera. they are 12v, powered by my 5/12v experimenting supply. Eventually i will just by a 12V wall wart for them. Altho they have a pretty purple color here, (thanks to my digital camera) to the naked eye you can only see a very dim red glow when they are on (since they are so close to the visible spectrum at 840nm). I have put some of the tracing paper into the glass covers to make them more diffuse, I also taped over the photosensitive resistor so that they are always on (they were originally for nighttime illumination for CCTV cameras) They are actually a bit close to the surface here, and they give a very spotlight-like coverage (even with the diffuser) which isnt exactly what you want. it makes the illumination very uneven, which causes the threshold filter to lose the blobs in the dark areas even though they are perfectly visible. This seems to be the big problem with the DI setup, nice even light coverage. I spent a great deal of time tweaking it before i came to the conclusion that i should be able to deal with the uneven coverage in software. Like a variable threshold. My thought is that if i put something that has roughly the same IR reflectance and my fingers (the cardboard back of the tracing pad is pretty close) and use that to cover the whole surface, then i can take a snapshot of that and use that to analyze the coverage of the IR lights. Once i have a lighting brightness map, i can use that to scale the threshold values accordingly and hopefully be able to easily pick out the blobs i want even as they pass from light to dark. More on that later, once i have tried it out.

dsc_2053.jpg

The projector is a ViewSonic PJ556d (which has a latency of about 1/20th of a second according to my tests, which is a bit slower than i want, but still passable). You can also see my super-duper-pro-plywood-scrap projector mount and adjustable rotation mirror. As crappy as it looks, it work fairly well, I can move the mirror back and forth to adjust the image on the surface. The surface is not 4×3 (obviously) and at the distance I have right now, my projection is just wide enough to cover the whole surface (the whole exposed surface i should say, since there is a 43mm border all around from the wood i used.) but i have spill on the top and bottom, which i use the mirror adjustment to put where i want (generally so I can see the menu bar on top). The projector has a native rez of 1024×768, so that is also nice. It can go as high as 1280 × 1024 (or maybe even higher) but that seems silly, since it is just scaling the image, and looks terrible. I am sticking to 1024×768.

As for control, I am using my powerbook g4 12″, which also has a native rez of 1024×768, so i can easily run it in mirror mode when i am testing, or run as a second monitor so i can see all the config stuff on the powerbook and still get the ‘real’ image on the surface.

Unibrain fire-i IR

After much waiting (like four days, they were actually very quick, but as i have mentioned, i am very impatient) I got the fire-i camera:

dsc_2046.jpg

There it is, with my 3-ply film-negative visible light filter professionally taped onto the 4.3/no IR lens.

Here are the obligatory IR shots:
First, here is the apple remote illuminating me making a silly face. Here is a hint tho: maybe dont use the apple remote when doing this kind of shot. iTunes went mad, and i found out if you hold down the play/pause button for too long, your computer will go to sleep.
photo-56.jpg

And here is the standard: ‘Hey IR makes liquids look clear! shot’, usually done with a cola of some sort. Shown here to also work with single malt scotch.

photo-57.jpg

Quick review: the unibrain fire-i is a pretty damn good camera. I highly recommend it for any of your fire-wire camera needs. One thing however, it is not autofocus. (which in this case, is a good thing) but you can see form the above images if you are just waving the thing around and not focusing it, then it can get a bit blurry. However, in the multitouch table it is fantastic. (and another problem i had with the iSight: autofocus. It wouldnt shut off! and since i had remove some of the optics, it could never find a good focus so it would constantly go from end to end of its focal length, which was quite annoying. You can turn that stuff off, but it is a giant pain in the ass. Just get the fire-i)

Multitouch recognition software

Ok, So I am a mac guy. Not a zealot mind you, but I develop software for the mac, it is what i do for a living. But, why reinvent the wheel? there is a great library for machine vision stuff already available: touchlib. I suggest if you are doing any multitouch stuff, to start there. . Also, if you are a mac person, you should check out the Mac Touchlib Install Tutorial at nuigroup.

This is where i started. however, step one (download and install darwinports) was taking too long (i am very impatient :-) so i started writing my own blob detector. By the time i got to step 4 I already had a working (albeit very very poorly) blob detector using my crummy modified iSight as the input source. (note: i didn’t really start from scratch. I had already done some firewire capture projects based around this excellent and easy to use framework: CocoaSequenceGrabber by Tim Omernick. So really all i did was take a quick background capture, subtract it from the source image, and then do a simple threshold to get my blobs, this took all of about 20 minutes. of course, that is the easy bit :-)

Anyhow, since I was already going down the path of doing it myself, i figured i might as well do it all the way, so I abandonded the touchlib and started my own Obj-C/Cocoa multi-touch project. (which i will post once it is in a form that I feel OK letting into the wild).

Here is a screengrab of a very very early version (let’s call it 0.01 beta :-)

picture-2.png

All it does right now is does some basic image processing to get the blobs in a nice findable state (ie monochrome, difference matte, threshold) then identifies them with a simple raster/recursive algorithm, and then build a blob event list based on how far they have moved, whether they are ‘new’ or whatever. (ie if they havent moved too far in one frame they are considered the same blob, otherwise they are new etc..)

I am currently working on a configuration program now that I have the basic blob detection working.

The FTIR Prototype

First off, I wanted to do an FTIR surface. I wanted to start small, make an experimental surface just for testing and such. My first surface only measured 280mm x 190mm.
dsc_2043.jpg

As far as a camera, I was being very very impatient, and since I had some old external iSight cameras laying around, i decided to use one of those. One of the more important parts of the camera setup is the visible light filter. According to many good sources gleaned from the helpful forums at nuigroup.com, one good cheap way to do a visible light filter is to find some old film negatives and use the black bits at the end of the roll where they have basically been processed with no light exposure (ie a full black frame, like taking a picture of the inside of your lens cap). The hardest part of this was finding some old film. I havent used a film camera for 10 years or more. Luckily, my lovely girlfriend is a bit less of a techno-nerd than I so she still had some old photo laying about and I managed to scavenge 3 whole 35mm frames of black goodness. I taped those to the front of the iSight and got ready to go!

Now, unfortunately, while the iSight CCD is in fact quite sensitive to IR, it does have an IR filter inside it’s optics. After doing some web searches to see if anyone had any experience removing the IR filter from an iSight i did run across a few people who said that there was one in there, but it was hard to get to (and had i read further i would have also noticed the advice that removing the IR optics bit resulted in an unusably short focal length, but I didnt) NOTE: if you have an external iSight, do NOT (i repeat: DO NOT) use it for FTIR or IR in general. you will be very disappointed.
I did however persevere and (since i have two of the externals and I am too lazy to sell them on eBay) went ahead and dissected my iSight. If for some reason you MUST use your iSight as an IR sensitive camera (don’t) then here is how you do it briefly: take the thing apart. It is pretty self-explanatory. Remove lots of tiny screws, pry those little tabs etc.. once you get the actual CCD (the little black cube on the little daughterboard) you need to take the screws off the bottom of that as well, and pull teh little cube apart. There is a tiny chunk of coated glass about 3mm on a side, and about 2mm thick, it has a slight red sheen, that is the IR filter, take it out. (if i havent made it clear that this will really screw up your focus, take note: this will screw up your focus (ie can only focus very very close to the camera)).. once you have removed that, you can re-assemble and you are ‘good to go’ (ie it will suck)

Ok, on to the lighting. Since the local Bunnings (hardware store in Melbourne, AU) only had plexiglass that is about 2 mils (and you really want something thicker than 5 for FTIR) I had to switch gears mid-prototype and go with a Diffused Illumination scheme.

Here is a very early shot of the small surface with two IR illuminators and the modified iSight with film-negative filter:

photo-43.jpg

Luckily, the small surface was fairly close to the modified iSight, so it isn’t too out of focus. It was at this point that I ordered a unibrain fire-i OEM Board camera. I also got the 4.3mm lens without the IR coating and a wide lense (just to see). But while i waited on that, my extracraptacular prototype was ready for me to write some software…

multi-touch beginning

So, awhile back i saw this cool thing by Jef Han. And it turns out the genius of it is that doing that isn’t actually that expensive or difficult, so much that there is a budding international community of DYI Multitouchers (sounds kinky, i know).

Since machine vision has always been a fascination of mine (i even started a visual gesture recognition project using the isight so you could do jedi-style gestures to control the computer, but i never finished it) I decided to give this multi-touch thing a go.

This was about a month ago. Now that the second prototype is nearly done (and kinda sorta working) i decided to blather on about it on here so that I maybe my experience will help others who are trying the same things.

Allow shipping time when extending Apple’s limited warranty to an AppleCare Protection Plan

Wow, I just spent 25 minutes on the phone with Apple Support. It was very professional and pleasant, even the time spent on hold listening to the likes of Moby and some groovy R&B, but completely unnecessary.

A word to the wise — allow for shipping time so your AppleCare Protection Program box arrives before your limited warranty expires, or just do the upgrade over the phone in the first place.

I bought a Mac mini a year ago and use it as a file server and central backup device for my network. Apple sent me a nice note a few weeks ago that my 1 year limited warranty was about to expire — would I like to purchase an AppleCare Protection Plan and extend my coverage another two years? I really like my mini and it's a crucial part of my business, so sure! But of course, Platforms took my attention for a few weeks, and I remembered on the last day of my mini's coverage that I needed to renew.

No problem I thought, it was still Oct. 6 in Cupertino, so I hopped on to apple.com/support, paid them my money, and expected to receive a "thanks for extending" message, or at least an email containing the magic enrollment number which I could plug in to the APP signup page. Instead, they had to ship something to me. Uh oh.

I received the box today, so I went to enroll online. But it wouldn't let me and told me to call Apple Support. After a 20 minute game of giving my serial number, then holding, then giving the contract number, then holding, then being asked where I bought the mini, then holding, then told I needed to fax the APP receipt to Apple (which I had just *bought* from Apple), then holding, then giving my APP web order number, hold, APP enrollment number (second time I gave it), hold, APP serial number from the box, hold, then a big hold for 5 minutes — finally I was told without fanfare that I was all set and to expect confirmation in the mail in two weeks.

I was ready to fight, but thankfully didn't have to. After all, I'm probably throwing $161.48 (pesky NY sales tax) straight into their bank account, as I've only ever needed service on my macs 4 times in 27 years of Mac ownership. (One was on a Mac Plus, the other 3 were laptops.) And if you wanted to get technical, I did purchase my plan before the limited warranty expired. But even so, I'm not trying to sneak in a few extra days, just add two years to the original expiration date and we're all happy.

Even tho I presented her with a bit of a gray-area problem, I have to think some fat could be trimmed from their process. What does 25 minutes of Phone Support Girl's time cost Apple, I wonder?

Apple Event Today: my .mac iDisk already bigger

Apple intro'd a bunch of things today: iMac, iLife '08, iWork '08, among other things — including up to 10GB of iDisk space. They're promising everyone will see it by August 14. I'm lucky enuf to have mine already.

.mac System Preferences didn't show it immediately, but I went in to the web control panel and it showed 10240 MB total. I fussed with my allocation between iDisk and Email and voila!

But why are email only accounts still hobbled at 50MB? I nearly went on a rant about Email Only accounts still being at 50MB, however this article proves me wrong. Little known fact: Email Only accounts now have a fairly healthy 512MB. Still not Gmail-sized, but also ad-free for $10.

I do like that .mac is now allowing you to bring your own domain name. Finally I can recommend iWeb with one less reservation — tho you do still need the initial .mac account. Rapidweaver still wins on price alone, if only I were more impressed by their templates.

Cuddly with a Cold

cuddly the cuttlefish with a cold
Ever since i drew the first ‘Cuddly the Cuttlefish’ my girlfriend, Leonie has been obsessed with cartoon cuttlefish. It was meant to be a one-off exercise, i kinda picked a random subject: the cuttlefish, and i drew it. The first few i drew from reference pictures (gotta love google images) were fairly realistic, but it leant itself to a nice cartoonization (if i may use that term) so i went ahead and made the original ‘Cuddly’ below.

This week both Leonie and I got a cold, nothing life threatening, but many many tissues were used. So, after repeated requests at drawing more cuttlefish, the cold became the impetus for the most recent Cuddly. (or should it be Cuttly?

cuddly the cuttlefish with a cold with sketchwork

And just for giggles: this is the sketchwork behind the ‘finished’ piece. (if you could call it finished, since it really is just a sketch in and of itself). All this was done on the wacom pad, in illustrator (cs2, dont have 3 yet) with the simplest round brush, 3 point diameter, and a 2 point pressure variation. I have sorta come to like that setting for most everything. (after much tweaking. it gives me a nice range of sizes, and allows for some nice flowing strokes, but without going too big). Since i mostly like just using pencils on paper when i am going analog, i find this nice minimal setting to be similar in simplicity to pencils. I rarely use anything else on the wacom (when drawing in any case, once the piece is drawn, then i might go back and fiddle with stroke weights and go in a micro-manage the points, but for the initial drawing, all 3-point round brush for me)

Cuddly the Cuttlefish

cuttlefish.jpgcuddlythecuttlefishwhitebg.gif

Here is todays sketch, it is Cuddly the Cuttlefish! The original pencil sketch is there, and the digital re-draw. I dont use live trace or anything like that (although i have in the past, and it is really cool.) Instead i place the jpg of the pencil sketch into illustrator, then trace it with the paintbrush to get the outline right. With the wacom i can use the pressure and get some nice organic outlines.

For the colors i went to this cool site, and typed in ‘fish’ into the palette search and found a zillion nice sea-color-palettes.

Illustration Friday

twist.gif

Since I have been doing more illustration lately ( a blast form the past, tho i have missed it) i decided to start in earnest to try and exercise my art muscle. In that vein i am trying to do a sketch of something or another every day. And the online ‘contests’ help with inspiration. One of those is Illustration Friday.

This is my first entry into the very cool Illustration Friday contest. I dont really hope to garner any notice from it, but i think that the idea behind IF is to force you to draw. And that is what i did. I drew so many little whorls and loops and ‘twists’ not to mention there are faces, at least one Cthulu, lots of spiders, a panda, a bunny, a cat, a bunch of DNA and many many other micro-sketches.

I did this on my brand-spankin-new Wacom intuos 3, which is pretty badass. I have been the king of teh mouse-drive pen-tool in illustrator for years now, and i would never have done a piece like this one without the wacom. it took me a long time, but the i think that the diversity of the shape and width that i got automatically from the wacom really helped make the doodles look nice as a background texture. Had i used the mouse and the pen (or brush even) like i normally used to do all my illustrator work, it would have taken me ten times as long, and looked worse because all the lines would be the same width.

anyhoo, yay! wacom intuos 3!