Wearable Computer with Projection and Gesture Recognition

Pattie Maes presentation at TED shows a very cool prototype for wearable, useful computing spearheaded by Pranav Mistry (who received a standing ovation at TED). It’s a wearable device with a projector that paves the way for profound interaction with our environment.

The prototype of the system cost only $350. The software, created by them, obviously is the key, but how amazing is that, $350 for the hardware used in the prototype! There is a useful web site on the Sixth Sense project.

The SixthSense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user’s hand gestures and physical objects using computer-vision based techniques.

The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction.

Curious Cat Gadgets

Wearable Computer with Projection and Gesture Recognition

3 thoughts on “Wearable Computer with Projection and Gesture Recognition”