SIXTH SENSE

‘SixthSense is a

Wearable gestural interface that augments the physical world around us with digital information and lets ususe natural hand gesturesto interact with that Information. This brilliant ideaWas proposed by Young Indian Scientist PRANAV MISTRY

ORIGINIn 1997 the first headworn Sixth sense technology device was developed.This was the origin ofthe sixth sense technology. Later in 1998 a neckworn sixth sense device wasdeveloped.

THE CONSTRUCTION & WORKINGThe SixthSense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket.

The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces.

• While the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques.

• The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction.

PRACTICAL LIFE APPLICATIONSThe SixthSense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system.

1. The projector displays a map on the wall, and the user can control the map using zoom and pan gestures.

2. A number pad is projected onto the user's palm, and the user can dial a phone number by touching his palm with a finger. t was hinted that the system is able to pin point the location of the palm.

3. The user can pick up a product in supermarket and the system could display related information (e.g. the amount of bleach used) back on the product itself.

4. The user can draw a circle on his wrist, and the system will project a clock on it. Note this demo hinted at the ability to accurately detect the location of the wrist.

5.The prjector can project the entire news paper infront of the user. It can project it wither on a white paper or even on a hand.

6.It is also used to display contents from internet and project them on any piece of paper.

•

DEVELOPMENT • Although the SixthSense technology achieved

wide press coverage in 2009, no commercial product had been released at that time. As of September 2013, the open source code published has not been updated since October 2012,and the Java development branch of the project was similarly stalled. With many users encountering difficulties compiling and running the source code, the technology itself has not spread as widely as its media coverage. Pranav Mistry hinted at several reasons for not being able to deliver the technology so far.

COMMERCIAL DETAILS• The price for developer’s preview is around $350.

• It is hinted that the device needs to incorporate newer hardwares and there is also need to remove dependencies on proprietary Microsoft code libraries before the commercial release.

THANK YOU

HARI PUNEETH AKHIL