sixth sense

Download Sixth sense

Post on 22-May-2015




3 download

Embed Size (px)


Sixth Sense technology proposed by Pranav Mistry.


  • 1. In 1997 the first headworn Sixth sense technology device was developed. This was the origin of the sixth sense technology. Later in 1998 a neckworn sixth sense device was developed.

2. The SixthSense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the users pocket. 3. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces. 4. While the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques. 5. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the users fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi- user interaction. 6. The SixthSense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system. 1. The projector displays a map on the wall, and the user can control the map using zoom and pan gestures. 7. 2. A number pad is projected onto the user's palm, and the user can dial a phone number by touching his palm with a finger. t was hinted that the system is able to pin point the location of the palm. 8. 3. The user can pick up a product in supermarket and the system could display related information (e.g. the amount of bleach used) back on the product itself. 9. 4. The user can draw a circle on his wrist, and the system will project a clock on it. Note this demo hinted at the ability to accurately detect the location of the wrist. 10. 5.The prjector can project the entire news paper infront of the user. It can project it wither on a white paper or even on a hand. 11. 6.It is also used to display contents from internet and project them on any piece of paper. 12. Although the SixthSense technology achieved wide press coverage in 2009, no commercial product had been released at that time. As of September 2013, the open source code published has not been updated since October 2012,and the Java development branch of the project was similarly stalled. With many users encountering difficulties compiling and running the source code, the technology itself has not spread as widely as its media coverage. Pranav Mistry hinted at several reasons for not being able to deliver the technology so far. 13. The price for developers preview is around $350. It is hinted that the device needs to incorporate newer hardwares and there is also need to remove dependencies on proprietary Microsoft code libraries before the commercial release.