sixth sense technology report by rishiraj singh ranawat
Post on 21-Aug-2014
Embed Size (px)
DESCRIPTION1A SEMINAR REPORT ON“SIXTH SENSE TECHNOLOGY”SIR PADAMPAT SINGHANIA UNIVERSITYSubmitted By: RISHIRAJ SINGH RANAWAT 09EC000620 ECE –VI SEM SEC – A2SIR PADAMPAT SINGHANIA UNIVERSITYBONAFIDE CERTIFICATECertificate that this seminar report “SIXTH SENSE TECHNOLOGY” is the Bonafide work of “RISHIRAJ SINGH RANAWAT” who carried out the seminar Work under my supervision.SIGNATUREMR. UDAYPRAKASH R. SINGH (HEAD OF THE DEPARTMENT)SIGNATUREMR. HIMANSHU PUROHIT (COORDINATOR) (ASSISTANT PRO
A SEMINAR REPROT ON
SIXTH SENSE TECHNOLOGY
SIR PADAMPAT SINGHANIA UNIVERSITY
Submitted By: RISHIRAJ SINGH RANAWAT 09EC000620 ECE VI SEM SEC A
SIR PADAMPAT SINGHANIA UNIVERSITYBONAFIDE CERTIFICATECertificate that this seminar report SIXTH SENSE TECHNOLOGY is the Bonafide work of RISHIRAJ SINGH RANAWAT who carried out the seminar Work under my supervision.
SIGNATUREMR. UDAYPRAKASH R. SINGH (HEAD OF THE DEPARTMENT)
SIGNATUREMR. HIMANSHU PUROHIT (COORDINATOR) (ASSISTANT PROFFESOR)
ELECTRONICS AND COMMUNICATION DEPARTMENT SIR PADAMPAT SINGHANIA UNIVERSITY BHATEWAR, UDAIPUR RAJASTHAN
ABSTRACT'Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. All of us are aware of the five basic senses seeing, feeling, smelling, tasting and hearing. But there is also another sense called the sixth sense. It is basically a connection to something greater than what their physical senses are able to perceive. To a layman, it would be something supernatural. Some might just consider it to be a superstition or something psychological. But the invention of sixth sense technology has completely shocked the world. Although it is not widely known as of now but the time is not far when this technology will change our perception of the world. Pranav Mistry, 28 year old, of Indian origin is the mastermind behind the sixth sense technology. The device sees what we see but it lets out information that we want to know while viewing the object. It can project information on any surface, be it a wall, table or any other object and uses hand / arm movements to help us interact with the projected information. The device brings us closer to reality and assists us in making right decisions by providing the relevant information, thereby, making the entire world a computer.The Sixth Sense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system. The map application lets the user navigate a map displayed on a nearby surface using hand gestures, similar to gestures supported by Multi-Touch based systems, letting the user zoom in, zoom out or pan using intuitive hand movements. The user can stop by any surface or wall and flick through the photos he/she has taken. Sixth Sense also lets the user draw icons or symbols in the air using the movement of the index finger and recognizes those symbols as interaction instructions. For example, drawing a magnifying glass symbol takes the user to the map application
or drawing an @ symbol lets the user check his mail. The SixthSense system also augments physical objects the user is interacting with by projecting more information about these objects projected on them. The current prototype system costs approximate $350 to build.
TABLE OF CONTENTS
TITLE ABSTRACT LIST OF FIGURES
PAGE NO. 3 5
INTRODUCTION 1.1 INTRODUCTION 1.2 INVENTOR 7 9
THE SIXTH SENSE DEVICE 2.1 COMPONENTS 2.1.1 Camera 2.1.2 Projector 2.1.3 Color Marker 2.1.4 Smartphone 2.1.5 Mirror 2.2 TECHNOLGIES 2.3 WORKING 2.4 APPLICATIONS 2.5 ADVANTAGES 10 10 11 11 11 11 12 16 19 21 23 24
LIST OF FIGURESFIG NO. NAME OF THE FIGURE PAGE NO
1.1 2.1 2.2
Pranav Mistry Sixth Sense Device Working of device
9 10 16
1.1 INTRODUCTION We've evolved over millions of years to sense the world around us. When we encounter something, someone or some place, we use our five natural senses to perceive information about it; that information helps us make decisions and chose the right actions to take. But arguably the most useful information that can help us make the right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world. Information is confined traditionally on paper or digitally on a screen. SixthSense bridges Seamlessly integrating it with reality, and thus making the entire world your computer. this gap, bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand gestures. SixthSense frees information from its confines by Sixth Sense technology is the science of tomorrow with the aim of connecting the digital world with the physical world seamlessly, eliminating hardware devices. Mistrys flirtations with the digital world began in the early 2000s when he pieced done is combine a number of standard gadgets including a webcam, projector together four mouse rollers with pulleys and springs to give shape to a motion sensing device. It is similar to Telepointer, a neck worn projector/camera system developed by Media Lab student Steve Mann (which Mann originally referred to as "Synthetic Synesthesia of the Sixth Sense"). What the researchers have, and
mobile phone, to form a brand new interaction experience. In its current form the battery-powered projector is attached to a hat, the webcam is hung around the neck (or also positioned on a hat), and the mobile phone provides the connection to the Internet. The wearer uses hand gestures combined with the gadgets to perform actions. So, for example, they could make a circle over their wrist with the fingers of one hand. WUW would recognize this action and project a clock face on to their wrist. Make a picture frame with both your hands and WUW will take a picture as if it was a camera. Stand near a wall and you can get a projected desktop allowing you to open applications, view the pictures youve taken, or surf the Net. With the invention of intuitive computer interfaces, the digital and physical worlds came together closer than ever. One just has to place an object (anything from a flight boarding pass to a key) on a Tangible Public Map (TaPuMa) on its horizontal smart screen to get inside-out information about it. Keep a coffee cup on a particular spot on the map and a whole range of cafs in the area is brought to you on a platter. All you have to do to get seamlessly connected with the digital world is wear a simple pendant-like equipment consisting of a camera and a portable battery-powered projection system with a mirror (a more modish version is just round the corner). The device (now known as the Sixth Sense Device) when connected to a cell phone acts as a computation and communication tool. The camera tracks hand gestures and helps gather Meta information (information from the surroundings) and articulates it with the digital domain. Wearing marker caps on ones fingers (a more stylish option is to paint the said fingernails in a different color each) and making gestures with them, one can use any interface to access and modify data. Clicking a picture is as easy as conjuring up a rectangle in the air aimed at the object of visual desire with the thumb and index fingers. A few finger motions help
edit and resize pictures and another set of gestures later, the pictures find themselves E-mailed to recipients.
Fig 1.1 Pranav mistry Pranav Mistry, 28 year old, of Indian origin is the mastermind behind the sixth sense technology. Born in Palanpur, Gujarat he received his Bachelors of technology in computer science and engineering from India and later received masters in design from MIT Boston. He invented Sixth Sense / WUW ( Wear UR World) which is a wearable gestural , user friendly interface which links the physical \world around us with digital Information and uses hand gestures to interact with them. Pranavs eagerness to pop pixels out of the digital world into the real world led to the birth of Sixth Sense technology.The device sees what we see but it lets out information that we want to know while viewing the object. It can project information on any surface, be it a
wall, table or any other object and uses hand / arm movements to help us interact with the projected information.
THE SIXTH SENSE DEVICE
Fig 2.1 sixth sense device
2.1 COMPONENTS The devices which are used in sixth sense technology ra : 1. 2. 3. 4. 5. Camera Projector Colour Marker Smartphone Mirror
2.1.1.CAMERA It captures the image of the object in view and tracks the users hand gesture. The camera recognizes individuals, images, pictures, gestures that user makes with his
hand. The camera then sends this data to a smart phone for processing. Basically the camera forms a digital eye which connects to the world of digital information 2.1.2 PROJECTOR The information that is interpreted through the smart phone can be projected into any surface. The projector projects the visual information enabling surfaces and physical objects to be used as interfaces. The projector itself consists of a battery which have3 hours of battery life. A tiny LED projector displays the data sent from the smart phone on any surface in view- object, wall or person. The downward facing projector projects the image on to a mirror
2.1.3.COLOR MARKERS There are color markers placed at the tip of users finger. Marking the users fingers with red, yellow green and blue colored tape helps the webcam to recognize the hand gestures. The movements and arrangement of these markers are interpreted into gestures that act as a interaction instruction for the projected application interfaces.