PowerPoint Presentation

SEMINAR PRESENTATIONONSIXTH SENSE TECHNOLOGY: A VARIANTFOR UPCOMING TECHNOLOGIES

CONTENTSIntroductionEvolutionSoftwareHardware ComponentsWorkingRelated TechnologiesApplicationsAdvantages and DisadvantagesConclusionReferences

Sixth sense is a wearable gestural device that augments the physical world around us with the digital information.Technology that plays with human gestures to make the world more interactive and workflow easier.It is portable device that is worn around neck.

INTRODUCTION

Steve Mann is considered the father of sixth sense technology.He invented a wearable computer device in 1990s.His work was carried forward by Pranav Mistry, of Indian origin, a PhD student in the Fluid Interfaces Group at the MIT Media Lab.

Pranav MistryEVOLUTION OF SIXTH SENSE TECHNOLOGY

SOFTWAREThe Sixth Sense prototype runs on windows operating system.

Major part of the software is coded in C# and C++

COMPONENTSCameraColor markersProjectorMirrorMobile componentMicrophone

CAMERA

The camera captures an object in view and tracks the users hand gestures.It sends the data to smart phone which runs sixth sense software.

The user has to wear marker caps (red, blue, green, yellow) known as visual tracking fiducials on the tip of his finger.It helps the camera to track the movements of the users finger.

COLOR MARKERS

The projector is the key output device.The projector projects visual information enabling surfaces and physical objects to be used as interface.

PROJECTOR

Mirror reflects the projection coming out from projector and thus helps in projecting out onto the desired location on walls or surfaces.

MIRROR

Mirror

The smartphone runs the sixth sense software to process the video stream data captured through the camera.It is used for computation and communication purpose.

MOBILE COMPONENT

The microphone is an optional component. It is required only when paper is used as an computing interface.The microphone captures the sound signals and sends it to the smart phone for processing.

MICROPHONE

WORKING

1. Augmented Reality

The Augmented Reality is a visualization technology that allows the user to experience the virtual world added over real world in real time. Sixth sense technology uses this concept to super impose digital information on the real world.

RELATED TECHNOLOGIES

2. Gesture recognition

It is a technology which is aimed at interpreting human gestures with the help of mathematical algorithms. Gestures can originate from any bodily motion or state but commonly originate from the face or hand.

The sixth sense software recognizes the following three types of gestures:Multi-touch gesturesEg: pinching and dragging FreeHand gesturesEg: clicking a pictureIconic gesturesEg: drawing a star for weather

3. Computer vision techniques

Computer Vision is the technology in which machines are able to interpret or extract necessary information from an image. This technology includes various fields like image processing, image analysis, pattern recognition.

Make a call

You can use the Sixth Sense to project a keypad onto your hand, then use that virtual keypad to make a call. The map application

With the map application we can call up the map of our choice and then use thumbs and index fingers to navigate the map

Check the time

Draw a circle on your wrist to get a virtual watch that gives you the correct timeCreate multimedia reading experiences

Sixth Sense can be programmed to project related videos onto newspaper articles you are reading

Drawing application

The drawing application lets the user draw on any surface by tracking the fingertip movements of the users index fingerZooming features

The user can zoom in or zoom out using intuitive hand movements

Get product information

Sixth Sense uses image recognition or marker technology to recognize products we pick up, then feeds us information on those productsGet book information

The system can project Amazon ratings on that book, as well as reviews and other relevant information

Get flight updates

The device can also tell the user whether your flight is delayed or on time and by looking at the ticket. Feed information on people

The system will project relevant information about a person such as what they do, where they work, and so on.

Take pictures

If you fashion your index fingers and thumbs into a square ("framing" gesture), the system will snap a photo.

After taking the desired number of photos, we can project them onto a surface, and use gestures to sort through the photos, and organize and resize them.

Connectedness between the world and information.PortableMulti-touch interactions.Data access directly from machine in real time.Open sourceCost effective

No privacyIntelligence opening doors for criminalsHealth issuesThere is no easy way to fix if device breaksThe device doesn't project on hard surfacesADVANTAGESDISADVANTAGES

Use of papers and pens will decrease. Online shopping may become easy if, Virtual changing room, where one can give his body measurements and try clothes on a virtual copy of his image, is created by web developers. It can become a fifth sense for handicapped people.New way of teaching in Education System. Videos can be widely annotated by physical events side by sideCONCLUSION

[1] Sixth Sense Technology by Abhinav Sharma, Mukesh Agarwal, Anima Sharma, Sachin Gupta, International Journal IJRITCC Volume 1, Issue 4, 277-282. [2] Gesture Based Interface Using Motion and Image Comparison by Shany Jophin, Sheethal M.S, Priya Philip, T M Bhruguram, IJAIT Vol. 2, No.3, June 2012. [4] Real Time Hand Gesture Interface for Computing Environment by Shitalkumar Pawar and M.A. Sayyad, International Journal of Computer Applications (0975 8887)(ICRTET'2013). [5] WUW - Wear Ur World - A Wearable Gestural Interface by Pranav Mistry, Pattie Maes and Liyan Chang , MIT Media Lab, ACM 978-1-60558-246-7/09/04.

REFERENCES