Presented by- GAURAV SINGH RAWAT

SYSTEMS ENGINEERING

Sixth Sense Technology

IntroductionComponents WorkingApplication

Contents

Steve Mann is father of sixth sense who made a wearable computer in 1990. The Sixth Sense Technology was first implemented as the neck worn projector + camera system. He was a media lab student at that time. There after it was used and implemented by an Indian who is the man has become very famous in the recent Pranav Mistry. There will be a long future rather than the short period of history for the Sixth Sense technology.

HISTORY

Sixth Sense is a wearable gestural interface that argument the physical world around us with digital information and lets us use natural hand gestures to interact with that information.

It was developed by Pranav Mistry, a PhD student on the fluid interfaces group at the MIT Media Lab.

Sixth sense comprises a projector pockets, a mirror and a camera. The hardware component like a mobile wearable device.

Sixth sense technology was developed at media labs in MIT and coined as Wear Ur World (WUW).

Introduction

SeenTaste SmellTouchHearSix sense device

Senses

Augmented RealityGesture RecognitionComputer VisionRadio Frequency Identification

Related Technology

It is a term for a live direct or indirect view of a physical real world environment whose elements are augmented by virtual Computer generated imagery.

It is related to a more general concept called mediated reality, in which a view of reality is modified (possibly even diminished rather than augmented) by a computer.

Augmented Technologies

It is a topic in Computer science and language technology with the goal of interpreting human gesture via mathematical algorithms.

Gestures can originate from any bodily motion or state but commonly originate from the face or hand.

Gesture recognition can be seen as a way for computers to begin to understand human body language, thus building a richer bridge between machines and humans than primitive text user interfaces or even GUIs (graphical user interfaces), which still limit the majority of input to keyboard and mouse.

Gesture Recognition

It is the science and technology of machines that see. It is concerned with the theory behind artificial systems that exact information from images.

Tasks of computer vision:1. Recognition2. Motion analysis3. Scene Reconstruction4. Image restoration

Computer Vision

It is basically an electronic tagging technology that allows the detection, tracking of tags and consequently the objects that they are affix to.

The tag contains electronically stored information which may be read from up to several meters away.

Access management Tracking of goods Tracking of persons and animals Toll collection.

RFID(Radio Frequency Identification)

Hardware component are coupled in a pendent like mobile wearable devices.

Camera Projector Mirror Mobile component color markers

Components

Capturing an object in view and tracks the users hand gestures.

Sends the data to the smart phone.It acts as a digital eye, connecting you to

world of digital information.

Camera

The projector projects visual information enabling surfaces and physical objects to be used as interfaces.

Projector has a battery inside with 3 hours of battery life.

A tiny LED projector displays data sent from the smart phone on any surfaces in view object, wall or person.

Projector

The usage of the mirror is significant as a projector dangles pointing downwards from the neck.

Mirror

Smart phone• A web enabled smart phone in the user’s

pocket process the video data.• Other software reaches the web &

interprets the hand gesture.

It is at the tip of the user’s fingers.Marking the user’s fingers with red, yellow,

green, blue tapes helps the webcam recognizes gesture.

The movement and arrangements of these markers are interpreted into gestures that act as interaction for the projected application interfaces.

Color markers

send for Capture

processing

Send information Project Reflect desired

image surfaces

How it work?

Images Picture

sgesture

Camera

Mobile(smart phone)

Into a surfaceMirrorsProjector

1. Ball mouse.

Earlier Exploration

A pen that can draw in 3 dimension

A Google map that can interact with physical world.

Make a call (keypad on your hand virtual keypad to call.)

Call up a map (navigate maps).

Application

Take a picture (index fingers & thumbs into a square system snap a photo).

Zoom edit email (after taking the pics you can project them onto the surface zoom in or zoom out by hand movement).

3D Drawing application: simply using the index finger you can draw.

Get product information: marker technology to recognize product we pick up then feeds us information on those product.

Get books information: You can get the book information via just hold books.

Check the time: Draw a circle in your wrist to get a virtual watch that gives you the correct time.

Get flight updates: Recognize your boarding pass and let you know whether your flight is on time and if gate has changed feed information on people.

The system will project relevant information about a person what they do, where they work and so on..

Creating multimedia reading experience: programmed to project related videos onto newspaper articles you are reading.

Weather information: Get the weather information directly to the newspaper.

Tablet pc by paper:Using microphone Surfing internet Watching moviePlaying motion sensing game

KNOW ABOUT PERSON

WATCHING PAPER NEWS

Weather info and flight info

Portability Supports multi touch and multi user

interactionConnection between world and information.Data access directly from machine in real

time.It is and open source(make own hardware

and application)Cost effective. This technology can be used as a replacement

of the 5th senses for handicapped peoples.

Advantages

Sixth sense recognizes the objects around us, displaying information automatically and letting us to access it in any way we need. The sixth sense prototype implements several application that demonstrate the usefulness, viability, and flexibility of system. Allowing us to interact with this information via natural hand gesture. This can provide easy control over machineries in industry. This will enable individuals to make their own application depending upon needs and imagination.

Conclusion

Sixth Sense devices are very much different from the computers; this will be a new topic for the hackers and the other people also. First thing is to provide the security for the Sixth Sense applications and devices. Lot of good technologies came and died due to the security threats. There are some weaknesses that can reduce the accuracy of the data. Some of them were the on palm phone keypad. It allows the user to dial a number of the phone using the keypad available on the palm. There will be a significant market competitor to the Sixth Sense technology since it still required some hardware involvement with the user.

Future Scope

http://boingboing.net/2009/11/12/sixth-sensetechnolo.htmlhttp://gizmodo.com/5167790/sixth-sensetechnology-

maychange-how-welook-at-the-world-foreverhttp://www.ted.com/talks/pattie-mass-demos-

thesixthsense.htmlhttp://theviewspaper.net/sixthsense-technology-

willrevolutinizetheworldhttp://www.freshcreation.com/entry/sixth-sense-technology/http://www.vsrdjournals.com/CSIT/Issue/2012_08_August/

Web/3_Monika_Arora_893_Research_Communication_CSIT_August_2012.pdf

http://www.pranavmistry.com/projects/sixthsense/

References

Sixth sense technology via video

Thank you

Questions?