Sixth Sense Technology based Virtual mouse and

Virtual drawing

Presented by:-Ms.Priyanka JainMr.Sudhir RautMr.Harshal RingeMr.Mayur Patil

Guided by:-Prof Deepali Gothawal

D.Y Patil College of Engineering, Akurdi (Pune), India

Contents

What is Virtual Reality? Introduction Features Requirements How camera captures work? Processing and Overall Execution Sequence Proposed System Applications Future Scope Conclusion Reference

What is virtual reality

Removing the standard input and output and building wearable computer system to create realistic environment for user software interaction.

Many input devices like camera, mic, sensors to make it easy to handle and make tough enough to develop

Introduction

Developing a advance human interaction system using computer vision.

Where, System will look for human behavior Process the action and convert to input Last perform a user defined action

Where we can provide a vision to industrial robots.

Features

Virtual paint brush using Red laser pointer Where user draw any thing on plane white surface

and it get drawn on computer

Finger motion based mouse control User move finger in air and system detect it

Hand gesture based photo snap shots Human hand position to grab image

Requirements

Development tools Microsoft Visual Basic

Operating System Microsoft Windows 98 or higher

Hardware Web camera, Laser Pointer

How Capture Work?

Camera Driver

Capture Window

Start Capturing

Show In Picture

Box

Fig 1: Interface of camera with computer

Processing

Capturing Camera View

Getting Current Frame out of it

Creating Memory Image

Finding Pixel RGB

Comparing Pixel color

Decision making

Overall Execution Sequence

Fig 2: Processing and Overall execution

Pixel Properties

.Y=50

X=75

A = GetPixel ( x , y )

255 255 255 = white

ExtractRGBFromColor(A, red, green, blue)

Laser Drawing

Fig 3: Virtual Drawing

How Drawing

VB Provides a picture box control to work as Drawing Pad

Using Function and property PictureBox.Line (x1,y1)-(x2,y2) PicuteBox.BackColor = ? PictureBox.ForeColor = ? PictureBox.DrawWidth + ?

Image Grabbing

Fig 4: Auto Image Grabbing

Grabbing Image

Once system process image and get Left , Top , Height , Width

Copy Image in to temporary picture boxUsing Function

SavePicture(FileName)

Save Image on diskCalled Auto Image Grabbing

Mouse Motion

Fig 5: Virtual Mouse

Mouse Control

In this module system will continuously track for finger

Finger has red color spot Image processing part will get the X, YPass these X, Y to the function

SetCursorPos()

It will control mouse motion

Application

Gaming is one of the major application which can avoid unnecessary wiring problems.

Defense Robots is also one of the application that can have wide scope in military applications.

Future Scope

Face based retailing systemsReading live news papersZooming features for Image grabbingShutdown

Conclusion

Sixth Sense technology is next generation

method to virtually communicate with the

systems now by implementing this proposed

system we are trying to give vision to

computer system for better and easy

interaction

References

S. Sadhana Rao “Sixth Sense Technology” Proceedings of the International Conference on Communication and Computational Intelligence – 2010, Kongu Engineering College, Perundurai, Erode, T.N., India.27 – 29 December, 2010.pp.336-339.

Sixth Sense- A Wearable Gestural Interface by P.Mistry, P. Maes.

http://blog.ted.com/2009/03/sixth_sense_pranav.php

http://en.wikipedia.org/wiki/

http://www.media.mit.edu/research/highlights/sixthsense-wearable-gestureal-interface augment-our-eorld

Thank - you