gesture recognition technology-seminar ppt
TRANSCRIPT
1
GESTURE RECOGNITION TECHNOLOGY
PRESENTED BY :-Suraj Kumar Rai Roll:- GUIDED BY :-
2Contents Introduction Motivation Gesture types Input devices Challenges Uses References
3Introduction What are Gestures?
A form of non-verbal communication. Movement of the hands, face, or other parts of the
body. What is Gesture Recognition?
Interpreting human gestures via mathematical algorithms.
Gestures as input to control devices or applications.
4
EXAMPLE
A smart TV recognizing the hand movement to control the channels or to select a option from the menu.
5
Gesturing is a natural form of communication Gesture naturally while talking
Babies gesture before they can talk
Interaction problems with the mouse Have to locate cursor
Hard for some to control (Parkinsons or people on a train)
Limited forms of input from the mouse
Motivation
6Gesture types In computer interfaces, two types of gestures
are distinguished. Offline gestures
Processed after the user’s interaction with the object. Ex:- gesture to activate a menu.
Online gestures Direct manipulations like scaling and rotating.
7Basic Working of Gesture Recognition Technology
Gesture Recognit
ion System
User interface display
Standard web camera
userUpdating
object
Image capture
Image input
Hand movement
8Input devices
Tools to track a person's movements Wired gloves Depth aware cameras Stereo cameras Gestures based Controller Single camera
9Technology Behind it..Wired gloves
Provides input to the computer about the position and notation of the hands.
Uses fiber optic cables running down the back of the hand. Light pulses are created and when the fingers are bent, and is registered giving an approximation of the hand pose.
10Technology Behind it..
Stereo cameras It has two lenses about the same
distance apart as your eyes and take two pictures at a same time.
A 3D representation can be approximated by the output of the cameras.
11
12Challenges
Lack of Gesture Language Different users make gestures differently,
causing difficulty in identifying motions
Robustness Many gesture recognition systems do not
read motions accurately or optimally due to factors like insufficient background light, high background noise etc.
13Uses
1.Sign Language Recognition
Just as speech recognition can transcribe speech to text, certain types of gesture recognition software can transcribe the symbols
represented through sign language into text.
142.Virtual Controllers
For systems where the act of finding or acquiring a physical controller
could require too much time, gestures can be used as an
alternative control mechanism. Controlling secondary devices in a
car, or controlling a television set are examples of such usage.
3.Remote ControlThrough the use of gesture recognition, remote control with the wave of a hand of various devices is possible.
Uses/Conclusion
15
Machine wheel chairs are coming with gesture based system. The movement of
the hand will act as a controller of speed as well
as direction
In video game consoles such as Microsoft X-box with kinect sensors, often the user is the controller and has to perform all physical movements that they desire the character in
the game to do.
4.Aid to PhysicallyChallenged
5.Immersive Gaming Technology
Uses
16References
Ying Wu and Thomas S. Huang, "Vision-Based Gesture Recognition: A Review", In: Gesture-Based Communication in Human-Computer Interaction, Volume 1739 of Springer Lecture Notes in Computer Science, pages 103-115,
Matthias Rehm, Nikolaus Bee, Elisabeth André, Wave Like an Egyptian - Accelerometer Based Gesture Recognition for Culture Specific Interactions, British Computer Society, 2007
Pavlovic, V., Sharma, R. & Huang, T. (1997), "Visual interpretation of hand gestures for human-computer interaction: A review", IEEE Trans. Pattern Analysis and Machine Intelligence., July, 1997. Vol. 19(7), pp. 677 -695
17
Any Questions??