gesture recognition system

23
Free Powerpoint Templates Page 1 STURE RECOGNITION SYST -Presented by Prashant Kumar 2016MB35 Application of ICT School of Management Studies, MNNIT, Allahabad

Upload: kumar1992prashant

Post on 15-Apr-2017

109 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Gesture Recognition System

Free Powerpoint Templates Page 1

GESTURE RECOGNITION SYSTEM

-Presented byPrashant

Kumar2016MB35

Application of ICT

School of Management Studies, MNNIT, Allahabad

Page 2: Gesture Recognition System

Free Powerpoint Templates Page 2

OVERVIEWWhat is Gesture?Introduction – Gesture RecognitionTypes of Gesture Recognition

Hand Gesture RecognitionFacial Gesture RecognitionSign Language RecognitionTypes of Gesture Sensing

Technology Electrical field sensing technology Device sensing technology Vision based technology

Technology BehindUses & ApplicationsConclusion

Page 3: Gesture Recognition System

Free Powerpoint Templates Page 3

What is gesture? A gesture is a form of non-verbal communication. Body motions involving physical movements of the fingers,

hands, arms, face, or body with the intent of conveying meaningful information.

Definition by Kurtenbach and Hulteen (1990): “A gesture is a motion of the body that contains information. Waving goodbye is a gesture. Pressing a key on a keyboard is not a gesture because the motion of a finger on its way to hitting a key is neither observed nor significant. All that matters is which key was pressed”.

Military air marshals use hand and body gestures to direct flight operations aboard aircraft carriers.

Page 4: Gesture Recognition System

Free Powerpoint Templates Page 4

Gesture recognition is a topic in Computer Science and Language Technology with the goal of interpreting human gestures via mathematical algorithms.

It can be seen as a way for computers to begin to understand Human Body Language, thus building a richer bridge between machines and humans than primitive text user interfaces or even GUIs (Graphical User Interfaces), which still limit the majority of input to keyboard and mouse.

It can be conducted with techniques from computer vision, image processing, motion sensing, etc.

It is an important skill for robots that work closely with humans.

Introduction :gesture Recognition

Page 5: Gesture Recognition System

Free Powerpoint Templates Page 5

Basic working of gesture

recognition technologyGesture

Recognition System

User interface display

Standard web camera

Updating object

Image capture

Image input

Hand

movement

Page 6: Gesture Recognition System

Free Powerpoint Templates Page 6

A child being sensed by a simple gesture recognition algorithm detecting hand location and movement.

Page 7: Gesture Recognition System

Free Powerpoint Templates Page 7

Page 8: Gesture Recognition System

Free Powerpoint Templates Page 8

Types of gesture Recognition

Hand gesture recognition Facial gesture recognition Sign language

recognition

Page 9: Gesture Recognition System

Free Powerpoint Templates Page 9

Type 1 :Hand gesture RecognitionHand gesture recognition is one obvious way to create a

useful, highly adaptive interface between machines and their users.

It would allow for the operation of complex machines using only a series of finger and hand movements, eliminating the need for physical contact between user and machine.

Page 10: Gesture Recognition System

Free Powerpoint Templates Page 10

Type 2 :Facial Gesture RecognitionThe goal of Facial

Gesture Recognition is to make machine effectively understand human emotions, regardless of the countless physical differences between individuals.

Facial Gesture Recognition can be used for purposes related to personal security & law enforcements.

Page 11: Gesture Recognition System

Free Powerpoint Templates Page 11

Type 3 :Sign language Recognition

Certain types of gesture recognition software can transcribe the symbols represented through sign language into text.

Effective sign language recognition can help the deaf people to communicate with both other people as well as the machine.

Page 12: Gesture Recognition System

Free Powerpoint Templates Page 12

Types of gesturesensing technology

Electrical field sensing technology

Device sensing technology

Vision based technology

Page 13: Gesture Recognition System

Free Powerpoint Templates Page 13

Type 1 : Electrical field

sensing technology Proximity of a human body or body part can be measured by sensing electric fields.

These measurements can be used to measure the distance of a human hand or other body part from an object; this facilitates a vast range of applications for a wide range of industries.

Page 14: Gesture Recognition System

Free Powerpoint Templates Page 14

Type 2 : DeviceSensing technology

Device-based techniques use a glove, stylus, or other position tracker, whose movements send signals that the system uses to identify the gesture.

The glove is equipped with a variety of sensors to provide information about hand position, orientation, and flex of fingers.

Page 15: Gesture Recognition System

Free Powerpoint Templates Page 15

Type 3 :Vision based technology

There are two approaches to vision based gesture recognition: Model based techniques:

They try to create a three dimensional model of the users hand and use this for recognition.

Image based methods:Image-based techniques detect a gesture by capturing pictures of a user’s motions during the course of a gesture.

Page 16: Gesture Recognition System

Free Powerpoint Templates Page 16

Technology Behind

Page 17: Gesture Recognition System

Free Powerpoint Templates Page 17

Tech behind - Wired Gloves

This uses fiber optic cables running down the back of the hand. Light pulses are created when the fingers are bent, and is registered giving an approximation of the hand pose.

They can detect finger bending with a high degree of accuracy (5-10 degrees).

Page 18: Gesture Recognition System

Free Powerpoint Templates Page 18

Tech behind - Stereo Cameras

A Stereo camera is a camera that has two lenses about the same distance apart as our eyes and takes two pictures at the same time. This simulates the way we actually see and therefore creates the 3D effect when viewed.

Using two cameras whose relations to one another are known, a 3D representation can be approximated by the output of the cameras.

Page 19: Gesture Recognition System

Free Powerpoint Templates Page 19

Tech behindController Based

Gestures These controllers act as an extension of the body so that when gestures are performed, some of their motion can be conveniently captured by software.

Mouse gestures are one example, where the motion of the mouse is correlated to a symbol being drawn by a persons hand.

Page 20: Gesture Recognition System

Free Powerpoint Templates Page 20

Socially assistive robotics Motion capture

Interactive Floors & Walls Aid to physically challenged

Uses & Applications

Page 21: Gesture Recognition System

Free Powerpoint Templates Page 21

Page 22: Gesture Recognition System

Free Powerpoint Templates Page 22

Conclusion Gesture recognition algorithm is relatively durable and

accurate. Convolution can be slow, so there is tradeoff between

speed and accuracy. This computing is not only going to reduce the

hardware impact of the system but also it increases the range of usage of physical world object instead of digital objects like keyboards, mouse.

Page 23: Gesture Recognition System

Free Powerpoint Templates Page 23

Any Questions...???