device based gesture recognition - unifr.ch · glove based gesture recognition a data glove is a...

12
  Device based gesture recognition Damien Zufferey Seminar on gesture recognition Autumn semester 2009

Upload: others

Post on 24-Aug-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Device based gesture recognition

Damien Zufferey

Seminar on gesture recognitionAutumn semester 2009

Page 2: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Contents

Introduction Gesture definition Accelerometer based gesture recognition

Overview / Process / Application / Evaluation

Glove based gesture recognition Overview / Process / Application / Evaluation

Discussions Questions

Page 3: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Introduction

”Human – Machine” interactions Reduce barrier between them More natural communication

Solution ? => Gesture recognition

Page 4: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Gesture definition

Difficult exercise to give a general definition With a focus on device based gesture recognition,

we have : Static gesture (posture) Dynamic gesture (gesture)

Page 5: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Accelerometer based gesture recognition

Device equiped with 3­axis accelerometer Wii Controller (Wiimote) SoapBox

Accelerometer provides Data vectors for acceleration in space (x,y,z)

Sample of gestures to be recognized :

Page 6: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Process

Filtering Quantizer Model Classifier

idle statedirectional equiv.

k-mean HMM Bayes

afterbefore

Page 7: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Application – Evaluation

Wiimote : recognition rate of 90 % A set of 5 clearly different gestures 15 training for each gesture

SoapBox : recognition rate of 95 % A set of 8 clearly different gestures 6 training for each gesture

=> Application: a controller for TV or VCR

Page 8: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Glove based gesture recognition

A data glove is a glove­like input device detection of bending of fingers (basic feature) detection of movements of the wrist (possible feature) An optical or magnetic tracking system to detect glove 

position/motion in 6 DOF (possible feature)

Page 9: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Process

Filtering due to lighting conditions, position informations can be 

very noisy

Postures are taught to the system by simply performing them should be held between 300­600 milliseconds to be 

recognized by the system

Gestures simply a sequence of postures

Page 10: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Application – Evaluation

Evaluation through a demo application virtual 3D desktop controlled with gestures

Some difficulties users are not accustomed to this device sometimes it is necessary to individually adapt the 

definition of some postures.

Page 11: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Discussions

Accelerometer based to many training (laborious for the user) a small set of clearly different gestures

Glove based equipment too intrusive for the user

Page 12: Device based gesture recognition - unifr.ch · Glove based gesture recognition A data glove is a glovelike input device detection of bending of fingers (basic feature) detection of

  

Questions

?