tele-operation of a humanoid robot, using operator bio-data
DESCRIPTION
We present our work on tele-operating a complex hu- manoid robot with the help of bio-signals collected from the operator. The frameworks (for robot vision, collision avoidance and machine learning), developed in our lab, allow for a safe interaction with the environment, when combined. This even works with noisy control signals, such as, the operator’s hand acceleration and their elec- tromyography (EMG) signals. These bio-signals are used to execute equivalent actions (such as, reaching and grasp- ing of objects) on the 7 DOF arm.TRANSCRIPT
![Page 1: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/1.jpg)
#iSAIRAS 2014
tele-operation for humanoid using operator bio-data
!
M. Luciw, A. Förster, J. Schmidhuber !
istituto dalle molle di studi sull’intelligenza artificiale università della svizzera italiana
idsia / usi / supsi
Jürgen ’Juxi’ Leitner
![Page 4: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/4.jpg)
manipulation
!
aimed at
[Metta et al., 2010]
![Page 6: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/6.jpg)
avoidancecollision
![Page 7: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/7.jpg)
MoBeE v1[Frank et al., 2011,2012, 2013]
![Page 8: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/8.jpg)
![Page 9: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/9.jpg)
MoBeEv2[Frank et al., 2011,2012, 2013]
![Page 10: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/10.jpg)
hand/armop-space forcing
CSWorld
CSHand
CSR/CSL
[Leitner et al, in prep]
-
![Page 11: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/11.jpg)
!
objectsdetecting
![Page 12: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/12.jpg)
rocksdetecting
e.g. [Leitner et al., i-SAIRAS’12]
![Page 13: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/13.jpg)
![Page 15: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/15.jpg)
repertoire[Leitner et al, in prep]
![Page 16: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/16.jpg)
operationtele
![Page 17: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/17.jpg)
acquisitionemg
![Page 18: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/18.jpg)
classificationemg
![Page 19: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/19.jpg)
acquiringemg
![Page 20: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/20.jpg)
iEMGboard
![Page 21: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/21.jpg)
+ acceleration
![Page 22: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/22.jpg)
hand/armop-space forcing
CSWorld
CSHand
CSR/CSL
-
CSHand’
![Page 23: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/23.jpg)
hand/armop-space forcing
![Page 24: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/24.jpg)
hand/armop-space forcing
![Page 25: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/25.jpg)
workfuture
human-robot interaction
variable autonomy
action outcome/prediction
WaY better classification
![Page 26: Tele-operation of a Humanoid Robot, Using Operator Bio-data](https://reader034.vdocuments.mx/reader034/viewer/2022042700/55738a89d8b42a9f288b4bd1/html5/thumbnails/26.jpg)
for listeningthanks
http://Juxi.net/projects !