joe romano 09.02...joe romano 09.02.10 2 haptics • “the study of the sense of touch.”...

22
Joe Romano 09.02.10

Upload: others

Post on 06-Aug-2021

40 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

Joe Romano09.02.10

Page 2: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

2

Haptics• “The study of the sense of touch.”

Neuroscience

Robotics

Page 3: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

3

Haptics

• Kinesthetic (proprioceptive) and tactile (cutaneous) feedback

• Inherently bidirectionalSensing and actuating are linkedControl becomes a “logical loop”

Page 4: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

4

Robots look stupid without tactile sensing

Page 5: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

5

Dangerous and unnecessary damage to robot and environment

Page 6: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

6

Advances in PR2 Tactile Sensing this Summer

• Delicate grasping and manipulation• Contact event detection (even through hand-held

objects and tools)

Page 7: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

7

Tactile SensorsHuman

Johansson and FlanaganNature Reviews Neuroscience

Robot

Page 8: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

8

How Humans Grasp

Johansson and Flanagan

Page 9: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

9

How The Robot Grasps

SA-I

FA-I

FA-II

Page 10: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

10

How The Robot Grasps

Page 11: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

11

Initial Grip Force Estimation

Page 12: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

12

Additional Results

=

Slip PerformanceReduced Motor Effort

Reduced Grip Force

Page 13: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

13

Grasp Pipeline

Page 14: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

14

Pick and Place

Page 15: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

15

Event Detection

• Table contact (Kaijen)• High-fives (me)• Beer hand-off (Gil)• Arm impact (Sachin)• Tools (Peter)

Page 16: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

16

Event Detection

Page 17: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

17

Event Detection

Page 18: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

18

Future Work

• Integrate proprioceptive information

• Improve the initial force estimate in grasp-pipeline using additional information

• Learning manipulation task state through observing actions and feedback

Page 19: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

19

Code Availability• Package: pr2_gripper_sensor_action

Released as part of grasp-pipeline 0.22Heavily documented on ROS Wiki

Page 20: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

20

Code Availability

• Package: haptic_event_detectorPart of trunk sandbox

• Package: pr2_propsPart of trunk sandboxDocumented on the Wiki

Page 21: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

21

Thanks• My advisors: Gunter/Kaijen (Katherine at Penn)

• Sachin, Matei, Derek

Page 22: Joe Romano 09.02...Joe Romano 09.02.10 2 Haptics • “The study of the sense of touch.” Neuroscience Robotics 3 Haptics • Kinesthetic (proprioceptive) and tactile (cutaneous)

Thanks to everyone at Willow for a great summer!