space robotics: enabling autonomy in challenging...
TRANSCRIPT
![Page 1: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/1.jpg)
RoboticsEnabling Autonomy in Challenging
Environments
Ioannis Rekleitis
Computer Science and Engineering,
University of South Carolina
CSCE 19021 Oct. 2014
Ioannis Rekleitis 1
![Page 2: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/2.jpg)
Why Robotics?
Driverless CarTED talk: S. Thrun
Underwater exploration, BarbadosMars exploration rover (MER) animation
Roomba® vacuuming robot in action Ioannis Rekleitis 2
![Page 3: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/3.jpg)
Present Everywhere
• At home
• On the road
• In the sky (drones)
• In the fields
(agricultural robotics)
• In resource utilization
(ROV in the oil industry)
• Along power lines
• EducationI. Rekleitis McGill University
![Page 4: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/4.jpg)
Robotics becomes affordable
I. Rekleitis McGill University
AR.DRONE Kinect
IMU
GPS
Raspberry Pi
Lego Mindstorm
TurtleBot 2
![Page 5: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/5.jpg)
Ioannis Rekleitis 5
![Page 6: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/6.jpg)
Robotic System
Ioannis Rekleitis 6
Sensors Actuators
World
?
![Page 7: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/7.jpg)
Robotic System
Ioannis Rekleitis 7
Sense ActWorld
Plan
![Page 8: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/8.jpg)
Sensors
Ioannis Rekleitis 8
• Proprioceptive Sensors(monitor state of robot)
– Battery Voltage
– IMU (accels & gyros)
– Wheel encoders
– Doppler radar
– GPS …
• Exteroceptive Sensors(monitor environment)
– Cameras (single, stereo, omni, FLIR, RGB-d, …)
– Laser scanner
– MW radar
– Sonar
– Tactile
– Chemical
– Olfactory…
![Page 9: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/9.jpg)
Perception
Sensing the world
versus
Understanding the world
Ioannis Rekleitis 9
![Page 10: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/10.jpg)
Three Main Challenges in Robotics
• How to Go From A to B ? (Path Planning)• What does the world looks like? (mapping)
– sense from various positions– integrate measurements to produce map– assumes perfect knowledge of position
• Where am I in the world? (localization)– Sense– relate sensor readings to a world model– compute location relative to model– assumes a perfect world model
• Together, the above two are called SLAM(Simultaneous Localization and Mapping)
10Ioannis Rekleitis
![Page 11: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/11.jpg)
Robot Map
World
11Ioannis Rekleitis
Stage, Actor, and Representation
![Page 12: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/12.jpg)
Robot Map
World
12Ioannis Rekleitis
Stage, Actor, and Representation
•Indoor/Outdoor•2D/2.5D/3D•Static/Dynamic•Known/Unknown•Abstract (web)
![Page 13: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/13.jpg)
Robot Map
World
13Ioannis Rekleitis
Stage, Actor, and Representation
•MobileIndoor/OutdoorWalking/Flying/Swimming
•Manipulator•Humanoid•Abstract (web-bot)
![Page 14: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/14.jpg)
Robot Map
World
14Ioannis Rekleitis
Stage, Actor, and Representation
•Topological•Metric•Feature Based•1D,2D,2.5D,3D
![Page 15: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/15.jpg)
Robot Map
World
15Ioannis Rekleitis
Stage, Actor, and Representation
•Indoor/Outdoor•2D/2.5D/3D•Static/Dynamic•Known/Unknown•Abstract (web)
•Topological•Metric•Feature Based•1D,2D,2.5D,3D
•MobileIndoor/OutdoorWalking/Flying/Swimming
•Manipulator•Humanoid•Abstract (web bot)
![Page 16: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/16.jpg)
Mapping• What the world looks like?
• Knowledge representation
– Robotics, AI, Vision
• Who is the end-user?
– Human or Machine
• Ease of Path Planning
• Uncertainty!
16
3D Laser point clouds
Occupancy Grid
Appearance basedIoannis Rekleitis
![Page 17: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/17.jpg)
Appearance based Mapping
• 1000Km Trajectories
Ioannis Rekleitis
Mark Cummins and Paul Newman. ``Appearance-only SLAM at Large Scale with FAB-MAP 2.0”. The International Journal of Robotics Research. November 2010
17
![Page 18: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/18.jpg)
Appearance based Mapping
Ioannis Rekleitis
Successful Loop Closures False Loop Closures
18
![Page 19: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/19.jpg)
Where am I?Localization
• Tracking: Known initial position
• Global Localization: Unknown initial position
• Re-Localization: Incorrect known position
– (kidnapped robot problem)
19Ioannis Rekleitis
![Page 20: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/20.jpg)
Localization
Initial statedetects nothing:
Moves and detects landmark:
Moves and detects nothing:
Moves and detects landmark:
20Ioannis Rekleitis
![Page 21: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/21.jpg)
Motion Planning• The ability to go from A to B
– Known map – Off-line planning
– Unknown Environment –Online planning
– Static/Dynamic Environment
Ioannis Rekleitis 21
qgoalqinit
qgoal
qgoalqinit
qinit
![Page 22: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/22.jpg)
Bug StrategyInsect-inspired “bug”
algorithms
Ioannis Rekleitis 22
“Bug 1” algorithm
• known direction to goal
• otherwise only local sensing
walls/obstacles encoders
1. head toward goal
2. if an obstacle is encountered, circumnavigate it and remember how close you get to the goal
3. return to that closest point (by wall-following) and continue
![Page 23: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/23.jpg)
More Complex Path Planning
Ioannis Rekleitis 23
![Page 24: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/24.jpg)
Historical Overview
• Factory automation
– (1950-now)
Ioannis Rekleitis 24
![Page 25: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/25.jpg)
Historical Overview
• Factory automation
• Indoor environments
– 1990-2005
Ioannis Rekleitis 25
![Page 26: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/26.jpg)
Historical Overview
• Factory automation
• Indoor environments
• Field Robotics
– 2005-future
Ioannis Rekleitis 26
![Page 27: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/27.jpg)
Highlights: Mapping the Titanic
Ioannis Rekleitis 27
Ryan Eustice, Hanumant Singh, John Leonard, Matthew Walter and Robert Ballard, Visually navigating the RMS Titanic with SLAM information filters. In Proceedings of the Robotics: Science & Systems Conference, pages 57-64, June 2005.
![Page 28: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/28.jpg)
Highlights: Many Quadrotors
Ioannis Rekleitis 28
V. Kumar, GRASP Lab,University of Pennsylvania
![Page 29: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/29.jpg)
Highlights: Legged Locomotion
Ioannis Rekleitis 29
![Page 30: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/30.jpg)
Highlights: DARPA Grand Challenge
• 2004: Mojave Desert USA, 240 km– CMU Sandstorm traveled
the farthest distance, completing 11.78 km
• 2005: Mojave Desert USA, 240 km– Stanford’s Stanley, first
place 6h54m
– CMU’s Sandstorm, second place 7h05m
Ioannis Rekleitis 30
![Page 31: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/31.jpg)
Highlights: DARPA Urban Challenge 2007
• George Air Force Base, California. 96 km urban area course
Ioannis Rekleitis 31
CMU’s BOS,first place 4h10m
Stanford’s Junior, second place 4h29m
![Page 32: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/32.jpg)
Driverless Car
• Safer
• More efficient
• Enable people
Ioannis Rekleitis 32
• The Nevada law went into effect on March1, 2012, and the Nevada Department ofMotor Vehicles issued the first license for aself-driven car in May 2012. The licensewas issued to a Toyota Prius modifiedwith Google's experimental driverlesstechnology.
• Google driverless car, with a test fleet ofautonomous vehicles that as of May 2012has driven 282,000 km.
![Page 33: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/33.jpg)
Another trendMobile Manipulation
The robots have only interpreted the world, in various ways; the point is to change it1.
Ioannis Rekleitis 331Paraphrasing a philosopher of the 19th century.
http://pr.cs.cornell.edu/videos.php
![Page 34: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/34.jpg)
Human-Robot Interaction
Ioannis Rekleitis 34
![Page 35: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/35.jpg)
Conclusions• It has been an exciting learning/working experience
– "My robot is misbehaving today!"
• I like what I am doing
• Computer Science– New and Dynamic Science
– Combines Theory and Practice
– Results are visible
– Changes the way we live (Robotic Technology everywhere)
• More Intelligence and Autonomy required– In Space
– In Production
– At Home
– On the road Ioannis Rekleitis 35
![Page 36: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/36.jpg)
CSCE Courses in Robotics
• CSCE 274
• CSCE 574
• CSCE 774
Ioannis Rekleitis 36
![Page 37: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments](https://reader036.vdocuments.mx/reader036/viewer/2022062609/60fdd5d1cc141e7ddf64bcdb/html5/thumbnails/37.jpg)
Questions?
Ioannis Rekleitis 37
Halifax, Nova Scotia, Canada Fisherman’s Reef, Barbados