robotics: science and systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/rss overview...
TRANSCRIPT
![Page 1: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/1.jpg)
Robotics: Science and Systems
Zhibin (Alex) LiSchool of Informatics
University of Edinburgh
Overview of Robotics
![Page 2: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/2.jpg)
Outline
2
❏ Definition: what are robots? ❏ Elements of robotics
❏ Mechanism & mechanical design❏ Actuation❏ Sensing❏ Motion capabilities: manipulation, locomotion & localization ❏ Artificial Intelligence (AI)❏ Level of robot intelligence
❏ Areas of robotics❏ Industrial/civil applications❏ Educational purposes❏ Research directions
❏ Robot control❏ Summary of key RSS elements❏ Robotics in real-world application: a field test
![Page 3: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/3.jpg)
Key elements of RSS
Basic robotics knowledge (property of the system):
1. Robot Kinematics & Dynamics
Process of information:
2. System Identification & State Estimation3. Kalman Filter
Mobile robots:
4. Localization and Mapping5. Path & Motion Planning
3
![Page 4: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/4.jpg)
Key elements of RSS
Planning of articulated robots:
1. Trajectory Planning and Motion Planning
Control:
2. Digital System & Control3. Design of Advanced Controllers4. Optimization5. Model Predictive Control
Machine learning:
6. Machine Learning for Robot Control4
![Page 5: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/5.jpg)
What are robots?
5
![Page 6: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/6.jpg)
An interdisciplinary area of science & engineering that covers: mechanical engineering, electrical engineering, computer science, and AI.
The word “robot” was introduced to the public by Czech writer Karel Čapek in his play R.U.R. (Rossum's Universal Robots) in 1920. In Czech, the same as other Slavic languages, “robota” means “labour” or “work”.
Original purpose of robots, automatic/autonomous labour that frees humans from tedious jobs.
Robotics
6
![Page 7: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/7.jpg)
© R.U.R. - Wikipedia
Rossum's Universal Robots
7
© Edward Alderton Theatre, image by Kevin Coward
![Page 8: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/8.jpg)
Robotics is the science & technology that deals with a variety of elements related with developing such machines or mechatronic devices, eg design & fabrication of the hardware, sensing & controls, and the applications.
Robotics
8
![Page 9: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/9.jpg)
Eric: UK's first robot
9
UK’s first robot, and most interestingly, it is a humanoid robot.
Built in 1928 by Captain Richards & A.H. Reffell
See more at: http://www.sciencemuseum.org.uk/visitmuseum/plan_your_visit/exhibitions/eric
![Page 10: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/10.jpg)
Robots: machines that automate some behavior
The first industrial robot: Unimate
George Charles Devol developed the prototype of Unimate in 1950s, the first material handling robot employed in industrial production work.
The first Unimate robot was sold to General Motors in 1961.
10
Unimate Robot, © the history channel
![Page 11: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/11.jpg)
Robots: machines that automate some behaviorHigh-speed motion control
11© ABB Robotics
Robot Kinematics & DynamicsSystem IdentificationKalman FilterDigital System & controlDesign of Advanced ControllersTrajectory Planning and Motion Planning
![Page 12: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/12.jpg)
Robots: machines that automate some behavior
Sorting parcels in warehouse application
12
Digital System & controlLocalization and MappingPath & Motion Planning
![Page 13: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/13.jpg)
Robots: machines that automate some behavior
13
Spot-mini and Handle robots from Boston Dynamics
![Page 14: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/14.jpg)
Robots: machines that automate some behavior
14
Ocean one, © Stanford University
![Page 15: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/15.jpg)
Robots: machines that automate some behavior
15
Valkyrie Robot, © University of Edinburgh
Related RSS elements:Robot Kinematics & DynamicsSystem Identification & State EstimationKalman FilterDigital System & controlDesign of Advanced ControllersOptimizationModel Predictive ControlTrajectory Planning and Motion Planning
![Page 16: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/16.jpg)
Mechanism & mechanical design
16
![Page 17: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/17.jpg)
Design of humanoid robots
Honda Asimo robots
17
![Page 18: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/18.jpg)
Design of humanoid robots
HRP robots
18Robots are getting lighter and stronger
![Page 19: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/19.jpg)
Biomimetic robot
19
©Festo robot
![Page 20: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/20.jpg)
Biomimetic robot
20
![Page 21: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/21.jpg)
Biomimetic robot
21
Biomimetics and Dexterous Manipulation Lab, Stanford
![Page 22: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/22.jpg)
Smart mechanism
Metamorphic robots kings, see video
22
From Prof. Jian S. Dai, King's College London: http://nms.kcl.ac.uk/jian.dai/research.html
![Page 23: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/23.jpg)
Design of energy-efficient robotic legs
Smart design of using soft elements for strong energy.
23W. Roozing, Z. Li, G. A. Medrano-Cerda, D. G. Caldwell and N. G. Tsagarakis, "Development and Control of a Compliant Asymmetric Antagonistic Actuator for Energy Efficient Mobility," in IEEE/ASME Transactions on Mechatronics, vol. 21, no. 2, pp. 1080-1091, April 2016.
![Page 24: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/24.jpg)
Smart mechanism: ostrich runner
24
Related field/knowledge: Newtonian & Solid Mechanics, Rigid body dynamics (momentum, force acting on rigid body, kinetic & potential energy).Book: Featherstone, Roy. Rigid body dynamics algorithms. Springer, 2014.Articles: IEEE/ASME Transactions on Mechatronics.
![Page 25: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/25.jpg)
The mechanical design of these systems are not the scope of RSS, however, controlling them involves:
❏ Robot Kinematics & Dynamics❏ Kalman Filter❏ Digital System & control❏ Design of Advanced Controllers❏ Optimization❏ Trajectory Planning and Motion Planning
Related RSS elements
25
![Page 26: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/26.jpg)
Actuation
26
![Page 27: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/27.jpg)
High-power actuators
Actuator of the previous example: torque control, high power
27
![Page 28: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/28.jpg)
Soft actuatorsVariable impedance by active control
28
Different variable damping actuator principles: (a) friction, (b) MR, (c) variable orifice fluid damper.
Vanderborght, Bram, et al. "Variable impedance actuators: A review." Robotics and autonomous systems 61.12 (2013): 1601-1614.
![Page 29: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/29.jpg)
Sensing
29
![Page 30: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/30.jpg)
Torque sensors
30
© 2017 ATI Industrial Automation, Inc.
Force/torque sensing
6-axis FT sensor typically mounted on the end-effector
![Page 31: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/31.jpg)
Position sensors
Absolution position sensors
31
Mechanical absolute encoders Optical absolute encoders (13 tracks) Schematics of optical absolute encoders (3 tracks)
![Page 32: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/32.jpg)
Position sensors
Relative position sensors, usually have higher resolutions.
32
![Page 33: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/33.jpg)
Motion capabilities: manipulation, locomotion & localization
33
![Page 34: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/34.jpg)
Yiming Yang et al., “HDRM: A Resolution Complete Dynamic Roadmap for Real-Time Motion Planning in Complex Environments”, 2017
Motion capabilities: manipulation
34
Retrieving an object in a clustered environment.
![Page 35: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/35.jpg)
Motion capabilities: manipulation
35
Bipedal walking in presence of external pushes
Related field/knowledge: Kinematics, Collision-avoidance motion planning, Rigid body dynamics.Book: Featherstone, Roy. Rigid body dynamics algorithms. Springer, 2014.Articles: IEEE Transactions on Robotics; IEEE International Conference on Robotics and Automation (ICRA), etc.
![Page 37: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/37.jpg)
❏ Robot Kinematics & Dynamics❏ Localization and Mapping❏ Path & Motion Planning❏ Kalman Filter❏ Digital System & control❏ Design of Advanced Controllers❏ Optimization❏ Model Predictive Control❏ Trajectory Planning and Motion Planning
Related RSS elements in these systems
37
![Page 38: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/38.jpg)
Artificial Intelligence (AI)
38
![Page 39: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/39.jpg)
Ideas of AI
In the 1940s and 50s, a lot of discussion was held by scientists from different fields on the possibility of creating an artificial brain.
Can machines think? In 1950, Alan Turing proposed Turing Test: a human judge engages in a natural language conversation with a human and a machine designed to generate performance indistinguishable from that of a human being.
39
![Page 40: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/40.jpg)
Turing Test
A natural language conversation, is that a human or a machine?
40
![Page 41: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/41.jpg)
The Dartmouth workshop
In 1956, a summer workshop for artificial intelligence, named the Dartmouth Summer Research Project on Artificial Intelligence open a new field of AI.
In John McCarthy’s proposal, he stated that the conference was
"to proceed on the basis of the conjecture that every aspect of learning or any other feature of intelligence can in principle be so precisely described that a machine can be made to simulate it."
41
Archive of Dartmouth workshop: http://raysolomonoff.com/dartmouth/
![Page 42: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/42.jpg)
The Dartmouth workshop
The Proposal states:
“We propose that a 2 month, 10 man study of artificial intelligence be carried out during the summer of 1956 at Dartmouth College in Hanover, New Hampshire. The study is to proceed …... We think that a significant advance can be made in one or more of these problems if a carefully selected group of scientists work on it together for a summer.”
42
Original proposal: https://www.cs.swarthmore.edu/~meeden/cs63/f11/AIproposal.pdf
1956, birth of the field of artificial intelligence (AI) research.
![Page 43: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/43.jpg)
Golden age of AI 1956–1974
Development of humanoid robot occurred in this golden age. Waseda University, Japan, initiated the WABOT project in 1967, and in 1972 completed the WABOT-1, the world's first full-scale intelligent humanoid robot.
43WL-3-1969 WABOT-1, 1973 WABIAN-2R, 2008
![Page 44: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/44.jpg)
AI winter
AI, cannot be exempted from the hype cycle for new technology.
44Menzies, Tim. "21st-century ai: Proud, not smug." IEEE Intelligent Systems 18.3 (2003): 18-24.
![Page 45: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/45.jpg)
In 2012, Deep Convolutional Neural Networks won the large-scale ImageNet competition by a significant margin over shallow machine learning methods.
Deep learning: more hidden layers, which enable composition of features from lower layers, potentially modeling complex data with fewer units than a similarly performing shallow network.
New era of deep learning, 2012
45
![Page 46: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/46.jpg)
New era of deep learning, 2014
2014, DeepMind developed Deep Q-learning capable of learning how to play Atari video games using only pixels as data input. [video]
46
![Page 47: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/47.jpg)
Alpha-Go vs Lee Sedol, 2016
AlphaGo is a narrow AI specialized in playing the board game Go.
47
![Page 48: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/48.jpg)
Alpha-Go vs Lee Sedol, 2016
What AI and robotics still cannot do? Can you see it?
48Reliable control of physical interaction is hard in a real world.
![Page 49: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/49.jpg)
Machine learning for solving robotics problems
49
Balance control of humanoid robot
Related RSS elements:Machine Learning for Robot Control
Credits: Chuanyu Yang, PhD student, University of Edinburgh
![Page 50: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/50.jpg)
Machine learning for solving robotics problems
Solving Bipedal-Walker challenge in OpenAI gym.
50
Related RSS elements:Machine Learning for Robot Control
Credits: Doo Re Song Msc thesis,School of Informatics; Chuanyu Yang, PhD student, University of Edinburgh
![Page 51: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/51.jpg)
Level of robot intelligence
51
![Page 52: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/52.jpg)
Robot intelligence
Level 5
Level 4
Level 3
Level 2
Level 1
52
Human intelligence level
Task-level programming
Structured programming
Motion primitive programming
Point to point programming
![Page 53: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/53.jpg)
Areas of robotics
53
![Page 54: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/54.jpg)
Diversity of categorization
By applications/services: welding, warehouse, cleaning, robots
By particular (actuation) technology: hydraulic, pneumatic robots
By the environment of the applications: aerial, aquatic, ground, space, underwater robots
By morphologies: robot arms, humanoid, insect (bio-inspired) robots
By features of functionality: wheeled, legged robots
………….
54
There are usually multiple ways of defining the type of robots.
![Page 55: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/55.jpg)
Robots in industry
YASKAWA: motoman.com
FANUC: fanuc.eu/uk/en/robots
Kawasaki Robotics: robotics.kawasaki.com
ABB: new.abb.com/products/robotics
KUKA: kuka.com
Schunk: schunk.com/be_en/homepage
Universal Robots: universal-robots.com
55
![Page 56: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/56.jpg)
Industrial robots
56
YASKAWA
ABB Schunk UR
KUKAFanuc
![Page 57: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/57.jpg)
Car assembly in Tesla
57Picture source: pinterest.com
![Page 58: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/58.jpg)
Robots in education
RSS practical: student-built lego robot that navigates.
58
![Page 59: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/59.jpg)
Robots in research
59Valkyrie Robot, @ Edinburgh Centre for Robotics, University of Edinburgh
![Page 60: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/60.jpg)
Robot Control
60
![Page 61: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/61.jpg)
Historically, robotics strongly involves the realization of physical motions, and most robots are essentially motion systems (“robota” → labour).
Therefore, the majority of robotics research focuses on:
1. Sensors2. Actuators3. Control
Particularly, as sensing and actuation problems are being solved gradually, more effort is made towards control, or more precisely speaking, autonomy.
Robotics research
61
Automation → Autonomy → Intelligence
![Page 62: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/62.jpg)
Concept of control
What is control?
1. Apply action or influence to achieve an expected outcome.2. It needs to apply actions, an actuation or an agent.3. It needs sensor feedback, a probe, if a feedback control system.
Generally, control (feedback control) is about reasoning about how to apply actions given the feedback information in order to achieve a goal.
62
![Page 63: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/63.jpg)
Control systems
The 5 levels of robot intelligence are about how to control a robotic system.
Three levels of control:
1. Servo/tracking control (SISO, MIMO)2. Optimization, optimal control3. Machine learning
The first two are model-based approaches, where knowledge of mechanics and physics is required. Knowledge is given a priori, computationally cheap.
Machine learning is a model-free approach, it ‘learns’ the model through data in a statistical manner. Model is built by big data, computationally expensive.
63
![Page 64: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/64.jpg)
Open-loop control
Examples:
1. Traffic light system, only the request is the input, the rest is pre-programmed regardless of the situation;
2. Fountain;3. Or your washing machine;4. ⋮
64
![Page 65: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/65.jpg)
Closed-loop control
Closed-loop (feedback) control: monitors feedback, uses the deviation signal to control the action so as to reduce the deviation to zero.
Note: closed-loop (feedback) control, closed-loop and feedback are mutually exchangeable words.
65
![Page 66: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/66.jpg)
Closed-loop control
Closed-loop (feedback) control uses negative feedback.
A centrifugal governor is a good example of a mechanical controller.
66Invented in 1788 by James Watt to control the steam engine.
![Page 67: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/67.jpg)
Robot control
Three levels of control:
1. Servo/tracking control2. Optimization, optimal control3. Machine learning
Typically featured by stable, robust, and dynamic motions
Typically featured by a diversity of intelligent behaviors
In many cases, as shown before, robot control attempts to exploit kinematics and dynamics of the system.
67
Human intelligence level
Task-level programming
Structured programming
Motion primitive programming
Point to point programming
![Page 68: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/68.jpg)
Why kinematics matter?
Explore all configurations, maximize or validate reachability.
68
![Page 69: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/69.jpg)
Why dynamics matter?
Can an object (ρ >0) stay above the water?
Stone skipping
69
![Page 70: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/70.jpg)
Why dynamics matter?
Tasks and performance that can only be achieved by dynamic motions
70
![Page 71: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/71.jpg)
Why behaviors matter?
Most robotic applications are particularly programmed for solving specific problems. However, what if we want more universal or versatile machines?
71
![Page 72: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/72.jpg)
Why behaviors matter?
Human intervention supervision.
72
![Page 73: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/73.jpg)
Why behaviors matter?
Human intervention supervision.
73© University of Bonn, Autonomous Intelligent Systems
![Page 74: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/74.jpg)
Roadmap for robotics
74
![Page 75: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/75.jpg)
Robot Kinematics & Dynamics J. J. Craig, Introduction to Robotics: Mechanics and Control
State Estimation & Kalman Filter Peter Corke, Robotics, Vision and Control, Springer-Verlag.
Localization and Mapping
Path & Motion Planning (mobile)
H. Choset, K.M. Lynch, S. Hutchinson, G. Kantor, Principles of Robot Motion: Theory, Algorithms, and Implementations.
S. Thrun, W. Burgard and D. Fox, Probabilistic Robotics.
Peter Corke, Robotics, Vision and Control, Springer-Verlag.
Summary of key RSS elements
75
![Page 76: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/76.jpg)
Summary of key RSS elements
76
Trajectory Planning and Motion Planning (articulated)
Digital System & Control
Design of Advanced Controllers
Siciliano, B., et al., Robotics: Modelling, Planning and Control.
Peter Corke, Robotics, Vision and Control, Springer-Verlag.
Franklin, Gene F., et al., Feedback control of dynamic systems.
Optimization Yoshihiko Nakamura, Advanced Robotics: Redundancy and Optimization.
Model Predictive Control J.M. Maciejowski, Predictive control : with constraints.
Machine Learning for Robot Control Ian Goodfellow, et al., Deep Learning.
![Page 77: Robotics: Science and Systemswcms.inf.ed.ac.uk/ipab/rss/lecture-notes-2017-2018/RSS Overview of... · Robotics: Science and Systems Zhibin (Alex) Li ... FANUC: fanuc.eu/uk/en/robots](https://reader030.vdocuments.mx/reader030/viewer/2022021507/5b0512bc7f8b9aba168e3413/html5/thumbnails/77.jpg)
Robotics, making a better world
Field test of robots in a post-earthquake scenario, video.
77