redundant design and adaptive control of an interleaved
TRANSCRIPT
![Page 1: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/1.jpg)
Redundant Design and Adaptive Control of an Interleaved Continuum Rigid Manipulator
—Ben Conrad
University of Wisconsin-Madison
2016/11/21
![Page 2: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/2.jpg)
Academics:
o Undergraduate (B.S) at UW-Madison in Engineering Mechanics – Astronautics
o Graduate Degrees: M.S. and Ph.D – pending – UW Madison
Publications:1. Conrad, B., Zinn, M., “Interleaved Continuum-Rigid Manipulation: An Approach to Increase the
Capability of Minimally-Invasive Surgical System”, ASME/IEEE Transactions on Mechatronics,
Accepted TMECH-02-2016-5178.R1
2. Conrad, B., Zinn, M., “Estimating Cardiac Catheter Performance Requirements”, ASEM Journal ofMedical Devices (submitted – via DMDC 2017).
3. Conrad, B., Zinn*, M.R., "Closed Loop Task Space Control of an Interleaved Continuum-RigidManipulator ", IEEE International Conference of Robotics and Automation, 26-30 May 2015,Seattle, WA, pp 1743 - 1750, (acceptance rate: 35%).
4. Conrad, B.L., Zinn, M.R., "Interleaved Continuum-Rigid Manipulation Approach: Developmentand Functional Evaluation of a Clinical Scale Manipulator", Intelligent Robots and Systems (IROS2014), 2014 IEEE/RSJ International Conference on, pp. 4290-4296, Chicago, IL.
5. Conrad, B.L., Jung, J., Penning, R.S., Zinn, M.R., "Interleaved Continuum-Rigid Manipulation: AnAugmented Approach For Robotic Minimally-Invasive Flexible Catheter-based Procedures", IEEEInternational Conference on Robotics and Automation, Karlsruhe, Germany, May 6-10, 2013(refereed proceedings: acceptance rate 35%).
Research and work experience including
o Summer internships at NASA Kennedy Space Center, TracLABS (mobile robotics)
and VytronUS (robotic catheters)
o Flew ZeroG twice with Prof. Shedd
o LaVision in Germany (with Prof Sanders) - Built hyperspectral lasers
o REACH Lab – Catheter / Interleaved Robotics
![Page 3: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/3.jpg)
Wisconsin has been a great experience…3
![Page 4: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/4.jpg)
youtube.com/watch?v=oiXgWG9ASMc
PhD research motivated by cardiac catheters4
We have a 3+ DOF manipulator Constructed from biosafe,nonlinear materials
Subject to unknownmechanical constraints Operating in a highly
dynamic environment
~5 mm/cycle
Guided by limited-resolution sensors Ablating tissue with
unknown material properties
Performing a procedure whose efficacy cannot be immediately determined
Skilled surgeons overcome many of these,but a fundamentally limited system...
![Page 5: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/5.jpg)
Consider the fundamental physics…
An elastomer structureo stiffness similar to organs inherent safety
Underactuated and highly hysteretico leads to limit cyclingo static models ok, dynamic insufficient
5
increasingarticulation
Safety limits performance…
80beats/min = 1.3Hzo heartbeat not sinusoidal
Bandwidth of ~2Hz Teleoperation wants ~20Hz
can we decouple safety and task performance?
![Page 6: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/6.jpg)
Let’s complement catheters with rigid joints6
![Page 7: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/7.jpg)
A new concept, let’s be strategic
Desire increased
…to enableo Teleoperationo Obstacle avoidanceo Avoidance of distal dynamicso Target motion compensationo Contact impedance managing…among others
7
5D Actuation &Control Prototype
Performance: Increase accuracy, precision, & speed?
Reduce or avoid nonlinearities?
Dexterity: Expand the dexterous workspace?
Maintain ‘good’ configurations?
1DPerformance
Testbed
![Page 8: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/8.jpg)
1 degree of freedom: 4x faster, same accuracy8
![Page 9: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/9.jpg)
Summarizing the performance testbed
Desire increased
Other takeaways:o Frequency partitioning attractiveo Joint limits are importanto Plant dynamics change with articulation
9
5D Actuation &Control Prototype
Performance: Increase accuracy, precision, & speed?
→ 4 times faster, same accuracy
→ CL fundamentally limited by first mode
Reduce or avoid nonlinearities?
→ Fine resolution from rigid joints
Dexterity: Expand the dexterous workspace?
Maintain ‘good’ configurations?
![Page 10: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/10.jpg)
A 5D clinically-approximate manipulator
The moving parts…
10
Ex-vivo Drives Vasculature Model
5 DOF Interleaved Manipulator
![Page 11: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/11.jpg)
5D design – degrees of freedom
2 flexible segments
o Proximal roll and catheter
2 rigid joints
o Distal pitch and roll
o Rigid joints 3D printed
1 virtual tip-to-target distance
Redundancy varies with configuration
11
Pitch Axis
Distal RollAxis
Base Roll Axis
ArticulationAngle
Pitch Angle
Tip-to-TargetDistance
![Page 12: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/12.jpg)
5D design – actuators and transmissions
Remote actuation
o Servos external to the patient
Flexible transmissions safely
navigate vasculature
o 12mm Teflon proximal tube
o SS driveshafts Ø0.64 x 894mm
o Shafts and tendon separated
by smaller tubes
o No distal joint encoders…
12
Tendon
![Page 13: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/13.jpg)
5D design – sectioned joints
Large, local reductions
o 700:1, reduces driveshaft windup
Miniature bearings on rigid axes
Cable transmissions (0.15mm diameter Kevlar)
Catheter tendon decoupled from rigid joints
o 0.23 mm, Teflon-coated
13
AblationProbe
CatheterTendon
Ø12mm
58mm = 2.2”
![Page 14: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/14.jpg)
Improvements since the preliminary
Rebuilt distal joints with much less compliance
14
![Page 15: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/15.jpg)
An adaptive controller
Error formed in the task space
Inverse kinematics fully specified, found using Subplex alg.
xPC servocontroller with >30Hz drive bandwidth
Kinematic parameters estimated from prior motions
15
![Page 16: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/16.jpg)
Tracking tasks look like
The target moves in a 3D shape, tip & target move by turns
16
~150mm
Tip emfsensor
Target emf sensor
![Page 17: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/17.jpg)
First, the open loop:
As-measured kinematics
17
unlearned, openunlearned, closed
![Page 18: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/18.jpg)
Closing the loop
As-measured kinematics
18
unlearned, openunlearned, closed
![Page 19: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/19.jpg)
Locally adapting kinematic parameters
Want to capture nonlinearities distributed in task space
Space divided between buckets
Each bucket estimates the kinematics for trajectories within
o NLOpt, Subplex: https://github.com/bc0n/ICRMKinematics
19
![Page 20: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/20.jpg)
Open loop
With learned kinematics
20
unlearned, openunlearned, closedlearned, open
![Page 21: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/21.jpg)
Closed loop
With learned kinematics
21
unlearned, openunlearned, closedlearned, openlearned, closed
![Page 22: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/22.jpg)
Live tracking summary
Learned open loop MORE accurate than closed loop..
..depends on trajectory speed
22
![Page 23: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/23.jpg)
Closed loop is desirable for absolute accuracy
Previously moving in a highly repetitive fashion,
some learning was path-dependent
Non-repetitive learning and
point-to-point motion require
closed loop control
23
![Page 24: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/24.jpg)
What have we actually learned?24
![Page 25: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/25.jpg)
This work has been described in
Interleaved continuum rigid manipulation: An augmented..
o Conrad, Jung, Penning, and Zinn, IEEE ICRA, 2013
Interleaved continuum-rigid manipulation approach..
o Conrad and Zinn, IEEE IROS, 2014
Closed loop task space control of an interleaved…
o Conrad and Zinn, IEEE ICRA, 2015
Interleaved Continuum-Rigid Manipulation: An Approach..
o Conrad and Zinn, Mechatronics, forthcoming
Adaptive Closed Loop Control of an Interleaved…
o Conrad and Zinn, in prep
25
![Page 26: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/26.jpg)
Summarizing the systems
Desire increased
Other takeaways:o Performance sensitive to rigid joint compliance
o Controller validation challenging, lengthy
o Functional design --2-3x clinical scale
o Hasn’t broken over 2000+ runs
26
Performance: Increase accuracy, precision, & speed?
→ 4 times faster, same accuracy (1dof)
→ CL fundamentally limited by noncollocated sensor and 1st mode
→ OL enables accuracy & speed
Reduce or avoid nonlinearities?
→ Fine resolution from rigid joints
→ Spatial easier, smaller than temporal
Dexterity: Expand the dexterous workspace?
→ Redundant design and control
Maintain ‘good’ configurations?
→ Optimization IK permits weighting
→ Bucket quality metric
![Page 27: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/27.jpg)
Towards a clinical device…27
http://w.namiki.net/product/kbo/dc/15motor.html
5D design very conservative
Max clinical OD of ~4mm:
o 5D scaled by gearhead Ф6 1.5mm?
![Page 28: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/28.jpg)
Towards a clinical device…28
Many new actuator concepts
Increasing ability to assemble at the micro scale
2mm
![Page 29: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/29.jpg)
I’m headed to the Schnitzer Lab
Senior ME at Howard Hughes Medical Institute / Stanford
They need systems like this fly manipulator, a Senior ME
29
![Page 30: Redundant Design and Adaptive Control of an Interleaved](https://reader031.vdocuments.mx/reader031/viewer/2022012101/6169f1db11a7b741a34d1b7e/html5/thumbnails/30.jpg)
Questions?
Thanks to
o Mike Zinn
o Committee
o Lab mates
Supported by NSF grant IIS-1316271
30