Transcript
Page 1: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

System Engineering and Automation Departmenthttp://www.isa.uma.es

University of Malaga (Spain)

INTELLIGENT ROBOTICS AND SYSTEMS (IROS 2010)

AUTO-GUIDED MOVEMENTS ON MINIMALLY INVASIVE SURGERY FOR SURGEON

ASSISTANCEEnrique Bauzano NúñezVíctor Muñoz-Martínez, Isabel García-Morales

Page 2: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

Auto-Guided Movements on MIS for Surgeon Assistance

OUTLINE

I. General Overview

II. Laparoscopic Auto-Guided Navigation Problem

III.Control Strategy

a.APF behavior

b.Velocity corrections

c.Backward movement

IV.Implantation and Experiments

V. Conclusions and Future Works

Page 3: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

I. GENERAL OVERVIEW

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

Auto-Guided Movements on MIS for Surgeon Assistance

Page 4: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

I. General Overview

LAPAROSCOPIC SURGERY

Advantages Lessen recovery time

Limit post-operative complications

Lower scars

Constraints Movement limitations

Loss of touch and 3D perception

Hand-eye coordination problems

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

Main Drawback of Robotic Assistants: Lengthen operating time

Solution: Give more autonomy to surgeon assistants

Page 5: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

A Semi-Autonomous Micro-Robotic System for Colonoscopy (Robotics & Biomimetics, 2008) G. Chen & M. Pham

Motion Estimation in Beating Heart Surgery (Biomedical Engineering, 2005) T. Ortmaier, M. Gröger et al.

I. General Overview

Visual Servoing: The robot assistant automatically focuses the workspace where the surgeon is working.

Auto-Guided Movements: The robot assistant moves to a target or performs a task without the surgeon direct intervention.

EXAMPLES

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

Page 6: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

II. LAPAROSCOPIC AUTO-GUIDED NAVIGATION PROBLEM

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

Auto-Guided Movements on MIS for Surgeon Assistance

Page 7: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

II. Laparoscopic Auto-Guided Navigation Problem

R

C S

P

RG

CG

SG

PG

Robot

Camera

Target

Primary Tool

View Field

Abdomen

Robot Trajectory

GOAL: Find a path for the robot to reach the Target (primary tool) by avoiding the Obstacle (secondary tool).

AUTO-GUIDED NAVIGATION PROBLEM

Secondary Tool

Page 8: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

CISOBOT: SEMI-AUTONOMOUS ROBOT ASSISTANT

Surgeon

Patient

Surgeon Model

3D TrackingImage Processing

ToolMovement

Surgeon Command (Voice, Gesture…)

Surgeon’s Tools Location

Maneuver

Processed Image

Dire

ct In

terv

entio

nRobot

Assistant

PWE Controller

Auto-Guide System

RobotTrajectory

ImageCaption

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

II. Laparoscopic Auto-Guided Navigation Problem

3-Layer Control for Active Wrists in Laparoscopic Surgery(IROS, 2009) E. Bauzano, V.F. Munoz et al.

Page 9: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

III. CONTROL STRATEGY

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

Auto-Guided Movements on MIS for Surgeon Assistance

Page 10: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

III. Control Strategy

MULTI-BEHAVIOR OBSTACLE AVOIDER

Fuzzy Decision

APF Planner

Velocity Correctio

ns

Backward Movemen

t

Σ

AUTO-GUIDE SYSTEM (LOCAL PLANNER)

c1

c2

c3

v1

v2

v3

vsecondaryvrobot

2

1

3

4

vsecondary

vrobot

FUZZY DECISION

Page 11: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

a.APF Planner

b.Velocity Corrections

c.Backward movement

IV.Experiments

V.Conclusions

III. Control Strategy

ARTIFICIAL POTENTIAL FIELD (APF) PLANNER

Procedure for Automatic Movements1) Locate the minimal distance point MR

2) Calculate its target MRf

3) Apply the forces and compute the needed velocity of MR

4) Move the robot tool to fit both, the new location and the fulcrum constraint GR

End Procedure

0

02

2

0

if0

ifˆ2

111

nr

KFgoal

rrep

goalaatt rKF

2

t

m

Ftvttv

1

111 )()(

New Method for Improving Artificial Potential Field in Mobile Robot Obstacle Avoidance (International Conference on Automation and Logistics, 2007) S. Enxiu, C. Tao et al.

Page 12: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

III. Control Strategy

VELOCITY CORRECTIONS

RM

SM

Estimated second tool trajectory

Robot’s Path

Time to cross

Distance to cross

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

a.APF Planner

b.Velocity Corrections

c.Backward movement

IV.Experiments

V.Conclusions

Behavior: Reduce the robot velocity when it moves nearby the surgeon’s secondary tool (obstacle).

Page 13: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

III. Control Strategy

BACKWARD MOVEMENT

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

a.APF Planner

b.Velocity Corrections

c.Backward movement

IV.Experiments

V.Conclusions

GR GS

Behavior: Follow the surgeon’s secondary tool trajectory when he or she forces the contact with the robot tool.

SvBF

3

ρmin

Page 14: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

IV. IMPLANTATION AND EXPERIMENTS

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

Auto-Guided Movements on MIS for Surgeon Assistance

Page 15: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

IV. Implantation and Experiments

IMPLANTATION

Robot Assistant

3D Tracker

Camera Tool

Surgeon’s Tools

Virtual Patient

Force Sensor

Page 16: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

IV. Implantation and Experiments

IN-VITRO EXPERIMENT

Link to videoCISOBOT Video

Page 17: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

IV. Implantation and Experiments

EXPERIMENTAL RESULTS

STATIC OBSTACLE

DYNAMIC OBSTACLE

Page 18: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

V. CONCLUSIONS AND FUTURE WORKS

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

Auto-Guided Movements on MIS for Surgeon Assistance

Page 19: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

CONCLUSIONS

The robot tool movements must be restricted to the camera cone of vision, and the camera should follow the robot tool.

Include a map of the abdominal cavity to avoid inner collisions with the patient.

The robot tool-patient interaction must be studied to extend the possible maneuvers.

FUTURE WORKS

An auto-guided system has been developed to find paths for the robot assistant to reach a surgeon tool while it avoids collisions with the other one.

Thanks to the force sensor, the fulcrum is always located and forces over the abdomen are reduced.

The robot tool may react just before a contact with the obstacle tool. This is useful for surgeon-robot interaction.

V. Conclusions and Future Works

INDEX

I. Overview

II.Auto-Guided Problem

III.Control Strategy

IV.Experiments

V.Conclusions

Page 20: [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance

Sys

tem

En

gin

eeri

ng

an

d

Au

tom

atio

n D

epar

tmen

t

Mr. Enrique Bauzano Nuñez [email protected]

Thanks for your attention

Auto-Guided Movements in Surgeon Assistance


Top Related