na-mic national alliance for medical image computing dbp2: software integration for image guided...

22
NA-MIC National Alliance for Medical Image Computing http://na-mic.org DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso Queen’s University, Canada

Upload: aleesha-barton

Post on 17-Jan-2018

224 views

Category:

Documents


0 download

DESCRIPTION

National Alliance for Medical Image Computing Point & Click Surgery, 1999 Digital images Planning & control computer Patient Imager: Robot Coordinates Physician CT,MRI, US, X-ray

TRANSCRIPT

Page 1: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

NA-MICNational Alliance for Medical Image Computing http://na-mic.org

DBP2: Software Integration for Image Guided Surgery

Gabor Fichtinger & Andras LassoQueen’s University, Canada

Page 2: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Goals• Applications for Image-guided needle

based interventions– Robotic prostate interventions– Spinal interventions w/ Augmented Reality

• Develop new 3D Slicer features relevant to Robotics and CAI

• Promote 3D Slicer in the Robotics and CAI communities

Page 3: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Point & Click Surgery, 1999

Digital images

Planning & control computer

Patient

Imager:

Robot

Coordinates

Physician

CT,MRI, US, X-ray

Page 4: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Grand Hypothesis

It is possible to architect robotic intervention systems

that to a reasonable extent are invariant to imager, robot, and even the clinical application

Page 5: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Robotic IGS Workflow

• Modeling • Planning• Robot Registration• Targeting & Monitoring• Verification

Page 6: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Early Implementation w/ Slicer

Page 7: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

A1: Robotic Prostate Biopsy

Krieger et al. IEEE TMBE, 2005

(Best paper in 2005-2009)

Page 8: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Overall Workflow

Page 9: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Multiple Robots

Page 10: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Planning – Segmentation /1

Tannenbaum et al.

Page 11: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Planning – Segmentation /2

Tannenbaum et al.

Page 12: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Robot Registration

Trans-rectal coil

Needle trajectoryProstate

Rectum

Fiducials

Page 13: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Targeting Biopsy Sites

Page 14: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Monitoring – 2nd Display

Page 15: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Verification - Registration

Page 16: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

A2: Augmented Reality

Fichtinger et al. IEEE TMBE, 2005 Fischer et al. JCAS, 2007

Page 17: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Workflow

Fischer et al. JCAS, 2007

Page 18: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Planning

Vikal et al. CMIG, 2009

Page 19: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Validation

Page 20: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

The Perk Station

Vikal et al. CMIG, 2009

Page 21: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

Perk Station Interface

Vikal et al. CMIG, 2009

Page 22: NA-MIC National Alliance for Medical Image Computing  DBP2: Software Integration for Image Guided Surgery Gabor Fichtinger & Andras Lasso

National Alliance for Medical Image Computing http://na-mic.org

The Ultimate Outreach Tool