medical exploration tool kit

8/4/2019 Medical Exploration Tool Kit

1/43

WELCOMEWELCOME


2/43


3/43

INTRODUCTIONINTRODUCTIONApplication developments is

often guided by the usage of

software libraries and toolkits.For medical applications , the

toolkits currently available focuson image analysis and volumerendering.

Hence, we present a toolkit for

application development in thefield of medical interventionplanning , training andpresentation THE MEDICALEXPLORATION TOOLKIT(METK).

Software assistants forintervention planning are arelatively recent development.

1.Introductio

n

2.Continues

3.Continues

8.Advantage

s

9.Requireme

nt

Conceptual

consideratio

n

Application

scenarios

scnario1

scenario2

Scenario 3


4/43

Surgical applications have special demands onvisualization and interaction.

It is not sufficient to display and analyze slicedata and to create volume rendered images.

Instead,an in-depth analysis of the image data

needs to be supported with appropriate 3Dinteraction techniques and advancedvisualization techniques.

METK present a widely applicable library for

application development that closes the gapbetween image analysis , processing and basic

visualizations on the one hand, and the surgical

needs on the other hand


5/43

The METK is based on the image processing anddevelopment environment MeVisLab.

Visual computing in surgical applications providecomprehensive patient-related information and enabling afaithful representation of the area around the pathologies.

Moreover , measurements , annotations , resection lines , andother information may be important to directly supportpreinterventional decisions.


6/43

Most of this information can only be derived after

segmentation of the relevant structures.

Further analyses such as infiltration of and distances betweenstructures as well as safety margins and volumes of structures

can only be performed after segmentation.

The METK support an easier application building process for

surgical applications where no extended programming skillsare needed.


7/43

Advantages of METK over theAdvantages of METK over the

existing MeVisLabexisting MeVisLab1) The METK provides advanced visualization techniques.

2) Animation facilities are provided.

3) Provides special facilities to save different states of a

visualization.4) The METK provides a case management.

5) The METK includes automatic synchronization.

6) Manyuser interface widgets area available.

7) No extended programming skills are needed.8) The open source and well-documented data interface


8/43


9/43

The basic requirements are

Conceptual considerations

Selected application scenarios

Requirements for surgical applications


10/43

Surgical departments often too small to include peoplewith substantial IT background.

Medical doctors are often not aware of the availableoptions.

We follow the process where we offer different solutionsto the medical doctors and ask them to comment on these

solutions.To come up very quickly with such prototypes was one of

the central requirements during the development ofMETK.


11/43

A second major goal was to enable that once developedvisualization and interaction techniques are easily reused

in a larger department with many projects.For a toolkit for application development it is crucial to

provide a modular character ,where every application canjust use the module it needs.

Extendibility is a second major aspect , since the toolkitmay be used for a large variety of applications withspecific requirements.


12/43

.Ready-to-use applications should be

created quickly .

.The application building process should

not require extended programming.

Existing applications as well as newapplications should be able to be

extended by new techniques obtained

from feedback or techniques from newervisualization developments.

Our concern lead to the followingrequirements for the METK development:


13/43


14/43

Here we are going to describe selectedHere we are going to describe selectedapplication scenarios which lead toapplication scenarios which lead to

refined and more specific requirements ofrefined and more specific requirements ofsurgical applications.surgical applications.

Neck dissections

Abdominal surgery

Spine surgery


15/43

Scenario 1:Scenario 1:

Neck dissections are carried out for patients withmalignant tumors in the neck or head region toremove lymph node metastases.

Depending on the broadening of enlarged lymph

nodes , only a few of them or a large part of the neckincluding muscles must be resected.

The surgeons must explore the distances of alllarger lymph nodes to vital structures of risk in order

to judge if there is enough space to safety resectthem individually.


16/43

Scenario 2:Scenario 2:

In abdominal surgery , the resection of tumor in theliver, kidney, or pancreas is rather similar with respectto the demands of software support.

Here , a tumor or metastases need to be resected

with a specific safety margin.In difficult cases this invention requires in-depth

computer-based operation planning.

The tumor and especially the surrounding vessels must

be carefully inspected in 2D as well as in 3D.


17/43

Scenario 3:Scenario 3:In spine surgery , small changes of the spines

anatomy can evoke symptomatic disorders for thepatient.

Hence the spine surgeon must inspect the spatialrelations between nerval and spinal structures aswell as the relation of the spine to surroundingmuscles ,vessels and glands.

The surgeons need to place virtual needles andimplants in the spine region to plan differentstrategies for the access route in the laterintervention.


18/43

1.Introduction

2.Continues

3.Continues8.Advantages

9.Requirements

Conceptualconsideratio

nApplicationscenarios

scnario1

scenario2

Scenario 3

requirement


19/43


20/43

For all scenarios , the exploration of the data setmust be as fast as possible.

Presentations are essential for collaborativeintervention planning.

In general , surgeons are medical experts , usuallywith only modest computer experience.

They usually have no special abilities to exploreand handle 3D data.


21/43

From the experience with surgicalFrom the experience with surgicalapplications , we derive basicapplications , we derive basic

requirements for such applications:requirements for such applications:a) Surgical appl. Must primarily support the surgeons

decision making process.

b) Measurement capabilities must be provided.

c) 2D&3D views should be synchronized.

d) Important anatomical structures needs to beemphasized.

e) Dedicated techniques for special surgical fieldsshould be provided.


22/43

RELATED WO

RKRELATED WO

RK..

Since medical visualization andmedical image analysis are fieldsof active research , severaltoolkits are available


23/43

VisTrails

VolumeShop

3DSlicerMITK

Julius

IGSTK

CAVASS

DEVIDE systemSciRun

Amira


24/43

MeVisLabMeVisLab..


25/43

It is a freely as well as commercially available visualprogramming and rapid prototyping platform for image

processing research and development with a focus onmedical imaging and visualization.

Besides general image processing and visualizationtools , it includes advanced medical imaging algorithms

for segmentation , registration , and quantitativemorphological and functional analysis.

New image processing algorithms and visualizationtools can be integrated as modules using a

standardized software interface.


26/43

An integral part of MeVisLab is the object-orientedMeVis Image Processing Library(ML) , provides ageneral frame work for image processing.

Image processing is accomplished in a strictlyrequest-driven manner using paging , caching , andmultithreaded strategies.

In addition the open source Insight ToolKit(ITK) for

performing registration and segmentation has beenwrapped into native MeVisLab modules.


27/43

The MeVis Giga Voxel Renderer(GVR) presents astate-of-the-art multivolume renderer that combinesa texture-based multiresolution approach with

advanced per object shading techniques.For visualization and interactive graphics programming

, the Open Inventor 3D visualization library as well asthe Visualization ToolKit(VTK) are fully integrated into

MeVisLab.Even the combination of Open Inventor and VTK

modules is possible.


28/43

ARCHITECTUREOFMETKARCHITECTUREOFMETKIn the MEDICALEXPLORATIONTOOLKIT,each

function is encapsulated in a module.

Using MeVisLabs visual programming

environment,modules can be freely combined in adata-flow network to build up applications withan individual feature proile.


29/43

All functions areAll functions are

conceptually organizedconceptually organizedin three layersin three layers

Data management andcommunication layer.

Visualization layer.Exploration layer.


30/43

The lowest layer imports the case dataand provides data management functions.

The visualization layer comprises viewerclasses and special rendering modules.

Basic viewer classes and the volume

rendering are reused from MeV

isL

ab.


31/43

Data ManagementData Management

and Communicationand CommunicationLayerLayer


32/43

The data management and communication layercontains functions for case data management, interapplication communication and generation of 3D

polygonal surfaces.Segmentation masks can be loaded to automatically

generate 3D polygonal surfaces.

Depending on the type of structures, different

algorithms for generating the polygonal surfaces areused


33/43

It includes

Multimodal data

Case and cache managementCommunication

SynchronizationMulticoded segmentation


34/43

MULTICODEDMULTICODEDSEGMENTATIONMASKSSEGMENTATIONMASKS


35/43

Visualization LayerVisualization Layer


36/43

In visualization layer all actions are performed thatare necessary for the 3D visualization techniques.

It includesVolume rendering

Advanced 2D visualization

Safety marginsIllustrative visualizations

Medical viewers


37/43


38/43

Exploration LayerExploration LayerTo support exploration process we provide

several techniques such as interactionfacilities,and interface widgets.

l d


39/43

It includes

Animation.

View point selection.

Camera paths.

Measurement tools

Key states

UndoAutomatic object selection

Interaction support

Object manipulation

Graphical application interface


40/43

Conclusion and Future workConclusion and Future work

W t t i t lkit f i l li ti


41/43

We present an extensive toolkit for surgical applicationdevelopment-THE MEDICAL EXPLORATION TOOLKIT.Using METK application can be build up quickly.

Multiple overlapping segmentation mask can be stored inone mask by the introduction of multicoded segmentationmask.With animation facilities , the exploration of 3D scenes

are provided.Recent development with user interface devices used in

surgical application necessitate the integration of a widervariety of input devices in the METK.


42/43

References.References.GOOGLE

WIKIPEDIA


43/43

THANK YOUTHANK YOU

medical exploration tool kit

Documents