1 . 2 medical image processing, analysis & visualization in clinical research justin senseney...
TRANSCRIPT
![Page 1: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/1.jpg)
1
http://mipav.cit.nih.gov
![Page 2: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/2.jpg)
2
Medical Image Processing, Medical Image Processing, Analysis & Visualization Analysis & Visualization
in Clinical Researchin Clinical Research
Justin SenseneyJustin Senseney
[email protected]@mail.nih.gov
dcb.cit.nih.gov/~senseneyjdcb.cit.nih.gov/~senseneyj
Biomedical Image Processing Research Services SectionBiomedical Image Processing Research Services Section
Center for Information TechnologyCenter for Information Technology
mipav.cit.nih.govmipav.cit.nih.gov
![Page 3: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/3.jpg)
3
MIPAV TeamMIPAV TeamEmployeesEmployees
Ruida ChengRuida Cheng
William GandlerWilliam Gandler
Matthew McAuliffeMatthew McAuliffe
Evan McCreedyEvan McCreedy
Justin SenseneyJustin Senseney
FellowsFellows
Sara Shen (Maryland)Sara Shen (Maryland)
ContractorsContractors
Alexandra Bokinsky, Geometric Tools Inc. (Visualization)Alexandra Bokinsky, Geometric Tools Inc. (Visualization)
Olga Vovk, SRA International Inc. (Technical Writing)Olga Vovk, SRA International Inc. (Technical Writing)
AlumniAlumni
Paul Hemler (Hampden-Sydney), Agatha Monzon, Nishith Pandya (FITBIR), Paul Hemler (Hampden-Sydney), Agatha Monzon, Nishith Pandya (FITBIR),
Beth Tyriee (Kentucky), Hailong Wang (Heidelberg)Beth Tyriee (Kentucky), Hailong Wang (Heidelberg)
![Page 4: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/4.jpg)
4
• PortabilityPortability– cross-platform or platform-independent executioncross-platform or platform-independent execution
• Data format independenceData format independence– access to images: DICOM, Analyze, TIFF, Raw, …access to images: DICOM, Analyze, TIFF, Raw, …
• ExtensibilityExtensibility – plugins and/or scriptsplugins and/or scripts
• ScalabilityScalability – foundation to support the growth to larger and more intricate data foundation to support the growth to larger and more intricate data
structuresstructures
• UsabilityUsability – coherent graphical user interface (GUI) coherent graphical user interface (GUI)
Requirements for an Image Quantification Requirements for an Image Quantification and Visualization Applicationand Visualization Application
![Page 5: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/5.jpg)
5
Portability Portability Java PrimerJava Primer
Source Code Byte Code(class files)
Java Interpreterfor the PC
Machine code
PC
Java Interpreterfor a
Unix Workstation
Machine code
UNIXJava applications can be "written once and run anywhere", significantly reducing cross-platform development and maintenance.
![Page 6: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/6.jpg)
6
Data Independence Data Independence
• DICOM file reader/writerDICOM file reader/writer• DICOM Query/Retrieve and “Catcher”DICOM Query/Retrieve and “Catcher”• Comprehensive file format support/conversionComprehensive file format support/conversion
– http://mipav.cit.nih.gov/fileformat.html
• MIPAV XML file format MIPAV XML file format
![Page 7: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/7.jpg)
7
ExtensibilityExtensibility
Plugins and Scripts Plugins and Scripts • PluginsPlugins
– Functions written in Java using the MIPAV API. Functions written in Java using the MIPAV API.
• ScriptsScripts– Use MIPAV to record and save function(s) applied to Use MIPAV to record and save function(s) applied to
image dataset(s).image dataset(s).
– Apply the script to any number of image datasets Apply the script to any number of image datasets using the script wizard.using the script wizard.
![Page 8: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/8.jpg)
8
• Model Image is an n-dimensional structure.Model Image is an n-dimensional structure.
• Algorithms can support up to 4D datasets.Algorithms can support up to 4D datasets.
• Viewers support 4D dataset with fusion.Viewers support 4D dataset with fusion.
ScalabilityScalability
![Page 9: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/9.jpg)
9
UsabilityUsability
• GUI elementsGUI elements
• Scripting systemScripting system
• Command-line toolsCommand-line tools
![Page 10: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/10.jpg)
10
![Page 11: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/11.jpg)
11
File types(Raw, Analyze, DICOM 3.0, GE, Siemens, Bruker, Interfile,
Micro cat, MINC, MRC, FITS, Cheshire, AFNI, TIFF, JPEG, GIF, BMP, AVI, QuickTime, Biorad, Ziess LSM510, XML, and more)
Data (Image) types: n-dimensional structure(boolean, byte, unsigned byte, short,
unsigned short, int, long, float, double, Complex, ARGB)
Views – with data fusion 2D planar, “Lightbox”, Cine (movie), Multi-planar, 3D tri-planar, Surface render, (supports 3D texture mapped volume rendering Volume render
Algorithms Filtering Segmentation/classification Measurement/quantification Registration/fusion Utilities Plugins
VOIs
32KManual and automated contouring
Functional OverviewFunctional Overview
PACS DICOM 3.0:
Query/Retrieve, Catcher
GUI
Script ing
![Page 12: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/12.jpg)
12
Opening ImagesOpening Images
![Page 13: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/13.jpg)
13
Opening ImagesOpening Images
![Page 14: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/14.jpg)
14
Image BrowserImage Browser
![Page 15: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/15.jpg)
15
Opening ImagesOpening Images
![Page 16: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/16.jpg)
16
Saving Image As (use suffix)Saving Image As (use suffix)
![Page 17: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/17.jpg)
17
Code SnapshotCode Snapshot
int destExtents[] = new int[2];
destExtents[0] = image.getExtents()[0]; // X dim
destExtents[1] = image.getExtents()[1]; // Y dim
// Make a result image of Unsigned byte type
resultImage = new ModelImage(ModelStorageBase.UBYTE, destExtents, “Result Image”, null);
int length = destExtents[0] * destExtents[1];
for (int i = 0; i < length; i++){
destImage.set(i, i%256);
}
ViewJFrameImage imageFrame; ModelLUT LUTa = new ModelLUT(ModelLUT.COOLHOT, 256, dimExtentsLUT);
imageFrame = new ViewJFrameImage(resultImage, LUTa, new Dimension(610,200), userInterface);
![Page 18: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/18.jpg)
18
Algorithms• Filters
• Calculation
• Registration
• Transformation
• Surface extraction
• Classification/Segmentation
![Page 19: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/19.jpg)
19
Download and SetupDownload and Setup1. http://mipav.cit.nih.gov/download2. Fill in form3. Install (e.g. installMIPAV.exe)
** Nightly download - lastest changes but might have bugs.** Archived releases also available.
![Page 20: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/20.jpg)
20
Memory AllocationMemory Allocation
General Rules• Do not exceed the computer’s physical RAM. For example if the computer has 1GB do not exceed approx 800MB.
• For 32-bit Windows systems do not exceed 1,400MB
![Page 21: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/21.jpg)
21
Memory UsageMemory Usage
Press to recover memory
![Page 22: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/22.jpg)
22
MIPAV Program OptionsMIPAV Program Options
![Page 23: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/23.jpg)
23
Digital Image Communication in Medicine Digital Image Communication in Medicine (DICOM).(DICOM).
American College of Radiology (ACR) and the National ElectricalAmerican College of Radiology (ACR) and the National Electrical
Manufacturers Association (NEMA) formed a joint committee in 1983 to develop a Manufacturers Association (NEMA) formed a joint committee in 1983 to develop a
standard in Digital Image Communication in Medicine (DICOM). standard in Digital Image Communication in Medicine (DICOM).
1.1. Promote communication of digital image information, regardless of device manufacturerPromote communication of digital image information, regardless of device manufacturer
2.2. Facilitate the development and expansion of picture archiving and communication Facilitate the development and expansion of picture archiving and communication systems (PACS) that can also interface with other systems of hospital informationsystems (PACS) that can also interface with other systems of hospital information
3.3. Allow the creation of diagnostic information databases that can be interrogated by a wide Allow the creation of diagnostic information databases that can be interrogated by a wide variety of devices distributed geographically.variety of devices distributed geographically.
![Page 24: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/24.jpg)
24
Patient
Database
DICOM Server
Images
Imaging Workstation (MIPAV) (PC, MAC, UNIX workstation)
Receiver
Query
Images
Image
Processing
&
Visualization
Imaging Device
DICOM ModelDICOM Model
PACS
Internet
![Page 25: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/25.jpg)
25
DICOM DICOM communication communication
interfaceinterface
![Page 26: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/26.jpg)
26
DICOMDICOM
![Page 27: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/27.jpg)
27
DICOMDICOM
Access to image header information
![Page 28: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/28.jpg)
28
DICOMDICOM AnonymizationAnonymization
![Page 29: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/29.jpg)
29
DICOM File BrowserDICOM File Browser
![Page 30: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/30.jpg)
30
XML Schema File FormatXML Schema File Format
![Page 31: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/31.jpg)
31
XML Schema File FormatXML Schema File Format
![Page 32: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/32.jpg)
32
XML Schema File FormatXML Schema File Format
![Page 33: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/33.jpg)
33
Image AttributesImage Attributes
![Page 34: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/34.jpg)
34
Volume of Interest (VOI)Volume of Interest (VOI)
![Page 35: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/35.jpg)
35
VOIVOI
![Page 36: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/36.jpg)
36
Lookup Table (LUT)Lookup Table (LUT)
![Page 37: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/37.jpg)
37
Multi-planar and LightboxMulti-planar and Lightbox
![Page 38: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/38.jpg)
38
Image FusionImage Fusion The loading of two images into the same frame
Controls blending between the two images
![Page 39: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/39.jpg)
39
Structural MRI and Functional MRIStructural MRI and Functional MRI
![Page 40: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/40.jpg)
40
Animation ToolAnimation Tool
![Page 41: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/41.jpg)
41
Masks and SurfacesMasks and Surfaces
![Page 42: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/42.jpg)
42
Scripting - RecordScripting - Record
![Page 43: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/43.jpg)
43
Scripting - RunScripting - Run
![Page 44: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/44.jpg)
44
HelpHelp
![Page 45: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/45.jpg)
45
Bug ReportBug Report
![Page 46: 1 . 2 Medical Image Processing, Analysis & Visualization in Clinical Research Justin Senseney SenseneyJ@mail.nih.govdcb.cit.nih.gov/~senseneyj](https://reader036.vdocuments.mx/reader036/viewer/2022081512/56649da25503460f94a8f7b8/html5/thumbnails/46.jpg)
46
MIPAVMIPAV
Visualization
Ubiquitous file reader
Quantification File writer
Processing Macros/Plugins