registration in slicer3
DESCRIPTION
Registration in Slicer3. Julien Jomier Kitware Inc. Registration. Coordinate System conversion Not only image-to-image: model-to-model, model-to-image Involves resampling and therefore interpolation Linear: Rigid, Similarity, Affine Deformable: TPS, EBS, B-Spline. j. j. i. i. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/1.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Registration in Slicer3
Julien JomierKitware Inc.
![Page 2: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/2.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Registration
• Coordinate System conversion
• Not only image-to-image: model-to-model, model-to-image
• Involves resampling and therefore interpolation
• Linear: Rigid, Similarity, Affine
• Deformable: TPS, EBS, B-Spline
![Page 3: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/3.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Fixed Image Grid
j
i
y
x
Fixed ImagePhysical Coordinates
y’
x’Moving Image
Physical Coordinates
Moving Image Grid
j
i
Space Transform
Coordinate System Conversion
![Page 4: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/4.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Images provided as part of the project: “Retrospective Image Registration Evaluation”, NIH, Project No. 8R01EB002124-03, Principal Investigator, J. Michael Fitzpatrick, Vanderbilt University, Nashville,
TN.
Images from the same patient
256 x 256 pixels
MRI-T2
Scaling Transform
128 x 128 pixels
PET
Scaling Factor
![Page 5: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/5.jpg)
National Alliance for Medical Image Computing http://na-mic.org
I will not register images in pixel space
I will not register images in pixel space
I will not register images in pixel space
I will not register images in pixel space
I will not register images in pixel space
I will not register images in pix
Things I will not do
![Page 6: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/6.jpg)
National Alliance for Medical Image Computing http://na-mic.org
FixedImage
MovingImage
Metric
Transform
Interpolator
Optimizer
Registration Method
Registration Framework
![Page 7: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/7.jpg)
National Alliance for Medical Image Computing http://na-mic.org
In principle the denomination of
Fixed Image & Moving Image
is arbitrary
In practice the moving image
is the one that will be resampled
into the fixed image
coordinate system
Selecting Moving & Fixed Images
![Page 8: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/8.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Registration Initialization
• Coarse-to-fine approach
• Center of mass
• High order moments (principal axes)
• RealignVolume
![Page 9: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/9.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Mutual Information
• Mutual dependence between pixel values of images
• Based on histograms
![Page 10: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/10.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Joint Histograms: Mono-modality
Images Aligned Translated by 0 to 20 pixels
White = zero valueBlack = highest value
Misalignment causesdispersion
![Page 11: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/11.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Translated by 0 to 20 pixels
Misalignment causesdispersion
Joint Histograms: Multi-modality
Images Aligned
White = zero valueBlack = highest value
![Page 12: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/12.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Affine Registration
• Mattes Mutual Information
• Histogram Bin
• Spatial Samples
• Translation scaling- Rotation and translation are not in the same units
![Page 13: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/13.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Deformable Transform
y
Fixed Image
Transform
x
y
Moving Image
x
![Page 14: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/14.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Deformable transform
y
Fixed Image
Transform
x
y
Moving Image
x
![Page 15: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/15.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Deformable Transformation
y
x
![Page 16: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/16.jpg)
National Alliance for Medical Image Computing http://na-mic.org
BSpline Grid
y
x
BSplineGrid
ResamplingGrid
![Page 17: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/17.jpg)
National Alliance for Medical Image Computing http://na-mic.org
BSplines Grid & Image Grid
![Page 18: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/18.jpg)
National Alliance for Medical Image Computing http://na-mic.org
BSplines Grid & Image Grid
BSplineGrid
![Page 19: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/19.jpg)
National Alliance for Medical Image Computing http://na-mic.org
BSplines Grid & Image Grid
BSplineGrid
ValidRegion
![Page 20: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/20.jpg)
National Alliance for Medical Image Computing http://na-mic.org
BSplines Grid & Image Grid
BSplineGrid
![Page 21: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/21.jpg)
National Alliance for Medical Image Computing http://na-mic.org
BSplines Grid & Image Grid
BSplineGrid
ValidRegion
![Page 22: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/22.jpg)
National Alliance for Medical Image Computing http://na-mic.org
BSpline Registration
• Mutual Information (Mattes)
• LBFGSBOptimizer
• Constrain Deformation: constrain the optimizer by bounds
![Page 23: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/23.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Slicer Demo
• Open Slicer
• Load Datasets
• Affine Registration
• BSpline Deformable Registration
• Transfer Functions Visualization
![Page 24: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/24.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Loading Datasets
![Page 25: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/25.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Affine Registration
![Page 26: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/26.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Affine Registration
![Page 27: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/27.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Deformable Registration
![Page 28: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/28.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Deformable Registration
![Page 29: Registration in Slicer3](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56813510550346895d9c656b/html5/thumbnails/29.jpg)
National Alliance for Medical Image Computing http://na-mic.org
Adjusting Transfer Functions