motion-moderated transfer function for volume rendering 4d cmr data
TRANSCRIPT
![Page 1: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/1.jpg)
Motion-Moderated Transfer Function for
Volume Rendering 4D CMR Data
(alt. title: what did rainbow colourmaps ever do to you?)
Simon Walton1 and Min Chen1 and Cameron Holloway2
1 Oxford University 2 St. Vincent's Hospital, Sydney
![Page 2: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/2.jpg)
Overview
• Brief introduction to CMR
• Motivation for motion-moderated TFs
• What are motion-moderated TFs
• How we implemented them
• More Results
![Page 3: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/3.jpg)
Cardiovascular MRI (CMR)
![Page 4: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/4.jpg)
Cardiovascular MRI (CMR)• Essentially ECG-timed MRI
https://www.med-ed.virginia.edu/courses/rad/cardiacmr/Techniques/
Gating.html
beepbeepbeep
![Page 5: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/5.jpg)
CINE Imaging
![Page 6: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/6.jpg)
LV
RV
apex
mid
base
Slices often targeted
![Page 7: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/7.jpg)
Colourmapping
low density high density
![Page 8: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/8.jpg)
Problems with Colourmaps• The colour bands are mapped
to raw intensity
• Intensity values represent density and not 'tissue type'
• Myocardium density changes through systole and diastole
• Therefore, intensity-mapped colour alone cannot visually track tissue
t distant distractor
t+1
nearby distractor
target region
distant distractor
nearby distractor
target region
![Page 9: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/9.jpg)
We wanted a solution which...
• ...could help alleviate density incoherence
• ...didn't require a new capture technique
• ...maintained the primary method of viewing
• ...could benefit 4D volume rendering generally
![Page 10: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/10.jpg)
New Transfer Function?• Transfer function f(x) = t
• A couple of examples of transfer function input types in the literature:
• Size, visibility (Correa et al. 2008; 2009)
• Histogram (Caban et. al. 2008)
• Shape (Sato et al. 2000)
• How about motion?
![Page 11: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/11.jpg)
Motion-Moderated Transfer Functions
![Page 12: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/12.jpg)
A motion-moderated TF
• We can use motion information as input
• Can bring the attention to areas under motion
• Can aid with occlusion caused by static objects in the foreground
• Can aid identification of high-velocity areas
![Page 13: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/13.jpg)
t1
t10
GradientIntensity Motion Mag
![Page 14: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/14.jpg)
How to obtain motion metadata
• Phase-contrast velocity mapping
• Tagged CMR techniques (see right)
• However:
• We cannot rely on this
• We wish for generality
![Page 15: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/15.jpg)
Optical Flow estimation• For generality we use
optical flow estimation
• Output is a 3D grid of vectors for each time step
![Page 16: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/16.jpg)
Workflow
1 bu
ild compute motionintensity
t
intensityt-1
motion field
Intensity Field: original volume dataset Motion Field: generated by optical flow
![Page 17: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/17.jpg)
Raycasting to 2D buffers
Intensity Field and
Motion Fieldcolour buffer
c: colourmap(intensity)α: motion mag
Motion Field
motion buffer
( )
![Page 18: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/18.jpg)
Workflow
1 bu
ild compute motionintensity
t
intensityt-1
motion field
2 ra
ycas
t
accumulate colour
accumulate motion
![Page 19: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/19.jpg)
Problem: noisy motion• The motion vectors from optical flow techniques
are usually noisy
• E.G. if we follow a region from left to right:
t0 t1 t2 t3 t4
• This can produce artefacts in the imagery
![Page 20: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/20.jpg)
• Motion from frames t-1, t-2, etc can be used to smooth out the motion in t
++
t
t� 1
t� 2
t� 3+
Solution for noisy motion
![Page 21: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/21.jpg)
Workflow
1 bu
ild compute motionintensity
t
intensityt-1
motion field
2 ra
ycas
t
accumulate colour
accumulate motion
3 co
mpo
se
temporal coherence
framebuffer
![Page 22: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/22.jpg)
Results
intensity intensity gradient motion mag x
intensity
![Page 23: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/23.jpg)
motion
motion x
intensity
motion x
intensity
motion2 x
intensity
![Page 24: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/24.jpg)
Alpha from intensity values
Alpha from motion magnitude
![Page 25: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/25.jpg)
Conclusion• We have introduced a transfer function utilising
motion information
• Such a technique can be generally applied
• Relies on an optical flow technique
• Clinical data often of reduced quality
• Research patients can be scanned for longer
![Page 26: Motion-Moderated Transfer Function for Volume Rendering 4D CMR Data](https://reader031.vdocuments.mx/reader031/viewer/2022011722/587bc2521a28ab6c3c8b48f7/html5/thumbnails/26.jpg)
Thanksfrom the heart (groan)