sparse mri -

22
Michael (Miki) Lustig Department of Electrical Engineering and Computer Science, UC Berkeley “Randomness is too important to be left to chance.”* *R. Conveyo, Oak Ridge National Laboratory Sparse MRI M. Lustig, EECS UC Berkeley Rapid MRI MRI data collection is inherently slow Faster imaging would: – Decrease scan-time – Decrease image artifacts – Increase spatial/temporal resolution – Increase coverage – Enable new applications Possible solution: – Faster imaging by reducing data (exploiting correlations & redundancies) ultrasound x-ray CT Cardiovascularultrasound.com, siemensehealthcare.com, Jim Pipe, BNI sub-Nyquist • Redundancy reduces sampling requirements (The more you know, the less you need) Nyquist limit M. Lustig, EECS UC Berkeley Data Redundancy prior knowledge everything Hennig limit everything nothing measurements Parallel Imaging k-t BLAST RIGR keyhole compressed sensing HYPR M. Lustig, EECS UC Berkeley Towards the Henning Limit There are situations where the Hennig limit is achievable. Yet, somewhat not so informative Prior knowledge saves scan time Dr. I want a foot MRI! This is going to be quick.....

Upload: others

Post on 24-Mar-2022

4 views

Category:

Documents


0 download

TRANSCRIPT

Michael (Miki) LustigDepartment of Electrical Engineering and Computer Science, UC Berkeley

“Randomness is too important to be left to chance.”*

*R. Conveyo, Oak Ridge National Laboratory

Sparse MRI

M. Lustig, EECS UC Berkeley

Rapid MRI

• MRI data collection is inherently slow

• Faster imaging would:– Decrease scan-time– Decrease image artifacts– Increase spatial/temporal

resolution– Increase coverage– Enable new applications

• Possible solution:– Faster imaging by reducing data

(exploiting correlations & redundancies)

ultrasound

x-ray

CT

Cardiovascularultrasound.com, siemensehealthcare.com, Jim Pipe, BNI

sub-Nyquist

• Redundancy reduces sampling requirements(The more you know, the less you need)

Nyquist limit

M. Lustig, EECS UC Berkeley

Data Redundancy

prior knowledge everything

Hennig limit

everything

nothing

mea

sure

men

ts

ParallelImaging

k-tBLAST

RIGRkeyhole

compressed sensing

HYPR

M. Lustig, EECS UC Berkeley

Towards the Henning Limit• There are situations where the Hennig limit is achievable. Yet,

somewhat not so informative

Prior knowledge saves scan time

Dr. I want a foot MRI!

This is going to bequick.....

Medical images are compressibleStandard approach: First collect, then compress

M. Lustig, EECS UC Berkeley

Image Compression

100110100110100010011101010100110100010001010110101010101011001011101110111010101011011011010100111111

1010001101001101011 Compression

Medical images are compressibleStandard approach: First collect, then compress

M. Lustig, EECS UC Berkeley

Compressed Sensing

100110100110100010011101010100110100010001010110101010101011001011101110111010101011011011010100111111

1010001101001101011 Compression

Sensing

Medical images are compressibleStandard approach: First collect, then compress

M. Lustig, EECS UC Berkeley

Compressed Sensing

100110100110100010011101010100110100010001010110101010101011001011101110111010101011011011010100111111

1010001101001101011 Compression

Sensing

*Courtesy, M. Uecker, J Frahm Max Planck

*

M. Lustig, EECS UC Berkeley

Example: DCE

delayed filling of aneurysm

J. Velkina and A. SamsonovUniversity of Wisconsin, Madison

Yijing Wu, Chuck MistrettaUniversity of Wisconsin, Madison

submilimiter spatial resolution~1 Frame/sec

CS-HYPR patient with dual arteriovenous fistula.

• Accelerated Cine Turbo-Spin-echo R=10

M. Lustig, EECS UC Berkeley

Example: Dynamic CINE

Courtesy, Denis Parker, University of Utah

2 Averages to avoid artifact Dynamic Cine

Mendes et al, MRM 66:1286, 2011

M. Lustig, EECS UC Berkeley

Example: 3D Real-time

• Real-time airway collapseR = 13

Mid-sagittal

Para-sagittal

Axial slicesSuperior

Inferior

Courtesy, YC Kim & K. Nayak, USC

normal breathing load during inspiration

Marked narrowing

M. Lustig, EECS UC Berkeley

A Surprising Experiment

recon

standard

sensing

Compressed

Randomly throw away84% of samples

Transform

Fourier

Candes, Romberg and Tao; 2004M. Lustig, EECS UC Berkeley

Implications…

Randomly throw away66% of samples

• MRI data are obtained in k-space

• Potential for significant scan time reduction

transform

Fourier

recon

standard

sensing

compressed

M. Lustig, EECS UC Berkeley

Compressed Sensing Hollywood Style

from: http://dunk3d.tumbler.com

•This software is state-of-the-art•With the right combination of algorithms...

•You got an image enhancer ?....

• x∈ℜN is a signal • Make N linear measurements

M. Lustig, EECS UC Berkeley

N N

Traditional Sensing

xy

=

Φ

sensing matrix

NxN

Desktop scanner/ digital camera sensing

• x∈ℜN is a signal • Make N linear measurements

M. Lustig, EECS UC Berkeley

N N

Traditional Sensing

xy

=

Φ

sensing matrix

NxN

MRI Fourier Imaging

M. Lustig, EECS UC Berkeley

N N

Traditional Sensing

• x∈ℜN is a signal • Make N linear measurements

xy

=

Φ

sensing matrix

NxN

A “good” sensing matrix is orthogonal

Φ* Φ = I

Arbitrary sensing

M. Lustig, EECS UC Berkeley

sensing matrix

Compressed Sensing (Candes, Romber, Tao 2006; Donoho 2006)

• x∈ℜN is a K-sparse signal (K<<N)• Make M (K<M<<N) incoherent linear projections

x

=

Φ

MxNK

sensing matrix

A “good” compressed sensing matrix is incoherent i.e, approximately orthogonal

Φ* Φ ≈ I

Incoherency can preserve information

M

y

M. Lustig, EECS UC Berkeley

CS recovery

• Given y = Φxfind x

• But there’s hope, x is sparse!

Under-determined

=

Φ xy

M. Lustig, EECS UC Berkeley

CS recovery

• Given y = Φxfind x

• But there’s hope, x is sparse!

minimize ||x||1

s.t. y = Φx

need M ≈ K log(N) <<N

Solved by linear-programming

Under-determinedminimum ||x||1 minimum ||x||2

M. Lustig, EECS UC Berkeley

Geometric Interpretation

domain of sparse signals

M. Lustig, EECS UC Berkeley

Practicality of CS

• Can such sensing system exist in practice?

Fourier matrix

M. Lustig, EECS UC Berkeley

Practicality of CS

• Can such sensing system exist in practice?

Fourier matrix

M. Lustig, EECS UC Berkeley

Practicality of CS

• Can such sensing system exist in practice?

Fourier matrix

M. Lustig, EECS UC Berkeley

• Can such sensing system exist in practice?

• Randomly undersampled Fourier is incoherent

Φ* Φ ≈ I

Practicality of CS

=

• MRI samples in the Fourier domain!

M. Lustig, EECS UC Berkeley

S p a r s i t y &

Compressibility

not sparsesparse

M. Lustig, EECS UC Berkeley

Sparsity and Noise

*image courtesy of J. Trzasko

*

M. Lustig, EECS UC Berkeley

Sparsity and Noise

*image courtesy of J. Trzasko

sparse not sparse

*

denoise/separate by threshold

M. Lustig, EECS UC Berkeley

Transform Sparsity

not sparse Sparse Edges

M. Lustig, EECS UC Berkeley

Transform Sparsity and Denoising

sparsenot sparsewavelet transform

low-frequency

high frequency

denoised

DL Donoho, I Johnstone Biometrika 1994;81(3):425-55

M. Lustig, EECS UC Berkeley

Transform Sparsity and Denoising

sparsenot sparsewavelet transform

denoised

low-frequency

high frequency

DL Donoho, I Johnstone Biometrika 1994;81(3):425-55

M. Lustig, EECS UC Berkeley

Transform Sparsity and Denoising

wavelet denoising

DL Donoho, I Johnstone Biometrika 1994;81(3):425-55

M. Lustig, EECS UC Berkeley

More Sparse Transforms

time

posi

tion

posi

tion

temporal frequency

Sparse

not Sparse *Video courtesy of Juan Santos, Heart Vista

Courtesy, M. Usman & T. SchaeffterKing’s College

furtherexploit group

sparsity

M. Lustig, EECS UC Berkeley

Sparsity and Compression

• Only need to store non-zeros

M. Lustig, EECS UC Berkeley

http://xkcd.com/26/

From Sparse Signals to Sparse Sampling

M. Lustig, EECS UC Berkeley

From Sparse Signals to Sparse Sampling

M. Lustig, EECS UC Berkeley

From Sparse Signals to Sparse Sampling

uniform subsampling

coherentfolding

M. Lustig, EECS UC Berkeley

From Sparse Signals to Sparse Sampling

coherentfolding

uniform subsampling

M. Lustig, EECS UC Berkeley

From Sparse Signals to Sparse Sampling

random subsampling

non-coherentartifact

M. Lustig, EECS UC Berkeley

From Sparse Signals to Sparse Sampling

variable density random

noise-likeartifact

M. Lustig, EECS UC Berkeley

From Sparse Signals to Sparse Sampling

K. Scheffler, J. Hennig, MRM 1998; 40(3):474-80

undersampled radial

streakingartifact

M. Lustig, EECS UC Berkeley

From Sparse Signals to Sparse Sampling

D. Peters et. al, MRM 2000; 43:91-101

better resolution than the 4003 400 FT (512 with 1.3 largerFOV). This places a lower limit on the actual resolution ofundersampled PR in this imaging situation.

Human StudiesThis section presents the results from four contrast-enhanced exams, out of the 10 exams conducted using PRwith contrast agent in healthy volunteers and a patient.

ZIPR With Progressively Fewer ProjectionsFigure 7 shows the femoral arteries imaged with ZIPRduring contrast agent infusion, originally collected as a 512(312 acquired) 3 400 projection angle PR image using thefollowing parameters: 40 3 40 3 11.2 cm FOV, 30° tip,TR/TE of 8.0 ms/1.1 ms, 664 kHz BW, 312 3 400 projec-tions3 16 kz3 1 frame acquisition matrix, 5123 5123 16reconstruction matrix, 0.78 3 0.78 3 7.0 mm true voxelsize, 51 s scan time, 0.3 mmol/kg at 0.5 ml/s gadoliniumcontrast agent injection, and torso phased array coil.Images were reconstructed with progressively fewer angles(using (a) 400, (b) 200, (c) 100, and (d) 50 angles) byskipping angles in the full dataset. The changing imagequality is due to the worsening of artifacts and reduction ofSNR at lower numbers of projections. Nevertheless, clini-

FIG. 6. Quantitative resolution comparison between FT and PR inthe resolution phantom for FT acquisitions with 512 phase encodings,400 phase encodings, 128 phase encodings, and PR with 128projections. The magnitude of oscillations for each dot pattern isrecorded. The 128 PR method performs similarly to the 512 FTmethod, and better than the 400 FT method.

a b cFIG. 5. Resolution comparison between FT and PR. a: FT 5123 128 phase encodings. b: PR 5123 128 projections. c: FT 5123 512 phaseencodings. The pixel resolution of the 512 3 512 image is 0.3 3 0.3 mm, and the smallest dots are 0.5 mm wide, spaced 0.5 mm apart. Theundersampled PR image has resolution similar to the 512 3 512 FT image, although it was acquired in one-fourth of the time. The Fourierfrequency-encoding direction is indicated by the arrow.

Undersampled PR for MRA 95

cally significant detail is present, even with 50 projections(an undersampling factor of 16 relative to fully sampledPR).

ZIPR Comparisons Between FT and PR in HumansTo evaluate undersampled PR for contrast-enhanced MRA,3D volumes obtained using the FT and PR imaging meth-ods were compared in a contrast-enhanced scan of thepulmonary vessels. MIP comparisons between FT (512 3128 phase encodings) and PR (512 3 128 projections) arepresented in Fig. 8. The following parameters were used:36 3 36 3 12.8 cm FOV, 30° tip, TR/TE 7.5 ms/1.2 ms,664 kHz BW, 312 3 128 projections or phase encodings 332 kz 3 1 frame acquisition matrix, 512 3 512 3 64reconstruction matrix, 0.70 3 0.70 3 4 mm true voxel sizefor PR, 0.7 3 2.8 3 4 mm true voxel size for FT, 31 s scantime, 18 ml at 1 ml/s gadolinium contrast agent injection,and a torso phased array coil. Minimal undersamplingartifact is visible in the PR images. The comparison clearlyillustrates significant improvement in resolution for PR inthe Fourier phase encoding (horizontal) direction. The FT

MIPs show better SNR and more vessels. The PR imageshave sharper vessels.

Fast Pulmonary ImagingOne use of undersampled PR is for fast moderate-resolution imaging. For example, patients with suspectedpulmonary embolism can only tolerate short breathholds.In Fig. 9 we compare contrast-enhanced FT and PR

pulmonary angiograms both obtained in a 17-sec breath-hold. We compare targeted MIPs of the undersampled PRand FT. The scan parameters for PRwere: 363 363 9.6 cmFOV, 40° tip, TR/TE 5 6.0 ms/1.2 ms, 664 kHz BW, 400(240 acquired) 3 170 projections 3 16 kz, 512 3 512 3 32reconstruction matrix, true voxel size 0.9 3 0.9 3 6 mm,27 mls at 2 ml/s gadolinium contrast agent injection, fatsuppression pulse once per slice loop, and a cardiacphased array coil. For the FT scan (Fig. 9b), all parameterswere the same except 256 xres (160 acquired) and a 128phase encodings resulting in 1.43 2.83 6.0 mm true voxelsize. The comparison shows the much better resolution of

a

c

b

dFIG. 7. ZIPR MIPs of the femoral arteries, all generated from the same data set using progressively fewer number of projections: (a) 400, (b)200, (c) 100, (d) 50. Even with 50 projections (d), clinically significant detail is present. The origin of the profunda femoral artery at the commonfemoral artery is well depicted.

96 Peters et al.

undersampled radial

• For sparse signals - artifacts are benign• Excellent for angiography• Often MIP through volume (like thresholding)

M. Lustig, EECS UC Berkeley

Compressed Sensing “denoising” artifacts

M. Lustig, EECS UC Berkeley

• Take compressible signals Have sparse transform representations

• Make incoherent measurements Make artifacts look like noise (after transform)

• Reconstruct using sparsity-enforcing non-linear reconstructionIteratively separate sparse signals from artifacts

Compressed Sensing - Basic Idea

Ingredients:

M. Lustig, EECS UC Berkeley

Intuitive Example of Compressed Sensing

M. Lustig, EECS UC Berkeley

Intuitive Example of Compressed Sensing

iFFT

Nyquistsampling

M. Lustig, EECS UC Berkeley

Intuitive Example of Compressed Sensing

iFFT

sub-Nyquistequispaced

M. Lustig, EECS UC Berkeley

Intuitive Example of Compressed Sensing

iFFT

sub-Nyquist

Ambiguity

M. Lustig, EECS UC Berkeley

Intuitive Example of Compressed Sensing

iFFT

sub-Nyquistrandom

M. Lustig, EECS UC Berkeley

Intuitive Example of Compressed Sensing

iFFT

sub-NyquistLooks like

“random noise”

M. Lustig, EECS UC Berkeley

Intuitive Example of Compressed Sensing

iFFT

sub-NyquistBut it’s not

noise!

M. Lustig, EECS UC Berkeley

Intuitive example of CS

iFFT

Recovery

Example inspired by Donoho et. Al, 2007

M. Lustig, EECS UC Berkeley

Question!

• What if the signal is sparse, and we sample it directly?

• Would CS still work?

sub-Nyquistrandom sub-Nyquist

M. Lustig, EECS UC Berkeley

Answer...

• What if the signal is sparse, and we sample it directly?

• Would CS still work?

sub-Nyquistrandom sub-Nyquist

Most likely we will get only zeros!M. Lustig, EECS UC Berkeley

Domains in Compressed Sensing

Signal

SparseDomain

SamplingDomain

Not Sparse!

Sparse! incoherent

M. Lustig, EECS UC Berkeley

Domains in CS MRI

Signal

k-space

Wavelet domain incoherent

Signal domain

M. Lustig, EECS UC Berkeley

Domains in CS MRI

x-f domain incoherent

k-t domainx-t domain

Acquired Data

Sparse “denoising”

Compressed SensingReconstruction

Acquired Data

Sparse “denoising”

Compressed SensingReconstruction

Acquired Data

Sparse “denoising”Undersampled Final Image

Compressed SensingReconstruction

Tutorial & code available at http://www.mlustig.comM. Lustig, EECS UC Berkeley

Practical Considerations

The theory can only take you so far... • Many practical considerations

– Weak sparsity of medical images

– Noise

– Sampling (pure random infeasible!)

– System imperfection

– Complex numbers / phase

– Parallel imaging

– Computation

– Validation?

– ......

• Noise– Noise in the sparse domain counts!– Subsampling reduces SNR– Resulting image noise is not white-Gaussian– Apparent SNR ≠ Sensitivityonly use when SNR is sufficient!

M. Lustig, EECS UC Berkeley

Limitations and Pitfalls

remainingartifact “noise” True noise

M. Lustig, EECS UC Berkeley

Artifacts

Blurred Blocky Good quality

• Artifacts: ( when pushed to limits)

• Usually easy to recognize• Can be subtle

– Washed contrast

– Loss of resolution

– Synthetic/artificial look

– Blocky artifacts

Example courtesy M. Uecker, UCB

M. Lustig, EECS UC Berkeley

Trade-offs

• CS provides new tradeoffs– Loss of low-contrast

features instead of resolution

acce

lera

tion

Low-Resolution Compressed Sensing

M. Lustig, EECS UC Berkeley

Incoherent sampling3D “Full” 3D “Compressed”

M. Lustig, EECS UC Berkeley

Incoherent Sampling

t

kyy

kx

2D non-Cartesian3D Cartesian

k-t sampling

Lustig et. al, MRM 2007;58(6):1182-95Santos et. al, MRM 2006;55:371-9Doneva et. al, ISMRM 2011Block KT, et. al, MRM 2007;57:1086-98Haider C. MRM 2008;60:749-760Graiser et. al, MRM 2003;50:1266-75

M. Lustig, EECS UC Berkeley

Compressed Sensing Meets

Parallel Imaging

M. Lustig, EECS UC Berkeley

Coil Arrays

M. Lustig, EECS UC Berkeley

Parallel Imaging and Compressed Sensing

• Synergetic combination• Used to

– Increase speed– Improve quality

• SENSE based methods• Auto-Calibrating methods

Block, et. al, MRM 2007;57:1086-1098

Wu et. al, ISMRM’08 pp.1480King et. al, ISMRM’08 pp. 1488Liu, Ying et. al, ISMRM’08 pp. 3154Otazo et. al, MRM 2010;64:767-76

Lustig et. al, MRM 2010;64:457-71

Liang, Ying et. al, MRM 2009;62:1574-84

M. Lustig, EECS UC Berkeley

SENSE Parallel Imaging and CS

1030 Trzasko et al.

FIG. 7. Selected images from Example 5: (a–c) are coronal MIPs of early, middle, and late filling stage volumes from a nonview-sharedSENSE + Homodyne reconstruction of the calves of a volunteer, and (d) is an axial cross-section of a middle filling stage volume; (e–g) and(h) are from the corresponding NCCS reconstruction. The location of the axial cross-section is marked by the dotted line in (b) and (f). (i) and(j) are the respective enlargements of an ROI in (b) and (f); (k) and (l) are the respective enlargements of an ROI in (d) and (h).

Another limitation of the proposed reconstruction strat-egy is that both the recovery model and the numericaloptimization routine each possess several parameters thatmust be reasonably assigned to achieve high quality results.For example, assigning too small a value to the regulariza-tion parameter, α, can allow noise amplification during thereconstruction, whereas assigning too large a value to α canresult in over-sparsification and thus over-smoothing of theimage, and a corresponding loss of features. However, it isnoted that once an effective setting is found for a particu-lar image scenario, it can be reused (e.g., all neurovascularstudies are run under the same settings).

Although beyond the scope of this manuscript, it isexpected that the improved vessel-to-background con-spicuity (i.e., contrast) and homogeneity of vessels, enhanc-ing structures, and background tissue resulting from theNCCS reconstruction strategy for CAPR CE-MRA imageseries will lead to improved diagnosis, with better sen-sitivity for detection of abnormalities, and fewer falsepositive/negative interpretations. Nonetheless, a formalradiological comparison of these two reconstruction strate-gies is still needed and will be the subject of a separate,future work.

APPENDIX: FINITE SPATIAL DIFFERENCECOMPUTATION

The adopted finite difference spatial model assumes thatany finite spatial difference centered inside Ω but for whichthe neighbor of interest is outside Ω will be zero. Morespecifically, ∀s ∈ Ω and any n,

[Dnu](s) =

u(s) − u(s + n), if (s + n) ∈ Ω

0, else .

Note that this operator can be abstracted as Dn = I −Sn−Cn,where I is the identity operator, Sn is a non-wrapped shiftoperator (towards neighbor n) with zero-filling, and Cn isan operator that copies nonshifted boundary elements. Letn = ∆x , ∆y , ∆z and s = x, y , z, where x ∈ [0, Nx ), y ∈[0, Ny ), and z ∈ [0, Nz). Assuming the notation u(s + n) =u(x + ∆x , y + ∆y , z + ∆z), the component operators of Dncan then be defined as

[Snu](s) =

u(s + n), if (x ∈ Υx ) ∧ (y ∈ Υy ) ∧ (z ∈ Υz)0, else

[20]

1030 Trzasko et al.

FIG. 7. Selected images from Example 5: (a–c) are coronal MIPs of early, middle, and late filling stage volumes from a nonview-sharedSENSE + Homodyne reconstruction of the calves of a volunteer, and (d) is an axial cross-section of a middle filling stage volume; (e–g) and(h) are from the corresponding NCCS reconstruction. The location of the axial cross-section is marked by the dotted line in (b) and (f). (i) and(j) are the respective enlargements of an ROI in (b) and (f); (k) and (l) are the respective enlargements of an ROI in (d) and (h).

Another limitation of the proposed reconstruction strat-egy is that both the recovery model and the numericaloptimization routine each possess several parameters thatmust be reasonably assigned to achieve high quality results.For example, assigning too small a value to the regulariza-tion parameter, α, can allow noise amplification during thereconstruction, whereas assigning too large a value to α canresult in over-sparsification and thus over-smoothing of theimage, and a corresponding loss of features. However, it isnoted that once an effective setting is found for a particu-lar image scenario, it can be reused (e.g., all neurovascularstudies are run under the same settings).

Although beyond the scope of this manuscript, it isexpected that the improved vessel-to-background con-spicuity (i.e., contrast) and homogeneity of vessels, enhanc-ing structures, and background tissue resulting from theNCCS reconstruction strategy for CAPR CE-MRA imageseries will lead to improved diagnosis, with better sen-sitivity for detection of abnormalities, and fewer falsepositive/negative interpretations. Nonetheless, a formalradiological comparison of these two reconstruction strate-gies is still needed and will be the subject of a separate,future work.

APPENDIX: FINITE SPATIAL DIFFERENCECOMPUTATION

The adopted finite difference spatial model assumes thatany finite spatial difference centered inside Ω but for whichthe neighbor of interest is outside Ω will be zero. Morespecifically, ∀s ∈ Ω and any n,

[Dnu](s) =

u(s) − u(s + n), if (s + n) ∈ Ω

0, else .

Note that this operator can be abstracted as Dn = I −Sn−Cn,where I is the identity operator, Sn is a non-wrapped shiftoperator (towards neighbor n) with zero-filling, and Cn isan operator that copies nonshifted boundary elements. Letn = ∆x , ∆y , ∆z and s = x, y , z, where x ∈ [0, Nx ), y ∈[0, Ny ), and z ∈ [0, Nz). Assuming the notation u(s + n) =u(x + ∆x , y + ∆y , z + ∆z), the component operators of Dncan then be defined as

[Snu](s) =

u(s + n), if (x ∈ Υx ) ∧ (y ∈ Υy ) ∧ (z ∈ Υz)0, else

[20]

JD Trzasko et. al, Mayo ClinicMRM 2011;66:1019-32

R = 8

SENSE CS+SENSE

raw slices raw slices

Cartesian 3D PR (CAPR)1020 Trzasko et al.

FIG. 1. An example W = 4 CAPR acquisition sequence (Ny = Nz = 256). During this acquisition, the phase-encoded plane of k-space(ky-kz) is partitioned into a distinct low-pass region, shown in orange, and a high-pass region (a). The high-pass annulus is itself furtherpartitioned azimuthally into W subsets of “vanes,” shown here in blue, green, yellow, and red, which are placed asymmetrically aboutthe origin. Although Cartesian, the CAPR sampling operator, by construction, tends to exhibit properties similar to non-Cartesian radialtrajectories (within the phase-encoded plane). The sampling order or schedule is shown in (b). During each temporal update, uniformly-spaced samples (here, spaced 2 × 2 apart) from within the low-pass region and a single high-pass vane set are acquired. This same set ofk-space indices is reinvestigated after W temporal updates. The set of all k-space indices investigated at any point during the entire exam isshown in (c) and is simply the union of the sample sets shown in (b). Note that, for this example, only about 20% of k-space is investigatedduring the exam, a property that facilitates practical formation of the reference signal needed for background subtraction.

THEORY

A Forward Model for Parallel MRI

Suppose we are interested in forming a discrete image esti-mate of some anatomy of interest using three-dimensionalCartesian (3DFT) parallel magnetic resonance imaging.Denoting f as the discrete image of interest, a commonly-assumed forward model for this acquisition process is

g1g2...

gC

=

ΦFΓ1ΦFΓ2

...ΦFΓC

f + n, [1]

where gc is the signal observed by the cth coil sensor, Γcis the element-wise (i.e., diagonal) spatial sensitivity func-tion for the cth coil sensor, F is the discrete 3D Fouriertransform (3DFT) operator, and Φ is a binary operator thatidentifies the subset of k-space measured during the imag-ing experiment. The vector n represents system noise and ishereafter assumed to be a complex additive white Gaussianprocess (13).

Time-Varying Signals and CAPR

In CE-MRA, the signal of interest is inherently tran-sient and thus routinely probed at multiple different timepoints to characterize patient hemodynamics in addi-tion to vascular morphology. Given the direct relationshipbetween the number of k-space indices measured duringan MRI exam and the duration of the exam, spatiotemporalundersampling is often employed to accelerate dynamic

MRI exams such as CE-MRA. Reconstruction techniquessuch as view-sharing (25), HYPR-type processing (8,26),and constraint or regularization methods (9,23,27–33) thatrely on a priori assumptions about spatial and/or temporalimage structure may be employed to avoid generation ofimages with significant artifacts.

Assuming that both the signal of interest and the sam-pling process may be temporally variant in dynamic MRI,(1) can be generalized to

g1(t)g2(t)

...gC (t)

=

Φ(t)FΓ1Φ(t)FΓ2

...Φ(t)FΓC

f (t) + n(t), [2]

where t ≥ 0 is an integer corresponding to the frame num-ber. During a CAPR acquisition, k-space is partitioned intotwo distinct regions: (1) a circularly-symmetric low-passregion that is sampled during each temporal update; (2)a high-pass region of which a different subset is sampledduring each temporal update. Thus, the effective samplingoperator for CAPR can be described as

Φ(t) =[

ΦLOΦHI(t)

]. [3]

The dynamic high-pass sampling operator ΦHI(t) is alsostrictly W -periodic and so, ∀t ≥ 0, ΦHI(t) = ΦHI(t+W ), and∀τ ∈ (0, W ), Trace(Φ*

HI(t+τ)ΦHI(t)) = 0. A pictorial exampleof a CAPR acquisition sequence is given in Fig. 1. For a moredetailed description of the CAPR acquisition protocol, thereader is referred to (11).

M. Lustig, EECS UC Berkeley

SENSE Parallel Imaging and CS

• 8-fold acceleration• 10 slices per heartbeat• Temporal resolution = 60ms/slice• Spatial resolution (in-plane) = 1.7 mm• SENSE +PI

Perfusion images(peak myocardial wall enhancement)

Delayed-enhancement

Otazo et al. NYUMagn Reson Med. 2010; 64:767-76

Patient with acute myocardial infarction

First-Pass perfusion MRI

t

kyy

kx

M. Lustig, EECS UC Berkeley

AutoCalibrating Parallel Imaging and CSL1-SPIRiT CS+PI6 years oldR = 83D SPGR0.87x0.87x1.6 mm

Vasanawala & Alley, LPCH, StanfordM. Lustig et. al, UCB

MIP

slice

L1-SPIRiT

temporal phases

M. Lustig, EECS UC Berkeley

AutoCalibrating Parallel Imaging and CS

6 years old maleR = 83D SPGRSub-mm32 channels

L1-SPIRiTPI + CS

autocalibratingParallel Imaging

Vasanawala & Alley, LPCH, StanfordM. Lustig et. al, UCB

M. Lustig, EECS UC Berkeley

Compressed Sensing in the Clinic

• Target: Robust, sedation-free pediatric body MRI

• Leverage:dedicated 32ch coilCompressed SensingMotion CorrectionParallel Computing

• ~6 clinical scan / day at LPCHsince 2010

dedicated 32Ch coil

GPU’s & multi-core CPU

Berkeley Stanford GE

M. Lustig, EECS UC Berkeley

Reconstruction speed

• Iterative reconstruction computationally intensive• Large data-sets are better for CS • Currently top hurdle in penetration to clinic• Current Solutions:

– Algorithmic – Parallel Computation

D. Kim, J. Trzasko, A. Manduca et. al “High Performance 3D CS MRI Reconstruction Using Many-Core Architectures, IJBI doi:10.1155/2011/473123Intel and Mayo Clinic

1-3min for 3D datasets

M. Murphy, M. Lustig et. al, “Fast L1-SPIRiT CS PI MRI:Parallel Implementation and Clinically Feasible Scan-Time” IEEE-TMI 2012; early viewUC Berkeley, Stanford University

M. Lustig, EECS UC Berkeley

Emerging Techniquesand Applications

M. Lustig, EECS UC Berkeley

Multi-Contrast Reconstruction• An exam consists of multiple scans• Mutual information between exams• Jointly reconstruct all exams

joint reconseparate recon*B. Bilgic et. al, MIT MRM 2011;66:1601-15,

err.

x10

R=2.

4

T1w

T2w

+F. Huang, ISMRM ’12 pp2539 Philips

R=5

err.

x5

M. Lustig, EECS UC Berkeley

Compressive Parameter Mapping (T1,T2)CS#&#PI#(R=

6)GR

APPA

#(R=4)

TE#=#10#ms T2#map#R=#6

0

80#ms

J. Chul Ye - k-t FOCUSS KaistFeng L et al. Magn Reson Med. 2011; 65(6): 1661-9

Doneva et al Magn Reson Med 2010, 1114-1120Philips Research

Time

T1 map R = 8

T2#relaxa=on

• Preclinical models of cancer• CS for high-res + dynamics

M. Lustig, EECS UC Berkeley

Metabolic Imaging Hyperpolarized 13C

R = 7.5

Hu, Vigneron et. al, JMR 2008;192(2):258Hu, Vigneron et. al, MRM 2010;63(2):312P. Larson, et. al, MRM 2011;65(3):3:610-9UCSF

Regular

Compressedsensing

R = 18

Tumor

pyruvate lactate

• Transform can be adapted• Better sparsity/model = better recon

M. Lustig, EECS UC Berkeley

k-SVD Transform

S. Ravishankar and Y. Br

Adaptive Transforms Dabov et al, IEEE TIP, 2007.M. Aharon,et al, IEEE TSP 2006;54(11):4311-22

Block-Matching 3D

M. Lustig, EECS UC Berkeley

Adaptive Compressed Sensing

LOST: High-res

Late Gadolinium Enhancement R=3

2D Random Sampling - 6 fold undersampling

0

0.05

0.1

0.15

0.2

0.25

0.3

LDP reconstruction (22 dB) LDP error magnitude

0

0.05

0.1

0.15

0.2

0.25

0.3

DLMRI reconstruction (32 dB) DLMRI error magnitude

S. Ravishankar and Y. Bresler DLMRI

2D Random Sampling - 6 fold undersampling

0

0.05

0.1

0.15

0.2

0.25

0.3

LDP reconstruction (22 dB) LDP error magnitude

0

0.05

0.1

0.15

0.2

0.25

0.3

DLMRI reconstruction (32 dB) DLMRI error magnitude

S. Ravishankar and Y. Bresler DLMRI

2D Random Sampling - 6 fold undersampling

0

0.05

0.1

0.15

0.2

0.25

0.3

LDP reconstruction (22 dB) LDP error magnitude

0

0.05

0.1

0.15

0.2

0.25

0.3

DLMRI reconstruction (32 dB) DLMRI error magnitude

S. Ravishankar and Y. Bresler DLMRI

2D Random Sampling - 6 fold undersampling

0

0.05

0.1

0.15

0.2

0.25

0.3

LDP reconstruction (22 dB) LDP error magnitude

0

0.05

0.1

0.15

0.2

0.25

0.3

DLMRI reconstruction (32 dB) DLMRI error magnitude

S. Ravishankar and Y. Bresler DLMRI

Fixed xForm (Wavelet)

DictionaryLearning*

*S. Ravishankar and Y. Bresler, UIUCIEEE TMI 2011;30(5):1028-41

non-Accelerated Dictionary Learning R=6

M. Akçakaya, R. Nezafat et. al Harvard/Beth IsraelMRM 2011;66(3):756-67

1.3x1.3x1.3mm31.7x1.7x4mm3

47-year old male patient undergoing CABG

M. Lustig, EECS UC Berkeley

Low-Rank Matrix CompletionR = 24

sparseSENSE + low rank R=6

sparse+lowrank sliding window

sparseSENSE Low-rank model R = 5

Courtesy:Zhi-Pei Liang, UIUCR. Otazo, NYUJ. Trzasko, Mayo Clinic

M. Lustig, EECS UC Berkeley

Conclusion & Comments

• Compressed Sensing: Sparsity, Incoherency and NL-recon

• Implementation must adapt to application• Use when limited by encoding time, not SNR• Larger dimensions are better

– 3D, dynamic, flow, diffusion....

M. Lustig, EECS UC Berkeley

What about fMRI?

• Sampling– EPI not ideal for CS

• Representation– what’s a good model for fMRI signal?

• My take:– CS in fMRI is possible and can be advantageous– But, no single silver bullet solution– Must tailor for experiment, task

M. Lustig, EECS UC Berkeley

Personal Note

• Take IT EASY! Acceleration costs!– Use carefully and responsibly

• CS has matured, but still missing clinical validation and clinical experience

• Share your code and work so it can be reproduced

http://www.eecs.berkeley.edu/~mlustig/Software.html

M. Lustig, EECS UC Berkeley

AcknowledgmentsSLIDES:

• Brian Hargreaves, Stanford

• Pauline Worters, Stanford

• Shreyas Vasanawala, Stanford

• Yoram Bresler, UIUC

• Zhi-Pei Liang, UIUC

• Denis Parker, Uni. of Utah

• Leslie Ying, Buffalo

• Reza Nezafat , BIDMC

• M. Akçakaya

• Feng Huang, Phillips

• Mariya Doneva, Phillips

• Anita Flynn, Berkeley

• Tobias Schaeffter, King’s College

• Muhammad Usman, king’s College

• Daniel Vigneron, Peder Larson, UCSF

• Jonh Chul-Ye, Kaist

• Berkin Bilgic, Elfar Adalsteinsson, MIT

• Maxim Zaitsev, Freiburg

• Martin Uecker, Max Planck & Berkeley

• Luca Marinelli, GE global research

• Ricardo Otazo, NYU

• Chuck Mistretta, Yijing Wu, UW

• Julia Velikina, Alexey Samsonov, UWNIH R01-EB009690, RR09794-15

GE Healthcare

Morgridge Foundation

American Heart Association

UC Discovery

“Everything to do with compression is very contentious in medical imaging. Every time you throw bits away somebody gets very nervous about it. The fortunate thing about ....[compressed sensing]... is that you don’t collect them in the first place, and that’s a much better situation!”

John Pauly 2007

Thank Youתודה רבה

http://www.eecs.berkeley.edu/~mlustig