medical image analysis -...

28
Medical Image Analysis Instructor: Moo K. Chung [email protected] Lecture 09. Gaussian Kernel Smoothing March 01, 2007

Upload: truongtuong

Post on 07-Aug-2019

222 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Medical Image AnalysisInstructor: Moo K. [email protected]

Lecture 09.Gaussian Kernel Smoothing

March 01, 2007

Page 2: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Gaussian Kernel Smoothing

We will study basic properties ofGaussian kernel smoothing and

numerical implementation issues.

Page 3: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Kernel Smoothing, Convolution, Linear Filter

inputoutput kernel

Page 4: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

2D example

Page 5: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Motivation for image smoothing: Improveperformance of PDE based segmentation - level set

No image filtering = More manual correction

Page 6: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Malladi & Sethian’s Min/Max Flowdone by Thomas Hoffmann.This is basically a PDE smoother.

Original

Gaussian

Min/Max Flow

Page 7: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Shape of kernelUnimodal, Symmetric (Isotropic), normalized

1D and 2D Gaussian kernel

Quiz: The cross section of 2D Gaussian kernel ?

Page 8: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

1D Brownian motion

Page 9: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Brownian motion simulation ---> Gaussian kernel

# random walk hitting a target voxel Probability = ----------------------------------------------- # total random walk

Page 10: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Constructing n-dimensional Gaussian Kernel

Page 11: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Red= Gaussian kernel smoothingBlue = Diffusion smoothing after 5, 25 and 50 iterations

Page 12: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

MATLAB codeK=inline('exp(-(x.^2+y.^2)/2/sig^2)');>>KInline function:K(sig,x,y) = exp(-(x.^2+y.^2)/2/sig^2)

[dx,dy]=meshgrid([-2:2]);weight=K(0.5,dx,dy)/sum(sum(K(0.5,dx,dy)));>>weight

0.0000 0.0000 0.0002 0.0000 0.00000.0000 0.0113 0.0837 0.0113 0.00000.0002 0.0837 0.6187 0.0837 0.00020.0000 0.0113 0.0837 0.0113 0.00000.0000 0.0000 0.0002 0.0000 0.0000

Page 13: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

weight=K(1,dx,dy)/sum(sum(K(1,dx,dy)));

>>weight =

0.0030 0.0133 0.0219 0.0133 0.00300.0133 0.0596 0.0983 0.0596 0.01330.0219 0.0983 0.1621 0.0983 0.02190.0133 0.0596 0.0983 0.0596 0.01330.0030 0.0133 0.0219 0.0133 0.0030

Y=conv2(X,weight,'same');

Quiz: Why there is no sqrt(2)*sigma term in thecomputation?

Page 14: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

2D simulation results

Page 15: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Better Algorithm

2D approach = 1D approach x 2

Perform 1D version of kernel smoothing in each coordinate

Page 16: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Gaussian Kernel estimator

Page 17: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

obervation = signal + noise

Page 18: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Signal

Page 19: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Prediction

Page 20: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

PredictionSignal

Page 21: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Optimal bandwidthchoose sigma that minimizes the

integrated squared error

Many technique uses some sort of cross-validation

Page 22: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Iterated kernel smoothing

smoothedX=X;for i=1:100 smoothedX=conv2(smoothedX, weight,'same');end;Y=smoothedX;

Page 23: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Covariance function ofrandom field

White noise = random field with Dirac-delta function asthe covariance function.

Gaussian white noise = Gaussian + white noise

Page 24: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Dirac-delta function

This is not really a function intraditional mathematical sense.

How you construct numerically?

Let the bandwidth of isotropicGaussian kernel goes to zero.

Page 25: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

How to simulate Gaussian field

Smooth field Gaussian white noise

How?

Page 26: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Numerical Implementation

e=normrnd(0,0.4,101,101);smooth_e=e;for i=1:10 smooth_e=conv2(smooth_e,K,'same'); figure;imagesc(smooth_e);colorbar;end;

Page 27: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Simulating Gaussian field

N(0, 0.4^2) Gaussian white noiseIterative kernel smoothing with sigma=0.4 and 1,4, 9 iterations

Page 28: Medical Image Analysis - pages.stat.wisc.edupages.stat.wisc.edu/.../MIA.lecture09.Gaussian.Smoothing.mar.01.2007.pdf · Gaussian Kernel Smoothing We will study basic properties of

Lecture 10 Topics

Random Field TheoryMultiple Comparison Corrections