fourier transform - ics.uci.edumajumder/vc/new-lectures/fouriertransform.pdffourier transform •...

62
Fourier Transform

Upload: others

Post on 31-May-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Fourier Transform

Page 2: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Fourier Transform• Any signal can be expressed as a linear combination of a bunch of sine gratings of different frequencyAmplitudePhase

2

Page 3: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

3

13 3

Page 4: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

4

13 sin 3

13 sin 3

15 sin 5

17 sin 7

13 sin 3

15 sin 5

13 sin 3

15 sin 5

17 sin 7 ⋯

Page 5: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Fourier Transform Input: infinite periodic signal Output: set of sine and cosine waves which together provide the input signal

5

Page 6: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Fourier Transform• Digital SignalsHardly periodicNever infinite

6

Page 7: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Fourier Transform in 1D

7

Page 8: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Representation in Both Domains

8Frequency

Am

plit

ude

2

1

0

Time Domain

Frequency Domain

Phas

e

180

0

Frequency

Page 9: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Discrete Fourier Transform• DFT decomposes x into 1 cosine and sine waves

• Each of a different frequency

9

Page 10: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

DFT - Rectangular Representation• Decomposition of the time domain signal x to the frequency domain and

10

Page 11: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Polar Notation• Sine and cosine waves are phase shifted versions of each other

11

Amplitude

Phase

Page 12: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Polar Representation

12

Page 13: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Polar Representation• Unwrapping of phase

13

Page 14: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Properties• Homogeneity

• Additivity

14

Page 15: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Properties• Linear phase shift

15

Page 16: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Symmetric Signals• Symmetric signal always has zero phase

16

Page 17: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Symmetric Signals• Frequency response and circular movement

17

Page 18: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Amplitude Modulation

18

Page 19: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Periodicity of Frequency Domain • Amplitude Plot

19

Page 20: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Periodicity of Frequency Domain • Phase Plot

20

Page 21: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Aliasing

21

Page 22: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Sampling – Frequency Domain

f s 2

-f s 2

f s 2 f s 3 f s - f s

f s 2 f s 3 f s - f s

Convolution

Page 23: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Reconstruction – Frequency Domain

f s 2

-f s 2

f s 2 f s 3 f s - f s

f s 2

-f s 2

Multiplication

Page 24: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Reconstruction (Wider Kernel)

f s 2

-f s 2

f s 2 f s 3 f s - f s

f s 2

-f s 2

PIXELIZATION: Lower frequency aliased as high frequency

Page 25: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Reconstruction (Narrower Kernel)

f s 2

-f s 2

f s 2 f s 3 f s - f s

f s 2

-f s 2

BLURRING: Removal of high frequencies

Page 26: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Aliasing artifacts (Right Width)

Page 27: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Wider Spots (Lost high frequencies)

Page 28: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Narrow Width (Jaggies, insufficient sampling)

Page 29: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

DFT extended to 2D : Axes• Frequency

Only positive

• Orientation 0 to 180

• Repeats in negative frequency Just as in 1D

Page 30: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Example

Page 31: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

How it repeats?• Just like in 1D

Even function for amplitude Odd function for phase

• For amplitude Flipped on the bottom

Page 32: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Why all the noise?• Values much bigger than 255

• DC is often 1000 times more than the highest frequencies

• Difficult to show all in only 255 gray values

Page 33: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Mapping• Numerical value = i

• Gray value = g

• Linear Mapping is g = ki

• Logarithmic mapping is g = k log (i) Compresses the range Reduces noise May still need thresholding to remove noise

Page 34: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Example

Original DFT Magnitude

In Log scale Post Thresholding

Page 35: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Low Pass Filter Example

Page 36: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Additivity

+

=

Inverse DFT

Page 37: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Nuances

Page 38: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in
Page 39: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in
Page 40: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Rotation

What is this about?

Page 41: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

X

Page 42: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

X

Page 43: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

More examples: Blurring• Note energy reduced at higher frequencies

• What is direction of blur? Horizontal

• Noise also added DFT more noisy

Page 44: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

More examples: Edges

• Two direction edges on left image Energy concentrated in two directions in DFT

• Multi-direction edges Note how energy concentration synchronizes with edge direction

Page 45: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

More examples: Letters• DFTs quite different

Specially at low frequencies

• Bright lines perpendicular to edges

• Circular segments have circular shapes in DFT

Page 46: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

More examples: Collections• Concentric circle

Due to pallets symmetric shape DFT of one pallet

Similar

• Coffee beans have no symmetry Why the halo? Illumination

Page 47: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

More examples: Natural Images• Natural Images

• Why the diagonal line in Lena? Strongest edge between hair and hat

• Why higher energy in higher frequencies in Mandril? Hairs

Page 48: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

More examples

• Repeatationmakes perfect periodic signal

• Therefore perfect result perpendicular to it

Spatial

Frequency

Page 49: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

More examples• Just a gray telling all frequencies

• Why the bright white spot in the center?

Spatial

Frequency

Page 50: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

AmplitudeHow much details?Sharper details signify higher frequenciesWill deal with this mostly

50

Page 51: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Cheetah

51

Page 52: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Magnitude

52

Page 53: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Phase

53

Page 54: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Zebra

54

Page 55: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Magnitude

55

Page 56: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Phase

56

Page 57: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Reconstruction• Cheetah Magnitude

• Zebra Phase

57

Page 58: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Reconstruction• Zebra magnitude

• Cheetah phase

58

Page 59: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Uses – Notch Filter

59

Page 60: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Uses

Page 61: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Smoothing Box Filter

61

Page 62: Fourier Transform - ics.uci.edumajumder/VC/new-lectures/fouriertransform.pdfFourier Transform • Any signal can be ... • Two direction edges on left image Energy concentrated in

Smoothing Gaussian Filter

62