modern sampling methods 049033
DESCRIPTION
Modern Sampling Methods 049033. Instructor: Yonina Eldar Teaching Assistant: Tomer Michaeli Spring 2009. Sampling: “Analog Girl in a Digital World…” Judy Gorman 99. Analog world. Digital world. Sampling A2D. Signal processing Denoising Image analysis …. Reconstruction D2A. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/1.jpg)
Instructor: Yonina EldarTeaching Assistant: Tomer
Michaeli
Spring 2009
Modern Sampling Methods
049033
[ ]c n[ ]c n[ ]c n
![Page 2: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/2.jpg)
2
Sampling: “Analog Girl in a Digital World…” Judy Gorman 99
Digital worldAnalog world
Signal processingDenoisingImage analysis …
ReconstructionD2A
SamplingA2D
[ ]c n[ ]c n[ ]c n[ ]c n[ ]c n
(Interpolation)
![Page 3: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/3.jpg)
3
ApplicationsSampling Rate Conversion
Common audio standards: 8 KHz (VOIP, wireless microphone, …) 11.025 KHz (MPEG audio, …) 16 KHz (VOIP, …) 22.05 KHz (MPEG audio, …) 32 KHz (miniDV, DVCAM, DAT, NICAM, …) 44.1 KHz (CD, MP3, …) 48 KHz (DVD, DAT, …) …
![Page 4: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/4.jpg)
4
Lens distortion correction
Image scaling
ApplicationsImage Transformations
![Page 5: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/5.jpg)
5
ApplicationsCT Scans
![Page 6: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/6.jpg)
6
ApplicationsSpatial Superresolution
![Page 7: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/7.jpg)
7
ApplicationsTemporal Superresolution
![Page 8: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/8.jpg)
8
ApplicationsTemporal Superresolution
![Page 9: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/9.jpg)
9
Our Point-Of-View
The field of sampling was traditionally associated with methods implemented either in the frequency domain, or in the time domainSampling can be viewed in a broader sense of projection onto any subspace or union of subspacesCan choose the subspaces to yield interesting new possibilities (below Nyquist sampling of sparse signals, pointwise samples of non bandlimited signals, perfect compensation of nonlinear effects …)
![Page 10: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/10.jpg)
10
Cauchy (1841):
Whittaker (1915) - Shannon (1948):
A. J. Jerri, “The Shannon sampling theorem - its various extensions and applications: A tutorial review”, Proc. IEEE, pp. 1565-1595, Nov. 1977.
Bandlimited Sampling Theorems
![Page 11: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/11.jpg)
11
Limitations of Shannon’s Theorem
Input Input bandlimitbandlimit
eded
Impractical Impractical reconstruction reconstruction
(sinc)(sinc)
Ideal Ideal samplisampli
ngng
Towards more robust DSPs:General inputsNonideal sampling: general pre-filters, nonlinear distortionsSimple interpolation kernels
![Page 12: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/12.jpg)
12
Generalized anti-aliasing filter
Sampling ProcessLinear Distortion
Sampling
functionsElectrical Electrical
circuitcircuitLocal Local
averagingaveraging
![Page 13: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/13.jpg)
13
Replace Fourier analysis by functional analysis, Hilbert space algebra, and convex optimization
Original + Initial guess
Reconstructed signal
Sampling ProcessNonlinear Distortion
Nonlinear distortion
Linear distortion
![Page 14: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/14.jpg)
14
Employ estimation techniques
Sampling ProcessNoise
![Page 15: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/15.jpg)
15
Signal Priors
x(t) bandlimitedx(t) piece-wise linear
Different priors lead to different reconstructions
![Page 16: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/16.jpg)
16
Shift invariant subspace:
General subspace in a Hilbert space
Signal PriorsSubspace Priors
Common in communication: pulse amplitude modulation (PAM)
Bandlimited Spline spaces
( )X f ( )x t( )x t
![Page 17: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/17.jpg)
17
Two key ideas in bandlimited sampling:Avoid aliasingFourier domain analysis
Beyond Bandlimited
Misleading concepts!
Suppose that with Signal is clearly not bandlimitedAliasing in frequency and timePerfect reconstruction possible from samples
Aliasing is not the issue
…
![Page 18: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/18.jpg)
18
Signal PriorsSmoothness Priors
![Page 19: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/19.jpg)
19
Signal PriorsStochastic Priors
Original Image Bicubic Interpolation Matern Interpolation
![Page 20: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/20.jpg)
20
Signal PriorsSparsity Priors
Wavelet transform of images is commonly sparseSTFT transform of speech signals is commonly sparseFourier transform of radio signals is commonly sparse
![Page 21: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/21.jpg)
21
Reconstruction ConstraintsUnconstrained Schemes
Sampling Reconstruction
![Page 22: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/22.jpg)
22
Reconstruction ConstraintsPredefined Kernel
Sampling Reconstruction
PredefinPredefineded
Minimax methodsConsistency requirement
![Page 23: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/23.jpg)
23
Reconstruction ConstraintsDense Grid Interpolation
PredefinedPredefined
(e.g. linear (e.g. linear interpolation)interpolation)
To improve performance: Increase reconstruction rate
![Page 24: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/24.jpg)
24
Reconstruction ConstraintsDense Grid Interpolation
Bicubic Interpolation Second Order Approximation to
Matern Interpolation with K=2
Optimal Dense Grid Matern Interpolation
with K=2
![Page 25: Modern Sampling Methods 049033](https://reader036.vdocuments.mx/reader036/viewer/2022081506/5681334f550346895d9a5860/html5/thumbnails/25.jpg)
25
Course Outline(Subject to change without further notice)
Motivating introduction after which you will all want to take this course (1 lesson)Crash course on linear algebra (basically no prior knowledge is assumed but strong interest in algebra is highly recommended) (~3 lessons)Subspace sampling (sampling of nonbandlimited signals, interpolation methods) (~2 lessons)Nonlinear sampling (~1 lesson)Minimax recovery techniques (~1 lesson)Constrained reconstruction: minimax and consistent methods (~2 lessons)Sampling sparse signals (1 lesson)Sampling random signals (1 lesson)