digital signal processing - lsv - universität des saarlandes · · 2015-04-27digital signal...
TRANSCRIPT
![Page 1: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/1.jpg)
Digital Signal Processing
Prof. Dietrich KlakowRahil Mahdian
![Page 2: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/2.jpg)
2
Language
• Teaching: English
• Questions: English (or German)
• Slides: English
• Tutorials: one English and one German group
• Exercise sheets: most likely English
• Your solutions: English or German
• Exam sheet: both languages
• Your answers: English or German
![Page 3: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/3.jpg)
3
Course-Homepage
See:
• www. lsv. uni-saarland. De
Contains:
- Slides
- Exercises
- Literature
![Page 4: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/4.jpg)
4
Register before Tuesday noon, please!
![Page 5: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/5.jpg)
5
Use your university e-mail!
Register byTuesday12:00!
![Page 6: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/6.jpg)
6
Lecture
• Lecture:
• Monday 10:15-11:45 (12)
• Location: -1.03 in building 13
• Contact:• Rahil Mahdian:
• tel. 58129
Termin OK?
![Page 7: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/7.jpg)
7
Exercises
• Exercises:
• Time: by arrangement (doodle)
• Location: will be announced on mailing list
• Tutors:• Ali Kanso
• Merlin Köhler
![Page 8: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/8.jpg)
8
Exercises/Practicals
• Details will follow
• Two groups
• Time and date: by doodle
• Programming language:
– Matlab (recommended!)
– or Coordinate with us before you proceed.
![Page 9: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/9.jpg)
9
Mailing List
• We will set a mailing list• All students + ME, AK, and DK will be on it
• Purpose:• Raise questions to everybody
• Discuss questions
• Announcements (!!! e.g. exam dates !!!)
• … everything else …
• For changes contact: (I will tell you later)• [email protected]
![Page 10: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/10.jpg)
10
Exam
• Written exam• 120 Minutes• Date: doodle
• Note: CuK master students can only take it as a corecourse if it was not mandatory in their bachelorsprogram
![Page 11: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/11.jpg)
11
Prerequisites
• Some math
• Programming
• E.g. matlab ,C++, java, maple, ...
![Page 12: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/12.jpg)
12
Rules of the Game
• In case you don't understand something:
1. Ask!!!
2. Ask!!!
3. Ask!!!
![Page 13: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/13.jpg)
1. Introduction
![Page 14: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/14.jpg)
14
Outline of the Lecture
1. Introduction: (3 lectures)i. DSP basics, Sampling, Convolution, Windowing, etc.
ii. Filtering (e.g., FIR, IIR, etc)
2. Signal representations, analysis, and modeling: (3/4 lectures)i. Transforms: DFS, DTFT, DFT, FFT
ii. Multi-resolution Analysis: T-F (Gabor), FilterBank, Wavelet
iii. Sparse Representations: DCT, Wavelet
iv. Signal modeling: LP, AR, ARMA, etc
3. Microphone Arrays (e.g., multi-sensor processing) – 1 lecture
4. [Filtering and Smoothing] : (1-lecture)
5. Feature Extraction (Speech, Image) – (1 lecture)
6. PCA (KLT), LDA, ICA/IVA (MIMO), etc – (2 lectures)
7. Statistical (& Adaptive) Signal Processing: (2/3 lectures)i. Wiener filter
ii. Spectral Subtraction
iii. LMS, RLS, Kalman filter
![Page 15: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/15.jpg)
15
DSP – The main goal
A generic term for some techniques: e.g.,a. Filteringb. Spectrum analysisc. Compressiond. Separatione. etc
applied to digitally sampled signals.
![Page 16: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/16.jpg)
16
Signal- Analog and Digital
![Page 17: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/17.jpg)
17
Image Signal
Taken from prof.sKatsaggelos, NWU
![Page 18: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/18.jpg)
18
Image Signal- resolution
Taken from prof.sKatsaggelos, NWU
![Page 19: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/19.jpg)
19
Signal- Quantization
Taken from prof.sKatsaggelos, NWU
![Page 20: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/20.jpg)
20
Multi-Spectral Imaging
Taken from prof.sKatsaggelos, NWU
![Page 21: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/21.jpg)
21
Multi-Spectral Imaging
Taken from prof.sKatsaggelos, NWU
![Page 22: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/22.jpg)
22
Feature Extraction from Images
Main features:•Color•Texture•Edges
![Page 23: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/23.jpg)
23
Speech Signal - representations
![Page 24: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/24.jpg)
24
Feature Extraction from Speech
Standard featureextraction fromspeech:Mel-Frequency-CepstralCoefficients
![Page 25: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/25.jpg)
25
Intersection of DSP and scientific areas
![Page 26: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/26.jpg)
26
Beamforming Blind Source Separation
Multi-sensor signal processing
![Page 27: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/27.jpg)
27
Microphone Arrays
+
d τ=dc
sinθ
Use time delay toenhance signalfrom a certaindirection.
![Page 28: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/28.jpg)
28
Spatial Filtering - Beamforming
![Page 29: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/29.jpg)
29
Test Data xi
Basic Principle of Pattern Recognition
Feature Extraction
Classifier Model
1 ….
Feature Extraction
Training Data
Training Algorithm
2 n
![Page 30: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/30.jpg)
30
Musical Genre Classification
?
Classical
Country
Rock
![Page 31: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/31.jpg)
31
or Speaker Recognition
Speaker verification:is this Mary?
Speaker identification:who is speaking?
![Page 32: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/32.jpg)
32
or Classification
• A simple introduction
• Nearest Neighbor Classifier
![Page 33: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/33.jpg)
33
KL-Transform andLinear Discriminant Analysis
Find the optimalsubspace forfeature vectors
![Page 34: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/34.jpg)
34
Linear Predictive Coding
Basic algorithm forspeech coding
![Page 35: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/35.jpg)
35
Linear Filters
With “salt-and-pepper”noise
Gaussian3x3-kernel
blurring of the image use other filters (e.g. median filter)
![Page 36: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/36.jpg)
36
Spectral Subtraction and Wiener Filter
From: http://www.tu-harburg.de/ft2/AktuForschungen/Bildverarbeitung/Bildverarbeitung.htm
Suppress noise
![Page 37: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/37.jpg)
37
Literature
Applied Pattern Recognitionvon Dietrich W. R. Paulus, Joachim HorneggerViewegISBN: 3528355581Ca. 40 Euro
•Speech and image analysis•Software oriented•Signal processing•…
![Page 38: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/38.jpg)
38
Literature
Digitale Sprachsignalverarbeitungby Peter Vary, Ulrich Heute, Wolfgang HessTeubner VerlagISBN: 3519061651Ca. 45 Euro
•Spectral subtraction•Wiener Filter•Microphone arrays•…
![Page 39: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/39.jpg)
39
Literature
Spoken Language Processingby Xuedong Huang, Alex Acero, Hsiao-Wuen Hon,Xuedong Huang, Hsiao-Wuen HonPrentice HallISBN: 0130226165
• very comprehensive
![Page 40: Digital Signal Processing - LSV - Universität des Saarlandes · · 2015-04-27Digital Signal Processing Prof. Dietrich Klakow Rahil Mahdian. 2 Language ... AK, and DK will be on](https://reader031.vdocuments.mx/reader031/viewer/2022022517/5b06a3037f8b9ac33f8d17a9/html5/thumbnails/40.jpg)
40
Questionnaire
• Take a sheet of paper
• Please give me you opinion of thosequestions:• All topic covered that you expect?
• Is there a topic we could skip?
• What do you expect in terms of teaching style
• What should not happen in the lecture
Take yourself 5 minutes time