speech sound processing in the brain mike kilgard university of texas at dallas
TRANSCRIPT
![Page 1: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/1.jpg)
Speech Sound Processing in the Brain
Mike KilgardUniversity of Texas at Dallas
![Page 2: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/2.jpg)
Hearing and Language
![Page 3: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/3.jpg)
Hearing is in the BRAIN.
![Page 4: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/4.jpg)
?? ? ?
What was that sound?
![Page 5: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/5.jpg)
![Page 6: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/6.jpg)
OR
?? ? ?
![Page 7: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/7.jpg)
0 0.1 0.2 0.3 0.4 0.5 Seconds
2018
1614
12108642 kHz
High
Low
0 0.1 0.2 0.3 0.4 0.5 Seconds
2018
1614
12108642 kHz
High
Low
![Page 8: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/8.jpg)
Spectrogram - Example Sounds
8000 Hz
7000
6000
5000
4000
3000
2000
1000
0
Frequency
0 .5 1.0 1.5 2.0 2.5 Seconds
![Page 9: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/9.jpg)
Example Speech Sound - “Bad”8000 Hz
7000
6000
5000
4000
3000
2000
1000
0
Frequency
0 .1 .2 .3 .4 .5 Seconds
![Page 10: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/10.jpg)
“Pad” vs. “Bad”8000 Hz
7000
6000
5000
4000
3000
2000
1000
0
Frequency
Time0 .1 .2 .3 .4 .5 Seconds
![Page 11: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/11.jpg)
Cash Gash Sash Rash Lash
![Page 12: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/12.jpg)
I wen t to the bea ch and played in the waves
![Page 13: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/13.jpg)
Your brain while hearing words.
![Page 14: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/14.jpg)
Kraus and colleagues, Science 1996
Brain Responses Da vs. Ga
Normal Learning Impaired
![Page 15: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/15.jpg)
Processing Speech in Noise
![Page 16: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/16.jpg)
Brain Responses to Speech in Noise
![Page 17: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/17.jpg)
How early are differences in brain responses apparent?
![Page 18: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/18.jpg)
Infant brain responses may predict reading 8 years later.
Molfese, Brain &Language, 2000
![Page 19: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/19.jpg)
Can anything be done to improve sound processing?
![Page 20: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/20.jpg)
20±10 vs. 75±20 μV 81±19 vs. 37±20 μV
0 50 100 150 200 250
Week 1
Am
plit
ud
e (
mV
)
Time (ms)0 50 100 150 200 250
Week 2
Time (ms)0 50 100 150 200 250
Week 5
Time (ms)
0 50 100 150 200 250
Week 12
Time (ms)
.10
.05
0
-.05
-.10
Red Group Enriched Blue Enriched
Environmental Enrichment
22 rats total
![Page 21: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/21.jpg)
EnrichedStandard
EnvironmentPhysically
Alters the Brain!
![Page 22: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/22.jpg)
TrainingImproves the Brain
![Page 23: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/23.jpg)
BeforeTraining
After Training
![Page 24: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/24.jpg)
How exactly does the brain process speech sounds?
![Page 25: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/25.jpg)
“Pad” vs. “Bad”8000 Hz
7000
6000
5000
4000
3000
2000
1000
0
Frequency
Time0 .1 .2 .3 .4 .5 Seconds
![Page 26: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/26.jpg)
![Page 27: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/27.jpg)
Microelectrode
![Page 28: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/28.jpg)
![Page 29: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/29.jpg)
![Page 30: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/30.jpg)
0 100 200 300 400 0 100 200 300 400
Sad Dad
High
Medium
Low
Time (milliseconds)
vs. is Easy.
![Page 31: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/31.jpg)
0 100 200 300 400 0 100 200 300 400
Rad Lad
High
Medium
Low
Time (milliseconds)
vs. is Hard.
![Page 32: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/32.jpg)
0 100 200 300 400 0 100 200 300 400
Dad?
0 100 200 300 400 0 100 200 300 400
Sad?or
But rats can’t hear speech.(or can they?)
![Page 33: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/33.jpg)
Rat can distinguish most consonants!!!
![Page 34: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/34.jpg)
Although rats will never learn to talk or read, this new model is providing new insights intothe early stages of speech processing and
how they might be improved.
![Page 35: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/35.jpg)
Conclusions:
1. Hearing happens in the brain.
2. Fractions of a second matter.
3. The brain doesn’t always do a good job.
5. Our new understanding of neural speech processing may aid development of new therapies.
4. The brain can change.
?? ??
![Page 36: Speech Sound Processing in the Brain Mike Kilgard University of Texas at Dallas](https://reader035.vdocuments.mx/reader035/viewer/2022070409/56649e8f5503460f94b92d02/html5/thumbnails/36.jpg)
Acknowledgements: www.utd.edu/~kilgard
Crystal Engineer Claudia Perez Helen Chen