harvard-mit division of health sciences and...
TRANSCRIPT
![Page 1: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/1.jpg)
Harvard-MIT Division of Health Sciences
and Technology
HST.725: Music Perception and Cognition
Prof. Peter Cariani
Prof. Andy Oxenham
Prof. Mark Tramo
The Auditory System: Where it happens (first)
www.cariani.com
![Page 2: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/2.jpg)
From cochlea to cortex
10,000k
500k
30k
3k
Primary auditory cortex
(Auditory forebrain)
Auditory thalamus
Inferior colliculus (Auditory midbrain)
Lateral lemniscus
Auditory brainstem
Auditory nerve (VIII)
Cochlea
![Page 3: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/3.jpg)
![Page 4: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/4.jpg)
The auditory system: where it happens (first) • A crash course in neuroscience
– Nervous systems -- general functions
• perception, steering and coordination of action
– Reverse-engineering: what do you need to know to understand how it works?
– Neurons -- cells specialized for signaling
– Neural coding: how neurons convey information
– Neural representations and computations
– General plan of nervous systems - periphery & central (CNS)
• The auditory pathway -- anatomy, response properties, functions – Cochlea
– Auditory nerve
– Brainstem
– Midbrain (a.k.a. inferior colliculus, IC)
– Thalamus (a.k.a. medial geniculate body, MGB)
– Auditory cortex
– Other cortical territories
![Page 5: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/5.jpg)
Basic auditory qualities
Dimensions of auditory perception
Pitch Location
LoudnessTimbre
TEMPORAL EVENT
STRUCTURE Meter, sequence
FUSION
Grouping into separate objects Temporal co-occurrence
harmonic structure John Lurie
Car Cleveland
Music from Stranger than Paradise
![Page 6: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/6.jpg)
The problem of reverse-engineering Given a vastly complicated device engineered by an advanced alien civilization (or wartime enemy) whose technology you don’t understand, figure out:
1. What the device is for (what’s its function)
2. How it works (what are the functional principles underlying its operation?) 3. How other devices can be built using the same functional principles.
How does the brain work?
What are the signals?
How are they processed?
![Page 7: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/7.jpg)
What is it for and how does it work?
What do you need to know to
understand how this device works?
Neural coding:
What is the nature of the
signals in the wires?
Purpose(s), function(s)
Parts-lists; What parts are essential?
Wiring diagrams: interconnections
Knowledge that helps:
How do the individual elements operate?
![Page 8: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/8.jpg)
Perception & action: receptors, interneurons &
effectors
The organism
THE BRAIN AS A NETWORK OF NEURONS
Environment
ReceptorsEffectorsCNS
![Page 9: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/9.jpg)
McCulloch’s
internal and
external loops
Continuous Line
Nervous, Somatic or Environmental
portion of path
Broken Line
Nervous portion of path
Drome
EffectorReceptor
Efferent peripheral
neuronExcitatory
Synapse
Afferent peripheral
neuron
C.N.S.
![Page 10: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/10.jpg)
Neurons
Please see information about Santiago Ramón y Cajal and his
neuroanatomical slides (http://www.psu.edu/nasa/cajal2.htm)
![Page 11: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/11.jpg)
Neurons as signaling elements
Dendrites Soma (cell body) Axon Synapses
![Page 12: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/12.jpg)
Neuron types
![Page 13: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/13.jpg)
Comparative neuroanatomy
![Page 14: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/14.jpg)
General plan of the vertebrate nervous system
![Page 15: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/15.jpg)
C Neural pulse codes Average discharge rate
Rate-channel codes
Interspike interval code
Multiplexed intervals
Temporal pattern Higher-order interval pattern codes
Burst length, interburst interval
Spike latency
reference times
Time- PST or latency pattern of-arrival
codes
Interneural synchrony
Codes are defined in terms
of their functional roles
What spike train messages
have the same meanings? (functional equivalence classes)
What constitutes
a difference
that makes a difference?
Temporal codes are neural
codes in which timings of
spikes relative to each other
are essential to their
interpretation.
![Page 16: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/16.jpg)
Temporal pattern codes
Interspike interval code
Temporal Multiple intervals in same spike train pattern codes
Higher-order interval pattern
.2
Phase-locking in auditoryl neurons Phase-locking in visual neurons
Cat auditory nerve fibers, 250 Hz tone (Horseshoe crab ommatidium, 5-15 Hz flashes)
Miller, Ratliff, and Hartline. "How Cells Receive Stimuli."
Scientific American 215, no.3 (1961): 222-238.
Adapted from:
.1
.08
Tone
Spikes
![Page 17: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/17.jpg)
Ascending
auditory
pathway
![Page 18: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/18.jpg)
![Page 19: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/19.jpg)
Ear
![Page 20: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/20.jpg)
Ear and cochlea
Tympanic Membrane
Stapes on Oval Window
Cochlear Base
Scala Vestibuli
Basilar Membrane
Re
lativ
eA
mp
litud
e
Scala Tympani“Unrolled” Cochlea
Cochlear Apex
Helicotrema
Narrow Base of
Basilar Membrane
is “tuned” for high
frequencies
Wider apex is
“tuned” for low
frequencies
Distance from Stapes (mm)
1600 Hz
800 Hz
400 Hz
200 Hz
100 Hz
50 Hz
25 Hz
0 10 20 30
Traveling waves along the cochlea. A
traveling wave is shown at a given instant
along the cochlea, which has been uncoiled
for clarity. The graphs profile the amplitude
of the traveling wave along the basilar
membrane for different frequencies, and
show that the position where the traveling
wave reaches its maximum amplitude varies
directly with the frequency of stimulation.
(Figures adapted from Dallos, 1992 and
von Bekesy, 1960)
![Page 21: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/21.jpg)
Ear & Cochlea
![Page 22: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/22.jpg)
Cochlear anatomy
Fluid-filled spiral structure Travelling wave Place principle
Transmission of vibrations to hair cells embedded in bone Basilar
(basement) membrane Tectorial
(roof) membrane
Mechanical filtering Active amplifiers
(OHCs) Transduction of vibrations
into electrical currents (ion flows)
Initiation of spikes in auditory nerve
fibers (cochlear nerve) Afferents and
efferents
(The permission is granted, as long as you acknowledge the site, quoting its address (www.the-cochlea.info), authors (Rémy Pujolet al.) and affiliations (University Montpellier 1 and INSERM*); plus name of author of picture/drawing.)
![Page 23: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/23.jpg)
Cochlea
"Promenade 'round the Cochlea" These slides, animations, and tutorials on sound & hearing http://www.iurc.montp.inserm.fr/cric/audition/english/ear/fear.htm
![Page 24: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/24.jpg)
Cochlea
M. Lavigne-Rebillard
Cochlea from a human fetus ( 5 months of gestation)
"Promenade 'round the Cochlea" These slides, animations, and tutorials on sound & hearing http://www.iurc.montp.inserm.fr/cric/audition/english/ear/fear.htm
(The permission is granted, as long as you acknowledge the site, quoting its address (www.the-cochlea.info), authors (Rémy Pujolet al.) and affiliations (University Montpellier 1 and INSERM*); plus name of author of picture/drawing.)
![Page 25: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/25.jpg)
Cochlear hair cells Inner hair cells IHCs
"Promenade 'round the Cochlea" These slides, animations, and tutorials on sound & hearing http://www.iurc.montp.inserm.fr/cric/audition/english/ear/fear.htm
Outer hair cells
OHCs
(The permission is granted, as long as you acknowledge the site, quoting its address (www.the-cochlea.info), authors (Rémy Pujolet al.) and affiliations (University Montpellier 1 and INSERM*); plus name of author of picture/drawing.)
![Page 26: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/26.jpg)
IHCs & ANFs
Type I ANFs
myelinated (fast)
innervate inner hair cells
afferents: convey info.
to the CNS
Type II ANFs
unmyelinated (slow)
innervate outer hair cells
efferents: convey info.
from CNS to cochlea
Humans ~30k Type I ANFs ~3k IHCs
(The permission is granted, as long as you acknowledge the site, quoting its address (www.the-cochlea.info), authors (Rémy Pujolet al.) and affiliations (University Montpellier 1 and INSERM*); plus name of author of picture/drawing.)
![Page 27: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/27.jpg)
Width at Apex 0.5 mm
Width at Base 0.04 mm
Average Width 0.21 mm Basal Turn
0.34 mm Middle Turn
0.36 mm Apical TurnLength 32 mm
Diagram of the human basilar membrane showing the approximate positions of maximal
displacement to tones of different frequencies and changes in width going from the base
(near the stapes and oval window) to the apex (near the helicotrema). The ratio of width
to length is exaggerated to show more clearly the variation in width.
Adapted from Stuhlman, 1943.
Diagram of the Human Basilar Membrane
200
400
2000
1500
5000
7000
20,000
1000
4000
800 3000
600
(The permission is granted, as long as you acknowledge the site, quoting its address (www.the-cochlea.info), authors (Rémy Pujolet al.) and affiliations (University Montpellier 1 and INSERM*); plus name of author of picture/drawing.)
![Page 28: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/28.jpg)
The auditory pathway (CNS)
Primary auditory cortex (forebrain)
Auditory thalamus
Inferior colliculus
(midbrain)
Auditory brainstem
![Page 29: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/29.jpg)
ANFs
![Page 30: Harvard-MIT Division of Health Sciences and …dspace.mit.edu/.../contents/lecture-notes/lecture4a.pdfHarvard-MIT Division of Health Sciences and Technology HST.725: Music Perception](https://reader034.vdocuments.mx/reader034/viewer/2022050520/5fa366d3c9ad561f8646bc77/html5/thumbnails/30.jpg)
Auditory nerve
10
1
Ch
ara
cte
ris
tic
fre
q.
(kH
z)
0 10 20 30 40 Peristimulus time (ms)
50