auditory cortex 4 sept 21, 2015 – day 12 brain & language ling 4110-4890-5110-7960 nsci...

27
AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

Upload: john-marsh

Post on 19-Jan-2016

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

AUDITORY CORTEX 4SEPT 21, 2015 – DAY 12

Brain & Language

LING 4110-4890-5110-7960

NSCI 4110-4891-6110

Fall 2015

Page 2: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

2

Course organization• http://www.tulane.edu/~howard/BrLg/• Fun with https://www.facebook.com/BrLg15/• I am still working on grading.

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 3: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

3

AUDITORY CORTEX 3The quiz was the review

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 4: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

Brain & Language - Harry Howard - Tulane University 4

Summary

LH

• stops & liquids/glides/fricatives

• lexical stress• CONvert ~ conVERT• tone languages

• phrasal stress• noun compounding• stress retraction

• clausal stress• contrastive stress

RH

• vowels (?)• emotional prosody• sentence type

• declarative, interrogative, imperative

9/21/15

Page 5: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

Brain & Language - Harry Howard - Tulane University 59/21/15

Size of temporal integration windows

• Primary auditory cortex builds high-fidelity representations of the signal and surrounding non-primary areas differentially ‘elaborate’ this signal by analyzing it on different time scales (Poeppel et al., 2008)• LH (non-primary) temporal cortex houses neuronal ensembles

with somewhat shorter integration constants (say, 20-50 ms) and therefore LH cortical fields preferentially reflect [fast] temporal properties of acoustic signals

• RH (non-primary) temporal cortex houses neuronal ensembles a large proportion of which have longer (150-300 ms) integration windows, and therefore are better suited to analyze [slower] spectral change

Page 6: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

6

AUDITORY CORTEX 4

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 7: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

7

FREQUENCY IN THE VISUAL DOMAINSpatial frequency

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 8: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

Brain & Language - Harry Howard - Tulane University 89/21/15

High- vs. low-frequency spatial information

What is this?

Page 9: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

Brain & Language - Harry Howard - Tulane University 99/21/15

Salvador Dali “Gala Contemplating the Mediterranean Sea, which at 30 meters becomes the portrait of Abraham Lincoln (Homage to Rothko)”, 1976

Page 10: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

Brain & Language - Harry Howard - Tulane University

109/21/15

"Lincoln illusion” Harmon & Jules (1973)

• Blurring acts as a low-pass filter, reducing the high masking frequencies

• http://www.michaelbach.de/ot/fcs_mosaic/index.html

Page 11: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

Brain & Language - Harry Howard - Tulane University 11

Spatial frequencyHigh spatial frequency

(two cycles per degree)

Low spatial frequency

(one cycle per degree)

9/21/15

Page 12: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

Brain & Language - Harry Howard - Tulane University 129/21/15

Spatial frequency:LHD ~ stimulus ~ RHD

Page 13: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

Brain & Language - Harry Howard - Tulane University 139/21/15

Lateralization of frequency• RH allows the low frequencies of a stimulus to pass through, ignoring the higher ones (low-pass filter).

• LH allows the high frequencies of a stimulus to pass through, ignoring the lower ones (a high-pass filter).

• Duration becomes a measure of frequency in the temporal domain:• a brief signal has a high temporal frequency; • a prolonged signal has a low temporal frequency,• and at least two other domains are recognized, the

spectral and the spatial (but we ignore spatial frequency for now).

Page 14: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

14

FINE VS. COARSE CODING

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 15: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

Brain & Language - Harry Howard - Tulane University 15

Categorical vs. graded or coordinate spatial relations

Is the black dot

above or below the bar?

Is the black dot

near or far from the bar?

9/21/15

Categorical > LH Graded > RH

Page 16: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

16

Fine vs. coarse coding

9/21/15 Brain & Language - Harry Howard - Tulane University

Fine coding:small receptive fieldwith no overlap

Coarse coding:large receptive field

with overlap

Page 17: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

17

A conversion to resolutionLeft hemisphere, fine coding:

9 neurons index 9 regions of space

Right hemisphere, coarse coding:

4 neurons index 12+ regions of space

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 18: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

18

Summary of lateralization of phonologyLH

fine grained, small window of temporal integration

• high temporal frequency:• rapid cues, like stops

• high spectral frequency: • formants

• categorical distinctions: • lexical, phrasal, clausal

stress;• lexical tone in Thai/Chinese

RHcoarse grained,

large window of temporal integration

• low temporal frequency: • slow cues, like vowels

• low spectral frequency: • fundamental

• graded/coordinate distinctions:• emotional intonation,• sentence type?

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 19: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

19

CATEGORICAL PERCEPTIONof voice-onset time

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 20: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

20

'BP' for [bi] vs. [pʰi]

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 21: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

21

Voice-onset time (VOT)

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 22: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

22

Is VOT perceived as a continuum?

9/21/15 Brain & Language - Harry Howard - Tulane University

What is this?(ignore the fact that it is crooked)

Page 23: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

23

If VOT is gradually lengthened from 0

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 24: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

24

Altmanna (2014) Categorical speech perception during active discrimination of consonants and vowels

9/21/15 Brain & Language - Harry Howard - Tulane University

This bar graph depicts the mean (n=15) response amplitudes from 430 to 500 ms after S2 onset within the left temporal cortex cluster as a region-of-interest.

Page 25: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

25

By the way …

9/21/15 Brain & Language - Harry Howard - Tulane University

Chinchillas do this too!

Page 26: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

26

Conclusion• Categorical perception

9/21/15 Brain & Language - Harry Howard - Tulane University

Page 27: AUDITORY CORTEX 4 SEPT 21, 2015 – DAY 12 Brain & Language LING 4110-4890-5110-7960 NSCI 4110-4891-6110 Fall 2015

NEXT TIMEDo we have class on Wednesday?

Mid-posterior STS, Wernicke’s area

9/21/15 Brain & Language - Harry Howard - Tulane University 27