csd 5400 rehabilitation procedures for the hard of hearing

53
CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING Auditory Perception of Speech and the Consequences of Hearing Loss

Upload: lavina

Post on 23-Jan-2016

28 views

Category:

Documents


0 download

DESCRIPTION

CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING. Auditory Perception of Speech and the Consequences of Hearing Loss. Overview. The aural rehabilitation goal is to remediate the effects of a hearing impairment - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

CSD 5400REHABILITATION

PROCEDURES FOR THE HARD OF HEARING

Auditory Perception of Speech and the Consequences of

Hearing Loss

Page 2: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Overview

The aural rehabilitation goal is to remediate the effects of a hearing impairmentUltimately comes down to

the effect of the hearing loss on speech recognition and perception

Develop a general understanding of what a hearing loss does to the speech signal

Page 3: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

The Auditory System in Review

The primary purpose of the auditory system is to take the speech code at the periphery and convert it to a representation used by the CNS to extract meaning

Page 4: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

The Auditory System in Review

Speech arrives to the auditory periphery as a series of pressure variations as a function of time

The normal auditory periphery converts these pressure variations into physical movement of the middle ear structures, which in turn causes fluid movement in the cochlea

Page 5: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

The Auditory System in Review

Cochlear fluid movement gives rise to the traveling wave along the basilar membraneSpectral code

Depending on the site of maximum amplitude of displacement of the traveling wave, certain auditory nerves will be activatedNeural activityCritical band theorySpectral and temporal code

Page 6: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

The Auditory System in Review

As the signal moves higher into the central pathways, more complicated processing occursBinaural processingTemporal processing

By the time the signal reaches the cortex, it has been analyzed and re-coded in a number of different ways

The cortex recognizes these various forms of analysis and extracts what is necessary, given the job at hand

Page 7: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

When the Auditory System is Impaired

Speech is inaccurately coded at the peripheryDistortedMissingAttenuated

Loss of redundancyWhen the signal reaches

the cortex, the coded representation may be unrecognizable

Page 8: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Who’s Making Use of the Signal?

Important considerationAdults

Rely very heavily on the linguistic, contextual, and nonverbal cues available

ChildrenNo extensive language

base

Page 9: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Acoustic Cues of Speech

1. Frequency2. Intensity 3. Temporal

Characteristics

Page 10: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Flexer’s Analogy

Page 11: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Illustrating Hearing Loss

Tape examples

Page 12: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Acoustic Cues of Speech

Short Term Characteristics Long Term Characteristics

Page 13: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Long Term Characteristics of Speech

Average changes over relatively long periods of time

Provides general acoustic characteristics of speech

Page 14: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Long Term Characteristics of Speech

Mean intensity level of conversational speech is 65-70 dB SPL

Individual speech segments fluctuate around this mean by 40 dB

Page 15: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Long Term Speech Spectrum

Long-interval acoustic spectrum of male voices taken 17 inches from speaker’s lips

Maximum energy is at approximately 500 Hz Roll-off rate of 9 dB/octave

Page 16: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Phonemes

Smallest unit of speech to have linguistic meaning

Traditional unit of speech to study short term acoustic characteristics

Page 17: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Phonemes

Classification systemVowelsConsonants

Page 18: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Differences Between Vowels and Consonants

These two classes of sounds differ in the manner they are produced and in the way we perceive them Vowels are considered more “prime”

RhymingSpeech Errors

Vocal tract configuration Voicing

Page 19: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Short Term Acoustic Characteristics of Vowels

1. Vowels are always voiced

2. The vocal tract is relatively open

3. Source-Filter Theory of vowel production

Page 20: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Sound Source of Vowels

The glottal pulseThe lowest component is the

fundamental frequency (f0)

Harmonics are labeled Hx.

Maximum energy is at the fundamental frequency of the speaker

Above the fundamental frequency, the spectrum rolls off 10-12 dB/octave

Page 21: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Filter of Vowels

The vocal tract, which can be thought of as a tube open at one end, closed at the other, and of a specified length

Page 22: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Putting the Source and Filter Together

Page 23: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Putting the Source and Filter Together

n The panel at the left shows the glottal source. The panel at the right shows the spectrum of the source after filtering by a filter representing a neutral vocal tract. The spectral characteristics of the filter is indicated in the middle panel

Page 24: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Changing the Effects of the Filter

In order to produce these three different vowels, we change the characteristics of the vocal tract. This will alter the resonant frequency characteristics of the tube and change the combined spectrum of the glottal pulse and the vocal tract

Page 25: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Changing the Effects of the Source

n This is what happens when the same vowel is produced by a man, a woman and a child

Page 26: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

An Important Short Term Acoustic Characteristic of

Vowels

Formants are the regions of increased spectral energy

They are only a characteristic of vowels The frequency regions they occupy, as well

as their relative intensities change as the vocal tract changes with each vowel production

All English vowels have 5-7 formants Vowels can be distinguished from one

another using the lowest (frequency) 2-3

Page 27: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Vocal Tract Shapes and Spectra

Vocal tract shapes and corresponding spectra (F1 and F2 only) for four back vowels

Page 28: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Vocal Tract Shapes and Spectra

n Vocal tract shapes and corresponding spectra (F1 and F2 only) for four front vowels

Page 29: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Peterson & Barney (1954)

Landmark spectrographic study of 76 men, women, and children producing vowels in isolation

Measured and reported the average fundamental frequency and the frequency/intensity of the first three formants of the ten English vowels

Page 30: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

A Summary of Peterson & Barney’s Results

Page 31: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Articulation and the Formant Frequencies

F1 corresponds to the degree of tongue constriction in the vocal tract

F2 corresponds to how forward in the mouth the tongue is

F3 is not related in a simple way to articulatory parameters

Page 32: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Vowel Normalization

Vowel quadrilaterals for men, women, and children

What’s thought to be important for vowel perception is the relative spacing between F1 and F2; not their absolute frequencies

Page 33: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Consequences of Hearing Loss on Vowel Perception

Vowel perception is impaired when a hearing loss erodes the acoustic information in the F2 range

Generally 1000 Hz and aboveVowels are generally robust to the effects

of hearing loss

Page 34: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Short Term Acoustic Characteristics of Consonants

Differences Between Vowels and Consonants Consonants:

Have a shorter duration Can’t be isolated Don’t have just one noise source Aren’t static Identification seems to rely primarily on the vowel that

precedes or follows Have a variety of methods of production and places in the

vocal tract where they are produced

Page 35: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Spectral Regions of Various Speech Sounds

A common spectral representation of major speech sounds

Related to the threshold of audibility curve

Page 36: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Spectral Regions of Various Speech Sounds

Another exampleLines A, B, and C

represent three different configurations and degrees of hearing loss

What predictions can you make?

Page 37: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Spectral Regions of Various Speech Sounds

Intensity and frequency distribution of speech sounds overlaid on an audiogram

Predictions based on characteristics of the hearing loss

Page 38: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Predicting the Degree and Type of Phoneme Errors

These type of charts are used often to help predict the effect of a particular degree and configuration a hearing loss might have on speech understanding

This works somewhat, but it only looks at the influence of a hearing loss in terms of a filter

Sensorineural hearing loss is more complicated than thisAttenuation and distortion

Page 39: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Hearing Loss as a Loss of Redundancy

Illustrates the reduction of pattern details (redundancy)

Page 40: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

The Consonant Classification System

n Every American English consonant can be identified uniquely according to its

1. Manner of articulation2. Place of articulation3. Voicing

Page 41: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Consonant Feature Classification System

n Classification of the consonants of American English according to the articulatory feature system

Page 42: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Acoustic Properties of Articulatory Features

Voicing:Energy is broadband

and extends from 100-4000 Hz

Page 43: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Acoustic Properties of Articulatory Features

n Place of Articulationn Energy is very high

frequency and confined to 1000-8000 Hz

Page 44: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Acoustic Properties of Articulatory Features

Manner of Articulation

Energy is spread through the mid frequencies (250-3500 Hz)

Page 45: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Consonants and Vowels Together

Schematic oral tract movements, etc for phrases a buy, a pie in the top spectrograms and a dye and a tie in the lower spectrograms

Page 46: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Formant Transitions

n Schematic of a transition and steady-state portion of a formant frequency

Page 47: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

F2 Formant Transitions

The second formant transition provides a lot of information about the consonant

Place of articulation is related to the direction of the transition

Manner of articulation is related to the rate of the transition

Page 48: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Error Patterns with SNHL

Place of articulation and manner of articulation error rates for 38 SNHI listenersPlace of articulation

errors are more prevalent, followed by manner of articulation errors

Page 49: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Feature Recognition as a Function of Degree of HL

Auditory identification of temporal patterns of vowels and consonant features by 121 HI children as a function of PTANotice how place of artic

feature recognition is adversely affected by HL

Voicing and vowel id are better preserved

Page 50: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

Summary of Findings…

General findings of studies of phoneme perception for SNHL when using meaningful CVC stimuliRelatively few errors are made with the vowel

When they do occur, they occur more often for front vowels

Higher F2 frequency

More errors are made with consonantsFinal position is extremely vulnerable

Most common error type is place of articulation, followed by manner of articulation

Voicing errors are rare

Page 51: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

In Closing..

It appears that phoneme error types seem to relate somewhat to the frequency region and degree of hearing lossIf the hearing loss is primarily confined to the

high frequencies, then we tend to see more errors with articulatory features that are more high frequency weighted (e.g. place)

Our predictive ability stops here

Page 52: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING

In Closing..

In fact, we see tremendous variability among hard of hearing listeners in terms of their ability to perceive and understand speechThe amount and way information is coded varies

from listenerVarying degrees of distortion not related to the

characteristics of the audiogram

If information is restricted at the phonetic or spectral level, it is also probably restricted at the linguistic level

How well individuals are able to integrate information varies

Page 53: CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING