listening effort scaling and preference rating for...
TRANSCRIPT
![Page 1: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/1.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Listening Effort Scaling and
Preference Rating for Hearing
Aid Evaluation
Michael Schulte, Matthias Vormann, Kirsten Wagener,
Michael Büchler, Norbert Dillier, Wouter Dreschler, Koen Eneman,
Matthias Froehlich, Giso Grimm, Niklas Harlander, Volker Hohmann,
Rolph Houben, Sofie Jansen, Arne Leijon, Anthony Lombard, Heleen
Luts, Dirk Mauler, Marc Moonen, Henning Puder, Ann Spriet, Jan
Wouters
![Page 2: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/2.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Motivation / Outline
- Goal was to evaluate 5 different algorithms in
background noise
- With normal hearing subjects as well as with hearing
impaired subjects
- Speech recognition and hearing comfort
- Different perceptual qualities should be evaluated
� Intelligibility
� Listening effort
� Preference
![Page 3: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/3.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Speech Intelligibility
• Measured by means of sentence tests
– German: 5 words with fixed structure
Oldenburg Sentence Test (OLSA)
– Dutch: everyday sentences (VU)
• Adaptive procedure, i.e. SNR was adapted to reach 50% intelligibility
![Page 4: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/4.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Listening Effort Scaling / WP7 T4
Speech Intelligibility
in % correctListening Effort
100 %
0 %
Max
Min
Signal to Noise Ratio [dB SNR]
![Page 5: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/5.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Listening Effort Scaling / WP7 T4
- 11 differents
SNRs
- two different
background noises
- 60 point scaling
- 7 categories
![Page 6: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/6.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Listening Effort Scaling / WP7 T4
- 10 subjects
- Normal hearing
- speech reception
(OLSA)
- LES with OLSA
sentences
![Page 7: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/7.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Listening Effort Scaling / WP7 T4
different effort for
the same
intelligibility
![Page 8: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/8.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Listening Effort Scaling / WP7 T4
• Speech Intelligibility and Listening Effort seem to be DIFFERENTfactors. This might also explain why e.g. Marzinzik & Kollmeier (1999) found no effect on intelligibility when using noise reduction algorithms but on Listening Effort.
• This is the case for normal hearing as well as hearing impaired persons.
• Different situations lead to different listening effort. It is not clear what causes the difference (spectra, modulation etc.). However, it seems that “naturalness” might be important (if you are used to the background noise).
![Page 9: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/9.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Listening Effort Scaling
15 dB SNR
9 dB SNR
3 dB SNR
0 dB SNR
13 point scaling
7 subcategories,
and always one
empty button in
between
![Page 10: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/10.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Listening Effort Scaling
• Each algorithm and unprocessed were tested
• Setup: Living room, babble noise at 65 dB(A),
S0N90/180/270
• Scaling at –10, -5, 0, +5 and +10 dB SNR
� 6 algorithms x 5 SNRs x test/retest = 60 ratings
![Page 11: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/11.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Preference Rating
![Page 12: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/12.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Preference Rating
• Each algorithm tested against unprocessed
• Setup: Living room, babble noise at 65 dB(A),
S0N90/180/270
• Rating at 0, +5 and +10 dB SNR
� 5 algorithms x 3 SNRs x test/retest = 30 ratings
![Page 13: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/13.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Preference Rating
The Linear Gaussian Model
• The LGM places the 6 algorithms on an interval scale
• Result of model is position of each algorithm on an interval scale
• Distance between algorithms is well defined and therefore useful for interpreting the data
Dahlquist/Leijon (2003)
![Page 14: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/14.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Speech Recognition
Office room - 90/180/270° babble noise
-8
-6
-4
-2
0
2
4
6
8
10
12
SC1 SC2 BSS MWF COH
SR
T im
pro
vem
en
t (d
B)
CH-UHZ
DE-HZO
BE-LEU
NL-AMC
Average
*
*
Office room – 90/180/270°babble noise
![Page 15: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/15.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Listening Effort Scaling
Office room, 0 dBSNR
-3
-2
-1
0
1
2
3
SC1 SC2 BSS MWF COH
Me
dia
n L
ES
dif
fere
nc
e
CH-UHZ
DE-HZO
BE-LEU
NL-AMC
Overall
**
*
*
**
*
*
*
*
*
**
Office room – 90/180/270°, babble noise, 0 dB SNR
* * * * *
![Page 16: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/16.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Listening Effort ScalingMean over all subjects (N=112)
Living Room, 90°/180°/270°
0
1
2
3
4
5
6
-10 dB SNR -5 dB SNR 0 dB SNR 5 dB SNR 10 dB SNR
unprocessed
SC1
SC2
BSS
MWF
COH
extreme
effort
no effort
much effort
considerable
effort
moderate
effort
little effort
very little
effort
![Page 17: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/17.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Listening Effort ScalingMean over all subjects (N=113)
Living Room, 90°/180°/270°
-2,0
-1,5
-1,0
-0,5
0,0
0,5
1,0
1,5
2,0
-10 dB SNR -5 B SNR 0 dB SNR 5 dB SNR 10 dB SNR
SC1
SC2
BSS
MWF
COH
Algorithm
better than
unprocessed
unprocessed
better
equal
![Page 18: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/18.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Preference Rating
Ident SC1 SC2 BSS MWF COH
Office room – 90/180/270°babble noise
![Page 19: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/19.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Preference Rating
Ident SC1 SC2 BSS MWF COH
Office room – 90/180/270°babble noise
![Page 20: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/20.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Preference Rating
Ident SC1 SC2 BSS MWF COH
Office room – 90/180/270°babble noise
![Page 21: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/21.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Comparison
LES / PrefRating / Intelligibility
Test Retest
• Preference rating: No significant difference
(t-test, p>0.5)
• SRT: Significant difference (p<0.001), average
retest scores are 0.2 dB higher as test scores
• Listening effort: Significant difference (p<0.001),
average retest scores are 0.12 scales lower as
test scores
![Page 22: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/22.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Comparison
LES / PrefRating / Intelligibility
SNR: -10 dB 0 dB 10 dB 20 dB
Intelligibility: 0 % 50 % 100 %
Preference Rating:
Listening Effort: extrem middle very low
SNR range
![Page 23: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/23.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
Comparison
LES / PrefRating / Intelligibility Speech Reception:
- very precise
- established
- most important feature
- needs time
Listening Effort:
- broader SNR range than speech intelligibility
- important feature, that helps to estimate cognitive demands
Preference Rating:
- even broader SNR range
- relative comparison
- works for very small differences
- overall feature (includes e.g. intelligibility, effort, artifacts etc)
![Page 24: Listening Effort Scaling and Preference Rating for …hearcom.eu/.../S2B-3_Michael-Schulte_Hearing-Aid-Scaling-Rating.pdf · Listening Effort Scaling and Preference Rating for Hearing](https://reader033.vdocuments.mx/reader033/viewer/2022042605/5ab1685a7f8b9a7e1d8c5a6f/html5/thumbnails/24.jpg)
Workshop Hearing Screening and Technology, Brussels 28 January 2009
The End