expressivity in sound and music roberto bresin, sofia dahl, anders friberg kth, stockholm – sob...
TRANSCRIPT
-
Expressivity inSound and MusicRoberto Bresin, Sofia Dahl, Anders FribergKTH, Stockholm SOb project partner
{roberto, sofia, andersf}@speech.kth.sehttp://www.speech.kth.se/music/performanceMusic Acoustics GroupSpeech Music Hearing Dep. (TMH) - Royal Institute of Technology (KTH) - Stockholm
R Bresin: SPM2001
-
Dead-pan version by computer and samplerPerformed by Alfred BrendelWhy does it sound good?BrendelIOI deviations (%)First 8 barsSchumanns Trumerei
R Bresin: SPM2001
-
Music performance: analysis and synthesis
Performance rules obtained mainly with 2 methods:
analysis-by-measurementanalysis-by-synthesis
Generative grammar for automatic music performance
R Bresin: SPM2001
-
Analysis-by-synthesis of music performanceExample: punctuation rule
R Bresin: SPM2001
-
Director Musices performance rules (~30 rules)Differentiation RulesExample: Duration Contrast Rule
Grouping RulesExample: Phrase Articulation Rule
Synchronization/Ensemble RulesExample: Ensemble timing
Other RulesExample: Repetition Articulation Rule
R Bresin: SPM2001
-
Director Musices
R Bresin: SPM2001
-
Phrase Arch Rule Fitted to Three Famous Pianists
R Bresin: SPM2001
-
Body control of music and soundMusic performance and body motion
R Bresin: SPM2001
-
Friberg, A., & Sundberg, J. (1999) Journal of the Acoustical Society of America, 105 (3)Final ritardandoRunners decelerationFinal ritardando alludes to a stopping runnerThree different melodies with a final ritardando curve from the stopping runners
R Bresin: SPM2001
-
Legato and walkingStaccato and runningLegato and staccato allude to walking and running?
R Bresin: SPM2001
Chart1
20050350152850
15060150401780
1004580705120
902520952
6010-20
Normal step frequency
High step frequency
Low step frequency
Bresin & Battel
MacKenzie and Van Eerd
Repp
Tc/2 (ms), IOI
Tdsu (ms), KOT
Step and key overlap time
Legato
Nilsson & Thorstensson: TdsuNilsson & Thorstensson: TcNilsson & Thorstensson: Tc vs Tdsu
Velocity (m/s)NFHFLFVelocity (m/s)NFHFLFNFHFLF
1-0.2-0.05-0.3511.20.412.4TcTdsuTcTdsuTcTdsu
1.5-0.15-0.06-0.151.510.41.8600200205501200350
2-0.1-0.045-0.0820.90.41.4550015020060900150
2.5-0.09-0.025-0.022.50.80.41.24501002004572580
3-0.06-0.010.0230.750.411400902002560020
3756020510500-20
Bresin&Battel
IOIGAPNormalised GAP
2501547
50040126
100070221
150095300
Oscillation Period for Leg Pendulum:TL
Oscillation Period for Finger Pendulum:TF
TL/TF=3.1622776602
VanEerd&MacKenzie
IOIGAPNormalised GAP
10002889
6671754
500516
33326
Repp
IOIGAPNormalised GAP
25050158
50080253
1000120379
Legato
000
000
000
000
000
NF
HF
LF
Velocity (m/s)
Tdsu (s)
Duration of double support phase (Tdsu)
Staccato
000
000
000
00
Repp
Bresin&Battel
VanEerd&MacKenzie
IOI (ms)
KOT (ms)
000
000
000
000
000
NF
HF
LF
Velocity (m/s)
Tc (s)
Normal step frequency
High step frequency
Low step frequency
Bresin & Battel
MacKenzie and Van Eerd
Repp
Tc/2 (ms), IOI
Tdsu (ms), KOT
Step and key overlap time
000000
000000
000000
00000
000
NF
HF
LF
B&B
V&M
R
Tc/2 (ms), IOI
Tdsu (ms), KOT
Feet and keys overlap
Nilsson & Thorstensson: TairNilsson & Thorstensson: TcNilsson & Thorstensson: Tc vs Tdsu
Velocity (m/s)NFHFLFVelocity (m/s)NFHFLFNFHFLFDefault mezzostaccato
1.5-0.010.010.141.50.780.31.8TcTairTcTairTcTairTcTairIOIKDT
20.010.010.1820.760.311.5390-101501090014034512010025
2.50.050.0150.212.50.750.321.33801015510750180335130500125
30.080.020.20530.740.331.23755016015650210300120Staccato in:
40.110.030.2440.70.351.13708016520600205290110Default StaccatoAdagioAllegroPresto
50.120.040.23550.690.3713501101753055024015010IOIKDTKDTKDTKDT
60.130.050.260.670.390.85345120185405002351551010050617178
70.120.0550.1870.60.40.783351301955042520016015500250305355390
80.110.060.1480.580.410.653001202005539018016520
2901102056032514017530
18540
19550
20055
20560
550240
500235
425200
390180
325140
(diagonal points only, all step frequencies)
Bresin & Battel
NaturalBrightDarkHeavyLightHardSoftPassionateFlat
199.0869565217131.8043478261178.1956521739123.0217391304199.8205128205113.4615384615186.090909090982.9393939394195.1739130435139.1739130435185.4666666667111.4444444444211.4545454545119.8863636364210.6470588235109.8529411765177.5227272727102.5
402.0526315789276.4210526316356.3684210526265.8421052632405.6842105263203.1578947368377.9473684211138.3684210526379.2105263158266.4736842105372.2631578947253.3157894737427.2105263158229.4210526316416.1578947368192.1052631579362.8421052632232.8421052632
000
000
000
000
000
000
000
000
000
NF
HF
LF
000
000
000
000
000
000
000
000
000
NF
HF
LF
000
000
000
000
000
000
000
000
000
NF
HF
LF
Tc/2 (ms)
Tair (ms)
Feet detached time
000000000
000000000
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Running
Default mezzostaccato
Default Staccato
Natural
Heavy
Adagio
Allegro
Presto
Default mezzostaccato
Tc/2 (ms), IOI
Tair (ms), KDT
Step and key detached time
Chart2
1202550131.804347826182.939393939461717825
130125250276.4210526316138.3684210526305355390125
120
110
10
10
15
20
30
40
50
55
60
240
235
200
180
140
Running
Default mezzostaccato
Default Staccato
Natural
Heavy
Adagio
Allegro
Presto
Default mezzostaccato
Tc/2 (ms), IOI
Tair (ms), KDT
Step and key detached time
Legato
Nilsson & Thorstensson: TdsuNilsson & Thorstensson: TcNilsson & Thorstensson: Tc vs Tdsu
Velocity (m/s)NFHFLFVelocity (m/s)NFHFLFNFHFLF
1-0.2-0.05-0.3511.20.412.4TcTdsuTcTdsuTcTdsu
1.5-0.15-0.06-0.151.510.41.8600200205501200350
2-0.1-0.045-0.0820.90.41.4550015020060900150
2.5-0.09-0.025-0.022.50.80.41.24501002004572580
3-0.06-0.010.0230.750.411400902002560020
3756020510500-20
Bresin&Battel
IOIGAPNormalised GAP
2501547
50040126
100070221
150095300
Oscillation Period for Leg Pendulum:TL
Oscillation Period for Finger Pendulum:TF
TL/TF=3.1622776602
VanEerd&MacKenzie
IOIGAPNormalised GAP
10002889
6671754
500516
33326
Repp
IOIGAPNormalised GAP
25050158
50080253
1000120379
Legato
000
000
000
000
000
NF
HF
LF
Velocity (m/s)
Tdsu (s)
Duration of double support phase (Tdsu)
Staccato
000
000
000
00
Repp
Bresin&Battel
VanEerd&MacKenzie
IOI (ms)
KOT (ms)
000
000
000
000
000
NF
HF
LF
Velocity (m/s)
Tc (s)
Normal step frequency
High step frequency
Low step frequency
Bresin & Battel
MacKenzie and Van Eerd
Repp
Tc/2 (ms), IOI
Tdsu (ms), KOT
Step and key overlap time
000000
000000
000000
00000
000
NF
HF
LF
B&B
V&M
R
Tc/2 (ms), IOI
Tdsu (ms), KOT
Feet and keys overlap
Nilsson & Thorstensson: TairNilsson & Thorstensson: TcNilsson & Thorstensson: Tc vs Tdsu
Velocity (m/s)NFHFLFVelocity (m/s)NFHFLFNFHFLFDefault mezzostaccato
1.5-0.010.010.141.50.780.31.8TcTairTcTairTcTairTcTairIOIKDT
20.010.010.1820.760.311.5390-101501090014034512010025
2.50.050.0150.212.50.750.321.33801015510750180335130500125
30.080.020.20530.740.331.23755016015650210300120Staccato in:
40.110.030.2440.70.351.13708016520600205290110Default StaccatoAdagioAllegroPresto
50.120.040.23550.690.3713501101753055024015010IOIKDTKDTKDTKDT
60.130.050.260.670.390.85345120185405002351551010050617178
70.120.0550.1870.60.40.783351301955042520016015500250305355390
80.110.060.1480.580.410.653001202005539018016520
2901102056032514017530
18540
19550
20055
20560
550240
500235
425200
390180
325140
(diagonal points only, all step frequencies)
Bresin & Battel
NaturalBrightDarkHeavyLightHardSoftPassionateFlat
199.0869565217131.8043478261178.1956521739123.0217391304199.8205128205113.4615384615186.090909090982.9393939394195.1739130435139.1739130435185.4666666667111.4444444444211.4545454545119.8863636364210.6470588235109.8529411765177.5227272727102.5
402.0526315789276.4210526316356.3684210526265.8421052632405.6842105263203.1578947368377.9473684211138.3684210526379.2105263158266.4736842105372.2631578947253.3157894737427.2105263158229.4210526316416.1578947368192.1052631579362.8421052632232.8421052632
000
000
000
000
000
000
000
000
000
NF
HF
LF
000
000
000
000
000
000
000
000
000
NF
HF
LF
NF
HF
LF
Tc/2 (ms)
Tair (ms)
Feet detached time
Running
Default mezzostaccato
Default Staccato
Natural
Heavy
Adagio
Allegro
Presto
Default mezzostaccato
Tc/2 (ms), IOI
Tair (ms), KDT
Step and key detached time
-
Accents in drumming: kinematics and timing.Frontal view of stick motion trajectory
R Bresin: SPM2001
-
Comparisons between subjectsMotion trajectories of the stick seen from the side.
R Bresin: SPM2001
-
Two singers sing excerpt from Gounods Faust
1. Nicolai Gedda
2. Thomas BurnsWrong body motion: Vocal ugliness
R Bresin: SPM2001
-
GeddaBurnsFrequency (kHz)Mean sound level (dB)Long-term average spectra
R Bresin: SPM2001
Chart2
-8.39-12.88
-3.9-10.48
-5.75-14.07
-5.9-6.82
-0.58-1.05
00
-2.68-3.47
-3.11-7.69
-1.8-8.59
-3.48-13.3
-8.81-18.02
-12.22-19.68
-7.49-16.64
-4.11-12.51
-3.46-10.97
-3.84-12.51
-4.45-16.4
-6.73-16.18
-8.3-12.91
-9.54-11.51
-10.67-11.36
-10.92-10.94
-12.07-14.36
-12.21-22.21
-8.7-23.67
-6.57-20.92
-5.98-22.06
-7.81-27.68
-10.47-29.15
-12.19-28.5
-13.48-30.72
-12.11-34.99
-9.32-34.44
-6.92-33.17
-6.5-32.6
-7.23-31.18
-7.77-28.82
-8.65-27.77
-9.66-28.2
-10.46-29.69
-9.96-33.38
-9.12-37.55
-8.94-38.81
-9.66-39.94
-10.42-39.24
-11.19-38.1
-12.44-38.59
-14.85-38.42
-17.96-35.94
-21.48-34.08
-24.57-34.79
-26.71-37.91
-29.01-38.05
-31.42-38.57
-33.1-41.04
-33.92-43.96
-33.94-44.7
-33.76-46.29
-33.98-49.46
-33.92-51.06
-34.11-53.39
-37.51-55.64
-36.76-54.71
-36.76-53.58
-36.93-52.73
-37.61-51.56
-38.08-49.58
-38.35-48.03
-38.44-47.02
-38.81-45.37
-38.69-43.37
-38.95-43.45
-39.11-44.81
-38.6-47.68
-39.01-51.56
-38.57-53.71
-39.03-52.2
-39.59-50.17
Gedda
Burns
Frequency (Hz)
Mean level (dB)
Sheet1
Fig 1
Fig 2
Fig 4
Fig 5
Fig 6
Fig 7
Sheet1
1958.29551940.0000055487
1958.820751940.3849321426
1969.18251941.5171138732
1967.988751943.3471189403
1972.2623751945.7950481173
1971.1163751948.7540232038
1966.31751952.0948533983
1966.2936251955.6716758539
1946.501251959.3283241461
1944.7583751962.9051466017
1951.80151966.2459767962
1940.7951251969.2049518827
1968.1321971.6528810597
1956.38551973.4828861268
1968.3231974.6150678574
1976.488251974.9999944513
1970.85375
1972.334
1965.649
1970.806
1960.301
1969.3735
1974.19625
1968.394625
1973.933625
1972.166875
1970.065875
1970.75825
1959.20275
1955.024625
1952.088
1969.397375
1972.8115
1966.1265
1969.636125
1979.25775
1940.986125
1949.676625
1938.216625
1941.4875
1974.363375
1973.62325
1973.3845
1974.506625
1964.4075
1967.6545
1966.55625
1972.525
1972.071375
1971.761
1965.076
1965.147625
1973.7665
1968.585625
1974.172375
1962.043875
1971.498375
1978.01625
1975.1035
1956.863
1958.749125
1966.55625
1946.4535
1969.66
1968.2275
1968.94375
1969.087
1966.007125
1971.546125
1970.424
1970.47175
1971.832625
1976.96575
1982.12275
1970.829875
1962.3065
1968.514
1970.66275
1964.335875
1941.72625
1943.755625
1949.772125
1938.38375
1947.432375
1936.37825
1944.066
1948.291875
1968.4185
1969.636125
1968.17975
1978.135625
REAL RECORDING YEAR
GUESSED RECORDING YEAR
LTAS
43.312537.125
47.7187545.46875
5156.8125
53.17187539.1875
39.566666666744.359375
35.0536.203125
45.533333333346.59375
53.116666666740.421875
44.0312540
43.29687547.3125
40.6562539.03125
41.26562538.125
48.7187542.59375
39.12535.765625
39.23437538.796875
42.37545.921875
50.2542.640625
41.95312551.78125
32.562541.359375
60.3437532.15625
42.0312556.953125
50.12547.6875
35.26562540.609375
35.0312532.53125
45.062539.25
49.60937547.828125
51.82812550.65625
52.89062542.78125
42.60937542.421875
39.14062534.40625
36.4062546.21875
39.2534.71875
53.07812542.96875
40.92187538.796875
43.85937534.6875
31.32812552.671875
42.84375
48.296875
49.765625
43.9375
41.90625
51.046875
32.984375
47.734375
39.140625
36.984375
42.625
44.890625
48.15625
41.84375
42.875
47.6875
33.28125
39.484375
49.875
Male
Female
REAL AGE (years)
GUESSED AGE (years)
Sheet3
-90-67.7
-52.97-30.5
-60.89-38.99
-66.59-52.78
-62.92-56.96
-54.52-51.08
-47.4-43.67
-43.52-38.69
-42.79-36.14
-45.36-36.41
-51.7-39.9
-54.02-46.5
-43.93-43.29
-37.26-36.52
-34.19-33.22
-33.22-32.4
-32.87-32.9
-34.2-34.45
-38.82-37.27
-43.68-38.17
-41.29-36.54
-40.29-35.44
-41.92-34.58
-45.47-34.76
-48.01-36.88
-49.78-40.3
-53.07-43.46
-54.15-45.94
-53.16-47.35
-53.13-45.17
-51.67-41.24
-48.41-38.58
-46.02-37.14
-44.64-36.47
-44.1-36.54
-44.55-37.21
-46.03-37.37
-48.67-36.9
-51.69-37.32
-51.72-39.04
-50.26-40.84
-48.62-41.11
-46.68-41.43
-45.06-42.25
-44.48-42.88
-45.58-43.55
-45.83-44.38
-44.03-44.34
-43.69-43.82
-45.35-44.29
-48.98-45.6
-54.3-46.69
-58.68-46.78
-60.14-44.87
-58.03-41.99
-55.63-40.58
-53.98-40.24
-53.65-39.18
-55.4-38.63
-59.48-39.76
-64.4-41.63
-64.59-43.09
-62.52-44.43
-61.65-45.27
-61.8-45.77
-62.48-46.91
-64.3-47.62
-67.37-46.84
-70.43-45.8
-70.28-44.46
-67.74-42.94
-66.62-41.56
-66.91-40.26
-66.67-39.52
-66.13-39.9
-65.93-40.67
-65.19-40.66
-63.82-40.61
-62.31-41.16
-61.36-41.65
-61.2-42.16
-61.38-42.97
-61.85-43.64
-62.25-44.06
-63.08-44.25
-64.93-43.79
-67.77-43.36
-70.63-43.04
-71.67-42.46
-71.81-42.33
-72.21-42.73
-72.88-43
-73.48-43.28
-73.74-43.6
-72.82-43.74
-71.85-44.05
-71.48-44.54
-71.34-45.08
-72.13-45.86
-73.07-47.2
-72.76-48.68
-71-50.01
-69.46-51.59
-68.51-53.31
-67.48-54.98
-66.89-56.59
-67.94-57.79
-70.8-58.58
-72.89-59.21
-72.18-60.08
-71.08-60.98
-71.21-61.43
-72.14-61.98
-73.03-62.19
-74.41-62.87
-76.48-63.35
-77.91-63.42
-78.03-63.58
-77.47-63.44
-77.85-63.15
-78.98-62.59
-80.7-63.41
-81.21-63.14
-81.97-63.65
-82.43-64.32
-82.77-63.02
-83.56-63.04
-83.58-62.92
-86.07-67.67
-85.31-66.59
-85.74-66.89
-84.62-66.21
-84.72-66.5
-84.5-66.89
-84.12-66.42
-84.18-66.75
-83.16-66.52
-82.82-66.91
-82.01-66.83
-81.5-66.77
-80.84-67.11
-80.1-67.1
-79.91-67.28
-79.93-66.8
-79.12-67.29
-77.49-66.83
-76.32-66.6
-76.14-66.53
-77.04-66.32
-77.43-66.54
-77.78-66.25
-79.32-66.43
-80.79-65.91
-82.54-65.93
-83.48-65.88
-84.88-65.92
-84.82-65.5
-84.38-65.36
-84.05-65.54
-82.98-65.59
-82.65-65.97
-81.97-65.35
-81.72-65.93
-81.44-65.53
-81.5-65.69
-81.26-65.73
-81.02-65.72
-81.41-65.85
-81.19-65.68
-80.47-66.06
-79.65-65.58
-79.43-65.76
-80.01-65.7
-80.34-65.9
-80.73-66.07
-81.65-65.8
-82.27-66.17
-82.42-65.95
-83.11-65.91
-83.52-65.95
-84.29-66.06
-85.07-66
-85.23-66.11
-85.87-66.4
-85.87-65.91
-86.34-66.06
-85.65-66.02
-85.07-66.32
-83.85-66.55
-83.34-66.46
-83.04-67.07
-82.83-66.41
-83.17-66.41
-82.89-66.26
-82.78-66.99
-82.13-66.19
-81.77-66.55
-81.59-66.59
-81.26-66.68
-81.47-66.77
-81.97-66.25
-82.54-66.68
-82.08-66.68
-81.49-66.59
-81.81-66.58
-82.93-66.65
-84.18-66.86
-84.43-66.52
-85.51-66.69
-85.4-66.36
-85.94-66.78
-85.48-66.82
-85.63-66.64
-85.95-66.84
-86.18-66.64
-86.63-66.74
-86.36-66.55
-86.8-66.94
-86.47-66.77
-86.64-66.93
-86.77-66.47
-86.61-66.44
-86.78-66.98
-86.84-66.79
-87.02-67.04
-86.56-67.04
-86.93-67.34
-86.01-66.77
-86.2-66.81
-85.86-67.02
-85.6-66.96
-86.31-67.19
-86.1-66.71
-86.48-67.08
-86.21-66.92
-86.4-67.03
-86.31-66.85
-86.28-66.47
-87.12-66.97
-87.03-66.78
-87.92-66.95
-87.45-66.4
-87.68-66.91
-87.18-66.88
-87.77-67.22
-88.01-67.09
-87.24-67.14
-87.71-67.15
-87.08-66.63
-87.94-67.19
-87.36-66.74
-87.85-67.49
-87.43-67.91
-87.51-66.47
-88.17-67.58
-87.7-66.87
BURNS
GEDDA
Frequency (Hz)
Spectrum level (dB)
-12.131.08
-3.054.29
1.482.44
1.92-0.75
-0.17-3.33
0.08-2.86
-1.470.04
-7.19-2.2
-9.99-10.66
-8.14-16.26
-8.36-17.33
-11.72-18.71
-15.23-19.14
-18.42-20.35
-19.01-21.28
-22.06-20.23
-24.22-20.88
-24.77-22.78
-25.8-22.93
-22.84-24.48
-19.38-27.24
-15.36-27.41
-12.47-27.5
-12.93-28.01
-15.61-29.36
-17.7-31.59
-20.74-33.42
-26.06-33.75
-30.3-35.11
-33.18-36.81
-36.62-36.4
-38.34-36.36
-39.9-38.87
-39.94-39.68
-39.92-40.03
-41.07-40.6
-42.7-41.58
-43.98-41.72
-44.2-41.98
-44.85-42.55
-45.34-43.12
-45.93-43.1
-46.31-43.19
-47-43.36
-47.24-43.39
-47.44-43.47
-47.69-43.36
-47.99-43.56
-48-43.13
-47.9-43.02
-48.05-42.98
-48.22-43.22
-48.35-43.49
-48.35-43.48
-48.37-43.38
-48.53-43.61
-48.49-43.38
-48.39-43.24
-48.51-43.24
-48.63-43.54
-48.59-43.46
-48.58-43.2
-48.48-43.02
-48.52-43.23
Operatic singer
Rock singer
Frequency (Hz)
Level (dB)
-2.51-4.1125
109.55109.55
125.2125.2
140.85140.85
156.5156.5
172.15172.15
187.8187.8
-7.3128571429-3.5546428571
219.11219.11
234.76234.76
250.41250.41
266.06266.06
281.71281.71
297.36297.36
-5.73-6.98
328.66328.66
344.31344.31
359.96359.96
375.61375.61
391.26391.26
406.91406.91
-5.21-8.8039285714
438.21438.21
453.86453.86
469.51469.51
485.16485.16
500.81500.81
516.46516.46
-9.1821428571-7.9971428571
547.76547.76
563.41563.41
579.06579.06
594.71594.71
610.37610.37
626.02626.02
-15.4992857143-11.1785714286
657.32657.32
672.97672.97
688.62688.62
704.27704.27
719.92719.92
735.57735.57
-16.4007142857-11.4642857143
766.87766.87
782.52782.52
798.17798.17
813.82813.82
829.47829.47
845.12845.12
-16.1907142857-14.0021428571
876.42876.42
892.07892.07
907.72907.72
923.37923.37
939.02939.02
954.67954.67
-18.9478571429-16.7667857143
985.97985.97
1001.631001.63
1017.281017.28
1032.931032.93
1048.581048.58
1064.231064.23
-17.3664285714-18.6121428571
1095.531095.53
1111.181111.18
1126.831126.83
1142.481142.48
1158.131158.13
1173.781173.78
-18.8142857143-21.1021428571
1205.081205.08
1220.731220.73
1236.381236.38
1252.031252.03
1267.681267.68
1283.331283.33
-24.5835714286-20.1439285714
1314.631314.63
1330.281330.28
1345.931345.93
1361.581361.58
1377.231377.23
1392.881392.88
-20.465-21.3089285714
1424.191424.19
1439.841439.84
1455.491455.49
1471.141471.14
1486.791486.79
1502.441502.44
-23.7478571429-19.6114285714
1533.741533.74
1549.391549.39
1565.041565.04
1580.691580.69
1596.341596.34
1611.991611.99
-23.6478571429-22.5953571429
1643.291643.29
1658.941658.94
1674.591674.59
1690.241690.24
1705.891705.89
1721.541721.54
-25.8814285714-22.0114285714
1752.841752.84
1768.491768.49
1784.141784.14
1799.791799.79
1815.451815.45
1831.11831.1
-22.8314285714-25.1414285714
1862.41862.4
1878.051878.05
1893.71893.7
1909.351909.35
19251925
1940.651940.65
-31.8978571429-24.3921428571
1971.951971.95
1987.61987.6
2003.252003.25
2018.92018.9
2034.552034.55
2050.22050.2
-30.6285714286-23.6364285714
2081.52081.5
2097.152097.15
2112.82112.8
2128.452128.45
2144.12144.1
2159.752159.75
-28.8735714286-24.3617857143
2191.052191.05
2206.712206.71
2222.362222.36
2238.012238.01
2253.662253.66
2269.312269.31
-29.1971428571-27.0789285714
2300.612300.61
2316.262316.26
2331.912331.91
2347.562347.56
2363.212363.21
2378.862378.86
-31.2064285714-24.8589285714
2410.162410.16
2425.812425.81
2441.462441.46
2457.112457.11
2472.762472.76
2488.412488.41
-32.8614285714-26.4767857143
2519.712519.71
2535.362535.36
2551.012551.01
2566.662566.66
2582.312582.31
2597.962597.96
-33.6592857143-24.6614285714
2629.272629.27
2644.922644.92
2660.572660.57
2676.222676.22
2691.872691.87
2707.522707.52
-34.3935714286-24.4817857143
2738.822738.82
2754.472754.47
2770.122770.12
2785.772785.77
2801.422801.42
2817.072817.07
-31.8214285714-26.3092857143
2848.372848.37
2864.022864.02
2879.672879.67
2895.322895.32
2910.972910.97
2926.622926.62
-35.3135714286-25.9060714286
2957.922957.92
2973.572973.57
2989.222989.22
3004.883004.88
3020.533020.53
3036.183036.18
-36.3328571429-27.1257142857
3067.483067.48
3083.133083.13
3098.783098.78
3114.433114.43
3130.083130.08
3145.733145.73
-35.9328571429-25.5057142857
3177.033177.03
3192.683192.68
3208.333208.33
3223.983223.98
3239.633239.63
3255.283255.28
-35.2671428571-25.9657142857
3286.583286.58
3302.233302.23
3317.883317.88
3333.533333.53
3349.183349.18
3364.833364.83
-35.2107142857-27.1942857143
3396.133396.13
3411.793411.79
3427.443427.44
3443.093443.09
3458.743458.74
3474.393474.39
-37.2542857143-26.6028571429
3505.693505.69
3521.343521.34
3536.993536.99
3552.643552.64
3568.293568.29
3583.943583.94
-37.7328571429-26.8657142857
3615.243615.24
3630.893630.89
3646.543646.54
3662.193662.19
3677.843677.84
3693.493693.49
-36.6207142857-27.8564285714
3724.793724.79
3740.443740.44
3756.093756.09
3771.743771.74
3787.393787.39
3803.043803.04
-36.53-28.84
3834.353834.35
38503850
3865.653865.65
3881.33881.3
3896.953896.95
3912.63912.6
-38.9607142857-29.2875
3943.93943.9
3959.553959.55
3975.23975.2
3990.853990.85
4006.54006.5
4022.154022.15
-41.6142857143-30.6957142857
4053.454053.45
4069.14069.1
4084.754084.75
4100.44100.4
4116.054116.05
4131.74131.7
-41.5992857143-31.1746428571
41634163
4178.654178.65
4194.34194.3
4209.964209.96
4225.614225.61
4241.264241.26
-40.8114285714-31.0621428571
4272.564272.56
4288.214288.21
4303.864303.86
4319.514319.51
4335.164335.16
4350.814350.81
-41.9528571429-29.9717857143
4382.114382.11
4397.764397.76
4413.414413.41
4429.064429.06
4444.714444.71
4460.364460.36
-41.3057142857-31.0114285714
4491.664491.66
4507.314507.31
4522.964522.96
4538.614538.61
4554.264554.26
4569.914569.91
-42.2442857143-30.3503571429
4601.214601.21
4616.874616.87
4632.524632.52
4648.174648.17
4663.824663.82
4679.474679.47
-41.6542857143-30.3607142857
4710.774710.77
4726.424726.42
4742.074742.07
4757.724757.72
4773.374773.37
4789.024789.02
-42.02-30.7353571429
4820.324820.32
4835.974835.97
4851.624851.62
4867.274867.27
4882.924882.92
4898.574898.57
-42.6321428571-32.1035714286
4929.874929.87
4945.524945.52
4961.174961.17
4976.824976.82
4992.474992.47
Mean, classical orchestra
Mean, rock band
Frequency (Hz)
Level (dB)
0.98186936940.82044366651
0.86565315320.86232764161
1.1014639641.0689790669
1.15427927931.1779309852
1.61486486491.5074658855
0.85157657661.0380795885
0.83040540540.8260698721
1.02049549550.9041223119
1.03108108111.163642209
1.87556306312.1764485247
1.18243243241.3340358648
0.8270270270.7563227835
0.81295045050.8791169536
0.92905405410.8483960849
0.95022522520.9823533614
1.18243243241.242230478
1.54166666671.5574766021
1.06283783780.8707222976
0.92905405410.8594698864
1.03468468470.9823533614
0.77072072070.7283703651
1.2480480481.1014264962
1.3229729731.6185611202
1.02060810810.9519897121
1.14414414411.1386368508
NOTE NUMBER
SUNG / NOMINAL RATIO
F. MENDELSOHN: PAULUS
MV F0+-1 SD240+-49231+-22 Hz
-50.95-28.91
GeddaBurns
16000raterate
256pointspoints
HzdBdB
0-50.790.16-50.99-22.08
62.5-52.23-1.28-52.19-23.28
125-66.49-15.54-51.56-22.65
187.5-59.34-8.39-41.79-12.88
250-54.85-3.9-39.39-10.48
312.5-56.7-5.75-42.98-14.07
375-56.85-5.9-35.73-6.82
437.5-51.53-0.58-29.96-1.05
500-50.950-28.910
562.5-53.63-2.68-32.38-3.47
625-54.06-3.11-36.6-7.69
687.5-52.75-1.8-37.5-8.59
750-54.43-3.48-42.21-13.3
812.5-59.76-8.81-46.93-18.02
875-63.17-12.22-48.59-19.68
937.5-58.44-7.49-45.55-16.64
1000-55.06-4.11-41.42-12.51
1062.5-54.41-3.46-39.88-10.97
1125-54.79-3.84-41.42-12.51
1187.5-55.4-4.45-45.31-16.4
1250-57.68-6.73-45.09-16.18
1312.5-59.25-8.3-41.82-12.91
1375-60.49-9.54-40.42-11.51
1437.5-61.62-10.67-40.27-11.36
1500-61.87-10.92-39.85-10.94
1562.5-63.02-12.07-43.27-14.36
1625-63.16-12.21-51.12-22.21
1687.5-59.65-8.7-52.58-23.67
1750-57.52-6.57-49.83-20.92
1812.5-56.93-5.98-50.97-22.06
1875-58.76-7.81-56.59-27.68
1937.5-61.42-10.47-58.06-29.15
2000-63.14-12.19-57.41-28.5
2062.5-64.43-13.48-59.63-30.72
2125-63.06-12.11-63.9-34.99
2187.5-60.27-9.32-63.35-34.44
2250-57.87-6.92-62.08-33.17
2312.5-57.45-6.5-61.51-32.6
2375-58.18-7.23-60.09-31.18
2437.5-58.72-7.77-57.73-28.82
2500-59.6-8.65-56.68-27.77
2562.5-60.61-9.66-57.11-28.2
2625-61.41-10.46-58.6-29.69
2687.5-60.91-9.96-62.29-33.38
2750-60.07-9.12-66.46-37.55
2812.5-59.89-8.94-67.72-38.81
2875-60.61-9.66-68.85-39.94
2937.5-61.37-10.42-68.15-39.24
3000-62.14-11.19-67.01-38.1
3062.5-63.39-12.44-67.5-38.59
3125-65.8-14.85-67.33-38.42
3187.5-68.91-17.96-64.85-35.94
3250-72.43-21.48-62.99-34.08
3312.5-75.52-24.57-63.7-34.79
3375-77.66-26.71-66.82-37.91
3437.5-79.96-29.01-66.96-38.05
3500-82.37-31.42-67.48-38.57
3562.5-84.05-33.1-69.95-41.04
3625-84.87-33.92-72.87-43.96
3687.5-84.89-33.94-73.61-44.7
3750-84.71-33.76-75.2-46.29
3812.5-84.93-33.98-78.37-49.46
3875-84.87-33.92-79.97-51.06
3937.5-85.06-34.11-82.3-53.39
4000-88.46-37.51-84.55-55.64
4062.5-87.71-36.76-83.62-54.71
4125-87.71-36.76-82.49-53.58
4187.5-87.88-36.93-81.64-52.73
4250-88.56-37.61-80.47-51.56
4312.5-89.03-38.08-78.49-49.58
4375-89.3-38.35-76.94-48.03
4437.5-89.39-38.44-75.93-47.02
4500-89.76-38.81-74.28-45.37
4562.5-89.64-38.69-72.28-43.37
4625-89.9-38.95-72.36-43.45
4687.5-90.06-39.11-73.72-44.81
4750-89.55-38.6-76.59-47.68
4812.5-89.96-39.01-80.47-51.56
4875-89.52-38.57-82.62-53.71
4937.5-89.98-39.03-81.11-52.2
5000-90.54-39.59-79.08-50.17
5062.5-90.37-77.94
5125-90.22-77.59
5187.5-90.15-77.35
5250-89.97-77.14
5312.5-89.87-75.79
5375-90.06-75.9
5437.5-90.37-77.14
5500-89.99-78.54
5562.5-90.2-80.09
5625-90.3-81.88
5687.5-90.1-83.51
5750-90.36-84.7
5812.5-90.22-83.89
5875-90.3-81.2
5937.5-90.1-79.85
6000-88.98-79.38
6062.5-89.49-78.81
6125-89.11-78.05
6187.5-89.8-77.7
6250-89.52-78.22
6312.5-89.83-78.25
6375-89.52-78.48
6437.5-89.72-80.93
6500-90.05-83.23
6562.5-89.95-84.22
6625-89.95-84.61
6687.5-90.25-85.75
6750-90.1-86.18
6812.5-90.06-86.39
6875-90.07-86.35
6937.5-90.45-86.54
7000-89.68-86.64
7062.5-89.58-85.99
7125-89.4-84.3
7187.5-89.87-84.28
7250-89.87-85.21
7312.5-90.06-85.49
7375-89.83-85.43
7437.5-90-86.56
7500-89.54-88.27
7562.5-89.47-88.57
7625-89.68-88.63
7687.5-89.81-88.52
7750-89.45-88.41
7812.5-89.36-88.42
7875-89.41-88.7
7937.5-89.59-88.81
00
00
00
00
00
00
00
00
00
00
00
00
00
00
Gedda
Burns
Frequency (Hz)
Mean level (dB)
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
Gedda
Burns
Frequency (Hz)
Mean level (dB)
MBD01DF6C0B.xls
Chart1
-1012120
4-1840
-61616
8-14-14
-2-2-2
-10-10-10
-121010
222
-81414
6-16-16
-4-418
10-12-12
000
Pythagorean
Pure
Pure
Interval (semitones)
Deviation from E.T. (cent)
Sheet1
IntervalPytPythagoreanPurePurePurePure
Min 2nd110090-10112112121200
Maj 2nd22002044182204-184120
Min 3rd3300294-63163161616
Maj 3rd44004088386386-14-14
Fourth5500498-2498498-2-2
Augm 4th6600590-10590590-10-10
Dim 5th6600588-126106101010
5th7700702270270222
Min 6th28800792-88148141414
Maj 6th99009066884884-16-16
Min 7th101000996-49961018-418
Maj 7th11110011101010881088-12-12
Oct121200120001200120000
&A
Page &P
Sheet1
0000
0000
000
000
000
000
000
000
000
000
000
000
000
&A
Page &P
Pythagorean
Pure
Pure
Interval (semitones)
Deviation from E.T. (cent)
Sheet2
00
00
00
00
00
00
00
00
00
00
00
00
00
Pure
Sheet3
&A
Page &P
Sheet4
&A
Page &P
Sheet5
&A
Page &P
Sheet6
&A
Page &P
Sheet7
&A
Page &P
Sheet8
&A
Page &P
Sheet9
&A
Page &P
Sheet10
&A
Page &P
Sheet11
&A
Page &P
Sheet12
&A
Page &P
Sheet13
&A
Page &P
Sheet14
&A
Page &P
Sheet15
&A
Page &P
Sheet16
&A
Page &P
&A
Page &P
-
Virtual fixing of Burns problems 1. Synthesis of original 2. Exaggerated glottal adduction Medication: enhance fundamental! 3. Irregular vibrato & out of tune Medication: increase vibrato regularity! apply equally tempered tuning! 4. Horrible formants Medication : Cluster F3, F4, F5!
5. Raise singers formant by 200 Hz!
R Bresin: SPM2001
-
Happy or sad music?
R Bresin: SPM2001
-
Performance Rules:Synthesis of Emotional ExpressionA.Gabrielsson and P.Juslin suggested a list of important cues for the simulation of emotions in music performance(Psychology of Music, 1996, vol. 24)No expressionTendernessSolemnityHappinessSadnessAngerFear
R Bresin: SPM2001
-
Synthesis of Emotion: SADNESS (1/2)
R Bresin: SPM2001
Expressive Cue
Gabrielsson & Juslin
Director Musices
Tempo
Slow
Tone duration is lengthened by 30%
SPL
Moderate or low
Sound level is decreased by 6 dB
Articulation
Legato
Score Legato Articulation (k = 2.7)
Time deviations
&
SPL deviations
Moderate
Soft duration contrast
Relatively large deviations in timing
Duration Contrast Rule (k = -2, amp = 0)
Punctuation (k = 2.1)
Phrase Arch Rule applied on three phrase levels (level 1, k = 2.7; level 2, k = 1.5; level 3, k = 1.5)
High Loud (k = 1)
Final ritardando
Yes
Obtained from the Phrase Arch Rule
-
Synthesis of Emotion: SADNESS (2/2)IOI deviationsdB deviations
R Bresin: SPM2001
-
Synthesis of Emotion: Listening Test Results
R Bresin: SPM2001
-
ConclusionsEmotional expressioncan be derived directlyfrom the music score, simplyby enhancing music structure
We want to recognize a meaning!!
R Bresin: SPM2001
-
More info, sound examples, sw ...http://www.speech.kth.se/music/performance
R Bresin: SPM2001
-
The Endwww.soundobject.org
R Bresin: SPM2001