audio rendering: from sound diffusion to sound projection
TRANSCRIPT
Audio rendering: from sound diffusion to sound projection Roberto Magalotti, B&C Speakers
Augusto Sarti, Politecnico di Milano
Roberto Magalotti - Augusto Sarti
B&C Speakers is...
... one of the largest and most prestigious electroacoustic transducer manufacturers in the world; designing, developing and manufacturing only for the high-end professional audio market under its own ‘B&C Speakers’ brandname
2
Roberto Magalotti - Augusto Sarti
Summary
• Loudspeakers § A bit if history § Loudspeakers today
• Directivity in acoustics § Definition § Specification § Examples
• Line arrays in sound reinforcement § In the '50 § In the '90 § Today
• What processing can do • Spatial audio • Acoustic holography • Room compensation • Virtual acoustics
• Technological and scientific challenges 3
Roberto Magalotti - Augusto Sarti
A bit of History…
• 1857, Antonio Meucci invents the “Telettrofono”, which includes the first loudspeaker
• “consiste in un diaframma vibrante e in un magnete elettrizzato da un filo a spirale che lo
avvolge. Vibrando, il diaframma altera la corrente del magnete. Queste alterazioni di corrente, trasmesse all'altro capo del filo, imprimono analoghe vibrazioni al diaframma ricevente e riproducono la parola”
• 1876, Alexander Graham Bell patents Meucci’s invention The US congress finally recognizes Meucci’s paternity of the invention in 2002
4
Roberto Magalotti - Augusto Sarti
A bit of History…
• 1877, Ernst Siemens (Germany) patented the first loudspeaker • 1898, Sir Oliver Lodge (England) second patent for a loudspeaker
(before music was electrified)
5
Roberto Magalotti - Augusto Sarti
• 1924, two General Electric researchers, Chester W. Rice and Edward Washburn Kellogg patented the Radiola speakers (moving coil, direct radiator loudspeaker)
A bit of History…
6
Roberto Magalotti - Augusto Sarti
A bit of History…
• 1926, two researchers from Bell Labs, E.C. Wente and A.L. Thuras, designed a “phase plug” in front of the membrane of a horn-loaded loudspeaker, creating the compression driver
7
Roberto Magalotti - Augusto Sarti
A bit of History...
• 1954, Edgar Villchur of Acoustic Research developed the acoustic suspension principle for loudspeaker enclosure deisgn
8
Roberto Magalotti - Augusto Sarti
A bit of History...
• 1957, Quad ESL marketed as the first full-range electrostatic loudspeaker, designed by Peter Walker and David Williamson, based on Edward W. Kellogg's patent from 1934
9
Roberto Magalotti - Augusto Sarti
Loudspeakers today
• Permanent magnets have replaced the field coil § AlNiCo ('40) § Ferrites ('50) § Rare Earth ('90)
• Voice coils are designed to handle the large electrical power supplied
from modern amplifiers • Finite Element Analysis is extensively used in all aspects of
loudspeaker design (acoustics, thermodynamics, electromagnetism,...) • Digital Signal Processing is widely used in loudspeaker system set-up
and management
10
Roberto Magalotti - Augusto Sarti
Directivity in acoustics
• Definition: radiation pattern in the far field with respect to the source(s) • Far field: the radiation pattern no longer changes with the distance
§ Several wavelengths form the source § Several times the size of the source
11
Roberto Magalotti - Augusto Sarti
Specifying directivity
-48
-42
-36
-30
-24
-18
-12
-6
0
60°
30°
60°
90°
120°
150°
180°
210°
240°
270°
300°
330°
10FCX64
500 Hz
1 kHz
2 kHz
4 kHz
8 kHz
16 kHz
Woofer
Driver
12
Roberto Magalotti - Augusto Sarti
Specifying directivity
13
Roberto Magalotti - Augusto Sarti
Specifying directivity
14
Roberto Magalotti - Augusto Sarti
Piston in an infinite baffle
15
Roberto Magalotti - Augusto Sarti
Piston at the end of a long tube
16
Roberto Magalotti - Augusto Sarti
Unbaffled piston
17
Roberto Magalotti - Augusto Sarti
Curved source (horn)
18
Roberto Magalotti - Augusto Sarti
Directivity shaping with more sources: uniform linear array
19
Roberto Magalotti - Augusto Sarti
Directivity shaping with more sources: tapered linear array
20
Roberto Magalotti - Augusto Sarti
Directivity shaping with more sources: linear array with delays (beam steering)
21
Roberto Magalotti - Augusto Sarti
Line arrays in live audio systems
Grateful Dead “Wall of Sound”, 1974
22
Roberto Magalotti - Augusto Sarti
Line arrays in live audio systems
Line array system Point source system 23
Roberto Magalotti - Augusto Sarti
Line arrays, early example: Parkin – Taylor 1952
24
Roberto Magalotti - Augusto Sarti
Line arrays, early example: Parkin – Taylor 1952
25
Roberto Magalotti - Augusto Sarti
Line arrays, early example: Parkin – Taylor 1952
26
Roberto Magalotti - Augusto Sarti
Line arrays: V-DOSC by L-Acoustics, 1992
27
Roberto Magalotti - Augusto Sarti
Line arrays: V-DOSC by L-Acoustics, 1992
28
Roberto Magalotti - Augusto Sarti
Contemporary line arrays: J-shape
29
Roberto Magalotti - Augusto Sarti
Contemporary line arrays: MLA by Martin Audio, 2010
30
Roberto Magalotti - Augusto Sarti
Contemporary line arrays: MLA by Martin Audio, 2010
DISPLAY 2 rendering software 31
Roberto Magalotti - Augusto Sarti
Cardioid subwoofers: principle
32
Roberto Magalotti - Augusto Sarti
Cardioid subwoofers: in practice
33
Roberto Magalotti - Augusto Sarti
WHAT PROCESSING CAN DO
Roberto Magalotti - Augusto Sarti
Perceptual cues for 3D audio Interaural Time/Level Difference
35
Roberto Magalotti - Augusto Sarti
Perceptual cues for 3D audio Head Related Transfer Function
36
Roberto Magalotti - Augusto Sarti
HRTF
37
Roberto Magalotti - Augusto Sarti
Multi-channel audio planar rendering (ITD only)
38
Roberto Magalotti - Augusto Sarti
Multi-channel audio vector rendering (ITD only)
39
Roberto Magalotti - Augusto Sarti
Beyond ITD
Binaural Rendering Wavefield Rendering
Roberto Magalotti - Augusto Sarti
Wavefield synthesis
Huygens’ principle (1690) The wavefield produced by
a primary source Ψ can be reconstructed using a distribution of secondary sources
41
Roberto Magalotti - Augusto Sarti
Wavefield Synthesis example of focused source
42
Roberto Magalotti - Augusto Sarti
Limits
• Large number of speakers
• Hard to go beyond planar rendering
• Invasive installation
Roberto Magalotti - Augusto Sarti
From 2D to 3D…
HoloPlot ModuleMatrix (Advanced Acoustic, Potsdam, Germany)
• Large number of speakers
• Hard to go beyond planar rendering
• Invasive installation
Roberto Magalotti - Augusto Sarti
DT solution to reduce invasivity…
45
Roberto Magalotti - Augusto Sarti
Spherical Harmonic functions:
Spherical Bessel
Functions:
Ambisonics fundamentals
Intrinsic quality of representation Using components Bmn
σ up to a limited order (m≤M) Angular resolution ó radial expansion % wave length
0 0 , 1( ) ( ) ( , )m
m mn mnm n m
p r j j kr B Yσ σ
σ
θ δ∞
= ≤ ≤ =±
=∑ ∑r
Ø Spherical Harmonic Decomposition : Fourier-Bessel series
o Sound field represented by coefficients Bmnσ
o = Spherical Harmonic component ó “Ambisonic Signals” o ópressure field spatial derivatives of successive orders m o Around a reference point = listener point of view
46
Roberto Magalotti - Augusto Sarti
Ambisonics rendering
Wavefield as a linear combination of (a basis of) spherical harmonic functions
47
Roberto Magalotti - Augusto Sarti
Ambisonics rendering
Wavefield approximation as the order increases
48
Roberto Magalotti - Augusto Sarti
Ambisonics dome in PoliMI
49
Roberto Magalotti - Augusto Sarti
Commercial ambisonics installations
50
Roberto Magalotti - Augusto Sarti
Commercial ambisonics installations
Roberto Magalotti - Augusto Sarti
High-order speakers Adrian Freed, Peter Kassakian, David Wessel (CNMAT)
Class-D embedded amplifiers § Embedded ethernet and DSP
Roberto Magalotti - Augusto Sarti
Soundfield sythesis: goals
• Render a virtual acous0c source using a loudspeaker array • Render the acous0cs of a virtual environment • Compensate for the early reflec0ons of the environment in which the loudspeaker array is opera0ng (“room compensa0on”) • Exploit the early reflec0ons of the real environment, e.g. for a virtual home theater system
53
Roberto Magalotti - Augusto Sarti
Rendering virtual acoustic sources
Beamshaping Goal: • Rendering of a virtual source along with its radia0on paDern in a listening region, by
means of a loudspeaker array • Focus on direc0onal sources, modeled as beams • Need to control:
• Source posi0on • Direc0on of emission • Beam aperture
virtual source
loudspeakers
listening region
54
Roberto Magalotti - Augusto Sarti
Virtual environment rendering
Wave field modeled as the superposi0on of elementary beams (geometrical acous0cs)
Use loudspeakers for synthesizing elementary
beams
55
Roberto Magalotti - Augusto Sarti
Virtual environment rendering
• Image sources are suitable only in simple convex environments
• Visibility tests are very 0me demanding • A convenient solu0on is beam tracing,
which compute visibility very efficiently
56
Roberto Magalotti - Augusto Sarti
Virtual environment rendering
Examples
NMSE (%): 500 Hz à 7.4 % 1000 Hz à 7.9 %
NMSE (%): 500 Hz à 5.1 % 1000 Hz à 5.3 %
57
Roberto Magalotti - Augusto Sarti
Virtual environment rendering in reverberant rooms
• Loudspeakers operate in an arbitrary reverberant room • Image loudspeakers determined through beam-‐tracing • Room compensa0on enables a free-‐field behaviour of the
beam shaping
• Design of a virtual environment to be rendered… • … and rendering through superposi0on of beams
58
Roberto Magalotti - Augusto Sarti
Environment-‐aware virtual environment rendering
Desired wave field Free-‐field wf rendering
Non-‐compensated wf rendering
Room-‐compensated wf rendering
59
Roberto Magalotti - Augusto Sarti
Exploi5ng the environment
… is it possible to think at the environment as an “augmented”
rendering system?
image array (first order)
image array (first order)
image array (second order)
image array (second order)
IDEA: use the walls (i.e., image loudspeakers) to increase the array
Applica0on: simula0on of a 5.1 surround system [Canclini2012]
60
Roberto Magalotti - Augusto Sarti
Exploiting the environment
Environment-‐aware virtual 5.1 surround
What about undesired reflec0ons?
We can introduce, again, room compensa0on (slightly modified):
Desired response Actual response
CGG roomdes =
desroomT
roomT
roomT GGGGC 1)(ˆ −=
ffcomp hCh ˆ=Compensated loudspeaker gains
listening area
CL R
RL RR
61
Roberto Magalotti - Augusto Sarti
Exploiting the environment
Example: reproduc0on of the rear-‐right channel
Desired Non-‐compensated Room-‐compensated
listening area
RR
62
Roberto Magalotti - Augusto Sarti
Exploiting the environment
63
Roberto Magalotti - Augusto Sarti
Technological challenges
• Pervasive but non-invasive audio • Immersive experience • Contained within the environment • Acoustic displays should not “take over” but should seamlessly
integrate with the surroundings • Design constraints
• slim, compact, …in the wrong place • High quality expectations
64
Roberto Magalotti - Augusto Sarti
Professional-grade solutions
65
Roberto Magalotti - Augusto Sarti
Consumer-oriented solutions MEMS loudspeakers
66
Roberto Magalotti - Augusto Sarti 67
Roberto Magalotti - Augusto Sarti
Lightness
“La seconda rivoluzione industriale non si presenta come la prima con immagini schiaccianti quali presse di laminatoi o colate d'acciaio, ma come i bit di un flusso d'informazione che corre sui circuiti sotto forma di impulsi elettronici. Le macchine di ferro ci sono sempre, ma obbediscono ai bit senza peso.”
68
Roberto Magalotti - Augusto Sarti
Quickness
• IPAL (Integrated Powered Adaptive Loudspeaker) § Virtual Parameter § Direct Pressure Control § Processing Time: 10 µs
69
“Sogno immense cosmologie, saghe ed epopee racchiuse nelle dimensioni di un epigramma. Nei tempi sempre più congestionati che ci attendono, il bisogno di letteratura dovrà puntare sulla massima concentrazione della poesia e del pensiero.”
Roberto Magalotti - Augusto Sarti
Exactitude
70
“…il giusto uso del linguaggio per me è quello che permette di avvicinarsi alle cose (presenti o assenti) con discrezione e attenzione e cautela, col rispetto di ciò che le cose (presenti o assenti) comunicano senza parole.”
Roberto Magalotti - Augusto Sarti
Exactitude
71
“…il giusto uso del linguaggio per me è quello che permette di avvicinarsi alle cose (presenti o assenti) con discrezione e attenzione e cautela, col rispetto di ciò che le cose (presenti o assenti) comunicano senza parole.”
Roberto Magalotti - Augusto Sarti
Visibility
72
“La mente del poeta e, in qualche momento decisivo, la mente dello scienziato, funzionano secondo un proceimento di associazioni di immagine che è il sistema più veloce di collegare e scegliere tra le infinite forme del possibile e dell’impossibile.”
Roberto Magalotti - Augusto Sarti
Multiplicity
• Home systems § From 2-ch stereo... § ...to multichannel and sound bars
• Cinema Sound § From 5.1, 7.1, 10.1, 22.2.... § ...to 3D Sound (Dolby Atmos)
73
“Ogni vita è un’enciclopedia, una biblioteca, un inventario di oggetti, un campionario di stili, dove tutto può essere continuamente rimescolato e riordinato in tutti i modi possibili.”