the sound of grand theft auto vtwvideo01.ubm-us.net/o1/vault/gdc2014/presentations/... ·...

30
Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand Theft Auto V

Upload: others

Post on 09-Aug-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Alastair MacGregorLead Audio Programmer, Rockstar North

The Sound of Grand Theft Auto V

Page 2: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand
Page 3: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

RAGE Audio

Page 4: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

RAGE Audio: Core Goals●Cross platform ● Assets should sound as close as possible across target platforms

●Scalable to large projects ●High Performance ●Memory efficient ● Predictable streaming

Page 5: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

RAGE Audio: Core Features●Support modular asset design ●Voice virtualisation ●Flexible routing

Page 6: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Voice routing●V uses our own mixing engine ●PCM sources generate data ●Voices filter and route into sub-mixes ●1, 4 or 6 channel sub-mixes ●Interleaved or non-interleaved processing

Page 7: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Modular Sound Hierarchies

Page 8: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Modular Sound Hierarchies

Page 9: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Kinetic Sound

Page 10: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Sample Accuracy●Timing guarantees ●Sample accurate: ●Pre-delays ●Source-chaining/splicing ●Decode latency compensation

Page 11: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Asset Sizes

Streaming Assets

(hou

rs)

0

22.5

45

67.5

90

IV V

Radio ScoreCinematics

Metadata

0

20,000

40,000

60,000

80,000

IV V

GameObjects SoundsDynamicMixer Synth

Lines of Dialogue

0

40,000

80,000

120,000

160,000

IV V

Scripted Ambient

Page 12: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Wave Memory

WeaponsVehicles

Speech

Script

Score Radio PainMovement

Collision

Ambience

Ambience Animals Collision Doors ExplosionsFrontend Melee Misc. Movement PainRadio Scanner Score Script SpeechVehicles Weapons Weather

Weapons

Vehicles

SpeechScript

RadioMovement

Misc.

Collision

Ambience

IV V

Page 13: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Dynamic Mixing ●Audio is sliced into categories for mixing ●Patches specify changes to the mix ●Patches applied globally or to mix groups ●Scenes define mix groups and patches

Page 14: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Music ●Score: 8 stereo stems plus one-shots ●‘Moods’ define stem-mixes and transitions ●Events generated by script and code ●Actions optionally quantised to music

Page 15: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Vehicles ●Multiple layers: detail/close, mid and far ●Highways ●Distant one-shots ●“City noise”

Page 16: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Vehicles - individual detail●Granular engine ●Synthesised intake/induction, transmission ●Combination of samples and synth for traction/aero ●Suspension, chassis, rumble

Page 17: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Vehicles - Engine Recording●In-motion recordings ●Mostly omni mics

Page 18: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Granular Pipeline

Page 19: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Granular Pipeline

Page 20: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Granular Runtime●Separate engine and exhaust ●NPC engines use exported loop data ●Granular clock used to sync oscillators ●Real-time DSP post-processing

Page 21: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Synthesis

●Motivation: dynamic assets, fidelity, memory ●Designed to be accessible and encourage experimentation

Page 22: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand
Page 23: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

AMP

●Used to create a wide variety of asset components ●Particularly good for noise-based sounds ●Enabled sound-designer-authored effects chains

Page 24: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

AMP ●Automatic asset optimisation ●Real-time cost feedback ●Automated asset testing

Page 25: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Environmental Audio ●Striving to create an immersive world:

●Environment produces sound

●Affects sounds playing within it

●Responds to sound

Page 26: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

GTA IV Ambience

86 zones 57 rules 198 static emitters

Page 27: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

GTA V Ambience

949 zones 1210 rules 518 static emitters

Page 28: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Environmental Audio ●Distance effects ●Occlusion ●Reflections ●Reverberation

Page 29: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

Environmental Audio ●Resonances ●Shockwaves

Page 30: The Sound of Grand Theft Auto Vtwvideo01.ubm-us.net/o1/vault/GDC2014/Presentations/... · 2014-03-24 · Alastair MacGregor Lead Audio Programmer, Rockstar North The Sound of Grand

●Thanks for listening! !

!

!

!

!

!

rockstargames.com/jobs