magnus nordin at ai frontiers: deep learning for game development
TRANSCRIPT
![Page 1: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/1.jpg)
Deep Learning
for
Game Development
Magnus NordinTechnical Director, EA SEED
![Page 2: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/2.jpg)
![Page 3: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/3.jpg)
![Page 4: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/4.jpg)
Future Worlds
Deep LearningVirtual Humans
Prototypes
![Page 5: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/5.jpg)
f( ) = cat
![Page 6: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/6.jpg)
f( ) =
f( ) =
”A person flying a kite
on a beach”
”A coffee, please.”
![Page 7: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/7.jpg)
f( ) =”A coffee, please.”
f( ) =
![Page 8: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/8.jpg)
f( ) =This bird is red and brown in
color, with a stubby beak
f( ) =This flower is pink, white,
and yellow in color, and
has petals that are striped
StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks, Zhang et al, 2016
![Page 9: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/9.jpg)
f( ) =
![Page 10: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/10.jpg)
Reinforcement Learning for
Game AI
![Page 11: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/11.jpg)
1987 2015
![Page 12: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/12.jpg)
Reinforcement Learning
Observations/Rewards
AgentEnvironment
Goal
Actions
Learning by doing
![Page 13: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/13.jpg)
Bad Balls
Our hero
Eat! +1 point
Avoid! -5 points
![Page 14: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/14.jpg)
![Page 15: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/15.jpg)
![Page 16: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/16.jpg)
![Page 17: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/17.jpg)
EA Trailer
![Page 18: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/18.jpg)
![Page 19: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/19.jpg)
![Page 20: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/20.jpg)
![Page 21: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/21.jpg)
Single-Action vs Multi-Action
![Page 22: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/22.jpg)
Objective area
The agent
Health
The opposition
Supplies
![Page 23: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/23.jpg)
50M steps of training
![Page 24: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/24.jpg)
![Page 25: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/25.jpg)
100M steps of training
![Page 26: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/26.jpg)
![Page 27: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/27.jpg)
![Page 28: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/28.jpg)
Generalization
![Page 29: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/29.jpg)
![Page 30: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/30.jpg)
Challenges
Observation (vision vs state)
Combining with classical game AI
Giving designers controlGoals
Imitation
Execution (GPUs are typically busy with graphics ☺)
![Page 31: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/31.jpg)
Machine Learning Gaming Use Cases
![Page 32: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/32.jpg)
![Page 33: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/33.jpg)
Physics
Physics Forests: Real-time Fluid Simulation using Machine Learning, Ladicky et al., 2015, www.physicsforests.com
![Page 34: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/34.jpg)
GAN geometry
Interactive Example Based Terrain Authoring with Conditional Adversarial Networks, Guérin et al, 2017
![Page 35: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/35.jpg)
Representation Learning and Adversarial Generation of 3D Point Clouds, Achlioptas et al., 2017
![Page 36: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/36.jpg)
• Needs to be Full of Life (Spore connection?)
![Page 37: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/37.jpg)
Emergence of Locomotion Behaviours in Rich Environments, Heess et al., 2017
![Page 38: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/38.jpg)
El último vals
A Neural Parametric Singing Synthesizer, Blaauw & Bonada, 2017
![Page 39: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/39.jpg)
Audio-Driven Facial Animation by Joint End-to-End Learning of Pose and Emotion, Karras et al., 2017, NVIDIA
![Page 40: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/40.jpg)
The Future
![Page 41: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/41.jpg)
![Page 42: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/42.jpg)
Geek & Sundry, D&Diesel
![Page 43: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/43.jpg)
[clip]
• Live role playing
![Page 44: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/44.jpg)
MMORPG
![Page 45: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/45.jpg)
MMO(RPG)s
• Not much RPG [pic of WoW raid]
• hence ”MMOs”
![Page 46: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/46.jpg)
True Role Playing
![Page 47: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/47.jpg)
![Page 48: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/48.jpg)
f( ) =
f( ) =
![Page 49: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/49.jpg)
Sopranos © HBO 2006
![Page 50: Magnus Nordin at AI Frontiers: Deep Learning for Game Development](https://reader031.vdocuments.mx/reader031/viewer/2022021923/5a67671b7f8b9a656a8b4e35/html5/thumbnails/50.jpg)
Games will change more in the next 5 years than they have in the last 45 years
Magnus NordinTechnical Director, EA SEED