teaching ai to compose video game music · teaching ai to compose video game music. i am valerio...

16
Teaching AI to compose video game music

Upload: others

Post on 05-Apr-2020

11 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

Teaching AI to compose video game music

Page 2: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

I am Valerio Velardo, PhD

Cofounder & CEO @ Melodrive

[email protected]

Hello!

Page 3: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and
Page 4: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and
Page 5: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

◍ Constrained and finite

◍ Visuals can’t be tightly scored

◍ Laborious composition and integration

Issues with human-composed VGM

Page 6: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

Video game music

Page 8: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

What does the Melodrive engine do?

Composition Performance ProductionEmotional

API MusicGame params

User input

Page 9: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

What doesn’t work

Page 10: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and
Page 11: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

Challenges building Melodrive

◍ Music is ill-defined

◍ No ground truth

◍ Subjective assessment

Page 12: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

Reproducing the compositional process

Page 13: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

Modular AI approach

Page 14: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

Hybrid AI approach

Page 15: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

Takeaway lessons

● Deep learning isn’t always the solution

● Complex problems benefit from domain-rich representations

● Modular architectures work well with ill-defined problems

Page 16: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and

https://medium.com/the-sound-of-ai

@musikalkemist

valerio_velardo

[email protected]