lawrence du seattle final
TRANSCRIPT
Deep Convolutional Generative Adversarial Networks (DCGANs) for Creating Pixel Art
Lawrence Du
Creating art for mobile apps takes skill and money
Problem: The Costs of Making Art for Indie/Mobile GamesTotal cost of adding one new character: $109,000Artwork cost: $30,000
Problem: The Costs of Making Art for Indie/Mobile GamesTotal cost of adding one new character: $109,000Artwork cost: $30,000
Deep Learning for AI assisted art generation
Fake pictures of bedrooms created by deep neural network
One franchise built around pixel art...
Pokémon Red (released 1998)
Using Pokémon as a training set
● 64 x 64 x 3 pixels = 12,228 features per image ● 700+ Unique Pokémon ● 76,000+ animation frames
Feature engineering with images
● database used for eliminating shape outliers
● 231 Pokémon selected (19,231 frames)
● Expansion of training set size:
○ Brightness○ Hue○ Contrast○ Left-right transformations.
Feature engineering with images
● database used for eliminating outliers
● 231 Pokémon selected (19,231 frames)
● Expansion of training set size:
○ Brightness○ Hue○ Contrast○ Left-right transformations.
Feature engineering with images
● database used for eliminating outliers
● 231 Pokémon selected (19,231 frames)
● Expansion of training set size:
○ Brightness○ Hue○ Contrast○ Left-right transformations.
DEMO
www.DeepPixelMonster.com(TRY IT YOURSELF)
Alternate link: http://76.176.145.160:5000/
Implementation
● Written using
● 30+ neural architecture combinations tested.
● Training takes 20-30 minutes on GPU
● Front-end Python
● Amazon AWS
Implementation
DISCRIMINATOR
GENERATOR
Implementation
GENERATOR
Network Balancing
DISCRIMINATORLOSS
GENERATORLOSS
● LINE messenger - $238 million on stickers in 2015● Easier to send a sticker than to write Chinese characters (kanji)
Additional use cases for AI pixel art
Solution: Use Deep Learning for AI assisted art generation
Intelligent infill
AI generated music album covers
