against forward models - moving ai...

31
expressive intelligence studio UC Santa Cruz Joseph C. Osborn ([email protected]) Michael Mateas ([email protected]) Against Forward Models

Upload: others

Post on 20-May-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio

UC Santa Cruz

Joseph C. Osborn ([email protected])Michael Mateas ([email protected])

Against Forward Models

Page 2: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Generalizations Ahead

Page 3: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Forward search is great

Page 4: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

MCTS is great

Page 5: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

RTS AI is great

Page 6: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Deep Q-Learning is great

Page 7: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Very pragmatic

Page 8: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Very pragmatic boring

Page 9: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Computers beat humans at <game>

Page 10: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Thousands ofComputers beat humans

at <game> using tons of electricity

Page 11: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

And it doesn’t scale

Page 12: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz© Hrist Valkyrja, https://www.youtube.com/watch?v=zHvNIOAISqk

Page 13: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz© Hrist Valkyrja, https://www.youtube.com/watch?v=zHvNIOAISqk

Page 14: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruzhttps://www.nintendo.co.jp/clv/manuals/en/pdf/CLV-P-NABJE.pdf

Page 15: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

General game playing=

Software model checking?

Page 16: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

General game playing

≠Software model

checking?

Page 17: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Symbolic execution

Page 18: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Symbolic execution

Bounded model checking

Page 19: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Symbolic execution

Bounded model checkingCounter-example-guided

abstraction refinement

Page 20: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Symbolic execution

Bounded model checkingCounter-example-guided

abstraction refinement

Concolic execution

Page 21: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Recent heuristic learning agents are great

Page 22: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

More of that please,but like way more,

and also other stuff

Page 23: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Modeling languagesdon’t help (yet)

Page 24: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Learn more from fewer trials

Page 25: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Speculate, don’t simulate

Page 26: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Abstract more

Page 27: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Summerville, Snodgrass, Mateas, Ontañón: The Videogame Level Corpus, 7th PCG Workshop (2016)

Page 28: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Fasterholdt, Pichlmair, Holmgård: You Say Jump, I Say How High? Operationalizing the Game Feel of Jumping, DiGRA 2016

Page 29: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

PROPOSAL:GVG Rule-Reading Track

Page 30: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

PROPOSAL:“No Takebacks” Track

Page 31: Against Forward Models - Moving AI Labmovingai.com/aigames17/slides/osborn-against-fms.pdfexpressiveintelligence studio UC Santa Cruz Joseph C. Osborn (jcosborn@soe.ucsc.edu) Michael

expressive intelligence studio UC Santa Cruz

Forward search is the last resort