![Page 1: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/1.jpg)
Minimally Naturalistic AISteven Hansen
![Page 2: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/2.jpg)
Outline
1. The Allegory of the Play-doh2. No Free Lunch3. Meta-Learning4. Imitation Learning5. Moving Forward6. Suggestions for COMM-AI
![Page 3: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/3.jpg)
Allegory Time!
Imagine you have a ball of play-doh
![Page 4: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/4.jpg)
Allegory Time!
Make a door-stop
![Page 5: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/5.jpg)
Allegory Time!
Make a paper-weight
![Page 6: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/6.jpg)
Allegory Time!
Make a spear
![Page 7: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/7.jpg)
Allegory Time!
Make an hamburger
![Page 8: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/8.jpg)
Allegory Time!
Make a computer
![Page 9: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/9.jpg)
Works fine:
● Door-stop● Paper-weight
Needs to be harder:
● spear
Needs to be more edible:
● hamburger
Needs to be more of a superconductor:
● computer
Allegory Time!
![Page 10: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/10.jpg)
Moral
● Inductive biases must sharpen as task complexity rises● The closer we get to human-level AI, the more naturalistic the tasks we
must train on
![Page 11: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/11.jpg)
No Free Lunch
?
?
?
![Page 12: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/12.jpg)
No Free Lunch
?
?
?
![Page 13: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/13.jpg)
But deep learning just works...
● Explicit priors aren’t the only way we shape the inductive bias● Convolutions and 2D equivariance● RNNs and repeated computation● Clockwork-RNNs and periodicity● NTMs and... turing machines
![Page 14: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/14.jpg)
Meta-learning / Learning-to-learn
● From tasks to task distributions● Learn an algorithm that can generalize
from few samples● “One-shot learning with
Memory-Augmented Neural Networks”○ Santoro et al 2016
![Page 15: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/15.jpg)
An Even Less Free Lunch
![Page 16: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/16.jpg)
An Even Less Free Lunch
![Page 17: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/17.jpg)
Imitation Learning
● Inverse reinforcement learning, apprenticeship learning, goal inference○ Supervised learning++
● Learn to copy your mentor by inferring their values/goal○ Generalize better than copying behavior
● Who is the mentor? A human or a program written by one.● Are we worth copying in artificial environments?● Would our goals in such environments have the same structure as in
natural environments?● These questions bound the naturalism required
![Page 18: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/18.jpg)
Moving Forward
1. Identify the next milestone where humans outperform AI2. Look for the regularities in that environment and in human performance3. Create artificial environments that still contain those regularities4. Look again if the AI fails to scale the real thing5. Remember that the regularities needed might include any previous
encountered environments!
![Page 19: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/19.jpg)
Some Regularities for COMM-AI
● Communication tasks tend to be encountered in a structured way○ The participants take into account each other's intelligence○ Tasks tend to be somewhat periodic
● Communication is grounded in sensory modalities○ Visual structure○ Auditory emotion cues
● Communication allows for rich feedback○ Observations of coherent episodes○ Occasional corrections
![Page 20: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/20.jpg)
Credit: Drew Purves
![Page 21: Minimally Naturalistic AI - GitHub Pages · Meta-learning / Learning-to-learn From tasks to task distributions Learn an algorithm that can generalize from few samples “One-shot](https://reader036.vdocuments.mx/reader036/viewer/2022081613/5fbdcfb5450b76092a516454/html5/thumbnails/21.jpg)
Questions?
Thanks for listening!