intelligent machines - microsoft.com · intelligent machines hermann hauser cambridge july 2018...
TRANSCRIPT
![Page 1: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/1.jpg)
Intelligent MachinesHermann Hauser Cambridge July 2018
Evolution Design
![Page 2: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/2.jpg)
Biological Machines
Neurons
Think: Brains
Hear: Ears
See: Eyes
Move: Legs
Learn: Schools
Disruption
Evolution
Human Goals
Artificial Machines
Transistors
Computers
Microphones
Cameras
Robots
Machine Learning
Cars, Healthcare
Design
Contents
![Page 3: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/3.jpg)
Neurons vs. Transistors
Size: 20um
Speed: 1kHz
Brain: 100bn
Connections: 100tr
20nm 1000x
1GHZ 1,000,000x
10bn 1/10x
Internet: 1bn hosts
20bn IOT connected
![Page 4: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/4.jpg)
Soma
Dendrites
Axons with myelin sheaths
Synapses
Voltage gated Ion channels
Hodgekin-Huxley model
Neurons
![Page 5: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/5.jpg)
• Source, Gate, Drain
• Simple, uniform
• Universal building block:
• NAND GATE
Transistors
![Page 6: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/6.jpg)
Think
![Page 7: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/7.jpg)
Capacity:
10 to 100TB
Processing power:
10Peta-1ExaFLOPS
Power consumption:
20W
Connections: 100tr
500TB 5x
10TeraFLOPS:
1000x
200kW 10,000x
Memory 512GB
1g
Brains vs. Computers
GPU Graphical Processing
Unit
![Page 8: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/8.jpg)
Neural Networks
![Page 9: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/9.jpg)
• MRI picture from Oxford
• 200 different brain regions
• 461 people
Human Connectome
![Page 10: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/10.jpg)
Graphcore IPU
(Intelligent Processing Unit)
• Graphcore
• 7,000 processors
• 350MB RAM
• largest chip in the world: inch a side
• BSP: Bulk Synchronisation Protocol
![Page 11: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/11.jpg)
Hear
![Page 12: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/12.jpg)
Frequency:
20-20kHz
Loudness:
0 to 120dB
Sound localisation:
5deg
20- GHz Ultrasound
10 to 220dB SaturnV
much finer
Ears vs Microphones
Hear
https://youtu.be/-7xvqQeoA8c
![Page 13: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/13.jpg)
• Amazon Echo
• Software from EVI
• Xmos working on best HW solution
• Hearing people across a crowded room
• Voice recognition across a room
Beam forming Microphone
![Page 14: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/14.jpg)
See
![Page 15: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/15.jpg)
Resolution:
0.1mm
Speed:
1/100 sec
Frequency
430-770THz
Number: 2
Angstrom: 1,000,000x
psec: 10^10x
3Hz-300EHz
100,000
Eyes
Camera
![Page 16: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/16.jpg)
![Page 17: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/17.jpg)
• At least 100k webcams
• Autonomous vehicles will need 6 to 16
• Connected cars will get info from cars in
front and CCTV
Many Cameras
![Page 19: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/19.jpg)
Millenials
• Transport as a service
• No interest in driving
• Live in cities
• Get their information on the web
![Page 20: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/20.jpg)
Move
![Page 22: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/22.jpg)
Learn
![Page 23: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/23.jpg)
What is Machine Learning?
Systems that learn from data rather then following
pre-programmed rules
(Royal Society ML Report)
![Page 24: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/24.jpg)
Branches of ML
• SUPERVISED ML: trained on LABELED DATA
• UNSUPERVISED ML: without labels
•
• REINFORCEMENT ML: learning from experience, reward
function (winning game)
• INVERSE REINFORCEMENT ML: system has to deduce
reward function buy observation (driving a car)
![Page 25: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/25.jpg)
ML Examples
• Speech recognition: Google, Siri, Alexa
• Object / Face recognition: Google Photo
• Recommender systems: Amazon, Netflix
![Page 26: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/26.jpg)
Probablility and ML
• NOT 0s and 1s but P for Probability
• NOT deterministic but STATISTICAL
• NOT programming but TEACHING
• Needs Big Data
• Needs (Human) GOALS
• Genie Problem
![Page 27: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/27.jpg)
Artificial Intelligence
![Page 28: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/28.jpg)
AI Risks
“Success in creating AI would be the
biggest event in human history.
Unfortunately, it might also be the last,
unless we learn how to avoid the risks.”
“Hope we’re not just the biological boot
loader for digital superintelligence.
Unfortunately, that is increasingly
probable.” 28
![Page 29: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/29.jpg)
Life 3.0
![Page 30: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/30.jpg)
Evonetix
The GeneSynthesis
Company
Pixelflo
w
![Page 31: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/31.jpg)
AlphaGo
Move 37
in game 2
Move 78
in game 4
![Page 32: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/32.jpg)
Disruption
![Page 33: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/33.jpg)
ARM Business model
Intel ARM
Customer Dell,HP Samsung,Apple
Chipfab Intel TSMC+450
Design Intel ARM
Intellectual
PropertyIntel ARM
![Page 34: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/34.jpg)
ARM
• 100bn shipped >10x population of earth
• $30bn sale to Softbank
• >95% market share in phones
• ARM:Intel = 20:1
• ARMs 450 licensees: ARM $ > Intel Revenue
• Licensing model
• Low power
![Page 35: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/35.jpg)
ML effect on Car industry
Today With ML
Customer Showroom Uber
Autonomous SW BMW, Tesla Uber, FiveAI
Car BMW,Tesla BYD, KIA
Components Bosch China
![Page 36: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/36.jpg)
Trillion $ Opportunity
• US spends $3tr on Healthcare
• Treating ill people: 70%
• Keeping them healthy: 30%
• Expected to change to 50:50 in 5 yrs
![Page 37: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/37.jpg)
ML effect on Pharma
Today With ML
Customer Patient Healthy person
Provider Doctor/hospital e-Health
Supplier PharmaPersonalised
Advice
Components Drugs Data
![Page 38: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/38.jpg)
Evolution vs DesignEvolution vs. Design
![Page 39: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:](https://reader033.vdocuments.mx/reader033/viewer/2022052614/605d3a8bfd11841f755fe523/html5/thumbnails/39.jpg)
• Humanity has a new partner:
• Intelligent Machines
• How to co-evolve with them?
Conclusion