artificial intelligence, lecture 16.1, page 1 · perfect rationality or bounded rationality ......
TRANSCRIPT
![Page 1: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/1.jpg)
Course Overview
Agents acting in an environment
Future and Ethics of AI
Dimensions of complexity
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 1
![Page 2: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/2.jpg)
What is Artificial Intelligence?
Artificial Intelligence is the synthesis and analysis ofcomputational agents that act intelligently.
An agent is something that acts in an environment.
An agent acts intelligently if:I its actions are appropriate for its goals and circumstancesI it is flexible to changing environments and goalsI it learns from experienceI it makes appropriate choices given perceptual and
computational limitations
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 2
![Page 3: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/3.jpg)
Agents acting in an environment
Prior Knowledge
Environment
StimuliActions
Past Experiences
Goals/Preferences
Agent
Abilities
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 3
![Page 4: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/4.jpg)
Inside Black Box
Learner Inference Engine
offline online
Prior Knowledge
Past Experiences/Data
ObservationsGoals/Preference
Actions
Abilities
KB
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 4
![Page 5: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/5.jpg)
Controller
memories Controller
percepts commands
Body
memories
Environment
stimuli actionsAgent
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 5
![Page 6: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/6.jpg)
Functions implemented in a controller
memories
percepts commands
memories
For discrete time, a controller implements:
belief state function returns next belief state / memory.What should it remember?
command function returns commands to body.What should it do?
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 6
![Page 7: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/7.jpg)
Future and Ethics of AI
What will super-intelligent AI bring?
I Automation and unemployment? What if people are notlonger needed to make economy work?
I Smart weapons? Automated terrorists?
What will a super-intelligent AI be able to do better?I predict the futureI optimize (constrained optimization)
Whose values/goals will they use? (Why?)
Will we need a new ethics of AI?
Is super-human AI inevitable (wait till computers getfaster)? (Singularity)Is there fundamental research to be done?Is it easy because humans are not as intelligent as we liketo think?
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 7
![Page 8: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/8.jpg)
Future and Ethics of AI
What will super-intelligent AI bring?I Automation and unemployment? What if people are not
longer needed to make economy work?
I Smart weapons? Automated terrorists?
What will a super-intelligent AI be able to do better?I predict the futureI optimize (constrained optimization)
Whose values/goals will they use? (Why?)
Will we need a new ethics of AI?
Is super-human AI inevitable (wait till computers getfaster)? (Singularity)Is there fundamental research to be done?Is it easy because humans are not as intelligent as we liketo think?
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 8
![Page 9: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/9.jpg)
Future and Ethics of AI
What will super-intelligent AI bring?I Automation and unemployment? What if people are not
longer needed to make economy work?I Smart weapons? Automated terrorists?
What will a super-intelligent AI be able to do better?I predict the futureI optimize (constrained optimization)
Whose values/goals will they use? (Why?)
Will we need a new ethics of AI?
Is super-human AI inevitable (wait till computers getfaster)? (Singularity)Is there fundamental research to be done?Is it easy because humans are not as intelligent as we liketo think?
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 9
![Page 10: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/10.jpg)
Future and Ethics of AI
What will super-intelligent AI bring?I Automation and unemployment? What if people are not
longer needed to make economy work?I Smart weapons? Automated terrorists?
What will a super-intelligent AI be able to do better?
I predict the futureI optimize (constrained optimization)
Whose values/goals will they use? (Why?)
Will we need a new ethics of AI?
Is super-human AI inevitable (wait till computers getfaster)? (Singularity)Is there fundamental research to be done?Is it easy because humans are not as intelligent as we liketo think?
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 10
![Page 11: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/11.jpg)
Future and Ethics of AI
What will super-intelligent AI bring?I Automation and unemployment? What if people are not
longer needed to make economy work?I Smart weapons? Automated terrorists?
What will a super-intelligent AI be able to do better?I predict the futureI optimize (constrained optimization)
Whose values/goals will they use? (Why?)
Will we need a new ethics of AI?
Is super-human AI inevitable (wait till computers getfaster)? (Singularity)Is there fundamental research to be done?Is it easy because humans are not as intelligent as we liketo think?
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 11
![Page 12: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/12.jpg)
Future and Ethics of AI
What will super-intelligent AI bring?I Automation and unemployment? What if people are not
longer needed to make economy work?I Smart weapons? Automated terrorists?
What will a super-intelligent AI be able to do better?I predict the futureI optimize (constrained optimization)
Whose values/goals will they use? (Why?)
Will we need a new ethics of AI?
Is super-human AI inevitable (wait till computers getfaster)? (Singularity)Is there fundamental research to be done?Is it easy because humans are not as intelligent as we liketo think?
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 12
![Page 13: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/13.jpg)
Future and Ethics of AI
What will super-intelligent AI bring?I Automation and unemployment? What if people are not
longer needed to make economy work?I Smart weapons? Automated terrorists?
What will a super-intelligent AI be able to do better?I predict the futureI optimize (constrained optimization)
Whose values/goals will they use? (Why?)
Will we need a new ethics of AI?
Is super-human AI inevitable (wait till computers getfaster)? (Singularity)Is there fundamental research to be done?Is it easy because humans are not as intelligent as we liketo think?
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 13
![Page 14: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/14.jpg)
Future and Ethics of AI
What will super-intelligent AI bring?I Automation and unemployment? What if people are not
longer needed to make economy work?I Smart weapons? Automated terrorists?
What will a super-intelligent AI be able to do better?I predict the futureI optimize (constrained optimization)
Whose values/goals will they use? (Why?)
Will we need a new ethics of AI?
Is super-human AI inevitable (wait till computers getfaster)? (Singularity)Is there fundamental research to be done?Is it easy because humans are not as intelligent as we liketo think?
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 14
![Page 15: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/15.jpg)
Dimensions of Complexity
Flat or modular or hierarchical
Explicit states or features or individuals and relations
Static or finite stage or indefinite stage or infinite stage
Fully observable or partially observable
Deterministic or stochastic dynamics
Goals or complex preferences
Single-agent or multiple agents
Knowledge is given or knowledge is learned fromexperience
Reason offline or reason while interacting withenvironment
Perfect rationality or bounded rationality
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 15
![Page 16: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/16.jpg)
State-space Search
flat or modular or hierarchical
explicit states or features or individuals and relations
static or finite stage or indefinite stage or infinite stage
fully observable or partially observable
deterministic or stochastic dynamics
goals or complex preferences
single agent or multiple agents
knowledge is given or knowledge is learned
reason offline or reason while interacting with environment
perfect rationality or bounded rationality
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 16
![Page 17: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/17.jpg)
Classical Planning
flat or modular or hierarchical
explicit states or features or individuals and relations
static or finite stage or indefinite stage or infinite stage
fully observable or partially observable
deterministic or stochastic dynamics
goals or complex preferences
single agent or multiple agents
knowledge is given or knowledge is learned
reason offline or reason while interacting with environment
perfect rationality or bounded rationality
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 17
![Page 18: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/18.jpg)
Decision Networks
flat or modular or hierarchical
explicit states or features or individuals and relations
static or finite stage or indefinite stage or infinite stage
fully observable or partially observable
deterministic or stochastic dynamics
goals or complex preferences
single agent or multiple agents
knowledge is given or knowledge is learned
reason offline or reason while interacting with environment
perfect rationality or bounded rationality
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 18
![Page 19: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/19.jpg)
Markov Decision Processes (MDPs)
flat or modular or hierarchical
explicit states or features or individuals and relations
static or finite stage or indefinite stage or infinite stage
fully observable or partially observable
deterministic or stochastic dynamics
goals or complex preferences
single agent or multiple agents
knowledge is given or knowledge is learned
reason offline or reason while interacting with environment
perfect rationality or bounded rationality
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 19
![Page 20: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/20.jpg)
Decision-theoretic Planning
flat or modular or hierarchical
explicit states or features or individuals and relations
static or finite stage or indefinite stage or infinite stage
fully observable or partially observable
deterministic or stochastic dynamics
goals or complex preferences
single agent or multiple agents
knowledge is given or knowledge is learned
reason offline or reason while interacting with environment
perfect rationality or bounded rationality
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 20
![Page 21: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/21.jpg)
Reinforcement Learning
flat or modular or hierarchical
explicit states or features or individuals and relations
static or finite stage or indefinite stage or infinite stage
fully observable or partially observable
deterministic or stochastic dynamics
goals or complex preferences
single agent or multiple agents
knowledge is given or knowledge is learned
reason offline or reason while interacting with environment
perfect rationality or bounded rationality
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 21
![Page 22: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/22.jpg)
Relational Reinforcement Learning
flat or modular or hierarchical
explicit states or features or individuals and relations
static or finite stage or indefinite stage or infinite stage
fully observable or partially observable
deterministic or stochastic dynamics
goals or complex preferences
single agent or multiple agents
knowledge is given or knowledge is learned
reason offline or reason while interacting with environment
perfect rationality or bounded rationality
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 22
![Page 23: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/23.jpg)
Classical Game Theory
flat or modular or hierarchical
explicit states or features or individuals and relations
static or finite stage or indefinite stage or infinite stage
fully observable or partially observable
deterministic or stochastic dynamics
goals or complex preferences
single agent or multiple agents
knowledge is given or knowledge is learned
reason offline or reason while interacting with environment
perfect rationality or bounded rationality
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 23
![Page 24: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/24.jpg)
Humans
flat or modular or hierarchical
explicit states or features or individuals and relations
static or finite stage or indefinite stage or infinite stage
fully observable or partially observable
deterministic or stochastic dynamics
goals or complex preferences
single agent or multiple agents
knowledge is given or knowledge is learned
reason offline or reason while interacting with environment
perfect rationality or bounded rationality
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 24
![Page 25: Artificial Intelligence, Lecture 16.1, Page 1 · Perfect rationality or bounded rationality ... Lecture 16.1, Page 15. State-space Search ator modular or hierarchical explicit statesor](https://reader033.vdocuments.mx/reader033/viewer/2022050404/5f816196c29a6567d2544ce9/html5/thumbnails/25.jpg)
Comparison of Some Representations
CP MDPs IDs RL POMDPs GThierarchical 4
properties 4 4 4
relational 4
indefinite stage 4 4 4 4
stochastic dynamics 4 4 4 4 4
partially observable 4 4 4
values 4 4 4 4 4
dynamics not given 4
multiple agents 4
bounded rationality
c©D. Poole and A. Mackworth 2016 Artificial Intelligence, Lecture 16.1, Page 25