cs 4100/5100 foundations of ai - northeastern university · artificial intelligence: a modern...
TRANSCRIPT
![Page 1: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/1.jpg)
CS 4100/5100
Foundations of AI
course introduction, intelligent agents
image credit: cuson (deviantart)
http://cuson.deviantart.com/art/play-chess-with-robot-61467927
![Page 2: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/2.jpg)
A bit about me…
“The Tea
Pa
rty”, by b
ou
m (D
eviantA
rt)
![Page 3: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/3.jpg)
Class Overview
Provide a broad foundation in core AI topics:
Logic and reasoning
Planning
Heuristic search
Knowledge representation
Machine learning
Website: http://www.ccs.neu.edu/course/cs5100f12
![Page 4: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/4.jpg)
Class Overview
Course Participation: 10%
Midterm Exam: 20%
Assignments: 35%
Final Project: 35%
![Page 5: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/5.jpg)
Getting Assistance
Professor: Gillian Smith
Office hours: Tuesdays 2-4pm, WVH 478
or by appointment
TA: Cheng Li
Office hours: TBA
![Page 6: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/6.jpg)
Textbook
Artificial Intelligence: A Modern Approach
Third Edition
Stuart Russell, Peter Norvig
![Page 7: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/7.jpg)
Course Participation
Additional readings
Discussion in-class
Piazza online discussion forum
Link is in the syllabus
![Page 8: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/8.jpg)
Reading Responses
One page, due at noon on the day of class
Brief, two sentence summary of the reading
The rest should be your opinion What are the shortcomings of the work?
What would you do to extend it?
What is the future work?
Is there anything you strongly disagree with? Strongly agree with?
How does the paper relate to your interests?
![Page 9: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/9.jpg)
Collaboration Policy
I encourage you to… Share ideas with other students
Work together to come up with general solutions
Discuss papers prior to response
I require you to… Write your own code for assignments
Understand every aspect of code you turn in
Give detailed credit to people you have worked with or online resources
Ask if you have any questions about this policy
Plagiarism and copying is strictly forbidden, and will result in disciplinary action.
![Page 10: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/10.jpg)
Collaboration Policy
I encourage you to… Share ideas with other students
Work together to come up with general solutions
Discuss papers prior to response
I require you to… Write your own code for assignments
Understand every aspect of code you turn in
Give detailed credit to people you have worked with or online resources
Ask if you have any questions about this policy
Plagiarism and copying is strictly forbidden, and will result in disciplinary action.
![Page 11: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/11.jpg)
Late Policy
Every day an assignment is late, 10% off
Each of you has five late days
Split them across assignments as you wish
Use for planned absences or unexpected issues
For assignments only
When turning in assignment late, specify how many late days you will use
Unexpected, longer-term emergencies: see me!
![Page 12: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/12.jpg)
Final Projects
Groups of 3-4 students More or less by my permission only (and have a really
good reason)
Your choice of topic
Phases: Pitch: October 4th
Proposal: October 18th
Presentation: November 29th/December 6th
Paper: December 13th
![Page 13: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/13.jpg)
Questions?
![Page 14: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/14.jpg)
A BRIEF HISTORY OF AI
![Page 15: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/15.jpg)
1956: The Birth of AI
…solve kinds of problems now reserved for humans… …significant advance
can be made in one or more of these problems if a carefully selected group of scientists work on it together for a summer…
![Page 16: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/16.jpg)
1960s: Initial Optimism
Playing checkers (Arthur Samuel)
General Problem Solver (Allen Newell & Herbert Simon)
![Page 17: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/17.jpg)
means-end analysis
Cornerstone of the General Problem Solver
Used now in planners and other search problems
image credit: http://www-rci.rutgers.edu/~cfs/472_html/Planning/GPS_472.html
![Page 18: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/18.jpg)
1970s – 80s: Knowledge-Based Systems
Microworlds
SHRDLU
“Expert” systems
DENDRAL, MYCIN
knowledge acquisition bottleneck
![Page 19: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/19.jpg)
1980s – 90s: The AI Winter
Overcoming the KA bottleneck
Industry oversells AI’s promise
![Page 20: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/20.jpg)
1990s: Resurgence
Probabilistic approaches
Adoption of scientific rigor
Return to dreams of human-level AI
![Page 21: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/21.jpg)
2000s: Big Data
Focus on data
Solution to KA bottleneck?
![Page 22: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/22.jpg)
AI APPLICATION AREAS
![Page 23: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/23.jpg)
Games
![Page 24: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/24.jpg)
Robotics
![Page 25: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/25.jpg)
Computer Vision
![Page 26: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/26.jpg)
Machine Translation
![Page 27: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/27.jpg)
Scheduling
![Page 28: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/28.jpg)
Creativity
![Page 29: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/29.jpg)
Natural Language Understanding
![Page 30: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/30.jpg)
INTELLIGENT AGENTS
![Page 31: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/31.jpg)
Thinking Humanly
Cognitive modeling
Focus not just on correct answers, but on how you get there
![Page 32: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/32.jpg)
Acting Humanly
Turing Test
Focus areas:
Natural Language Processing
Knowledge Representation
Automated Reasoning
Machine Learning
Computer Vision
Robotics
![Page 33: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/33.jpg)
ELIZA
Person : Men are all alike.
ELIZA : In what way?
Person : They're always bugging us about something or other.
ELIZA : Can you think of a specific example?
Person : Well, my boyfriend made me come here.
ELIZA : Your boyfriend made you come here?
Person : He says I'm depressed much of the time.
ELIZA : I am sorry to hear that you are depressed.
Person : It's true. I am unhappy.
ELIZA : Do you think coming here will help you not to be unhappy?
Person : I need some help, that much seems certain.
ELIZA : What would it mean to you if you got some help?
Person : Perhaps I could learn to get along with my mother.
ELIZA : Tell me more about your family
![Page 34: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/34.jpg)
Thinking Rationally
Purely logical thought and reasoning
Mathematically well-defined
Problems with scalability and expressiveness
![Page 35: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/35.jpg)
Acting Rationally
Acting towards a goal
Always doing the “right” thing
![Page 36: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/36.jpg)
Agent-Based AI
![Page 37: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/37.jpg)
Agent Design
What can the agent do? Range of actions
What is the environment? (Input: percepts) How is it interpreted?
What does the agent know? History of previous inputs and actions (how far back?) Properties of environment: world knowledge Knowledge of its own goals and preferences Strategies for behavior
How does the agent choose to act? Mapping from percept sequence -> action called an
agent function
![Page 38: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/38.jpg)
Example: Vacuum Cleaner World
What are the actions? What are the percepts?
![Page 39: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/39.jpg)
Kinds of Agents: Simple Reflex Agent
![Page 40: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/40.jpg)
Kinds of Agents: Model-Based Agent
![Page 41: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/41.jpg)
Kinds of Agents: Goal-Based Agent
![Page 42: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/42.jpg)
Kinds of Agents: Utility-Based Agent
![Page 43: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/43.jpg)
Kinds of Agents: Learning Agent
![Page 44: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/44.jpg)
Group Exercise: Design a Taxi Agent
![Page 45: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/45.jpg)
Knowledge Representation: Goals
General purpose
Environment and behavior
Consequences of behavior
Well-structured, represent to computer
![Page 46: CS 4100/5100 Foundations of AI - Northeastern University · Artificial Intelligence: A Modern Approach Third Edition Stuart Russell, Peter Norvig . Course Participation Additional](https://reader033.vdocuments.mx/reader033/viewer/2022052004/60173540b552967ac075e938/html5/thumbnails/46.jpg)
Knowledge Representation: Solution
Formal logic!