conversation as action under uncertainty tim paek eric horvitz
TRANSCRIPT
![Page 1: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/1.jpg)
Conversation as Action Under UncertaintyConversation as Action Under Uncertainty
Tim Paek
Eric Horvitz
![Page 2: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/2.jpg)
AbstractAbstract
Conversation uncertainties of various kinds
Quartet architecture Inference/Decision making under uncertainty 4 levels of analysis Representations Inference procedures Decision strategies
Interaction between a user and dialog system
![Page 3: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/3.jpg)
1. Introduction1. Introduction
Spoken dialog system robust, unified architecture for sharing key uncertainties
Quartet
![Page 4: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/4.jpg)
2. Toward an Architecture for 2. Toward an Architecture for ConversationConversation
General conversation To make themselves understood Uncertainty: communication failure Collaborate/establish mutual belief “feedback” = coordination
• Head nod, “uh huh”
• Clear up uncertainties, take other measures
• Conversation = collaborative effort or joint activity
![Page 5: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/5.jpg)
Grounding 상호 이해를 위해 대화의 presentation 또는 acceptance 를
coordinate 하는 과정 Consideration of how key uncertainties depend on each other and
influence mutual understanding What decisions to make in light of these uncertainties
![Page 6: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/6.jpg)
Quartet Treat grounding as decision making under uncertainty Key uncertainty Bayesian Network Local expected utility/VOI
• Identify action maximize mutual understanding
Focus on handling uncertainties Enable dialog system to adapt strategies Allow components to share uncertainties
![Page 7: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/7.jpg)
2.1 Four Levels of Analysis2.1 Four Levels of Analysis
Evaluate grouding at 4 levels of analysis 4 Levels
Channel level Signal level Intention level: signal 의 semantics 이해 Conversation level
All levels need coordination/collaboration Unified architecture
Model probabilistic dependencies between levels
![Page 8: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/8.jpg)
![Page 9: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/9.jpg)
2.2 Models, Inference, Decisions2.2 Models, Inference, Decisions
atemporal/temporal Bayesian networks compute likelihood of variables of interest Ex) overall grounding status
![Page 10: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/10.jpg)
2.2.1 Modularity2.2.1 Modularity
Maintenance module handle uncertainties about channel and signal levels
Intention module About intention level
Conversation control Keep track of the grounding status Where to focus on resolving uncertainties What grounding actions to take in light of their likely costs/benefits
![Page 11: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/11.jpg)
Reasons for distinct modules Probabilistic dependencies
• abundant with the modules
• sparse between them
Enhancement of the flexibility of Quartet• To be applied to variety of task domains
Belief, decision, degree of detailed necessary for each level varied significantly depending on the communication medium or modality
![Page 12: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/12.jpg)
![Page 13: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/13.jpg)
![Page 14: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/14.jpg)
2.2.2 Representation for Decision Making2.2.2 Representation for Decision Making
Grouding status Diagnoses the overall mutual understanding
![Page 15: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/15.jpg)
2.2.3 Refinement through Value of 2.2.3 Refinement through Value of InformationInformation
Need to refine actions by sharing uncertainties Utterance design
improve understanding
Conversation decision making Capitalize on VOI analysis to ask questions, make
recommendations, and seek out information
![Page 16: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/16.jpg)
VOI analysis• find best evidence in light of the inferred probabilities
Compute VOI 모든 observation 에 대해 expected utility of the best decision 을
계산 VOI recommend a piece of evidence to observe: system 이
recommendation 제공 또는 phrase a question
![Page 17: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/17.jpg)
Exact computation of VOI all possible sequences of observations
Greedy VOI: reasonable approximation
![Page 18: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/18.jpg)
3. Runtime Behavior3. Runtime Behavior
Dialog system ASR NLPWin parser Face-pose tracker
![Page 19: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/19.jpg)
3.1 Providing Services3.1 Providing Services
완전 이해후의 highest expected utility action User 와 requested action 을 연관시키는 것
![Page 20: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/20.jpg)
![Page 21: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/21.jpg)
3.2 Exploiting Multiple Levels3.2 Exploiting Multiple Levels
Goal 이 not so clear at the intention level Consider uncertainties at lower levels of analysis
![Page 22: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/22.jpg)
![Page 23: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/23.jpg)
3.3 Adapting Strategies over Time3.3 Adapting Strategies over Time
Mutual understanding 이 fluctuate adapt strategy over time
Do requested service / resort to only three repair strategies ASK REPEAT, CONFIRM, TROUBLESHOOT (use VOI
analyses to recommend procedures to improve mutual understanding)
![Page 24: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/24.jpg)
![Page 25: Conversation as Action Under Uncertainty Tim Paek Eric Horvitz](https://reader036.vdocuments.mx/reader036/viewer/2022070412/56649f045503460f94c182bf/html5/thumbnails/25.jpg)
4. Conclusions4. Conclusions
Approach to continuous spoken dialog centering on an architecture called Quartet