a pragmatic approach to implementation of emotional
Post on 16-May-2022
2 Views
Preview:
TRANSCRIPT
A Pragmatic Approach
to Implementation of Emotional
Intelligence in Machines
Michal Ptaszynski Rafal Rzepka Kenji Araki
Language Media Laboratory
Graduate School of Information Science and Technology
Hokkaido University
Presentation Outline
1. Affective Computing (AC) - a bit of criticism
2. Our approach - Pragmatism in AC research
3. What we did already - AC through Pragmatics
4. (Near and Far) Future Work
2 5-7 November 2009AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09),
Affective Computing – Criticism
3 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Affective Computing – Criticism
4
Goal of Affective Computing
(Picard, 1995, 1997):
AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
To create a machine able to
understand the emotions of
a user and adapt its behavior
according to them.
R. W. Picard, "Affective Computing," MIT-TR, 321, 1995
R. W. Picard, Affective Computing, MIT Press, 1997
Affective Computing – Criticism
5
Two approaches to fulfill this goal:
1. Recognizing user emotions
(user-focused)
2. Implementing emotion experience
in machines (machine-focused)
AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Affective Computing – Criticism
6 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
• Human-like / Socialized Robots
• Learn about the emotion processes in humans (by analogy)
• Find a cure for psychosomatic diseases (stress, depression, etc.)
2. Emotion Experience in Machines
Motivations:
2. Emotion Experience in Machines
• Human-like / Socialized Robots
Affective Computing – Criticism
7 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
2. Emotion Experience in Machines
• Human-like / Socialized Robots
What does it mean to be HUMAN-LIKE? Charles Manson is a
human …Do we need our robots to be like C.M.?
Affective Computing – Criticism
8 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Which robots should be human-like? Which needn’t?
Quarrels, fights and disputes are also social phenomena
User: Make me a coffee.
Robot: I’m not in the mood right now…Very human-like, but
would you buy it?
2. Emotion Experience in Machines
Affective Computing – Criticism
9 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
But… To actually implement emotions into machines
we already need to know the process…
And unfortu-nately…
We don’t, and our knowledge about emotions is often not computable yet.
• Learn about the emotion processes in humans (by analogy)
* GOOD EXAMPLE: see Karl Fua
• Find cure for psychosomatic diseases (stress, depression, etc.)
2. Emotion Experience in Machines
Affective Computing – Criticism
10 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
• For research like that you need to employ psychologists, neuropsychologists, psychiatrists, medicine doctors, more than computer scientists.
• Computer scientists: dirty work of computing the knowledge.
* GOOD EXAMPLE: see Diane Gromala
1. Emotion Recognition
Facial Expressions
Voice
Biometric data
Gestures
Language
Affective Computing – Criticism
11 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Use some
(behavioral)
assumptions to
determine emotional
state of a human
1. Emotion RecognitionExamples of assumptions:
User is crying = sad
Speaks loudly = angry
His waving hands above his head = angry
High blood pressure = excited
Says “f*ck” = irritated
Affective Computing – Criticism
12 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
1. Emotion RecognitionExamples of assumptions:
User is crying = sad Maybe he’s cutting an onion in the kitchen?
Speaks loudly = angry
Maybe is listening to the music and cannot hear well?
His waving hands above his head = angry Maybe it means “help!”
High blood pressure = excited
Could this be hypertension?
Says “f*ck” = irritated
What is he is saying it like “Oh, f*ck, yeah!”
Affective Computing – Criticism
13 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
1. Emotion Recognition
Affective Computing – Criticism
14 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Very little research
Simplified to motivation on
the beginning of papers
Almost no research
Problem 1.
• Need to continuously review the assumptions according to context.
Problem 3.
• Is it enough to recognize the emotions,or is there more?
Problem 2.
• How to use the recognized information further?
Our Approach – Pragmatism in AC
15 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Our Approach – Pragmatism in AC
16
Emotions are strate-gies/abilities that (should) enhance our lives.*
Robots are tools to
enhance human lives.
AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
*) Robert C. Solomon. The Passions: Emotions and the Meaning of Life, Hackett Publishing, 1993.
Our Approach – Pragmatism in AC
17
Emotions are strate-gies/abilities that (should) enhance our lives.*
Robots are tools to
enhance human lives.
AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
*) Robert C. Solomon. The Passions: Emotions and the Meaning of Life, Hackett Publishing, 1993.
What functions could
robots fulfill to enhance
our (emotional) lives?
Our Approach – Pragmatism in AC
18 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Conversation
Conversation
Our Approach – Pragmatism in AC
19 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Our Approach – Pragmatism in AC
20 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
1990. Peter Salovey & John D. Mayer:
Emotional Intelligence
The ability to recognize, monitor one's own and
others' emotions, to discriminate among them and
to use this information to guide one's thinking and
actions.
Salovey, P. & Mayer, J.D. (1990) "Emotional intelligence" Imagination, Cognition, and Personality, 9, 185-211
Our Approach – Pragmatism in AC
21 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Our Approach – Pragmatism in AC
22 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
manage emotion in oneself
and others.Emotion management is the
final ability!
Our Approach – Pragmatism in AC
23 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
After over 15 years of Affective
Computing we’re still here!!
recognize emotions
Our Approach – Pragmatism in AC
24 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
It’s time to go a half step
further!discriminate between […]
appropriate and inappropriate
[…] expressions of emotions
Our Work – AC through Pragmatics
25 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Our Work – AC through Pragmatics
26 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Our Work – AC through Pragmatics
27 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Our Work – AC through Pragmatics
28 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Our Work – AC through Pragmatics
29 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Our Work – AC through Pragmatics
30 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
“I’m so happy (because) I passed the exam!”
Expressions of
emotion appearing
most often =
appropriate /natural/
for this context Confront expression from
the sentence with the list
Our Work – AC through Pragmatics
31 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Baseline = 45%-50%
Baseline+CVS = 50%
Blog mining = 60%
Blogs+CVS = 60%-70%
Future Work
32 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
Other abilities
are waiting!
Future Work
33 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
With EI framework Reformulate some abilities for the need of machine
implementation
There are some attempts toward other abilities in several research
With conversational agent
Gather appropriate conversational strategies
Create conversation model
Implications toward ethics Could we compute irony, sarcasm using information
about emotion appropriateness?
And a lot more!
Thank you for your attention!
34 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009
top related