affective computing - homes.di.unimi.it · affective computing affective computing (ac) is an...
TRANSCRIPT
![Page 1: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/1.jpg)
Affective ComputingA gentle introduction to the study of emotions
WS Tangible InteractionsDomus Academy
12.02.2019
Vittorio [email protected]://www.vcuculo.com
![Page 2: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/2.jpg)
Presentations
Founding member
Postdoctoral researcher
![Page 3: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/3.jpg)
AIM
Give you some basic knowledge aboutAffective Computing
and how this could enhance the effectiveness of ahuman-machine interaction.
![Page 4: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/4.jpg)
From Ivory Towers...
![Page 5: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/5.jpg)
… to mind reading
![Page 6: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/6.jpg)
… to mind reading
![Page 7: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/7.jpg)
![Page 8: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/8.jpg)
AIM
Design, prototype and produce machines that:
● Detect emotions● Express emotions● “Feel” emotions
![Page 9: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/9.jpg)
Reference
Picard, R. (1997).Affective computing. 1st ed. Cambridge, Mass.: MIT Press.
![Page 10: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/10.jpg)
Intro
“The question is not whether intelligent machines can have any emotions, but whether machines
can be intelligent without emotions”
Marvin Minsky, The Society of Mind (1958)
![Page 11: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/11.jpg)
Are emotions really needed?
![Page 12: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/12.jpg)
Short answer
No.
![Page 13: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/13.jpg)
Long answer
Emotions are not a panacea and is not need to be put into everything that computes. Designers should not abuse of it to
make computers and other devices affective.
Printers, lamps and moka works fine without emotions. While others, for example software agents that interact with people,
will benefit from a repertoire similar to our own.
![Page 14: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/14.jpg)
AutoEmotive (MIT)
![Page 15: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/15.jpg)
MoodLamp (Università degli Studi di Milano)
![Page 16: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/16.jpg)
NAO (Aldebaran Robotics)
![Page 17: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/17.jpg)
MoodFuse (on Spotify)https://github.com/ChrisZieba/MoodFusehttps://developer.spotify.com/documentation/web-api/reference/tracks/get-audio-features/
![Page 18: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/18.jpg)
Affective computing
Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science.
“AC is computing that relates to, arises from, or deliberately influences emotion or other affective phenomena” (Picard, 1997)
The machine should interpret the emotional state of humans and adapt its behaviour to them, giving an appropriate response for those emotions.
![Page 19: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/19.jpg)
...but, wait!
What is an emotion?
![Page 20: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/20.jpg)
Emotions are
- intentional, representational and part of virtue. (Aristotle, 330 A.D.)
- an obstacle to reason and therefore an obstacle to virtue. (Stoicism, 300 A.D.)
![Page 21: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/21.jpg)
Emotions are
- the result of evolution, served in communication and survival.(Charles Darwin, 1800)
- physiological response to a stimuli.(William James, 1884)
![Page 22: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/22.jpg)
Emotions are
- discrete and expressed by a set of facial expressions.(Paul Ekman, Carroll Izard)
![Page 23: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/23.jpg)
Emotions are discrete
Universality of basic facial expressions.(Ekman, 1971; 1992; 1993)
![Page 24: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/24.jpg)
Emotions are
- influenced by a core affect and expressed in terms of valence and arousal.(James Russell)
![Page 25: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/25.jpg)
Emotions are dimensional
There is no one-to-one correspondence between an emotion word and a facial expression.
![Page 26: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/26.jpg)
Emotions are dimensional
![Page 27: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/27.jpg)
Emotions are dimensional
The emotions are neither discrete entities nor points on a few dimensions; they are overlapping point-clouds in an N-dimensional space.(Nesse, Ellsworth)
![Page 28: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/28.jpg)
How emotions are expressed?
![Page 29: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/29.jpg)
![Page 30: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/30.jpg)
Affective computing
Emotional cues
Visible Less Visible
Facial expression
Voice intonation
Gesture
Posture Pupillary dilation
Respiration Heart rate Temperature
Electrodermal response
Muscle actions
Blood pressure
![Page 31: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/31.jpg)
Autonomic Nervous System (ANS)
![Page 32: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/32.jpg)
- Heart rate (HRV)
- Electrodermal response (GSR)
- Muscle activity (EMG)
Measure of physiological signals
![Page 33: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/33.jpg)
Measure of physiological signals
![Page 34: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/34.jpg)
Measure of physiological signals - HRV
Heart rate variability (HRV) refers to the oscillation of the interval between consecutive heartbeats
![Page 35: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/35.jpg)
Measure of physiological signals - HRV
HRV is obtained through the Electrocardiography (ECG).
… typically invasive!
![Page 36: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/36.jpg)
Measure of physiological signals - HRV
Blood volume pulse (BVP) measures indirectly the heart rate and is less invasive.
![Page 37: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/37.jpg)
Measure of physiological signals - HRV
Sends infrared light with a specific wavelength (990nm) and measures the reflected amount of light.
![Page 38: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/38.jpg)
Measure of physiological signals - GSR
Skin conductivity (SC) sensor measures the skin’s ability to conduct electricity.
![Page 39: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/39.jpg)
Measure of physiological signals - GSR
SC is measured in microsiemens (mS) with a device equipped with two electrodes to be applied on the skin
![Page 40: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/40.jpg)
Measure of physiological signals - GSR
Varies with the level of skin sweating.
Sweat glands are activated by the sympathetic nervous system, therefore is a good indicator of arousal.
![Page 41: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/41.jpg)
Measure of physiological signals - EMG
Electromyogram (EMG) measures muscle activity by detecting surface voltages that occur when a muscle is contracted.
![Page 42: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/42.jpg)
Measure of physiological signals - EMG
Surface Electromyogram (sEMG) requires the application of electrodes to the skin.
![Page 43: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/43.jpg)
Measure of physiological signals - EMG
Corrugator supercilii muscle
Lowers the eyebrow and is involved in producing frowns.
Varies inversely with the emotional valence.
![Page 44: Affective Computing - homes.di.unimi.it · Affective computing Affective Computing (AC) is an interdisciplinary field spanning computer science, psychology, and cognitive science](https://reader034.vdocuments.mx/reader034/viewer/2022042713/5faf86021d02892cb17cc34a/html5/thumbnails/44.jpg)
Measure of physiological signals - EMG
Zygomaticus major muscle
Controls smiling and is said to be positively associated with positive emotional valence.