effects of tasks and phases on noverbal communication : conference presentation in cog-sci moscow...
TRANSCRIPT
![Page 1: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/1.jpg)
Effects of tasks and phases on nonverbal communication
Liv Lefebvre - Alexandre Pauchet - Laurence Perron
France Telecom R&D
University of South Britany, France
![Page 2: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/2.jpg)
2
Mediated communications
![Page 3: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/3.jpg)
3
Theorical basis
![Page 4: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/4.jpg)
4
Theorical basis
Computer Mediated Communications studies:
– Face to face
– Audio-visual
– Audio alone
Results : consequence of absence of visual cues :
– Management of communication turn is less fluent
– Reference to the shared environment must be more explicit
– Less mutual comprehension
– Negotiation and consensus more difficult to find, less solutions
BUT Whittaker's hypothesis (2003) : effects of mediated communication are task dependent
– Resolution problem tasks: few differences
– Task that require access to interpersonal information: larger differences
![Page 5: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/5.jpg)
5
The experiment
![Page 6: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/6.jpg)
6
Task comparison
Narrative co-conceptionPuzzle completion task
"create the most beautiful and coherent story possible with
your partner"
16 dyads18 dyadsParticipants:
Instructions : "complete the puzzle as quickly as possible with your partner
"
![Page 7: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/7.jpg)
7
Task comparison: narrative co-conception task
![Page 8: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/8.jpg)
8
Task comparison: puzzle completion task
![Page 9: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/9.jpg)
9
Task comparison
Narrative co-conceptionPuzzle completion task
spatialverbal
knownnot knownNature of the solution :
Nature of the task :
![Page 10: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/10.jpg)
10
Technical device
![Page 11: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/11.jpg)
11
Measurement
Nonverbal production:
– Gaze
![Page 12: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/12.jpg)
12
Measurement
Nonverbal production:
– Gaze
– Communicative gestures: serve to complete and module discourse (Ekman & Friesen, 1969 ; Goldin-Meadow, 1999 ; McNeill, 1992)
– Metaphorics
– Beats
metaphoric beat
![Page 13: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/13.jpg)
13
Measurement
Nonverbal production:
– Non communicative gestures (adaptors):– are gestures produced in case of personal
disorganization (Ekman and Friesen, 1969)– they don't have any relation with social interaction
(Argentin, 1984 ; Masse, 2000)
adaptators
![Page 14: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/14.jpg)
14
Measurement
Nonverbal production:
– Gaze– Communicative gestures: serve to complete and module
discourse (Ekman & Friesen, 1969 ; Goldin-Meadow, 1999 ; McNeill, 1992)– Metaphorics– Beats
– Non communicative gestures (adaptors):– are gestures produced in case of personal disorganization
(Ekman and Friesen, 1969)– they don't have any relation with social interaction
(Argentin, 1984 ; Masse, 2000) Rate of nonverbal production = ( time spend to product /
session's time ) * 100
![Page 15: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/15.jpg)
15
Results
![Page 16: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/16.jpg)
16
Results: comparison between two tasks
0
2
4
6
8
10
12
14
16
puzzle completiontask
narrative co-conception task
Ra
tes
of
no
nv
erb
al p
rod
uc
tio
n
Non communicativegestures
Communicativegestures
Gaze
![Page 17: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/17.jpg)
17
Results: comparison between two tasks
Puzzle completion
taskNarrative co-
conception taskGaze 16 % 44 %
Communicative gestures 6 % 7 %
Non communicative gestures 79 % 49 %
Patterns of nonverbal production are task dependent
Can see his partner is not necessary in puzzle completion task…
…but there isn't the case in narrative co-conception task
Confirmation of the Whitaker's hypothesis
![Page 18: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/18.jpg)
18
Results: comparison between phases in the puzzle completion task
Comparison between phases in the puzzle completion task
– Planning phase
– Execution phase
![Page 19: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/19.jpg)
19
0
2
4
6
8
10
12
14
16
Planificationphase
Executionphase
Rat
e o
f n
on
verb
al p
rod
uct
ion
Non communicativegestures
Communicativegestures
Gaze
Results: comparison between phases in the puzzle completion task
Planning phase
Execution phase
![Page 20: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/20.jpg)
20
Results: comparison between phases in the puzzle completion task
Big difference in non verbal production
Planning phase Execution phase
Gaze 53 % 7%
Communicative gestures 42% 4%
Non communicative gestures 5% 90%
![Page 21: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/21.jpg)
21
Results: comparison between phases in the narrative co-conception task
21 dyads interact via computers
– Same task
– Same instructions
Differences between phases are less clear:
– Review of items
– Narrative phase
– Interaction phase
![Page 22: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/22.jpg)
22
Results: comparison between phases in the narrative co-conception task
0
5
10
15
20
25
30
35
40
Review ofitems
Narrativephase
Interactionphase
Rat
es o
f n
on
verb
al p
rod
uct
ion
Non communicativegestures
Communicative gestures
Gaze
![Page 23: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/23.jpg)
23
Results: comparison between phases in the narrative co-conception task
Review of items Narrative phase Interaction phase
Gaze 34% 30% 46%
Communicative gestures 2% 13% 9%
Non communicative
gestures 64% 57% 45%
![Page 24: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/24.jpg)
24
Results summary
Production of gaze:
– In puzzle completion task in planning phase: 53 %
– In narrative co-conception task: 44 %
– In interaction phase: 46 %
Production of communicative gestures:
– In puzzle completion task in planning phase: 42 %
Production of non communicative gestures:
– In puzzle completion task: 79 %
– In execution phase: 90 %
![Page 25: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/25.jpg)
25
Conclusion
![Page 26: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/26.jpg)
26
Conclusion
Whittaker's hypothesis (2003) is verified:
– During the narrative co-conception: more gaze and communicative gestures
– During puzzle completion: more non communicative gestures In addition: differences between phases in interactions:
– Planification phase: more gaze and communicative gestures– Execution phase: more non communicative gestures
Applications for design of new systems of mediated communications
– Importance of visual access:– During tasks that require access to interpersonal information– When users have need to negotiate the task planification
– Not necessary to have a visual access:– During resolution problem tasks– When users have already plan the task and they execute their
plans
![Page 27: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/27.jpg)
thank you
contact: [email protected]
Whittaker, S. (2003). Theories and Methods in Mediated Communication. In A. C. Graesser & M. A. Gernsbacher &S. R. Goldman (Eds.), Handbook of Discourse Processes. Mahwah: NJ: LEA.
![Page 28: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/28.jpg)
28
![Page 29: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/29.jpg)
29
![Page 30: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/30.jpg)
30
Experimental manipulation
4 experimental conditions:
– At a distance with the same view on the material
– At a distance with opposite view on the material
– Collocated situation side-by-side
– Collocated situation face-to-face
![Page 31: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/31.jpg)
31
Experimental manipulation
4 experimental conditions:
– At a distance with the same view on the material
– At a distance with opposite view on the material
– Collocated situation side-by-side
– Collocated situation face-to-face
![Page 32: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/32.jpg)
32
Experimental manipulation
4 experimental conditions:
– A a distance with the same view on the material
– A a distance with opposite view on the material
– Collocated situation side-by-side
– Collocated situation face-to-face
![Page 33: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/33.jpg)
33
Experimental manipulation
4 experimental conditions:
– A a distance with the same view on the material
– A a distance with opposite view on the material
– Collocated situation side-by-side
– Collocated situation face-to-face
![Page 34: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/34.jpg)
34
Results by conditions
Distance
0
2
4
6
8
10
12
14
16
puzzle completion narrative co-conception
Rat
es o
f n
on
verb
al p
rod
uct
ion
Non communicativegestures
Communicative gestures
Gaze
![Page 35: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/35.jpg)
35
Results by conditions
collocated
0
1
2
3
4
5
6
7
puzzle completion narrative co-conception
Rat
es
of
no
nv
erb
al p
rod
uc
tio
n
Non communicativegestures
Communicativegestures
Gaze
![Page 36: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/36.jpg)
36
Results by conditions
face-to-face
0
2
4
6
8
10
12
14
puzzle completion narrative co-conception
Rat
es
of
no
nv
erb
al p
rod
uc
tio
n
Non communicativegestures
Communicativegestures
Gaze
![Page 37: Effects of tasks and phases on noverbal communication : conference presentation in Cog-sci Moscow June 2008](https://reader035.vdocuments.mx/reader035/viewer/2022070323/55974fbd1a28abec018b480a/html5/thumbnails/37.jpg)
37
Results by conditions
Side-by-side
0
2
4
6
8
10
12
14
puzzle completion narrative co-conception
Ra
tes
of
no
nv
erb
al p
rod
uc
tio
n
Non communicativegestures
Communicativegestures
Gaze