verbal and nonverbal and non-verbal cues ofverbal cues of … · 2008. 5. 16. · verbal and...

33
Verbal and Non verbal cues of Verbal and Non-verbal cues of deception TTO 3402: Detecting Deception in Interviews TTO 3402: Detecting Deception in Interviews Scott Weems Scott Weems Petra Scheck-Bradley Elizabeth Rogler Carrie Clarady Barbara Forsyth

Upload: others

Post on 28-Aug-2020

20 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Verbal and Non verbal cues ofVerbal and Non-verbal cues of deception

TTO 3402: Detecting Deception in InterviewsTTO 3402: Detecting Deception in Interviews

Scott WeemsScott WeemsPetra Scheck-Bradley

Elizabeth RoglerCarrie Clarady

Barbara Forsyth

Page 2: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

OutlineOutline

• Overview of CASL deception detectionOverview of CASL deception detection

T f d ti• Types of deception cues

• Future CASL deception work

2

Page 3: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

TTO 3402 Detecting Deception in InterviewsTTO 3402 Detecting Deception in Interviews

• Recording interviews of people from non-g p pWestern cultures in a polygraph setting. Questions are asked regarding:– FamilyFamily– Residences– Contacts overseas

Naturalization– Naturalization

• These recordings are examined for verbal and• These recordings are examined for verbal and non-verbal cues of deception– Verbal coding: Montclair State University and

D ti D t ti T h l i

3

Deception Detection Technologies– Non-verbal coding: University at Buffalo

Page 4: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

TTO 3402 Detecting Deception in Interviews

Autonomic Behavioral

TTO 3402 Detecting Deception in Interviews

Engage in a deceptive act

Emotional and cognitive response to

i i

Autonomic reflex to emotion

BehavioralSpeechPhysiological

deceptive act engaging in deception Controlled

response to emotion

BehavioralLinguisticPhysiological

• Spotting deception requires the liar to “care.”• Punishments and rewards are key• Punishments and rewards are key• Conscious choice to deceive (i.e., control)

4

Frank, M. and Ekman, P. (2005). Technological adjuncts to detecting malfeasant behavior. Poster presented at Annual Homeland Security Research Conference, Boston, MA, April 26-27, 2005.

Page 5: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

TTO 3402 Detecting Deception in InterviewsTTO 3402 Detecting Deception in Interviews

• The challenge of studying non-WesternThe challenge of studying non Western deceivers

Very little is known about how culturally– Very little is known about how culturally universal (or culture-specific) deception cues are

– Linguistic and cultural background can have a strong influence on deceptiong p

5

Page 6: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cuesDeception cues

Liar?

T th t ll ??

Truth-teller?

6

Page 7: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cuesDeception cues

Eyes to the Upper Left When youEyes to the Upper Left. When you see someone’s eyes move quickly up-left, they are constructing images in their head. A person looking up-left is using their imagination to put a picture together in their mind. Ask a person to imagine a large blue house filled with marbles and they should look up andmarbles and they should look up and to the left.

7

Page 8: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cuesDeception cues

Eyes to the Upper Left When youEyes to the Upper Left. When you see someone’s eyes move quickly up-left, they are constructing images in their head. A person looking up-left is using their imagination to put a picture together in their mind. Ask a person to imagine a large blue house filled with marbles and they should look up and

NOT TRUEmarbles and they should look up and to the left.

“The science has come and gone, yet the belief still remains.”

8

Devily, G. (2005) “Power therapies and possible threats to the science of psychology and psychiatry”

Page 9: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cuesDeception cues

Cue type Example cuesCue type Example cues

Facial expressionsEmotionsBlinking ratesEye contactEye contact

Body behaviorsPostural shiftsLeg movementsVisible breathing

Pitch and timbreWord usage (contractions, passive

Acoustic and linguistic cuesg ( , p

voice, “uhms”)Hesitations

9

Page 10: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues - verbalDeception cues verbal• Liars

– spend less time describing un-true incidents– provide fewer detailsp– use less immediate language (i.e., distance

themselves from their statements))– sound less certain than truth-tellers– repeat words morep– admit lack of memory more (“The Reagan

effect”)

10

)DePaulo, B., Malone, B., Lindsay, J., Muhlenbruck, L., Charlton, K., Cooper, H. (2003).

Cues to deception, Psychological Bulletin, 129(1), 74-118.

Page 11: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues - verbalDeception cues verbal

“I was traveling through the checkpoint and I knew that there might be a problem. I wasn’t alone. I was sort ofnervous that I had lost my passport the day before, which made me scared In the end they let us all through andmade me scared. In the end they let us all through and didn’t even check our documents. I was so relieved, I cried all the way home.”

11

Page 12: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues - verbalDeception cues verbal

N ti di h iti ld dHedge

“I was traveling through the checkpoint and I knew that

Negative wording when positive would do

there might be a problem. I wasn’t alone. I was sort ofnervous that I had lost my passport the day before, which made me scared In the end they let us all through andmade me scared. In the end they let us all through and didn’t even check our documents. I was so relieved, I cried all the way home.”

Switch to plural pronounExtreme

exaggeration

12

Bachenko, J. Fitzpatrick, E., and Schonwetter, M. (2008). Verification and implementation of language-based deception indicators in civil and criminal narratives.

Page 13: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbalDeception cues Non verbal

• Gaze aversionGaze aversion• Eye blinking

H d t• Head movements• Hand / arm movements

13

Page 14: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbalDeception cues Non verbal

• Gaze aversionGaze aversion• Eye blinking

H d t*

• Head movements• Hand / arm movements

DePaulo (2003) failed to see any consistent pattern across studies for these cues for deceivers versus truth-tellers

14

Page 15: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbalDeception cues Non verbal

Emotion as a potential cue of deception

15

Frank, M., Friesen, W., and Hager, J. (2002) Facial Action Coding System Investigator’s Guide.

Page 16: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

16

Page 17: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurprise* Surprise*

17

Page 18: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

18

Page 19: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi t

*DistressFearSadnessSurpriseSurprise

19

Page 20: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

20

Page 21: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi t* DistressFear

*

SadnessSurpriseSurprise

21

Page 22: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

22

Page 23: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFear*SadnessSurpriseSurprise

23

Page 24: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

24

Page 25: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger*

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

25

Page 26: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

26

Page 27: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurprise

*Surprise

27

Page 28: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbalSURPRISE

Deception cues Non verbal

FEAR

Action Units: 1+2+5

Action Unit 1 Action Unit 2FEAR

Action Units: 1+2+4

Action Unit 1 Action Unit 2Inner eyebrow is raised

Center eyebrow is raised

SADNESS

Action Units: 1+4

ANGERAction Units: 4+5

Action Unit 4 Action Unit 5Whole eyebrow lowers, converge

Upper eyelid raises

28

Action Units: 4+5

Page 29: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbalDeception cues Non verbal

“I really do trust and respect John”

Disgust Back to neutralNeutralRaising of the upper lip

29

Page 30: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Deception cues – Non-verbalDeception cues Non verbal

30

Paul Ekman video

Page 31: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Future CASL Deception DetectionFuture CASL Deception Detection

• Study deception cues in a simulatedStudy deception cues in a simulated security interview environment– Actual security interviews have high y g

ecological validity, but ground truth is difficult to collectC t ll d i ll h t– Controlled scenarios allow researchers to know when people are deceiving, but motivation to succeed must be inducedmotivation to succeed must be induced

• Target a specific non-Western group

31

group

Page 32: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

Future CASL Deception Detection

• Key issues when developing a deception

Future CASL Deception Detection

Key issues when developing a deception detection experiment– Motivation to lie– Cross-cultural differences– Control of the narrative– Extended narrative– Baseline of truthful behavior– Availability of ground truth– Choice of subjects

32

Page 33: Verbal and NonVerbal and Non-verbal cues ofverbal cues of … · 2008. 5. 16. · Verbal and NonVerbal and Non-verbal cues ofverbal cues of deception TTO 3402: ... Poster presented

SummarySummary

• Deception is a complex problem, and isDeception is a complex problem, and is not easily detected

• There exist a variety of cues, many are poorly understood.p y

• Extending deception study findings to theExtending deception study findings to the “real world” is a big challenge to experimental designs.

33

p g