verbal and nonverbal and non-verbal cues ofverbal cues of … · 2008. 5. 16. · verbal and...

Verbal and Non verbal cues ofVerbal and Non-verbal cues of deception

TTO 3402: Detecting Deception in InterviewsTTO 3402: Detecting Deception in Interviews

Scott WeemsScott WeemsPetra Scheck-Bradley

Elizabeth RoglerCarrie Clarady

Barbara Forsyth

OutlineOutline

• Overview of CASL deception detectionOverview of CASL deception detection

T f d ti• Types of deception cues

• Future CASL deception work

2

TTO 3402 Detecting Deception in InterviewsTTO 3402 Detecting Deception in Interviews

• Recording interviews of people from non-g p pWestern cultures in a polygraph setting. Questions are asked regarding:– FamilyFamily– Residences– Contacts overseas

Naturalization– Naturalization

• These recordings are examined for verbal and• These recordings are examined for verbal and non-verbal cues of deception– Verbal coding: Montclair State University and

D ti D t ti T h l i

3

Deception Detection Technologies– Non-verbal coding: University at Buffalo

TTO 3402 Detecting Deception in Interviews

Autonomic Behavioral

TTO 3402 Detecting Deception in Interviews

Engage in a deceptive act

Emotional and cognitive response to

i i

Autonomic reflex to emotion

BehavioralSpeechPhysiological

deceptive act engaging in deception Controlled

response to emotion

BehavioralLinguisticPhysiological

• Spotting deception requires the liar to “care.”• Punishments and rewards are key• Punishments and rewards are key• Conscious choice to deceive (i.e., control)

4

Frank, M. and Ekman, P. (2005). Technological adjuncts to detecting malfeasant behavior. Poster presented at Annual Homeland Security Research Conference, Boston, MA, April 26-27, 2005.

TTO 3402 Detecting Deception in InterviewsTTO 3402 Detecting Deception in Interviews

• The challenge of studying non-WesternThe challenge of studying non Western deceivers

Very little is known about how culturally– Very little is known about how culturally universal (or culture-specific) deception cues are

– Linguistic and cultural background can have a strong influence on deceptiong p

5

Deception cuesDeception cues

Liar?

T th t ll ??

Truth-teller?

6

Deception cuesDeception cues

Eyes to the Upper Left When youEyes to the Upper Left. When you see someone’s eyes move quickly up-left, they are constructing images in their head. A person looking up-left is using their imagination to put a picture together in their mind. Ask a person to imagine a large blue house filled with marbles and they should look up andmarbles and they should look up and to the left.

7

Deception cuesDeception cues

Eyes to the Upper Left When youEyes to the Upper Left. When you see someone’s eyes move quickly up-left, they are constructing images in their head. A person looking up-left is using their imagination to put a picture together in their mind. Ask a person to imagine a large blue house filled with marbles and they should look up and

NOT TRUEmarbles and they should look up and to the left.

“The science has come and gone, yet the belief still remains.”

8

Devily, G. (2005) “Power therapies and possible threats to the science of psychology and psychiatry”

Deception cuesDeception cues

Cue type Example cuesCue type Example cues

Facial expressionsEmotionsBlinking ratesEye contactEye contact

Body behaviorsPostural shiftsLeg movementsVisible breathing

Pitch and timbreWord usage (contractions, passive

Acoustic and linguistic cuesg ( , p

voice, “uhms”)Hesitations

9

Deception cues - verbalDeception cues verbal• Liars

– spend less time describing un-true incidents– provide fewer detailsp– use less immediate language (i.e., distance

themselves from their statements))– sound less certain than truth-tellers– repeat words morep– admit lack of memory more (“The Reagan

effect”)

10

)DePaulo, B., Malone, B., Lindsay, J., Muhlenbruck, L., Charlton, K., Cooper, H. (2003).

Cues to deception, Psychological Bulletin, 129(1), 74-118.

Deception cues - verbalDeception cues verbal

“I was traveling through the checkpoint and I knew that there might be a problem. I wasn’t alone. I was sort ofnervous that I had lost my passport the day before, which made me scared In the end they let us all through andmade me scared. In the end they let us all through and didn’t even check our documents. I was so relieved, I cried all the way home.”

11

Deception cues - verbalDeception cues verbal

N ti di h iti ld dHedge

“I was traveling through the checkpoint and I knew that

Negative wording when positive would do

there might be a problem. I wasn’t alone. I was sort ofnervous that I had lost my passport the day before, which made me scared In the end they let us all through andmade me scared. In the end they let us all through and didn’t even check our documents. I was so relieved, I cried all the way home.”

Switch to plural pronounExtreme

exaggeration

12

Bachenko, J. Fitzpatrick, E., and Schonwetter, M. (2008). Verification and implementation of language-based deception indicators in civil and criminal narratives.

Deception cues – Non-verbalDeception cues Non verbal

• Gaze aversionGaze aversion• Eye blinking

H d t• Head movements• Hand / arm movements

13

Deception cues – Non-verbalDeception cues Non verbal

• Gaze aversionGaze aversion• Eye blinking

H d t*

• Head movements• Hand / arm movements

DePaulo (2003) failed to see any consistent pattern across studies for these cues for deceivers versus truth-tellers

14

Deception cues – Non-verbalDeception cues Non verbal

Emotion as a potential cue of deception

15

Frank, M., Friesen, W., and Hager, J. (2002) Facial Action Coding System Investigator’s Guide.

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

16

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurprise* Surprise*

17

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

18

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi t

*DistressFearSadnessSurpriseSurprise

19

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

20

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi t* DistressFear

*

SadnessSurpriseSurprise

21

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

22

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFear*SadnessSurpriseSurprise

23

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

24

Deception cues – Non-verbal

Anger*

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

25

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurpriseSurprise

26

Deception cues – Non-verbal

Anger

Deception cues Non verbal

AngerDisgustDi tDistressFearSadnessSurprise

*Surprise

27

Deception cues – Non-verbalSURPRISE

Deception cues Non verbal

FEAR

Action Units: 1+2+5

Action Unit 1 Action Unit 2FEAR

Action Units: 1+2+4

Action Unit 1 Action Unit 2Inner eyebrow is raised

Center eyebrow is raised

SADNESS

Action Units: 1+4

ANGERAction Units: 4+5

Action Unit 4 Action Unit 5Whole eyebrow lowers, converge

Upper eyelid raises

28

Action Units: 4+5

Deception cues – Non-verbalDeception cues Non verbal

“I really do trust and respect John”

Disgust Back to neutralNeutralRaising of the upper lip

29

Deception cues – Non-verbalDeception cues Non verbal

30

Paul Ekman video

Future CASL Deception DetectionFuture CASL Deception Detection

• Study deception cues in a simulatedStudy deception cues in a simulated security interview environment– Actual security interviews have high y g

ecological validity, but ground truth is difficult to collectC t ll d i ll h t– Controlled scenarios allow researchers to know when people are deceiving, but motivation to succeed must be inducedmotivation to succeed must be induced

• Target a specific non-Western group

31

group

Future CASL Deception Detection

• Key issues when developing a deception

Future CASL Deception Detection

Key issues when developing a deception detection experiment– Motivation to lie– Cross-cultural differences– Control of the narrative– Extended narrative– Baseline of truthful behavior– Availability of ground truth– Choice of subjects

32

SummarySummary

• Deception is a complex problem, and isDeception is a complex problem, and is not easily detected

• There exist a variety of cues, many are poorly understood.p y

• Extending deception study findings to theExtending deception study findings to the “real world” is a big challenge to experimental designs.

33

p g