©2

00

9 C

arn

eg

ie M

ello

n U

niv

ers

ity :

1

Navigating Cyberspace

Computational Cybersecurity in Compromised Environments (C3E )Jan 14, 2014

Jason Hong

ComputerHumanInteraction:MobilityPrivacySecurity

Making Sense of

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

2

• Bandwidth

Time

Computing Trends

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

3

• Bandwidth• Storage

Time

Computing Trends

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

4

Time

Computing Trends

• Bandwidth• Storage• Computing Power

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

5

Time

Computing Trends

• Bandwidth• Storage• Computing Power• Information

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

6

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

7

• Cognitive Processing

Time

Human Capabilities

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

8

• Cognitive Processing• Visual acuity

Time

Human Capabilities

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

9

• Cognitive Processing• Visual acuity• Human bandwidth

…

Time

Human Capabilities

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

10

7 2

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

11

Evidence suggests it’s more like 4

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

12

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

13

The Power of Visualization

1. Start out going Southwest on ELLSWORTH AVE Towards BROADWAY by turning right. 2: Turn RIGHT onto BROADWAY. 3. Turn RIGHT onto QUINCY ST. 4. Turn LEFT onto CAMBRIDGE ST. 5. Turn SLIGHT RIGHT onto MASSACHUSETTS AVE. 6. Turn RIGHT onto RUSSELL ST.

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

14

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

15

The Power of Visualization

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

16

Some Lessons

1. Aesthetics and color really matter2. Study what people are trying to do3. InfoViz is also what you don’t show

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

17

US Election 2004

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

18

InfoViz’s Can Show and Hide Info

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

19

All Viz’s Show and Hide Info

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

20

InfoViz’s Can Show and Hide Info

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

21

All Viz’s Show and Hide Info

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

22

Some Lessons

1. Aesthetics and color really matter2. Study what people are trying to do3. Infoviz is also what you don’t show4. All visualizations have inherent biases

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

23

London Underground Map 1990s

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

24

Visualization of DNA

by Ben Fry

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

25

Visualization of the Internet

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

26

Earlier Conceptions of the Net

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

27

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

28

Some Lessons

1. Aesthetics and color really matter2. Study what people are trying to do3. Infoviz is also what you don’t show4. All visualizations have inherent biases5. May not have natural representations,

but can have good conceptual models

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

29

Example from Jeff Heer

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

30

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

31

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

32

Work by Jeff Heer

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

33About 85 per cent of my

"thinking" time was spent getting into a position to think, to make a decision…Much more time went into finding or obtaining information than into digesting it… When the graphs were finished, the relations were obvious at once, but the plotting had to be done in order to make them so.

- J.C.R. Licklider, 1960

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

34

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

35

Some Lessons

1. Aesthetics and color really matter2. Study what people are trying to do3. Infoviz is also what you don’t show4. All visualizations have inherent biases5. May not have natural representations,

but can have good conceptual models6. Viz just one part of toolchain

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

36

Collaborative Analysis?

• Many Eyes (by IBM)

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

37

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

38

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

39

CrowdScanner

• Pay Mturkers to help find potential problems with smartphone apps

90% users were surprised this app sent their precise location to mobile ads providers.

95% users were surprised this app sent their approximate location to mobile ads providers.

95% users were surprised this app sent their phone’s unique ID to mobile ads providers.

See all

0% users were surprised this app can control camera flashlight.

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

40

Combine Data Mining + Viz

User can specify exemplars of a groupBelief Propagation to find more nodes

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

41

Apolo’s Key Contributions

• Mixed-initiative: Human + Machine

• Builds a highly personalized landscape (unlike automatic methods)

I feel like I have a “partnership with the

machine”

©2

01

4 C

arn

eg

ie M

ello

n U

niv

ers

ity :

42

Summary

• Considering visualizations1. Aesthetics and color really matter2. Study what people are trying to do3. Infoviz is also what you don’t show4. All visualizations have inherent biases5. May not have natural representations,

but can have good conceptual models6. Viz just one part of toolchain

• Ongoing research– Collaborative analysis– Machine learning + infoviz