3. graphical perception · 2019. 1. 25. · weber constant (empirically determined) for detecting...

85
Graphical Perception Nam Wook Kim Mini-Courses — January @ GSAS 2018

Upload: others

Post on 08-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Graphical PerceptionNam Wook Kim

Mini-Courses — January @ GSAS 2018

Page 2: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

The visual decoding of information encoded on graphs

What is graphical perception?

Page 3: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Why?

Page 4: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

“Visualization is really about external cognition, that is, how resources outside the mind can be used to boost the cognitive capabilities of the mind” — Stuart Card

Page 5: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

“Graphical excellence is that which gives to the viewer the greatest number of ideas in the shortest time with the least ink in the smallest space” — Edward Tufte

Page 6: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

GoalTo understand how humans perceive visualization

Page 7: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Topics• Signal Detection • Magnitude Estimation • Pre-Attentive Processing • Using Multiple Visual Encodings • Gestalt Grouping • Change Blindness

Page 8: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Detection

Page 9: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Detecting Brightness

Which is brighter? A B

Page 10: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

(128,128,128) (144,144,144)

A B

Detecting Brightness

Page 11: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Detecting Brightness

Which is brighter? A B

Page 12: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

(138,138,138)(134,134,134)

Detecting Brightness

A B

Page 13: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Just Noticeable Difference (JND) — Weber’s Law

dp = kdSS Physical Intensity

Page 14: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Just Noticeable Difference (JND) — Weber’s Law

dp = kdSS Physical Intensity

Change of Intensity

Page 15: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Just Noticeable Difference (JND) — Weber’s Law

dp = kdSS Physical Intensity

Change of Intensity Perceived Change

Page 16: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Just Noticeable Difference (JND) — Weber’s Law

dp = kdSS Physical Intensity

Change of Intensity Perceived Change

Weber constant (Empirically determined)

Page 17: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Just Noticeable Difference (JND) — Weber’s Law

dp = kdSS Physical Intensity

Change of Intensity Perceived Change

Weber constant (Empirically determined)

For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are perceived in discrete steps

Page 18: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Ranking visualizations for depicting correlation

[Harrison et al 2014]

Page 19: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Ranking visualizations for depicting correlation

[Harrison et al 2014]

r = 0.7 r = 0.6

Which of the two appeared to be more highly correlated?

Page 20: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Ranking visualizations for depicting correlation

[Harrison et al 2014]

r = 0.7 r = 0.65

Which of the two appeared to be more highly correlated?

Page 21: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Ranking visualizations for depicting correlation

[Harrison et al 2014]

Overall, scatterplots are the best for both positive and negative correlations.

Parallel coordinates are only good for negative correlations .

Page 22: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Magnitude Estimation

Page 23: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

A Quick Experiment…

Page 24: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

A B

Page 25: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

A

B

Page 26: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

A B

Page 27: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

A

B

Page 28: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Steven’s Power Law [Graph from T. Munzner 2014]

S = I p

Physical Intensity

Perceived Sensation

Exponent (Empirically Determined)

Predicts bias, not necessarily accuracy!

Models the relationship between the magnitude of a physical stimulus and its perceived intensity.

Page 29: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Steven’s Power Law [Graph from T. Munzner 2014]

Overestimate

Underestimate

Unbiased

Page 30: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Apparent Magnitude Scaling

Cartography: Thematic Map Design, Figure 8.6, p. 170, Dent, 96

To compensate for human error in interpreting scale because people tend to underestimate area

Page 31: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Graphical Perception [Cleveland & McGill 84] What percentage of the smaller was of the larger?

Page 32: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Graphical Perception [Cleveland & McGill 84] What percentage of the smaller was of the larger?

Compare positions (along common scale)

Compare lengths

Page 33: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are
Page 34: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

What percentage each value was of the maximum?

Compare positionsComare angles

Page 35: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Bar chart won!

Page 36: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

[T. Munzer 2014]

Effectiveness Ranking of Visual Encoding Variablesfor comparing numerical quantities

Page 37: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Pre-Attentive Processing

Page 38: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

How Many 3’s?

1281768756138976546984506985604982826762 9809858458224509856458945098450980943585 9091030209905959595772564675050678904567 8845789809821677654876364908560912949686

[based on a slide from J. Stasko]

Page 39: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

1281768756138976546984506985604982826762 9809858458224509856458945098450980943585 9091030209905959595772564675050678904567 8845789809821677654876364908560912949686

How Many 3’s?

[based on a slide from J. Stasko]

Page 40: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

The ability of the low-level human visual system to rapidly and effortlessly identify certain basic visual properties.

Pre-attentive processing

Page 41: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Visual Pop-Out: Color

Christopher Healey, https://www.csc.ncsu.edu/faculty/healey/PP/index.html

Page 42: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Christopher Healey, https://www.csc.ncsu.edu/faculty/healey/PP/index.html

Visual Pop-Out: Shape

Page 43: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Christopher Healey, https://www.csc.ncsu.edu/faculty/healey/PP/index.html

and more…

Page 44: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

No unique visual property of the target

Christopher Healey, https://www.csc.ncsu.edu/faculty/healey/PP/index.html

Feature Conjunctions

Page 45: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Pre-attentive ConjunctionsMost conjunctions are not pre-attentive. Some spatial conjunctions are pre-attentive.

• Motion and 3D disparity • Motion and color • Motion and shape • 3D disparity and color • 3D disparity and shape

Page 46: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Multiple Attributes

Page 47: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

One-Dimensional: Lightness

White

Black

White

Black

White

White

White

Black

Black

White

or

Classify objects based on lightness

Page 48: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Square

Circle

Circle

Circle

Square

Circle

Circle

Circle

Square

Circle

or

One-Dimensional: ShapeClassify objects based on shape

Page 49: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Redundant: Shape & Lightness

Circle

Square

Square

Square

Circle

Circle

Circle

Square

Square

Square

or

Classify objects based on shape. Easier?

Page 50: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Redundant: Shape & Lightness

Circle

Square

Square

Square

Circle

Circle

Circle

Square

Square

Square

or

Classify objects based on shape. Easier?

Page 51: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Orthogonal: Shape & Lightness

Circle

Circle

Square

Square

Circle

Classify objects based on shape. Difficult?

Page 52: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Speeded Classification Redundancy Gain Facilitation in reading one dimension when the other provides redundant information.

Filtering Interference Difficulty in ignoring one dimension while attending to the other.

Page 53: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Speeded Classification

R: Redundant Encoding 1: One-dimensional O: Orthogonal Encoding

Interference

Gain

Page 54: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Speeded Classification

R: Redundant Encoding 1: One-dimensional O: Orthogonal Encoding

Stable

White

White

Black

White

Black

Page 55: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Types of Perceptual DimensionsIntegral Filtering interference and redundancy gain

Separable No interference or gain

Asymmetric One dimension separable from other, not vice versa e.g., Lightness was not really influenced by shape

Page 56: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Separability vs. Integrality

2 groups each

Position Hue (Color)

Size Hue (Color)

Width Height

Red Green

Fully separable Some interference Some/significant interference

Major interference

[Tamara Munzner 14]

What we perceive:

Page 57: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Separability vs. Integrality

2 groups each 2 groups each

Position Hue (Color)

Size Hue (Color)

Width Height

Red Green

Fully separable Some interference Some/significant interference

Major interference

[Tamara Munzner 14]

What we perceive:

Page 58: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Separability vs. Integrality

2 groups each 2 groups each 3 groups total: integral area

Position Hue (Color)

Size Hue (Color)

Width Height

Red Green

Fully separable Some interference Some/significant interference

Major interference

[Tamara Munzner 14]

What we perceive:

Page 59: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Separability vs. Integrality

2 groups each 2 groups each 3 groups total: integral area

4 groups total: integral hue

Position Hue (Color)

Size Hue (Color)

Width Height

Red Green

Fully separable Some interference Some/significant interference

Major interference

[Tamara Munzner 14]

What we perceive:

Page 60: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Not about good or badMatch the characteristics of the channels to the information that is encoded.

For a single data attribute with three categories, this may work just fine: small, flattened, and large.

[Tamara Munzner 14]

Page 61: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Gestalt Grouping

Page 62: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Principles of Perceptual OrganizationSimilarity Proximity Uniformed Connectedness

Connection Enclosure

Continuity Symmetry and there are more not covered here…

Page 63: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Proximity

Columns Rows

Page 64: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Similarity

Rows stand out due to similarity.

Page 65: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Scatter Plot MatrixClusters and outliers

Page 66: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Uniformed Connectedness: Connection

Connectedness dominates proximity and similarity

Proximity (column) vs connection (row)

Similarity (row) vs connection (column)

Page 67: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Uniformed Connectedness: Enclosure

Page 68: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Chart Annotations

[ https://chartaccent.github.io/ ]

EnclosureConnection

Page 69: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Visualizing Sets

[ Slides from A. Lex ]

Bubble Sets Line Sets Kelp Diagrams

Page 70: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Treemap and Circle Packing

https://bl.ocks.org/mbostock/4063530 https://bl.ocks.org/mbostock/4063582

Proximity, Similarity, Enclosure

Page 71: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Continuity

We prefer smooth not abrupt changes [from Ware 04]

Connections are clearer with smooth contours [from Ware 04]

Page 72: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Hierarchical Edge Bundling

[ Holten 06 ]

Page 73: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

SymmetryElements that are symmetrical to each other tend to be grouped together.

https://www.populationpyramid.net/united-states-of-america/2017/

Page 74: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Population Pyramid (or tornado chart?)

https://www.populationpyramid.net/united-states-of-america/2017/

Korean War?

Page 75: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Change Blindness

Page 76: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

http://www.psych.ubc.ca/~rensink/flicker/download/

Change Detection Test

Page 77: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

https://www.youtube.com/watch?v=ubNF9QNEQLA

Change Detection Test

Page 78: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

“To see an object change, it is necessary to attend to it.” — Ronald A. Rensink

Page 79: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Reducing change blindness in visualizationProvide attentional guidance by leverage pre-attentive features, Gestalt principles, etc.

Example: Ease tracking objects through animated transitions

https://bl.ocks.org/mbostock/3885705

Page 80: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Topics• Signal Detection • Magnitude Estimation • Pre-Attentive Processing • Using Multiple Visual Encodings • Gestalt Grouping • Change Blindness

Page 81: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Take away

1. Human don’t perceive changes and magnitude at face value.

2. Use pre-attentive visual features for faster target detection.

3. Be aware of interference and redundancy of multiple features.

4. Leverage gestalt principles for high-level grouping. 5. Change blindness in visualization is the failure of design, not

because of our vision system.

Knowledge of perception can benefit visualization design

Page 82: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

1. Value of visualization

2. Design principles

3. Graphical perception

TodayFundamental

Page 83: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

1. Data model and visual encoding

2. Exploratory data analysis

3. Storytelling with data

4. Advanced visualizations

Practical

Tomorrow

Page 84: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

Data model and visual encoding

NextRankings of visual variables

for quantitative, ordinal, and normal data

Page 85: 3. Graphical Perception · 2019. 1. 25. · Weber constant (Empirically determined) For detecting JND, ratios more important than magnitude Most continuous variation in stimuli are

See you tomorrow!