rudiments of proper display: i. tables “getting information from a table is like extracting...

69
Rudiments of Proper Display: I. Tables Getting information from a table is like extracting sunbeams from a cucumber(Farquhar & Farquhar, 1891) Howard Wainer National Board of Medical Examiners

Upload: tracy-shelton

Post on 12-Jan-2016

228 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

Rudiments of Proper Display: I. Tables

“Getting information from a tableis like extracting sunbeams from a cucumber”

(Farquhar & Farquhar, 1891)

Howard WainerNational Board of Medical Examiners

Page 2: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

Why Tables?1. Data usually start out as a table. Why not make it a good

one?

2. Tables are easy to prepare - all you need is EXCEL.

3. For extracting specific details tables are superb.

4. Historically tables were used for data archiving.

5. Tables look more serious than graphs.

Page 3: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

6. If one wants to present a number it is always important (and usually critical) to present it in context. Tables help to do this.

For example:“There are 57 doctors in our town.”Is this a lot? “There are 57 doctors!”Or too few? “There are only 57 doctors.”

A small tables adds context and so emphasis:Towns our size # of MDsOur town 57Town B 18Town C 2 Average town our size 23

Page 4: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

There are but three simple rules that almost guarantee the easing of comprehension problems that usually

accompany tabular presentation.

But first we need an orientating attitude:

A Table is for communication not data storage.Modern data storage is accomplished electronically.

Paper and print are meant for human eyes and human minds.

Page 5: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

Some basic ideas that underlie all presentation.

1. Know what you are doing - All data displays are answers to questions. Before preparing a display, know what those questions are.

2. Don’t try to do too much - A display can have four purposes. Build the display to accomplish your primary goal. If it also satisfies a secondary one, fine. But that’s just gravy. It is a rare multipurpose display that is as good for a specific task as even a mediocre special purpose one.

3. Revise your display at least as often as you revise your prose - People will often look at you display more carefully than at your words, and they will certainly remember it better, hence it deserves at least as much of your attention. This usually means revising your display several times, as each revision tells you more about how you should have done it originally.

4. A picture may be worth 1000 words, but it may take 100 words to do it - Captions and Legends are critical. Makes sue they are correct legible and complete.

5. Less is more - Avoid chartjunk. If the material is not part of the story, exclude it.

Page 6: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 7: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

What kinds of questions are these data meant to answer?

1. How many unexpected deaths occur?

2. Which countries had the highest accidental death rates? The lowest? Why?

3. What sorts of fatal accidents are the most frequent? The least frequent?

4. Are there any unusual data points? Which ones?

Page 8: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

The three rules

1. Round - a lot. This is for three reasonsa. Humans cannot comprehend more than

two digits very easily.b. We can only rarely justify more than two

digits of accuracy statistically.c. We almost never care about accuracy of

more than two digits

Page 9: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

The three rules (continued)

2. Order the rows and columns in a way that makes sense. We are almost never interested in “Alabama First.” Two often useful ways to order are:

a. Size places - put the largest first. Often we look most carefully at what is on top and less carefully further down.

b. Naturally - time is ordered from the past to the future. Showing data in that order melds well with what the reader might expect; always a good idea.

Page 10: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

The three rules (continued)

3. ALL is different and is important. Separate ALL from the rest spatially and perceptually: make it darker, bigger, and spaced away.

Page 11: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

Let’s start with rounding.

Some might complain that profound rounding loses valuable information.

Not likely.

Page 12: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 13: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 14: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 15: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

Now that we have reordered the rows of the table by the overall death rate we note

immediately that:

France and Austria have the highest rates;

The United Kingdom and Japan the lowest.

Why?

Page 16: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 17: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 18: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 19: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 20: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 21: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 22: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 23: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 24: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

The last table makes clear the most fundamental rule of data display.

Think hard about the data being displayed to understand what is the point,

then think hard about best to make it.

Data do not speak for themselves.

They can only tell their tale through you, and that only happens when you know what you are doing and why you are doing it.

Page 25: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 26: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 27: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 28: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 29: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 30: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 31: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 32: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 33: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 34: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

Once the row and column effects have been removed the residuals become obvious.

We can just pick out the large ones to emphasize in a reformatted table.

This is how I knew which entries in the accidental death table to put a box around.

Page 35: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

These tabular data can be displayed as a graph.

Exactly how to do this has a number of simple steps.

I’ll get to this next.

Page 36: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 37: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

Next let us look at a real-life example that has to do with satisfying laws

about racial integration in Princeton, NJ

elementary schools

Page 38: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 39: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 40: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 41: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

Final Model with ResidualsRounded and Reordered

SchoolSchool White Asian Black Hispanic Indigenous effects

Johnson Pk 41 6 -17 1 -12 10

Littlebrook 24 0 -3 -16 0 1

Riverside -24 0 8 -1 0 -1

Community Pk -35 -18 3 40 0 -1

Ethnic effects 235 1 0 -8 -29 31

Page 42: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

Final Model with ResidualsShown as a percentage of ethnic median

Rounded and ReorderedSchool

School White Asian Black Hispanic Indigenous effects

Johnson Pk 15 20 -55 3 -821 10

Littlebrook 9 0 -11 -71 7 1

Riverside -9 0 25 -3 7 -1

Community Pk -13 -58 11 181 -7 -1

Ethnic effects 235 1 0 -8 -29 31

Page 43: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

Yet another example of great interest to us all:

Understanding Canadian unemployment data

Page 44: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 45: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard

Let us begin with a sample from the whole data set and then we’ll

return to the whole thing.

The only reason for sampling is to ease visibility problems.

Page 46: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 47: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 48: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 49: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 50: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 51: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 52: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 53: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 54: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 55: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 56: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 57: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 58: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 59: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 60: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 61: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 62: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 63: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 64: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 65: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 66: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 67: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 68: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard
Page 69: Rudiments of Proper Display: I. Tables “Getting information from a table is like extracting sunbeams from a cucumber” (Farquhar & Farquhar, 1891) Howard