General knowledge norms: Updated and expandedfrom the Nelson and Narens (1980) norms
Sarah K. Tauber & John Dunlosky &
Katherine A. Rawson & Matthew G. Rhodes &
Danielle M. Sitzman
Published online: 24 January 2013# Psychonomic Society, Inc. 2013
Abstract The Nelson and Narens (Journal of VerbalLearning and Verbal Behavior 19:338–368, 1980) generalknowledge norms have been valuable to researchers inmany fields. However, much has changed over the 32 yearssince the 1980 norms. For example, in 1980, most peopleknew the answer to the question “What is the name of theLone Ranger’s Indian sidekick?” (answer: Tonto), whereasin 2012, few people know this answer. Thus, we updated the1980 norms and expanded them by providing new meas-ures. In particular, we report two new metacognitive meas-ures (confidence judgments and peer judgments) andprovide a detailed report of commission errors. Each ofthese measures will be valuable to researchers, and togetherthey are likely to facilitate future research in a number offields, such as research investigating memory illusions,metamemory processes, and error correction. The presenceof substantial generational shifts from 1980 to 2012 neces-sitates the use of updated norms.
Keywords General knowledge questions . Metacognition .
Commission errors
Over three decades ago, Nelson and Narens (1980) publishednormative information for a set of questions over multipledomains of knowledge. They created 300 questions andassessed several cognitive and metacognitive measures, in-cluding the probability of recall and the latency to generate a
response. Their norms have been used widely in researchinvestigating the processes involved in long-term memory(e.g., Fazio & Marsh, 2008; Hanley, 2011; Marsh, Meade, &Roediger, 2003; Murayama & Kuhbandner, 2011; Woltz,Gardner, & Gyll, 2000), those involved in metacognition(e.g., Barber, Rajaram, & Marsh, 2008; Metcalfe & Finn,2011; Nelson, Leonesio, Shimamura, Landwehr, & Narens,1982; Schwartz, 2001; Singer & Tiede, 2008; Weinstein &Roediger, 2010; Winne & Muis, 2011), and how all of theseprocesses change over the lifespan (e.g., Cosentino, Metcalfe,Butterfield, & Stern, 2007; Dodson, Bawa, & Krueger, 2007;MacDonald, Dixon, Cohen, & Hazlitt, 2004; Mansueti, deFrias, Bub, & Dixon, 2008; Marsh, Balota, & Roediger,2005; Metcalfe & Finn, 2012). Given the continued relianceon these measures, our primary goals were to (a) update the1980 norms and assess shifts in knowledge that have occurredover the 32 years since they were collected, and (b) expand the1980 norms by providing new measures for the questions.
The three-decade gap warrants new data collection in partbecause knowledge is likely to have shifted in comparisonwith people’s knowledge in 1980. For example, in 1980 mostpeople knew the answer to the question “What is the name ofthe Lone Ranger’s Indian sidekick?” (Tonto; 1980 probabilityof recall = .87). Given that the Lone Ranger was most popularin the early to mid-1900s, it is reasonable that people in 2012would be less likely to know that Tonto was the LoneRanger’s sidekick. Conversely, for other information, genera-tional differences may lead to increased knowledge in 2012relative to 1980. For instance, in 1980 very few people knewthe answer to the question “Of which country isBaghdad the capital?” (1980 probability of recall = .07).Iraq, which is the correct response, has been in the news agreat deal since the 1990s, most notably in reference to theIraq war, which began in 2003. Given such generational shifts,researchers should not rely on the 1980 norms.
S. K. Tauber (*) : J. Dunlosky :K. A. RawsonDepartment of Psychology, Kent State University, Kent,OH 44242, USAe-mail: [email protected]
M. G. Rhodes :D. M. SitzmanDepartment of Psychology, Colorado State University,Fort Collins, CO, USA
Behav Res (2013) 45:1115–1143DOI 10.3758/s13428-012-0307-9
We also identified several questions from the 1980 normsthat were either outdated or incorrect. For instance, considerthe question “What is the name of the company that produ-ces Baby Ruth candy bars?” In 1980, the correct responsewas Curtiss, but now Nestle produces this candy bar. As anexample of incorrect information, consider the question“What is the last name of the first American author to winthe Nobel Prize for literature?” In the 1980 norms, thecorrect answer was listed as “Henry,” but the correct answeris “Lewis.”
In addition to updating the 1980 norms and correctingsuch errors, we also wished to provide three new measures:confidence judgments, peer judgments, and commissionerrors. We will discuss each in turn. After answering eachquestion, participants made a confidence judgment about thelikelihood (0 %–100 %) that the response was correct.Confidence judgments provide an index of how certainpeople are that their knowledge is correct. To foreshadow,in some cases, people’s confidence was in line with theirknowledge: that is, high confidence for correct responsesand low confidence for incorrect responses. However, forother questions, people’s confidence was a poor indicator ofknowledge. For decades, research has investigated illusionsof memory such as confidently held false memories. Suchresearch has commonly investigated false memories thathave been created from word lists (e.g., Anastasi, Rhodes,& Burns, 2000; Gallo, 2010; Roediger & McDermott,1995), produced by misinformation (e.g., Frenda, Nichols,& Loftus, 2011; Loftus & Hoffman, 1989), or implantedinto one’s past (e.g., Loftus, 1997). The expanded measuresreported here provide researchers with information that willfacilitate research on long-term false memories for generalknowledge information by identifying questions with lowprobabilities of recall and high levels of confidence inerrors.
We also created a new metacognitive measure, peer judg-ments, by having people predict how many peers wouldcorrectly answer each question. This measure provides nor-mative information about people’s sense of how their ownknowledge compares with that of others, which will beuseful within a number of research areas. For instance,researchers have increasingly focused on metacognitivejudgments made for oneself, in comparison with judgmentsfor another person (e.g., Kelley & Jacoby, 1996; Koriat &Ackerman, 2010; Nickerson, 1999). Such research has fo-cused on the influence of one’s subjective experience onmetacognitive processes, and on the relationship betweenpredictions made for oneself as compared with predictionsmade for someone else. The peer judgments reported hereprovide an index of the latter relationship. To preview, forsome questions the confidence and peer judgments werestrongly associated (e.g., Pearson’s r > .80), whereas forother questions the measures were weakly associated (e.g.,
Pearson’s r < .30). Thus, researchers can identify subsets ofquestions for which confidence and peer judgments arehighly correlated, and other subsets for which the two meas-ures are uncorrelated or weakly correlated.
Perhaps most importantly, we have provided a detailedassessment of the kinds of errors that people made whenanswering each question. In particular, we focused on com-mission errors by providing the most commonly reportedincorrect responses and confidence in these errors.Information about commissions and normative confidencein these errors may support inquiry in numerous areas, suchas in research investigating false memories and error cor-rection. Concerning the latter area, researchers are currentlyinvestigating how people correct errors (e.g., Butler, Fazio,& Marsh, 2011; Butterfield & Metcalfe, 2001). To do so, theresearchers use items for which people generate responsesthat are incorrect but are held in high confidence, as com-pared with errors that are held in low confidence. Thecommission errors reported here provide normative valuesfor this kind of information by identifying questions forwhich commission errors are both frequent and associatedwith differing levels of confidence.
Method
Participants, materials, and procedure
Six hundred seventy one students (age:M = 20.1, SE = 0.14,n = 639 who reported age; 443 females, 207 males, n = 650who reported gender) from two large state universities par-ticipated in exchange for course credit. The participantswere recruited from introductory psychology courses atKent State University (KSU; n = 636, who provided51,245 responses included in the probability of recall), aswell as from introduction to psychology and introduction toresearch methods courses at Colorado State University(CSU; n = 35, who provided 1,628 responses included inthe probability of recall). This sample was selected forcomparison purposes with the student sample involved inthe original 1980 norms. However, future research mayprofit by targeting a broader sample of participants (e.g.,community samples) to evaluate the degree to which the2012 norms extend to more diverse samples.
The materials were identical to those used in the Nelsonand Narens (1980) norms. These questions tapped generalknowledge in several domains, including art, body andhealth, entertainment, games, geography, history, literature,science and nature, and sports (see Table A1). The proce-dure was similar to that employed for the 1980 norms, witha few exceptions. The odd-numbered questions from the1980 norms were assigned to Set A, and the even-numbered questions were assigned to Set B (150 questions
1116 Behav Res (2013) 45:1115–1143
per set). Participants were randomly assigned to Set A or B.A small subset of participants (n = 56) completed one setand at least a portion of the second set of questions. For bothsets, the entire experiment was computerized, and the ques-tions were randomly ordered anew for each participant.Questions were presented in uppercase letters, one at a timein the center of the screen. Participants were given thefollowing instructions:
This experiment will test your knowledge about generalkinds of information. You will be asked a question, andyou will type your best guess in the space providedbelow the question. The answer will always consist ofexactly one word and will never be longer than oneword. As each question is presented search your mem-ory hard in an attempt to find the answer to the question.When you have determined the answer there is no needto waste extra time before typing in your response.However, if you do not locate the answer immediately,give yourself a chance to find it by searching yourmemory a bit more. Some questions may take a whilebefore you locate an answer. The questions vary greatlyin difficulty such that you will probably be able toanswer some easily, while others will be harder, and stillothers you may not know at all. If, after searching yourmemory, you are sure you don’t know the answer, thentype the word “NEXT” and proceed to the next ques-tion. Please never leave an answer space blank; forevery answer space, either fill in “NEXT” or fill in yourbest guess. However, there is no penalty for guessing,and incorrect answers will not affect your score, so besure to take a guess, if you can, whenever you areunsure. We are only concerned that you get as manyquestions correct as you possibly can.
For each response, the total amount of time to read thequestion, search memory, and type a response was measuredas an index of response latency. Following each question,participants made a confidence judgment on a scale from 0to 100, indicating their level of confidence that their answerwas correct, such that 0 % indicated not confident and100 % indicated absolutely confident. After the confidencejudgment the participants made a peer judgment, given thefollowing instructions:
Make a judgment about how well you think otherpeople would do with that question. Specifically, ifwe gave the question to 100 students who were aboutyour age, how many of them do you think would beable to answer the question correctly?
Participants based their judgments on a scale from 0 to 100people, where 0 indicated that no other students would get thequestion correct, and 100 indicated that all 100 students wouldget the question correct.
The questions in most cases were administered after partic-ipants had finished an unrelated experimental protocol. Giventhat participants took different amounts of time to finish theinitial protocol, they had different amounts of time remaining(given that they participated for a fixed amount of time overall)to answer questions and make their judgments. Also, with thetime remaining, a participant might not have completed all ofthe questions in his or her assigned set. Thus, the number ofobservations varied per question. However, participants com-pleted all responses (i.e., recall attempt, confidence judgment,and peer judgment) for each question that they attempted,which prevented reporting partial information per question.Confidence judgments were not measured for omission errors(i.e., typing NEXT), because confidence judgments for omis-sions should be 0, and hence are uninteresting. However, foromission errors participants did provide a peer judgment, somore observations would typically be available for peer thanfor confidence judgments. Thus, given that the numbers ofobservations per question and per measure could vary forprincipled reasons, Table A1 includes the number of responsesthat contributed to each measure.
Data scoring
As for the 1980 norms, the data were scored so that answerswere considered correct if the first four letters of the responsematched the correct answer. Due to our interest in commissionerrors, the data were then also hand scored by the first author, toadjust for spelling. The vast majority of the hand scoring wasobjective (e.g., WHODINI for HOUDINI, TERANCHALAfor TARANTULA, and OSTERAGE for OSTRICH were allconsidered correct), but in the rare cases in which scoring wasuncertain, the responses were discussed and resolved by thefirst three authors. Hand scoring also allowed us to adjust forcases in which the first four letters could indicate a correct orincorrect response (e.g., for Question 83, the correct responsewas METEORS, not METEORITES).
Results and discussion
The results were collapsed across testing locations (i.e., KSUand CSU) because the Spearman correlation (ρ) between therank-ordered probabilities of correct recall across questions washigh (.94, p < .001), indicating that the question orders werelargely consistent across the two locations. On average, partic-ipants answered 79.0 (SE = 2.3) questions (range from 1 to 300),provided confidence judgments for 34.5 (SE = 1.1) questions(range from 1 to 214), and provided peer judgments for 80.6(SE = 2.3) questions (range from 1 to 300). The total number ofresponses per question ranged from 126 to 232. Although this issomewhat lower than the total number of responses per itemreported in the original norms (N = 270), the number of
Behav Res (2013) 45:1115–1143 1117
responses per item in the present norms is nonetheless sufficientfor establishing normative patterns of performance.
The results for each question are presented in Table A1. Thistable contains normative data for 299 of the original 300 ques-tions (one question—“What is the capital of Czechoslovakia?”—was dropped because it was outdated and had no correct an-swer). Questions are reported in rank order from the highest tothe lowest probability of correct recall. For purposes of compar-ison, the 1980 rank order is provided as well. Most importantly,for each question Table A1 provides (a) the probability of recall,(b) the mean response latencies (in seconds) for correct andincorrect responses, (c) the proportions of commission andomission errors, (d) the mean confidence judgment across allnonomission responses, as well as the mean confidence judg-ment computed separately for correct responses and commissionerrors, (e) the mean peer judgment, and (f) the correlationbetween the confidence and peer judgments. With reference topoint (b), response latencies for incorrect responses are providedonly for commission errors, and not for omission errors.
As is detailed in the Method section, the number ofresponses varied for each measure. For example, whenparticipants omitted an answer, they did not make a confi-dence judgment, but they did make a peer judgment. Thenumber of responses also varied slightly due to the partic-ipants’ typing errors. For example, given that participantswere instructed (and reminded) that answers were one-wordresponses, if participants typed a number (e.g., “5,” “7,” or“12”), this response was considered a typing error (as if theparticipant had accidentally proceeded from a question with-out getting a chance to respond) and did not contribute to theprobability of recall. Accordingly, in Table A1, we reportthe number of responses that contributed to each measure.
To assess generational stability, a coarse-grained measurewas the rank-order correlation between the new norms and theoriginal ones. The Spearman correlation (ρ) was .83 (p < .001),which suggests stability from 1980 to 2012. Even so, this valuemay overestimate stability, and it does not indicate that the newnorms simply duplicated the original ones. For instance, con-sider that in 1980 the most challenging quartile of questions(the items ranked 225–300) contained only four questions thatwere impossible for participants to answer (i.e., the probabilityof correct recall was zero). By contrast, in 2012, themajority ofthe items (68 %, or 51 questions) in this last quartile wereimpossible. Thus, if researchers today wanted to select rela-tively difficult questions and used the original norms, theymight instead be selecting questions with which many—ifnot all—of their college participants had no experience.
For a fine-grained measure of generational stability, weconducted an independent-samples t test for each question tocompare the current recall against the normative values fromthe 1980 norms. The p value was set at .0002 to adjust for the299 tests. The results revealed nonsignificant differences indi-cating generational stability for 157 questions, and significant
differences indicating generational instability for 142 ques-tions. For the latter set, participants in 2012 had a higherprobability of recall for only three questions, and a lowerprobability of recall for 139 questions (see Table A1). Theshifts in knowledge for some questions were likely due to thecontent being dated, and people in 2012 having had lessexposure to the information. This shift is most likely the casefor many of the game questions—for example, “Which gameuses a doubling cube?” (backgammon). In 2012, backgammonis apparently not a popular game among college-aged students.
Table A2 provides details about commission errors, in-cluding (a) the most common commission errors, (b) howoften each commission error occurred out of all of thecommission responses for that question, (c) how often thecommission error occurred out of all responses for thatquestion, and (d) the mean confidence in the commissionerror. Some commission errors were made with high confi-dence. For example, participants were highly confident (M =86.5 %) that the correct answer to “What is the name of adried grape?” is “prune.” For other commission errors, par-ticipants were not confident. For example, they were notconfident (M = 3.1 %) that “Radium” is the correct answerto “What is the last name of the scientist who discoveredradium?” In this particular case, participants may have beenguessing.
As noted previously, we identified questions thatwere either outdated or incorrect from the 1980 norms.Table A3 provides details about these questions, includ-ing (a) the 1980 correct answer and (b) the 2012 correctanswer. For a final subset of questions, the answer fromthe 1980 norms was correct, but participants providedalternative responses that were correct as well. Forexample, the 1980 correct answer to the question“What is the name of an airplane without an engine?”was “glider.” This answer is still correct, of course, butparticipants provided two alternative responses that werealso correct (“paper” and “model”).
To conclude, the update to this set of norms is essential,because much has changed since the original norms werecollected. As a final example, in 1980 the question “Whatwas the last name of the man who was the voice of Mr.Magoo?” (answer: “Backus”) was considered moderately dif-ficult (1980 probability of recall = .341), but in 2012 thisquestion was impossible, because none of our participantsanswered it correctly. Even so, the updated norms maintainedvariability in the question difficulty (range: .933–.000), andhence will remain a valuable research tool.
Author note This research was supported by the James S. McDonnellFoundation 21st Century Science Initiative in Bridging Brain, Mind, andBehavior Collaborative Award. Thanks to Jeff Anastasi and Beth Marshfor helpful comments on a draft of the manuscript.
1118 Behav Res (2013) 45:1115–1143
Tab
leA1
Probabilitiesof
recall,
respon
selatencies,prop
ortio
nsof
errors,confidence
judg
ments,peer
judg
ments,andcorrelations
betweentheconfidence
andpeer
judg
ments
for29
9general
know
ledg
equ
estio
ns
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
12
WHATIS
THENAMEOFTHEHORSE-LIK
EANIM
AL
WITH
BLACK
AND
WHITESTRIPES?(ZEBRA)
.933
196
146.3
14.7
.03
.04
95.0
96.2
58.2
689
.421
3.66*
23
WHATIS
THENAMEOFTHELONG
SLEEPSOME
ANIM
ALSGO
THROUGH
DURIN
GTHEENTIRE
WIN
TER?(H
IBERNATIO
N)
.890
137
179.6
11.8
.06
.05
92.5
95.6
49.5
1083
.815
4.61*
316
WHATIS
THENAMEOFTHERUBBEROBJECTTHATIS
HIT
BACK
AND
FORTH
BY
HOCKEY
PLAYERS?(PUCK)
.888
198
256.7
10.3
.04
.08
93.8
96.3
29.9
883
.122
6.53*
415
WHATIS
THENAMEOFTHEREMAIN
SOFPLANTSAND
ANIM
ALSTHATAREFOUND
INSTONE?(FOSSILS)
.873
137
209.1
23.5
.06
.07
89.0
93.3
24.3
979
.015
9.65*
513
WHICH
PRECIO
USGEM
ISRED?(RUBY)
.849
141
254.6
11.2
.08
.07
8.6
90.8
33.4
1477
.616
6.64*
625
WHATIS
THENAMEOFTHESEVEREHEADACHETHAT
RETURNSPERIO
DICALLY
AND
OFTEN
ISACCOMPA
NIED
BY
NAUSEA?(M
IGRAIN
E)
.847
133
2410
.215
.2.07
.08
80.5
84.0
38.7
1169
.815
9.64*
730
WHATIS
THELASTNAMEOFTHEAUTHORWHO
WROTE
“ROMEO
AND
JULIET”?
(SHAKESPEARE)
.843
172
3210
.814
.5.03
.13
89.3
90.8
45.0
679
.921
0.61*
89
WHATIS
THENAMEOFA
DRIED
GRAPE?(RAISIN
).835
116
236.8
6.5
.12
.05
87.7
91.0
64.1
1683
.914
0.52*
91
WHATIS
THENAMEOFTHECOMIC
STRIP
CHARACTER
WHO
EATSSPIN
ACH
TO
INCREASEHIS
STRENGTH?
(POPEYE)b
.824
112
248.5
12.7
.06
.12
91.5
94.1
56.3
873
.414
1.66*
1093
WHATANIM
ALRUNSTHEFA
STEST?(CHEETA
H)a
.816
115
265.6
12.8
.13
.05
76.2
83.5
32.1
1971
.114
1.72*
1133
WHATIS
THENAMEOFTHEPROCESSBY
WHICH
PLANTS
MAKETHEIR
FOOD?(PHOTOSYNTHESIS)
.800
104
2611.8
15.0
.04
.16
84.3
87.4
19.0
570
.213
4.40*
1219
WHATIS
THENAMEOFDOROTHY’S
DOG
IN“T
HEWIZARD
OFOZ”?
(TOTO)
.799
123
316.7
16.9
.08
.12
89.6
97.0
13.9
1280
.715
4.69*
137
WHATIS
THENAMEOFTHEMOLT
EN
ROCK
THATRUNS
DOWN
THESID
EOFAVOLCANO
DURIN
GAN
ERUPTIO
N?
(LAVA)
.793
119
318.6
11.7
.10
.11
87.2
90.7
59.7
1577
.115
0.54*
1437
WHATWASTHENAMEOFTHESUPPOSEDLY
UNSIN
KABLE
SHIP
THATSUNK
ON
ITSMAID
EN
VOYAGEIN
1912
?(TITANIC)
.789
112
309.3
12.9
.05
.16
83.8
87.5
24.3
772
.514
4.81*
158
WHICH
SPORTUSESTHETERMS“G
UTTER”AND
“ALLEY”?
(BOWLIN
G)
.788
164
446.6
11.5
.09
.12
86.1
93.5
22.1
1975
.021
0.80*
1657
WHATIS
THENAMEOFA
GIA
NTOCEAN
WAVECAUSED
BYAN
EARTHQUAKE?(TSUNAMI)
.784
120
3310
.514
.3.09
.12
84.4
89.2
45.7
1572
.715
3.63*
1724
WHATIS
THETERM
FORHITTIN
GAVOLLEYBALLDOWN
HARD
INTO
THEOPPONENT’S
COURT?(SPIK
E)
.784
163
457.2
11.3
.12
.10
86.9
91.1
59.4
2574
.921
4.49*
Appendix
Behav Res (2013) 45:1115–1143 1119
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
1873
WHATIS
THELASTNAMEOFTHEVILLAIN
OUSCAPTA
ININ
THESTORY
“PETERPA
N”?
(HOOK)a
.781
114
328.5
16.1
.03
.18
89.9
92.6
28.0
577
.614
6.61*
195
WHATWASTHENAMEOFTA
RZAN’S
GIRLFRIEND?(JANE)
.781
121
344.3
18.7
.12
.10
85.9
96.5
14.8
1874
.015
6.71*
204
WHATIS
THELASTNAMEOFTHEBROTHERSWHO
FLEW
THEFIRSTAIRPLANEATKITTY
HAWK?(W
RIG
HT)b
.751
151
508.6
11.5
.05
.19
81.1
83.5
48.2
1165
.420
4.72*
2117
WHATIS
THENAMEFORA
MEDICALDOCTORWHO
SPECIA
LIZESIN
CUTTIN
GTHEBODY?(SURGEON)
.748
101
3411.5
8.7
.04
.21
70.7
74.0
15.0
659
.013
9.80*
2253
WHATIS
THELASTNAMEOFTHEFIRSTPERSON
TO
SET
FOOTON
THEMOON?(A
RMSTRONG)
.741
100
3511.0
16.2
.12
.14
74.6
77.6
55.8
1672
.013
5.77*
236
WHATIS
THECAPITALOFFRANCE?(PARIS)b
.730
157
585.8
9.3
.11
.16
68.0
71.9
42.6
2468
.021
9.78*
2411
WHATIS
THENAMEOFTHECRIM
EIN
WHICH
ABUILDIN
GORPROPERTY
ISPURPOSELY
SETON
FIRE?(A
RSON)b
.722
109
428.6
18.0
.14
.14
79.1
88.3
31.9
2168
.715
3.72*
2579
WHATIS
THENAMEOFTHESHORTPLEATED
SKIRT
WORN
BY
MEN
INSCOTLAND?(K
ILT)
.717
9939
6.7
13.9
.08
.20
87.9
95.9
15.4
1170
.113
8.75*
2618
WHATIS
THENAMEOFAN
INABILITY
TO
SLEEP?
(INSOMNIA
).714
150
607.6
19.0
.18
.11
81.0
89.4
47.3
3768
.521
4.65*
2726
WHATIS
THENAMEFORA
MEDICALDOCTORWHO
SPECIA
LIZESIN
DISEASESOFTHESKIN
?(D
ERMATOLOGIST)
.692
146
6512
.313
.7.09
.22
80.7
86.7
34.5
1960
.921
7.66*
2843
WHATIS
THENAMEOFTHELARGESTOCEAN
ON
EARTH?(PACIFIC)
.685
9845
8.1
13.4
.28
.03
65.4
72.2
48.9
4070
.314
4.71*
2922
WHATIS
THENAMEOFTHESHIP
THATCARRIED
THE
PILGRIM
STO
AMERICA
IN16
20?(M
AYFLOWER)b
.663
130
668.5
17.6
.16
.18
77.7
86.6
40.3
3166
.520
2.80*
3041
WHATIS
THENAMEFORA
CYCLONETHATOCCURS
OVERLAND?(TORNADO)
.641
8246
8.0
10.8
.18
.18
79.3
86.9
52.3
2368
.412
8.82*
3110
WHICH
SPORTIS
ASSOCIATED
WITH
WIM
BLEDON?
(TENNIS)b
.619
135
835.4
10.4
.14
.24
80.2
91.5
29.0
3058
.722
4.71*
3234
WHATIS
THENAMEOFTHEBIRD
THATCANNOTFLY
AND
ISTHELARGESTBIRD
ON
EARTH?(O
STRICH)b
.603
132
8711.7
14.4
.29
.11
69.2
79.1
48.5
6362
.822
1.68*
3363
WHATIS
THENAMEOFTHEISLAND-CITY
BELIEVED
SIN
CEANTIQ
UITY
TO
HAVESUNK
INTO
THEOCEAN?
(ATLANTIS)
.593
8659
11.7
16.4
.06
.34
78.5
85.1
15.4
957
.614
7.85*
3488
WHATIS
THENAMEOFTHELIZARD
THATCHANGES
ITSCOLORTO
MATCH
THESURROUNDIN
GS?
(CHAMELEON)
.589
126
8811.3
13.2
.34
.07
70.4
85.1
45.0
7368
.421
8.69*
3535
WHATIS
THENAMEOFTHETHICK
LAYEROFFA
TON
AWHALE?(BLUBBER)b
.572
7959
6.2
9.0
.17
.26
73.4
85.5
32.0
2356
.013
9.87*
3649
WHATIS
THELASTNAMEOFTHEBASEBALLPLAYER
WHO
HAD
THEMOSTHOMERUNSIN
ASIN
GLE
SEASON
PRIO
RTO
1961
?(RUTH)b
.568
8464
12.3
16.8
.10
.33
48.6
49.6
43.1
1546
.815
1.44*
3759
WHATIS
THENAMEOFAYOUNG
SHEEP?(LAMB)
.561
8365
7.8
11.8
.22
.22
71.6
87.2
32.5
3365
.614
9.74*
1120 Behav Res (2013) 45:1115–1143
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
3865
WHATIS
THELARGESTPLANETIN
THESOLARSYSTEM?
(JUPITER)
.559
8063
8.1
10.9
.38
.06
68.4
81.0
50.0
5569
.314
4.75*
3952
WHATIS
THENAMEOFTHENAVIG
ATIO
NIN
STRUMENT
USED
ATSEATO
PLOTPOSITIO
NRELATIV
ETO
THE
MAGNETIC
NORTH
POLE?(COMPA
SS)
.526
103
9311.7
15.9
.14
.34
61.2
68.2
34.4
2747
.520
4.84*
4075
WHATIS
THETERM
INGOLFREFERRIN
GTO
ASCOREOF
ONEUNDERPA
RON
APA
RTICULARHOLE?(BIRDIE)
.523
8174
12.2
17.6
.16
.32
60.2
66.9
38.7
2549
.915
8.54*
4177
WHICH
GAMEUSESA
RUBBERBALLAND
LITTLEMETA
LPIECES?(JACKS)
.521
7569
9.8
22.4
.15
.33
69.2
84.0
16.4
2152
.714
5.70*
4247
WHATIS
THENAMEOFA
DRIED
PLUM?(PRUNE)b
.517
7671
7.7
10.7
.27
.21
65.2
79.3
38.3
4058
.514
7.61*
4340
INWHICH
SPORTDOESA
RID
ERON
HORSEBACK
HIT
ABALLWITH
HIS
MALLET?(POLO)b
.510
106
102
9.8
17.4
.20
.29
69.5
85.7
28.7
4255
.721
2.71*
4478
WHATIS
THENAMEOFTHELEGENDARY
ONE-EYED
GIA
NTIN
GREEK
MYTHOLOGY?(CYCLOPS)
.507
107
104
9.1
13.1
.11
.38
74.6
85.0
26.0
2353
.921
5.71*
4536
INWHATPA
RK
IS“O
LD
FAITHFUL”LOCATED?
(YELLOWSTONE)b
.491
105
109
9.7
13.5
.17
.34
62.0
76.8
20.0
3748
.022
0.75*
4651
WHATIS
THENAMEOFTHEPOKERHAND
INWHICH
ALLOFTHECARDSAREOFTHESAMESUIT?(FLUSH)b
.486
6872
14.6
16.1
.25
.26
54.6
64.8
34.8
3553
.914
1.39*
4790
INWHICH
SPORTIS
THESTA
NLEY
CUPAWARDED?
(HOCKEY)
.481
103
111
5.8
9.2
.42
.10
69.7
87.7
49.0
8963
.821
6.72*
4889
WHATIS
THENAMEOFTHECHAPELWHOSECEILIN
GWASPA
INTED
BY
MICHELANGELO?(SISTIN
E)
.475
6774
12.7
17.7
.16
.37
73.2
83.6
41.5
2253
.414
2.67*
4924
1OFWHICH
COUNTRY
ISBAGHDAD
THECAPITAL?(IRAQ)a
.468
5967
9.8
12.6
.40
.13
60.3
68.5
51.9
5063
.312
8.58*
5076
WHATIS
THENAMEOFTHELIQ
UID
PORTIO
NOF
WHOLEBLOOD?(PLASMA)
.468
9410
710
.312
.7.17
.36
47.4
53.9
29.2
3438
.020
6.56*
5155
WHATIS
THENAMEOFTHECITY
INITALY
THATIS
KNOWN
FORITSCANALS?(V
ENICE)b
.459
6779
9.3
10.5
.26
.28
65.4
82.0
36.1
3854
.314
8.72*
5221
WHATIS
THENAMEOFTHESPEARLIK
EOBJECT
THATIS
THROWN
DURIN
GATRACK
MEET?(JAVELIN
)b.452
7186
10.5
19.4
.29
.25
68.0
85.6
40.8
4659
.015
8.39*
5323
WHATIS
THELASTNAMEOFTHEMAN
WHO
RODE
HORSEBACK
IN17
75TO
WARN
THATTHEBRITISH
WERECOMIN
G?(REVERE)b
.443
6683
13.3
14.8
.12
.44
72.1
85.2
24.1
1855
.115
0.67*
5432
WHO
WASTHEEGYPTIA
NQUEEN
WHO
JOIN
ED
FORCESWITH
MARK
ANTONY
OFROME?(CLEOPA
TRA)b
.443
93117
11.0
19.4
.13
.43
57.3
70.4
12.3
2739
.121
5.73*
5567
WHATIS
THELASTNAMEOFTHEMAN
WHO
ASSASSIN
ATED
ABRAHAM
LIN
COLN?(BOOTH)b
.438
6381
10.5
15.8
.20
.36
68.8
90.0
23.5
2958
.914
4.65*
5620
WHATIS
THELASTNAMEOFTHEMAN
WHO
SHOWED
THATLIG
HTNIN
GIS
ELECTRIC?(FRANKLIN
)b.437
9312
011.6
11.5
.34
.22
64.7
75.5
51.0
7357
.921
7.67*
5728
WHATIS
THELASTNAMEOFTHEFA
MOUS
MAGICIA
NAND
ESCAPEARTISTWHO
DIED
OF
APPENDICITIS?(H
OUDIN
I)b
.436
9512
312
.816
.9.06
.50
52.5
58.7
10.7
1437
.322
5.73*
Behav Res (2013) 45:1115–1143 1121
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
5883
WHATIS
THENAMEOFDEERMEAT?(V
ENISON)b
.432
6484
10.4
11.5
.30
.27
65.8
88.6
32.5
4454
.014
9.59*
5945
WHATIS
THENAMEOFTHELARGEHAIRY
SPID
ER
THATLIV
ESNEARBANANAS?(TARANTULA)b
.429
6384
13.8
15.9
.14
.43
42.8
48.8
24.7
2136
.514
9.62*
6082
WHATIS
THENAMEOFTHEOCEAN
THATIS
LOCATED
BETWEEN
AFRICA
AND
AUSTRALIA
?(INDIA
N)b
.427
9012
112
.915
.8.47
.10
52.0
67.4
38.1
9957
.621
6.62*
6127
WHATIS
THELASTNAMEOFTHESIN
GERWHO
RECORDED
“HEARTBREAK
HOTEL”AND
“ALL
SHOOK
UP”?
(PRESLEY)b
.424
6183
11.5
12.4
.21
.37
72.5
80.9
55.3
3052
.514
6.77*
6281
WHATIS
THENAMEOFTHECRIM
EIN
WHICH
APERSON
PURPOSELY
BETRAYSHIS
COUNTRY?
(TREASON)b
.418
6185
12.0
21.6
.20
.38
63.9
83.5
22.7
2956
.314
8.62*
6310
9WHATIS
THENAMEOFTHEFIRSTARTIFICIA
LSATELLITEPUTIN
ORBIT
BY
RUSSIA
IN19
57?
(SPUTNIK
)
.417
5881
9.9
19.8
.08
.50
68.3
79.2
11.1
1146
.014
0.62*
6412
7WHATBRAND
OFCIG
ARETTEWASFIRSTTO
HAVE
THEFLIP-TOPBOX?(M
ARLBORO)
.399
5583
10.8
10.0
.32
.28
27.8
26.7
29.3
4431
.814
0.32*
6529
WHATKIN
DOFMETA
LIS
ASSOCIATED
WITH
A50
TH
WEDDIN
GANNIV
ERSARY?(G
OLD)b
.396
5787
8.5
11.4
.38
.23
48.0
62.2
33.0
5445
.714
4.73*
6639
WHICH
TYPEOFSNAKEDO
ASIA
NSNAKE-CHARMERSUSE?(COBRA)b
.391
5484
9.7
10.3
.28
.33
60.0
74.8
39.5
3940
.914
0.61*
6742
WHATIS
THEONLY
LIQ
UID
META
LATROOM
TEMPERATURE?(M
ERCURY)b
.388
8313
19.5
20.2
.21
.41
49.6
66.6
17.6
4440
.922
0.65*
6856
WHATIS
THENAMEOFTHEDESERTPEOPLEWHO
WANDERIN
STEAD
OFLIV
ING
INONEPLACE?
(NOMADS)b
.352
7413
612
.121
.7.29
.36
47.4
69.1
20.7
6036
.121
6.72*
6912
1WHATIS
THECAPITALOFNEW
YORK?(A
LBANY)
.331
4999
12.8
16.6
.51
.16
68.2
89.0
54.6
7566
.115
3.54*
7010
1WHATIS
THENAMEOFTHEORGAN
THAT
PRODUCESIN
SULIN
?(PANCREAS)b
.327
4910
113
.821
.1.46
.21
54.1
78.1
37.0
6949
.515
1.63*
7114
0WHATIS
THENAMEOFTHECOLLARBONE?
(CLAVICLE)
.324
7014
68.6
13.7
.22
.46
57.4
78.6
25.7
4739
.622
2.56*
7210
4WHATIS
THENAMEOFTHEEXTIN
CTREPTILES
KNOWN
AS“T
ERRIBLELIZARDS”?
(DIN
OSAURS)b
.315
6313
711.2
15.1
.18
.51
32.5
42.8
14.0
3528
.720
7.76*
7354
WHATIS
THECAPITALOFRUSSIA
?(M
OSCOW)b
.309
6414
37.6
14.3
.09
.60
66.7
79.7
20.4
1841
.721
0.77*
7462
WHICH
BREED
OFCATHASBLUEEYES?(SIA
MESE)b
.308
6614
89.4
8.2
.24
.45
48.5
59.1
34.8
5133
.321
7.68*
7510
2WHATIS
THELASTNAMEOFTHESECOND
U.S.
PRESID
ENT?(A
DAMS)b
.303
6314
510
.012
.7.41
.29
46.5
61.0
35.8
8554
.621
5.43*
7615
2WHATIS
THENAMEOFTHECONSTELLATIO
NTHATLOOKSLIK
EA
FLY
ING
HORSE?(PEGASUS)
.300
6414
99.6
12.5
.22
.48
47.0
64.6
22.7
4633
.721
6.71*
7710
6WHATIS
THENAMEOFTHEKIN
DOFCATTHAT
SPOKETO
ALICEIN
THESTORY
“ALICE’S
ADVENTURESIN
WONDERLAND”?
(CHESHIRE)b
.300
6314
710
.416
.8.30
.40
51.3
84.9
18.3
6447
.321
3.71*
1122 Behav Res (2013) 45:1115–1143
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
7864
WHATIS
THELASTNAMEOFTHEMAN
WHO
PROPOSED
THETHEORY
OFRELATIV
ITY?
(EIN
STEIN
)b
.297
6816
19.9
11.8
.21
.49
53.8
65.3
37.2
4743
.323
2.81*
7958
WHATWASTHELASTNAMEOFTHEWOMAN
WHO
SUPPOSEDLY
DESIG
NED
AND
SEWED
THEFIRSTAMERICAN
FLAG?(ROSS)b
.286
6215
58.0
14.0
.24
.48
60.9
87.6
28.5
5143
.022
5.68*
8012
4WHATIS
THELASTNAMEOFTHEFIRSTSIG
NER
OFTHE“D
ECLARATIO
NOFIN
DEPENDENCE”?
(HANCOCK)
.285
6516
311.7
12.2
.44
.27
49.5
64.1
40.1
101
49.0
233
.68*
8118
7WHATWASTHENAMEOFKIN
GARTHUR’S
SWORD?(EXCALIBUR)
.285
4110
310
.09.3
.12
.60
71.1
92.1
20.4
1742
.814
5.86*
8261
WHATIS
THEWORD
THATMEANSA
NAUTICAL
MILEPERHOUR?(K
NOT)b
.277
3910
211.8
17.8
.27
.45
51.6
69.0
33.7
3839
.514
2.75*
8370
WHATIS
THENAMEFORTHEASTRONOMICAL
BODIESTHATENTERTHEEARTH’S
ATMOSPHERE?
(METEORS)b
.271
5414
514
.816
.4.43
.30
46.6
48.7
45.3
8645
.720
5.58*
8487
WHATIS
THELONGESTRIV
ERIN
SOUTH
AMERICA?
(AMAZON)b
.267
40110
9.8
9.3
.29
.44
57.9
79.9
38.0
4445
.315
2.75*
8586
WHATIS
THENAMEOFTHEAUTOMOBILE
INSTRUMENTTHATMEASURESMILEAGE?
(ODOMETER)b
.258
5415
513
.216
.2.39
.35
51.1
77.6
33.5
8155
.521
3.59*
8614
5WHATITALIA
NCITY
WASDESTROYED
WHEN
MOUNTVESUVIU
SERUPTED
IN79
A.D.?(POMPEII)
.258
41118
9.9
12.9
.26
.48
53.9
87.0
20.8
4137
.015
9.70*
87115
WHATIS
THELASTNAMEOFBATMAN’S
SECRET
IDENTITY
INTHEBATMAN
COMICS?(W
AYNE)b
.252
3510
411.0
19.0
.18
.57
68.0
93.9
31.7
2554
.514
1.78*
8866
WHATIS
THELASTNAMEOFTHEMYTHICAL
GIA
NTLUMBERJA
CK?(BUNYAN)b
.245
5115
714
.113
.1.23
.53
58.2
88.9
24.8
4740
.621
2.72*
8919
9WHATIS
THENAMEOFTHECOMPA
NY
THAT
PRODUCES“B
ABY
RUTH”CANDY
BARS?(N
ESTLE)
.245
3410
510
.710
.2.39
.37
42.8
45.1
41.3
5444
.014
0.59*
9010
3WHATIS
THENAMEOFSOCRATES’MOSTFA
MOUS
STUDENT?(PLATO)b
.239
3410
814
.712
.0.35
.42
46.3
55.2
40.0
4938
.914
2.57*
91111
WHATIS
THENAMEOFTHETHREE-LEAFCLOVER
THATIS
THEEMBLEM
OFIRELAND?(SHAMROCK)b
.239
3310
510
.916
.1.25
.51
55.9
84.4
28.1
3447
.413
9.82*
92110
OFWHICH
COUNTRY
ISBUENOSAIRESTHECAPITAL?
(ARGENTIN
A)b
.204
4417
210
.112
.6.50
.29
43.4
70.3
32.6
109
40.4
219
.66*
9360
WHATIS
THELASTNAMEOFTHEACTRESSWHO
RECEIV
ED
THEBESTACTRESSAWARD
FORTHE
MOVIE
“MARY
POPPIN
S”?
(ANDREWS)b
.203
4316
911.5
14.3
.14
.66
58.9
87.3
18.2
3039
.321
8.73*
9412
6WHATIS
THENAMEOFTHEMOUNTA
INRANGEIN
WHICH
MOUNTEVERESTIS
LOCATED?(H
IMALAYAS)b
.198
4116
613
.814
.3.34
.46
42.6
64.4
30.0
7143
.421
3.68*
9580
WHATIS
THEUNIT
OFSOUND
INTENSITY?(D
ECIBEL)b
.190
4017
18.8
14.2
.51
.30
46.1
73.1
36.1
108
41.0
218
.70*
9620
7.188
27117
11.5
16.9
.14
.67
57.5
86.8
18.0
2042
.314
4.71*
Behav Res (2013) 45:1115–1143 1123
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
WHATIS
THENAMEOFTHEPROJECTWHICH
DEVELOPED
THEATOMIC
BOMBDURIN
GWORLD
WARII?(M
ANHATTA
N)
9799
WHATIS
THEUNIT
OFELECTRICALPOWERTHAT
REFERSTO
ACURRENTOFONEAMPEREATONE
VOLT
?(W
ATT)b
.187
26113
12.6
15.6
.32
.49
41.6
59.7
31.1
4537
.014
0.61*
9813
2WHATIS
THELASTNAMEOFTHEAUTHOROFTHE
BOOK
“198
4”?(O
RWELL)b
.185
3716
312
.913
.0.15
.67
66.0
90.5
34.7
2934
.520
4.65*
9969
INWHICH
GAMEAREMEN
CROWNED?(CHECKERS)b
.176
25117
12.9
17.6
.32
.50
39.6
64.0
26.4
4633
.914
3.71*
100
97WHATIS
THELASTNAMEOFTHEMAN
WHO
ASSASSIN
ATED
PRESID
ENTJO
HN
F.KENNEDY?
(OSWALD)b
.172
2512
014
.819
.1.26
.57
55.0
83.9
35.4
3752
.714
7.47*
101
137
WHATIS
THENAMEOFBATMAN’S
BUTLER?
(ALFRED)b
.163
23118
11.4
13.4
.31
.52
51.8
93.0
30.2
4450
.614
2.74*
102
117
WHICH
COUNTRY
WASTHEFIRSTTO
USE
GUNPOWDER?(CHIN
A)b
.160
2312
18.8
11.2
.53
.31
38.9
73.5
28.5
7738
.614
4.69*
103
14WHATIS
THENAMEOFAN
AIRPLANEWITHOUT
AN
ENGIN
E?(G
LID
ER)b
.157
3016
111.8
13.7
.29
.55
33.9
55.8
22.2
5629
.119
6.58*
104
178
WHATIS
THENAMEOFTHENORTH
STA
R?(POLARIS)
.156
3217
36.5
10.6
.21
.63
44.5
81.8
16.6
4338
.121
4.71*
105
159
WHATIS
THEONLY
WORD
THATTHERAVEN
SAYS
INEDGARALLEN
POE’S
POEM
“THERAVEN”?
(NEVERMORE)
.155
2413
111.2
17.2
.37
.48
38.8
91.3
16.7
5735
.615
6.66*
106
46FORWHICH
COUNTRY
ISTHEYEN
THEMONETA
RY
UNIT?(JAPA
N)b
.152
3318
47.1
9.1
.62
.23
54.0
75.5
48.7
134
45.0
222
.70*
107
139
INWHATEUROPEAN
CITY
ISTHEPA
RTHENON
LOCATED?(ATHENS)b
.150
2514
28.4
13.0
.40
.45
51.2
76.8
41.7
6740
.316
9.68*
108
113
WHATIS
THENAMEOFTHEFURRYANIM
AL
THATATTA
CKSCOBRA
SNAKES?(M
ONGOOSE)b
.149
20114
8.0
16.4
.36
.49
46.4
89.7
28.3
4833
.313
6.61*
109
166
FORWHICH
COUNTRY
ISTHERUPEETHE
MONETA
RY
UNIT?(INDIA
).147
3118
08.6
13.3
.27
.58
35.7
71.1
16.8
5824
.521
6.75*
110
154
WHATIS
THELASTNAMEOFTHEMAN
WHO
FIRST
STUDIED
GENETIC
INHERITANCEIN
PLANTS?(M
ENDEL)
.144
3017
99.9
11.2
.21
.65
49.5
85.2
24.6
4329
.221
7.63*
111
107
WHATIS
THELASTNAMEOFTHEMAN
WHO
WROTETHE“STA
RSPA
NGLED
BANNER”?
(KEY)b
.141
2012
28.9
14.8
.22
.64
46.2
85.0
21.1
3142
.914
1.77*
112
112
WHATIS
THENAMEOFTHEPA
LACEIN
LONDON
INWHICH
THEMONARCH
OFENGLAND
RESID
ES?
(BUCKIN
GHAM)b
.141
2917
716
.019
.4.20
.66
46.0
72.9
26.9
4132
.9211
.62*
113
125
INWHICH
GAMEARETHESTA
NDARD
PIECESOF
STA
UNTON
DESIG
N?(CHESS)b
.138
2113
114
.216
.1.14
.72
20.0
30.5
10.0
2221
.415
4.53*
114
206
WHATAREPEOPLEWHO
MAKEMAPSCALLED?
(CARTOGRAPHERS)
.138
2918
19.3
12.4
.41
.45
34.1
73.2
20.8
8632
.021
6.61*
1124 Behav Res (2013) 45:1115–1143
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
115
94WHATWASTHENAMEOFTHEZEPPELIN
THAT
EXPLODED
INLAKEHURSTN.J.IN
1937
?(H
INDENBURG)b
.134
2918
820
.212
.5.13
.74
40.6
68.8
11.3
2824
.022
3.64*
116
167
WHATIS
THEPA
LACEBUILTIN
FRANCEBY
KIN
GLOUIS
XIV
?(V
ERSAILLES)
.128
17116
10.1
13.1
.16
.71
40.7
71.1
16.2
2129
.413
4.38*
117
114
INWHICH
CITY
ISTHEU.S.NAVALACADEMY
LOCATED?(A
NNAPOLIS)b
.127
2718
511.3
20.4
.37
.50
39.0
75.6
26.4
7937
.821
6.61*
118
72WHATIS
THENAMEOFTHELIG
HTESTWOOD
KNOWN?(BALSA)b
.125
2618
29.0
11.9
.45
.43
32.8
48.3
28.5
9328
.521
6.66*
119
31WHATIS
THELASTNAMEOFTHEBOXERWHO
LATERBECAMEKNOWN
ASMUHAMMAD
ALI?
(CLAY)b
.117
1712
810
.613
.1.25
.63
45.1
94.9
21.6
3646
.114
6.69*
120
119
WHATISLAND
ISTHELARGESTIN
THEWORLD
EXCLUDIN
GAUSTRALIA
?(G
REENLAND)b
.111
1612
815
.418
.7.60
.28
34.3
51.3
31.1
8741
.014
4.55*
121
71WHATIS
THENAMEOFTHESMALLJA
PANESE
STOVEUSED
FOROUTDOORCOOKIN
G?(H
IBACHI)b
.110
1612
911.9
10.3
.32
.57
38.2
60.3
30.5
4631
.814
6.65*
122
105
WHATIS
THELASTNAMEOFTHEWOMAN
WHO
BEGAN
THEPROFESSIO
NOFNURSIN
G?
(NIG
HTIN
GALE)b
.108
1613
213
.410
.6.14
.75
41.9
66.9
22.8
2126
.914
8.66*
123
175
WHO
WASTHELEADEROFTHEARGONAUTS?
(JASON)
.107
1512
55.0
11.6
.07
.82
52.2
81.6
8.2
1023
.514
1.69*
124
214
WHATIS
THELASTNAMEOFTHEARTISTWHO
PAIN
TED
“GUERNICA”?
(PICASSO)
.107
2117
611.5
11.7
.16
.73
30.8
56.6
13.8
3220
.820
3.74*
125
177
INWHATANCIENTCITY
WERETHE“H
ANGIN
GGARDENS”LOCATED?(BABYLON)
.103
1412
216
.813
.8.38
.51
36.0
67.9
27.4
5230
.013
6.60*
126
200
WHATAREPEOPLECALLED
WHO
EXPLORE
CAVES?(SPELUNKERS)
.100
2118
814
.712
.6.44
.45
27.7
61.2
20.1
9330
.821
4.53*
127
168
WHATIS
THENAMEOFTHECAPTA
INOFTHE
PEQUOD
INTHEBOOK
“MOBY
DICK”?
(AHAB)
.097
2018
711.7
12.0
.19
.71
41.3
90.9
16.6
4033
.421
2.59*
128
258
WHATIS
THECAPITALOFKENTUCKY?(FRANKFORT)
.095
1918
218
.614
.2.34
.57
48.8
78.4
40.6
6844
.320
5.56*
129
85WHATIS
THENAMEOFAN
ILLEGALMOVEBYA
BASEBALLPITCHERTHATRESULT
SIN
ALL
RUNNERSADVANCIN
GONEBASE?(BALK)b
.093
1413
610
.022
.1.45
.45
53.9
95.7
45.3
6851
.715
2.51*
130
129
WHATIS
THELASTNAMEOFTHEAMERICAN
WHO
STA
RRED
INTHE19
36OLY
MPICS?(O
WENS)b
.093
1413
612
.111.6
.17
.74
31.2
58.6
15.8
2522
.914
9.59*
131
174
THEDEEPESTPA
RTOFTHEOCEAN
ISLOCATED
ATWHICH
TRENCH?(M
ARIA
NA)
.093
1918
511.2
13.2
.29
.61
29.4
70.1
16.6
6026
.420
8.62*
132
169
WHICH
SPORTUSESTHETERMS“STONES”AND
“BROOMS”?
(CURLIN
G)
.092
1312
819
.314
.7.48
.43
37.3
74.6
30.0
6736
.814
2.61*
133
182
WHATIS
THEPROPERNAMEFORA
BADMIN
TON
BIRD?(SHUTTLECOCK)
.091
2020
09.8
10.0
.49
.42
49.6
88.5
42.4
108
37.1
225
.72*
134
128
.090
2020
39.2
14.0
20.71
43.2
87.5
23.0
4435
.122
9.64*
Behav Res (2013) 45:1115–1143 1125
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
WHATIS
THELASTNAMEOFTHEAUTHORWHO
WROTE“O
LIV
ERTWIST”?
(DICKENS)b
135
196
WHATIS
THECAPITALOFDELAWARE?(D
OVER)
.090
1919
39.9
19.4
.15
.76
39.8
74.6
19.2
3236
.821
6.60*
136
120
WHATIS
THELASTNAMEOFTHEMAN
WHO
INVENTED
THEPHONOGRAPH?(EDISON)b
.086
1718
015
.89.5
.24
.68
43.8
63.2
36.8
4729
.820
0.76*
137
48IN
WHICH
TYPEOFSKIRACEDOESTHEDOWNHILL
SKIERMAKESHARPTURNSAROUND
POLES?
(SLALOM)b
.086
1920
214
.319
.0.29
.62
30.4
68.3
19.3
6533
.622
6.55*
138
153
INWHICH
CITY
ISHEATHROW
AIRPORTLOCATED?
(LONDON)b
.083
1213
38.1
14.6
.26
.66
31.4
90.8
12.6
3824
.214
5.50*
139
235
WHATIS
THECAPITALOFJA
MAICA?(K
INGSTON)
.081
1213
710
.513
.3.18
.74
34.1
77.5
14.7
2730
.515
0.49*
140
44WHICH
PLANETWASTHELASTTO
BEDISCOVERED?
(NEPTUNE)b
.080
1719
518
.47.5
.77
.15
51.9
47.6
52.3
164
50.5
217
.76*
141
185
WHATIS
THELASTNAMEOFTHEAUTHORWHO
WROTE“T
HEMURDERSIN
THERUEMORGUE”?
(POE)
.080
1112
78.5
13.6
.11
.81
28.3
55.5
8.5
1522
.714
1.82*
142
205
WHATIS
THENAMEOFTHESHIP
ON
WHICH
CHARLES
DARWIN
MADEHIS
SCIENTIFIC
VOYAGE?(BEAGLE)
.079
1112
910
.215
.3.16
.76
38.3
98.1
8.5
2228
.114
2.54*
143
213
WHATIS
THECAPITALOFCHILE?(SANTIA
GO)
.077
1113
115
.311.6
.19
.73
35.2
70.0
21.0
2733
.814
3.41*
144
100
WHATIS
THELASTNAMEOFTHEAUTHORWHO
WROTE“T
HEOLD
MAN
AND
THESEA”?
(HEMIN
GWAY)b
.077
1619
38.9
12.6
.11
.81
39.3
75.4
14.1
2322
.521
3.73*
145
147
WHATIS
THELASTNAMEOFTHEMAN
WHO
WROTE“C
ANTERBURY
TALES”?
(CHAUCER)b
.076
1113
410
.115
.5.23
.69
37.0
93.2
18.8
3433
.614
8.60*
146
262
WHATIS
THENAMEOFTHEFOUNTA
ININ
ROMEIN
TO
WHICH
COIN
SARETHROWN
FORGOOD
LUCK?
(TREVI)
.071
1418
324
.712
.2.32
.60
28.9
86.6
16.3
6434
.120
5.52*
147
162
WHATWASTHELASTNAMEOFTHEMAN
WHO
WAS
PRESID
ENTDIRECTLY
AFTERJA
MESMADISON?
(MONROE)b
.068
1520
511.7
14.7
.40
.53
29.3
64.3
23.3
8835
.322
1.53*
148
143
WHATIS
THELASTNAMEOFTHEASTRONOMER
WHO
PUBLISHED
IN15
43HIS
THEORY
THATTHE
EARTH
REVOLV
ESAROUND
THESUN?(COPERNICUS)b
.067
912
615
.016
.8.50
.44
50.5
63.3
48.8
6740
.213
9.69*
149
242
WHATIS
THELASTNAMEOFTHECRIM
INALWHO
WASKNOWN
AS“SCARFA
CE”?
(CAPONE)
.066
1419
99.9
14.3
.38
.56
57.7
60.6
57.3
8050
.122
0.78*
150
12WHATIS
THENAMEOFTHELONERANGER’S
INDIA
NSID
EKICK?(TONTO)b
.061
1320
07.5
11.6
.17
.77
25.3
71.8
8.9
3722
.321
9.52*
151
170
WHATIS
THECAPITALOFDENMARK?
(COPENHAGEN)b
.060
1320
423
.414
.4.18
.76
29.0
52.1
21.3
3927
.222
1.51*
152
96.059
1219
09.5
20.7
.13
.81
32.9
79.9
11.3
2624
.720
9.44*
1126 Behav Res (2013) 45:1115–1143
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
WHATWASTHELASTNAMEOFTHEMAN
WHO
WASTHERADIO
BROADCASTERFORTHE“W
AR
OFTHEWORLDS”?
(WELLES)b
153
203
INWHICH
CITY
ISMICHELANGELO’S
STA
TUEOF
DAVID
LOCATED?(FLORENCE)
.058
812
914
.510
.0.64
.30
39.3
60.0
37.4
8843
.013
8.65*
154
146
WHATWASFRANK
LLOYD
WRIG
HT’S
PROFESSIO
N?
(ARCHITECT)b
.058
1219
67.8
11.1
.45
.49
33.7
91.7
26.3
9425
.921
4.65*
155
135
OFWHICH
COUNTRY
ISNAIROBITHECAPITAL?
(KENYA)b
.053
712
66.6
14.6
.34
.61
27.9
79.1
19.9
4526
.313
4.53*
156
134
WHATIS
THENAMEOFTHEHILLBILLY
FAMILY
THATHAD
AFA
MOUSFEUD
WITH
THEMCCOY
FAMILY?(H
ATFIELD)b
.052
1119
912
.716
.0.22
.73
30.8
81.8
18.6
4627
.721
5.69*
157
156
WHATKIN
DOFPOISON
DID
SOCRATESTA
KEASHIS
EXECUTIO
N?(H
EMLOCK)b
.052
1120
07.5
13.8
.27
.67
26.7
87.8
15.1
5823
.321
6.63*
158
74WHATIS
THELASTNAMEOFTHEFIRSTPERSON
TO
COMPLETEA
SOLO
FLIG
HTACROSSTHEATLANTIC
OCEAN?(LIN
DBERGH)b
.052
1120
115
.614
.7.38
.57
43.1
81.8
37.8
8036
.121
9.66*
159
38ANDY
GRIFFITH
WASTHESHERIFFOFWHATTOWN
ON
TELEVISIO
N’S
“ANDY
GRIFFITH
SHOW”?
(MAYBERRY)b
.052
1120
29.7
13.6
.15
.80
34.3
94.5
12.9
3128
.322
0.64*
160
142
WHATIS
THENAMEOFTHEROMAN
EMPEROR
WHO
FID
DLED
WHILEROMEBURNED?(N
ERO)b
.052
1120
210
.614
.8.25
.70
33.8
72.3
25.8
5323
.422
0.69*
161
231
WHATIS
THECITY
INWHICH
THEBASEBALLHALL
OFFA
MEIS
LOCATED?(COOPERSTOWN)
.051
713
09.8
17.2
.41
.54
29.7
67.9
25.0
5643
.713
7.51*
162
98WHATIS
THENAMEOFTHEUNIT
OFMEASURE
THATREFERSTO
ASIX
-FOOTDEPTH
OFWATER?
(FATHOM)b
.051
1120
619
.217
.0.32
.63
34.9
70.9
29.3
7029
.822
1.49*
163
108
WHATIS
THELASTNAMEOFTHESCIENTISTWHO
DISCOVERED
RADIU
M?(CURIE)b
.046
918
68.9
11.4
.19
.76
19.5
65.0
8.7
3819
.920
1.74*
164
149
WHATIS
THELASTNAMEOFTHEAUTHORWHO
WROTE“B
RAVENEW
WORLD”?
(HUXLEY)b
.045
714
910
.914
.2.19
.77
32.9
98.6
17.1
2932
.315
7.67*
165
164
INADDITIO
NTO
THEKENTUCKY
DERBYAND
THE
BELMONTSTA
KESWHATHORSERACECOMPRISES
THETRIPLECROWN?(PREAKNESS)b
.044
1021
821
.021
.9.16
.80
33.4
96.5
15.9
3626
.223
3.66*
166
204
WHATIS
THELASTNAMEOFTHECRIM
INALWHO
WASKILLED
BY
FBIAGENTSOUTSID
EOFA
CHICAGO
MOVIE
THEATER?(D
ILLIN
GER)
.044
919
717
.420
.6.20
.76
31.8
81.1
20.9
4122
.4211
.68*
167
95WHATIS
THENAMEOFTHESIN
GERWHO
POPULARIZED
ADANCEKNOWN
ASTHE“T
WIST”?
(CHECKER)b
.041
613
921
.412
.8.30
.66
31.4
63.5
27.0
4432
.514
6.49*
168
221
OVERWHICH
RIV
ERIS
THEGEORGEWASHIN
GTON
BRID
GE?(H
UDSON)
.041
614
132
.214
.1.37
.59
32.5
73.3
27.9
5433
.914
8.39*
Behav Res (2013) 45:1115–1143 1127
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
169
189
WHATIS
THELASTNAMEOFTHEMAN
WHO
INVENTED
DYNAMITE?(N
OBEL)b
.040
614
37.4
11.3
.26
.70
24.6
95.0
13.8
3925
.814
9.54*
170
228
WHATIS
THENAMEOFTHECHIN
ESERELIG
ION
FOUNDED
BY
LAO
TSE?(TAOISM)
.040
819
213
.013
.0.42
.54
37.9
56.3
36.1
8428
.620
7.74*
171
84WHATIS
THELASTNAMEOFTHECOMMANDER
WHO
LOSTTHEBATTLEOFTHELITTLE
BIG
HORN
RIV
ER?(CUSTER)b
.038
820
111.0
12.5
.20
.77
31.9
76.3
23.2
4126
.521
2.66*
172
155
WHATIS
THENAMEOFTHENAVIG
ATIO
NIN
STRUMENTUSED
ATSEATO
PLOTPOSITIO
NBY
THESTA
RS?(SEXTA
NT)b
.038
512
714
.919
.4.54
.42
32.3
62.2
30.2
7136
.813
4.58*
173
161
WHO
WASTHEMOSTFA
MOUSGREEK
DOCTOR?
(HIPPOCRATES)b
.037
513
116
.215
.3.18
.79
27.1
83.0
15.5
2423
.313
9.68*
174
165
INWHICH
CITY
DOESTHECOTTON
BOWLTA
KE
PLACE?(D
ALLAS)b
.037
513
110
.714
.3.36
.60
23.8
16.0
24.6
4933
.713
8.56*
175
192
WHATIS
THELASTNAMEOFTHEAUTHORWHO
WROTETHESHERLOCK
HOLMESSTORIES?
(DOYLE)
.036
821
217
.013
.4.18
.79
30.1
90.6
17.6
3934
.022
6.59*
176
225
FORWHICH
COUNTRY
ISTHEDRACHMATHE
MONETA
RY
UNIT?(G
REECE)
.036
513
519
.615
.4.31
.66
24.7
88.0
17.3
4320
.914
1.27
177
148
WHATIS
THENAMEOFTHEMANSIO
NIN
VIRGIN
IATHATWASTHOMASJEFFERSON’S
HOME?(M
ONTICELLO)b
.035
719
111.9
16.9
.15
.81
29.5
89.3
15.5
3026
.720
5.51*
178
236
WHATIS
THELONGESTRIV
ERIN
ASIA
?(YANGTZE)
.035
719
117
.310
.0.37
.59
33.4
32.1
33.5
7432
.220
2.71*
179
183
WHATIS
THELASTNAMEOFTHEACTORWHO
RECEIV
ED
THEBESTACTORAWARD
FOR
THEMOVIE
“ON
THEWATERFRONT”?
(BRANDO)b
.034
514
311.3
7.3
.08
.89
31.7
100.0
3.3
1224
.715
1-.06
180
91WHATIS
THELASTNAMEOFTHEMALESTA
ROFTHEMOVIE
“CASABLANCA”?
(BOGART)b
.034
514
49.6
18.1
.27
.70
26.8
86.0
19.4
4033
.414
9.55*
181
150
OFWHICH
COUNTRY
ISBUDAPESTTHECAPITAL?
(HUNGARY)b
.033
720
59.9
11.9
.43
.54
28.9
70.9
25.7
9126
.021
5.64*
182
191
WHO
ISKNOWN
AS“T
HEFA
THEROF
GEOMETRY”?
(EUCLID
)b.033
514
820
.713
.2.31
.66
25.5
70.0
20.7
4730
.415
3.41*
183
193
WHATIS
THELASTNAMEOFTHEHUSBAND-W
IFE
SPIESWHO
WEREELECTROCUTED
IN19
51FORPA
SSIN
GATOMIC
SECRETSTO
RUSSIA
?(ROSENBERG)
.031
412
629
.014
.9.17
.80
21.7
56.3
15.5
2220
.613
2.42*
184
261
WHATIS
THELASTNAMEOFTHECOMPOSERWHO
WROTE
THEOPERA
“DON
GIO
VANNI”?(M
OZART)
.030
412
810
.112
.1.21
.76
18.3
13.8
18.9
2818
.513
2.60*
185
190
WHATIS
THELASTNAMEOFTHEAUTHOROF
THEJA
MESBOND
NOVELS?(FLEMIN
G)b
.030
722
511.4
9.6
.16
.81
19.0
80.7
7.6
3829
.123
4.45*
186
122
WHATWASTHELASTNAMEOFBUFFA
LO
BILL?
(CODY)b
.030
619
614
.210
.2.27
.70
29.0
79.8
23.5
5526
.020
7.62*
1128 Behav Res (2013) 45:1115–1143
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
187
136
WHATIS
THELASTNAMEOFTHEAUTHORWHO
WROTE
UNDERTHEPSEUDONYM
OFMARK
TWAIN
?(CLEMENS)b
.029
620
115
.211.8
.16
.81
21.6
61.0
14.6
3424
.121
4.68*
188
233
WHATIS
THENAMEOFTHEISLAND
ON
WHICH
NAPOLEON
WASBORN?(CORSICA)
.029
413
638
.313
.5.28
.69
25.0
72.5
20.1
3927
.414
1.40*
189
157
WHATIS
THELASTNAMEOFTHEDOCTORWHO
FIRSTDEVELOPED
AVACCIN
EAGAIN
STPOLIO
?(SALK)b
.028
413
716
.119
.8.16
.82
26.2
80.0
16.4
2229
.314
3.68*
190
181
WHATIS
THELASTNAMEOFTHEMAN
WHO
BEGAN
THEREFORMATIO
NIN
GERMANY?(LUTHER)b
.028
413
818
.79.9
.53
.44
54.1
75.0
53.0
7542
.114
2.64*
191
211
WHATIS
THECAPITALOFFIN
LAND?(H
ELSIN
KI)
.026
414
914
.010
.4.17
.80
19.2
67.3
11.8
2628
.415
4.53*
192
188
WHATWASTHENAMEOFTHEAPOLLO
LUNAR
MODULETHATLANDED
THEFIRSTMAN
ON
THEMOON?(EAGLE)b
.025
519
330
.916
.9.37
.61
28.9
38.4
28.2
7339
.024
1.67*
193
264
WHATIS
THELASTNAMEOFTHECOSMONAUT
WHO
WASTHEFIRSTPERSON
TO
ORBIT
AROUND
THEEARTH?(G
AGARIN
)
.024
520
710
.914
.6.28
.69
31.0
70.0
27.8
6026
.221
7.46*
194
243
WHATWASTHENAMEOFROY
ROGER’S
DOG?
(BULLET)
.021
313
88.6
8.1
.23
.74
7.1
3.3
7.5
3321
.914
1.48*
195
171
WHATWASTHENAMEOFALEXANDERGRAHAM
BELL’SASSISTA
NT?(W
ATSON)b
.021
313
912
.513
.7.13
.85
22.6
26.7
21.9
1923
.114
6.50*
196
176
WHATWASTHELASTNAMEOFTHECOMPOSER
OFTHE“M
APLELEAFRAG”?
(JOPLIN
)b.020
419
69.8
9.5
.15
.83
14.3
75.0
6.2
3016
.720
7.75*
197
216
WHATIS
THELASTNAMEOFTHEPLAYWRIG
HTWHO
WROTE“A
STREETCARNAMED
DESIRE”?
(WILLIA
MS)
.020
419
726
.913
.1.13
.85
18.4
87.5
8.1
2720
.120
5.77*
198
158
WHATIS
THELASTNAMEOFTHEAUTHOROF
“LITTLEWOMEN”?
(ALCOTT)b
.020
419
86.4
11.4
.17
.81
20.0
72.5
13.9
3425
.320
5.76*
199
209
WHATIS
THELASTNAMEOFTHEFIRSTPERSON
TO
CLIM
BMOUNTEVEREST?(H
ILLARY)
.020
314
98.4
9.9
.13
.85
22.8
96.7
11.8
2025
.515
5.62*
200
68WHATIS
THELASTNAMEOFTHEACTORWHO
PLAYED
RHETTBUTLERIN
“GONEWITH
THE
WIN
D”?
(GABLE)b
.020
419
922
.716
.0.14
.84
17.0
68.8
9.6
2823
.920
8.32
201
254
INWHICH
COUNTRY
ISANGELFA
LLSLOCATED?
(VENEZUELA)
.020
419
917
.212
.7.39
.59
27.4
76.3
25.0
8024
.720
6.66*
202
218
WHATIS
THECAPITALOFCANADA?(O
TTA
WA)
.019
420
718
.111.8
.73
.25
41.5
65.0
40.9
154
44.8
215
.61*
203
286
WHATIS
THELASTNAMEOFTHETWENTY-FIRST
U.S.PRESID
ENT?(A
RTHUR)
.019
420
826
.416
.8.49
.49
23.4
93.8
20.7
104
32.0
218
.53*
204
274
WHATWASTHENAMEOFTHEGOLDFISH
INTHE
STORY
OFPIN
OCCHIO
?(CLEO)
.019
421
216
.010
.9.24
.74
15.8
90.0
10.0
5230
.122
1.45*
205
282
WHATIS
THENAMEOFTHEVILLAIN
OUSPEOPLE
WHO
LIV
ED
UNDERGROUND
INH.G.WELLS’S
BOOK
“THETIM
EMACHIN
E”?
(MORLOCKS)
.018
421
919
.516
.4.17
.81
13.5
75.0
7.1
3819
.622
8.52*
Behav Res (2013) 45:1115–1143 1129
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
206
224
WHATWASTHELASTNAMEOFTHECHARACTER
PORTRAYED
BY
ROBERTSTA
CK
ON
THETELEVISIO
NSHOW
“THEUNTOUCHABLES”?
(NESS)
.015
319
511.4
14.9
.12
.86
10.8
63.3
4.2
2424
.020
3.57*
207
284
WHATIS
THECAPITALOFAUSTRALIA
?(CANBERRA)
.015
319
615
.57.7
.63
.35
70.3
100.0
69.6
126
52.2
204
.62*
208
259
WHATIS
THELASTNAMEOFTHEARTISTWHO
PAIN
TED
“THEPERSISTENCEOFMEMORY”?
(DALI)
.015
213
416
.013
.7.21
.77
14.3
57.5
11.3
2919
.314
0.48*
209
144
WHATIS
THELASTNAMEOFTHEMAN
WHO
INVENTED
THETELEGRAPH?(M
ORSE)b
.014
321
09.1
12.0
.41
.58
41.8
83.3
40.3
8735
.821
8.79*
210
160
WHATIS
THENAMEOFTHERIV
ERON
WHICH
BONN
ISLOCATED?(RHIN
E)b
.014
321
017
.512
.1.16
.83
12.9
43.3
10.2
3417
.521
9.69*
211
247
WHATIS
THENAMEOFTHESUBSTA
NCEDERIV
ED
FROM
AWHALETHATIS
USED
TO
MAKEPERFUME?
(AMBERGRIS)
.014
214
141
.612
.9.45
.54
33.8
55.0
33.1
6428
.814
3.73*
212
133
WHATIS
THENAMEOFTHESUBMARIN
EIN
JULESVERNE’S
“20,00
0LEAGUESBENEATH
THESEA”?
(NAUTILUS)b
.014
214
38.4
11.0
.12
.86
15.7
100.0
6.3
1823
.814
6.76*
213
223
WHATWASTHENAMEOFTHECLOWN
ON
THE
“HOWDY
DOODY”TELEVISIO
NSHOW?(CLARABELL)
.014
214
324
.210
.0.18
.81
18.5
45.0
16.5
2625
.314
7.89*
214
226
WHATIS
THELASTNAMEOFDAGWOOD’S
BOSSIN
THECOMIC
STRIP
“BLONDIE”?
(DITHERS)
.010
219
09.3
10.9
.10
.89
15.4
92.5
7.7
2020
.219
8.29
215
184
WHATIS
THELASTNAMEOFTHEMOVIE
ACTOR
WHO
PORTRAYED
SPA
RTA
CUS?(D
OUGLAS)b
.010
219
27.6
12.0
.27
.72
31.5
45.0
31.0
5231
.320
2.67*
216
230
WHATIS
THELASTNAMEOFTHEWOMAN
WHO
FOUNDED
THEAMERICAN
RED
CROSS?(BARTON)
.010
219
814
.115
.6.27
.73
18.0
87.5
15.4
5326
.420
6.55*
217
292
WHATIS
THELASTNAMEOFTHEUNIO
NGENERAL
WHO
DEFEATED
THECONFEDERATEARMYATTHE
CIV
ILWARBATTLEOFGETTYSBURG?(M
EADE)
.010
220
116
.614
.7.44
.55
35.8
60.0
35.3
8935
.520
9.55*
218
198
WHATIS
THENAMEOFTHEAVENUETHAT
IMMEDIATELY
FOLLOWSATLANTIC
AVENUEIN
THEGAMEOFMONOPOLY
?(V
ENTNOR)b
.010
220
231
.816
.4.38
.61
23.1
75.0
21.7
7832
.021
3.63*
219
92WHICH
GAMEUSESA
DOUBLIN
GCUBE?(BACKGAMMON)b
.010
220
826
.715
.7.26
.73
23.6
25.0
23.5
5527
.621
3.72*
220
296
WHATIS
THELASTNAMEOFTHEMAN
WHO
SUPPOSEDLY
KILLED
JESSEJA
MES?(FORD)
.009
221
59.4
16.6
.19
.80
13.2
47.5
11.5
4225
.222
2.53*
221
245
WHATIS
THELASTNAMEOFTHEEUROPEAN
AUTHORWHO
WROTE“T
HETRIA
L”?
(KAFKA)
.008
112
770
.811.4
.13
.87
2.8
0.0
3.0
1619
.912
9.27
222
255
THEGENERALNAMED
HANNIBALWASFROM
WHATCITY?(CARTHAGE)
.007
113
711.5
14.9
.28
.71
13.4
40.0
12.7
3924
.714
3.43*
223
237
WHATIS
THELASTNAMEOFTHEBRITISH
ADMIRALWHO
WON
THEBATTLEOFTRAFA
LGAR?(N
ELSON)
.007
113
86.9
13.4
.12
.88
8.6
100.0
2.9
1618
.414
1-.12
224
265
WHATIS
THENAMEOFTHEIN
DIA
NCOLLEGE
INPENNSYLV
ANIA
FORWHICH
JIM
THORPE
PLAYED
FOOTBALL?(CARLISLE)
.007
114
566
.720
.0.17
.82
11.8
100.0
8.3
2524
.314
7.08
1130 Behav Res (2013) 45:1115–1143
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
225
273
WHATIS
THENAMEOFTHEPLAY
INWHICH
ELW
OOD
P.DOWD
ISA
CHARACTER?(H
ARVEY)
.007
114
56.8
21.8
.12
.88
16.8
100.0
11.9
1720
.214
7.55*
226
251
WHATFA
MOUSKNOTDID
ALEXANDERTHE
GREATUNDO?(G
ORDIA
N)
.007
114
84.5
12.6
.17
.82
8.0
100.0
4.5
2624
.015
1.15
227
131
WHATWASTHENAMEOFTHEUNSUCCESSFUL
AUTO
THATWASMANUFA
CTURED
BY
THE
FORD
MOTORCOMPA
NY
FROM
1957
–19
59?(EDSEL)b
.007
114
95.2
17.9
.15
.85
20.3
100.0
16.7
2226
.715
2.67*
228
293
WHATIS
THELASTNAMEOFTHESONG
WRITER
WHO
WROTETHESONG
“ILOVEPA
RIS”?
(PORTER)
.007
114
935
.910
.9.10
.89
10.9
50.0
8.3
1520
.015
3.68*
229
297
WHATIS
THELASTNAMEOFTHEFIRSTAMERICAN
AUTHORTO
WIN
THENOBELPRIZEFOR
LITERATURE?(LEWIS)
.007
115
026
.315
.4.24
.75
19.6
20.0
19.6
3626
.515
1.85*
230
219
WHATIS
THELASTNAMEOFTHEIN
VENTOROF
THEWIRELESSRADIO
?(M
ARCONI)
.007
115
25.8
14.1
.24
.75
25.3
40.0
24.9
3726
.015
4.22
231
267
WHATIS
THELASTNAMEOFTHEARTISTWHO
PAIN
TED
“AMERICAN
GOTHIC”?
(WOOD)
.007
115
218
.814
.0.19
.80
18.5
100.0
15.7
2924
.615
3.45*
232
195
INWHATPROFESSIO
NWASEMMETTKELLY
?(CLOWN)b
.006
115
33.9
9.8
.31
.68
15.6
100.0
13.8
4822
.815
7.15
233
249
WHATIS
THENAMEOFTHERIV
ERTHATRUNS
THROUGH
ROME?(TIBER)
.006
115
43.5
18.1
.23
.76
22.8
100.0
20.6
3632
.015
7.51*
234
285
WHATIS
THELASTNAMEOFTHEPOETWHO
ORIG
INALLY
WROTE“D
ON
JUAN”?
(BYRON)
.006
116
215
.313
.6.17
.83
17.0
75.0
14.9
2721
.716
6.44*
235
210
WHATIS
THELASTNAMEOFTHEFRENCH
AUTHORWHO
WROTE“T
HESTRANGER”?
(CAMUS)
.005
118
87.4
10.8
.12
.88
8.8
100.0
4.6
2217
.819
8.87*
236
250
WHO
WASTHEFIRSTRULEROFTHEHOLY
ROMAN
EMPIRE?(CHARLEMAGNE)
.005
119
715
.012
.8.47
.53
30.9
50.0
30.7
9328
.920
5.59*
237
276
WHATIS
THELASTNAMEOFTHEMAN
WHO
ISREGARDED
ASTHENATIO
NALPOETOF
SCOTLAND?(BURNS)
.005
119
86.0
12.8
.15
.84
9.6
70.0
7.6
3014
.320
2.23
238
202
WHATIS
THELASTNAMEOFTHEFOOTBALL
PLAYERKNOWN
AS“T
HEGALLOPIN
GGHOST”?
(GRANGE)
.005
119
96.6
12.7
.20
.80
6.4
100.0
4.1
4027
.920
5-.08
239
118
WHATIS
THENAMEOFROY
ROGERS’HORSE?
(TRIG
GER)b
.005
120
23.9
9.4
.24
.76
17.4
100.0
15.7
4819
.020
8.30*
240
288
WHATWASTHENAMEOFTHENUCLEARSUBMARIN
ETHATSUNK
INTHEATLANTIC
IN19
63?(THRESHER)
.005
120
442
.616
.7.15
.84
11.8
90.0
9.3
3122
.1211
.46*
241
248
WHATIS
THENAMEOFTHEMAN
WHO
REMOVED
THE
THORN
FROM
THELIO
N’S
PAW
INTHE
STORY
FROM
AESOP’S
FABLES?(A
NDROCLES)
.005
120
523
.812
.3.19
.80
14.3
20.0
14.2
4022
.721
0.72*
242
232
WHATIS
THENAMEOFTHEBRIG
HTESTSTA
RIN
THESKY
EXCLUDIN
GTHESUN?(SIRIU
S)
.005
120
79.8
12.7
.71
.29
46.4
50.0
46.4
147
44.7
216
.69*
243
290
.005
120
721
.913
.3.13
.86
10.7
80.0
8.2
2825
.9211
.39*
Behav Res (2013) 45:1115–1143 1131
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
WHATIS
THENAMEOFTHELAND
OFTHEGIA
NTS
IN“G
ULLIV
ER’S
TRAVELS”?
(BROBDIN
GNAG)
244
220
WHATWASTHELASTNAMEOFTHEFEMALESTA
ROF
THEMOVIE
“CASABLANCA”?
(BERGMAN)
.005
120
97.4
10.9
.19
.80
13.3
99.0
11.1
4024
.321
2.44*
245
238
WHATIS
THELASTNAMEOFTHEACTORKNOWN
AS
“THEMAN
OFATHOUSAND
FACES”?
(CHANEY)
.005
121
08.3
15.9
.27
.73
18.0
95.0
16.6
5626
.321
8.71*
246
194
WHATIS
THENAMEOFTHEBASEBALL
PLAYERWITH
THEHIG
HESTLIFETIM
EBATTIN
GAVERAGEIN
THEMAJO
RLEAGUES?(COBB)b
.005
121
27.8
14.1
.68
.32
35.7
100.0
35.2
144
43.3
218
.52*
247
116
WHATWASTHELASTNAMEOFTHE
ACTORIN
THEROLEOFPERRY
MASON
ON
TELEVISIO
N?(BURR)b
.005
121
312
.010
.2.12
.87
13.6
100.0
10.2
2620
.621
9.49*
248
212
WHATIS
THELASTNAMEOFTHEMOST
POPULARPIN
-UPGIRLOFWORLD
WARII?
(GRABLE)
.004
122
515
.514
.0.42
.58
39.9
100.0
39.2
9430
.523
3.72*
249
50WHATIS
THENAMEOFTHELARGESTDESERT
ON
EARTH?(A
NTA
RTICA)b
.000
203
8.7
.78
.22
59.4
59.4
159
54.5
208
.77*
250
123
WHATIS
THELASTNAMEOFTHEJO
CKEY
WITH
THEMOSTLIFETIM
EWIN
NERSIN
HORSERACIN
G?(BAZE)b
.000
148
13.0
.15
.85
5.5
5.5
2220
.914
8.25
251
130
WHATIS
THELASTNAMEOFTHEMAN
WHO
WASTHEVOICEOFMR.MAGOO?(BACKUS)b
.000
220
11.2
.17
.83
15.4
15.4
3722
.622
6.46*
252
138
WHATIS
THELASTNAMEOFTHEACTORWHO
PORTRAYED
SERGEANTFRID
AY
ON
“DRAGNET”?
(WEBB)b
.000
211
10.4
.13
.87
2.3
2.3
2817
.421
4.44*
253
141
WHATWASTHELASTNAMEOFTHEACTORWHO
PORTRAYED
THEFA
THERON
THETELEVISIO
NSHOW
“FATHERKNOWSBEST”?
(YOUNG)b
.000
150
13.8
.09
.91
19.7
19.7
1427
.715
3.59*
254
151
WHATWASTHELASTNAMEOFTHEVENTRILOQUIST
WHO
PROVID
ED
THEVOICEFORCHARLIE
MCCARTHY?(BERGEN)b
.000
148
12.6
.14
.86
7.5
7.5
2116
.614
8.70*
255
163
WHATWASTHELASTNAMEOFTHECAPTA
INOFTHEBRITISH
SHIP
“BOUNTY”WHEN
THE
MUTIN
YOCCURRED?(BLIG
H)b
.000
134
18.3
.13
.87
7.9
7.9
1717
.513
7.20
256
172
WHATIS
THELASTNAMEOFTHEIN
VENTOR
OFTHESTEAMBOAT“C
LERMONT”?
(FULT
ON)b
.000
219
9.7
.23
.77
10.5
10.5
5019
.122
3.49*
257
173
WHATIS
THENAMEOFGERMANY’S
LARGEST
BATTLESHIP
THATWASSUNK
INWORLD
WARII?
(BISMARCK)b
.000
148
14.5
.15
.85
23.3
23.3
2228
.814
8.59*
258
179
WHATIS
THELASTNAMEOFTHEJU
DGEWHO
WAS
KNOWN
AS“T
HELAW
WESTOFTHEPECOS”?
(BEAN)b
.000
156
9.1
.08
.92
2.1
2.1
1318
.415
7.77*
1132 Behav Res (2013) 45:1115–1143
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
259
180
WHATIS
JOHN
KENNETH
GALBRAITH’S
PROFESSIO
N?
(ECONOMIST)b
.000
219
10.6
.26
.74
8.4
8.4
5818
.722
4.35*
260
186
WHATWASTHENAMEOFTHEUNIO
NIRONCLAD
SHIP
THATFOUGHTTHECONFEDERATEIRONCLAD
MERRIM
ACK?(M
ONITOR)b
.000
207
17.6
.14
.86
3.2
3.2
2816
.621
2.38*
261
197
WHATIS
THELASTNAMEOFTHEDOCTORWHO
PERFORMED
THEFIRSTSUCCESSFULHUMAN
HEARTTRANSPLANT?(BARNARD)b
.000
151
11.0
.13
.87
11.0
11.0
1919
.415
4.79*
262
208
WHATIS
THELASTNAMEOFTHEMAN
WHO
SAID
“IONLY
REGRETTHATIHAVEBUTONELIFETO
LOSEFORMY
COUNTRY”?
(HALE)
.000
206
18.3
.27
.73
17.9
17.9
5628
.321
2.49*
263
215
WHATIS
THELASTNAMEOFTHEPILOTOFTHEU-2
SPY
PLANESHOTDOWN
OVERRUSSIA
IN19
60?(POWERS)
.000
144
12.7
.13
.88
10.6
10.6
1824
.614
7.54*
264
217
WHATIS
THELASTNAMEOFTHEACTORWHO
PORTRAYED
THESHERIFFIN
THEMOVIE
“HIG
HNOON”?
(COOPER)
.000
145
10.9
.19
.81
16.7
16.7
2722
.514
6.51*
265
222
WHATIS
THENAMEOFTHEMOUNTA
INRANGETHAT
SEPA
RATESASIA
FROM
EUROPE?(U
RAL)
.000
212
14.0
.50
.50
33.8
33.8
107
35.1
217
.65*
266
227
WHATIS
THELASTNAMEOFTHEBOXERWHO
WASKNOWN
ASTHE“M
ANASSA
MAULER”?
(DEMPSEY)
.000
140
10.5
.24
.76
14.6
14.6
3325
.014
4.62*
267
229
WHATIS
THELASTNAMEOFTHEMAN
WHO
CREATED
THECOMIC
STRIP
“LI’LABNER”?
(CAPP)
.000
146
13.5
.14
.86
3.9
3.9
2019
.615
0.21
268
234
WHATIS
THELASTNAMEOFTHEBASEBALL
PLAYERWHO
PITCHED
APERFECTGAMEIN
THE
1956
WORLD
SERIES?(LARSEN)
.000
217
10.3
.36
.64
22.0
22.0
7934
.022
3.56*
269
239
WHATIS
THELASTNAMEOFTHEFIRSTMAN
TO
RUN
THEMILEIN
UNDERFOURMIN
UTES?(BANNISTER)
.000
158
13.5
.25
.75
23.2
23.2
4022
.616
1.59*
270
240
WHATIS
THELASTNAMEOFTHEAUTHORWHO
WROTE“B
ROTHERSKARAMAZOV”?
(DOSTOYEVSKI)
.000
200
10.9
.14
.87
7.5
7.5
2715
.020
8.78*
271
244
WHATIS
THENAMEOFTHEAUTHORWHO
RECEIV
ED
APULITZERPRIZEFORHIS
WRITIN
GS
ABOUTABRAHAM
LIN
COLN?(SANDBURG)
.000
205
10.9
.10
.90
6.3
6.3
2019
.421
0.41
272
246
WHATIS
THELASTNAMEOFTHEMAN
WHO
CREATED
THECOMIC
STRIP
“WOODY
WOODPECKER”?
(LANTZ)
.000
219
9.9
.21
.79
16.1
16.1
4521
.722
5.69*
273
252
WHATIS
THENAMEOFTHEIN
STRUMENTUSED
TO
MEASUREWIN
DSPEED?(A
NEMOMETER)
.000
207
13.7
.41
.59
27.8
27.8
8531
.621
3.57*
274
253
WHATIS
THELASTNAMEOFTHEAUTHOROF
“OURTOWN”?
(WILDER)
.000
142
11.1
.14
.86
11.0
11.0
2023
.214
7.62*
275
256
WHATIS
THELASTNAMEOFTHESIN
GERWHO
MADEA
HIT
RECORDIN
GOFTHESONG
“WHO’S
SORRY
NOW”?
(FRANCIS)
.000
207
12.6
.15
.85
5.3
5.3
3222
.821
4.33
Behav Res (2013) 45:1115–1143 1133
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
276
257
WHATIS
THELASTNAMEOFTHECUBAN
LEADERTHATCASTRO
OVERTHREW?(BATISTA
).000
141
17.5
.12
.88
20.4
20.4
1632
.214
4.33
277
260
WHATIS
THENAMEOFTHERUBBERROLLERON
ATYPEWRITER?(PLATEN)
.000
200
13.4
.23
.77
7.8
7.8
4619
.520
5.41*
278
263
WHATWASTHENAMEOFTHELARGEST
CONFEDERATEMILITARY
PRISON
DURIN
GTHECIV
ILWAR?(A
NDERSONVILLE)
.000
139
18.3
.14
.86
24.8
24.8
1929
.613
8.50*
279
266
WHATIS
THELASTNAMEOFTHEAUTHOROF
“THEAGONYAND
THEECSTA
SY”?
(STONE)
.000
204
10.5
.10
.90
6.8
6.8
2117
.421
3.44
280
268
WHATIS
THELASTNAMEOFFLASH’S
GIRLFRIEND
INTHECOMIC
STRIP
“FLASH
GORDON”?
(ARDEN)
.000
214
11.0
.20
.80
5.6
5.6
4219
.921
7.04
281
269
WHATIS
THENAMEOFTHEFIRSTMOVIE
TO
RECEIV
ETHEACADEMYAWARD
FORBESTPICTURE?(W
INGS)
.000
127
17.8
.24
.76
23.8
23.8
3019
.613
0.59*
282
270
WHATIS
THELASTNAMEOFTHEDISCOVEREROF
THEVACCIN
ATIO
NFORSMALLPOX?(JENNER)
.000
204
12.8
.19
.81
12.0
12.0
3923
.020
8.84*
283
271
WHATIS
THELASTNAMEOFTHEBOY
INTHEBOOK
“TREASUREISLAND”?
(HAWKIN
S)
.000
144
10.4
.20
.80
20.0
20.0
2932
.014
6.48*
284
272
WHATIS
THELASTNAMEOFTHEBOXERWHO
WON
THEBOXIN
GTITLEFROM
JOHN
L.
SULLIVAN?(CORBETT)
.000
211
10.6
.42
.58
24.7
24.7
8828
.021
5.43*
285
275
WHATIS
THELASTNAMEOFTHEMAN
WHO
WROTE
THESONG
“HOW
DEEPIS
THEOCEAN”?
(BERLIN
).000
145
8.6
.12
.88
2.9
2.9
1720
.914
8.27
286
277
WHATWASTHELASTNAMEOFBILLY
THEKID
?(BONNEY)
.000
138
11.5
.25
.75
17.1
17.1
3525
.414
2.23
287
278
WHATIS
THELASTNAMEOFTHESIN
GERWHOSE
THEMESONG
WAS“W
HEN
THEBLUEOFTHENIG
HT
MEETSTHEGOLD
OFTHEDAY”?
(CROSBY)
.000
214
11.7
.13
.87
8.3
8.3
2817
.921
9.27
288
279
FROM
WHATMUSICALIS
THESONG
“BAUBLESBANGLESAND
BEADS”?
(KISMET)
.000
147
12.0
.16
.84
15.3
15.3
2421
.314
8.55*
289
280
WHATWASTHELASTNAMEOFTHE
ACTORWHO
PORTRAYED
DR.WATSON
INTHESHERLOCK
HOLMESSERIES?(BRUCE)
.000
204
14.2
.25
.75
36.6
36.6
5032
.1211
.76*
290
281
WHATIS
THELASTNAMEOFTHEMAN
WHO
WASMOSTRESPONSIBLEFORPHOTOGRAPHIN
GTHEU.S.CIV
ILWAR?(BRADY)
.000
142
14.9
.13
.87
12.4
12.4
1819
.514
5.39
291
283
WHATIS
THENAMEOFA
NUMBERTWO
WOOD
INGOLF?(BRASSIE)
.000
149
15.0
.50
.50
26.8
26.8
7437
.015
1.38*
292
287
WHATIS
THELASTNAMEOFTHEPOETWHO
WROTE
THELIN
E“INTO
EACH
LIFEA
LITTLERAIN
MUST
FALL”?
(LONGFELLOW)
.000
130
13.0
.19
.81
11.0
11.0
2520
.613
1.49*
293
289
WHATWASTHENAMEOFGENEAUTRY’S
HORSE?(CHAMPIO
N)
.000
154
11.7
.19
.81
9.2
9.2
2914
.715
9.58*
1134 Behav Res (2013) 45:1115–1143
Tab
leA1
(con
tinued)
2012
Rank
Order
1980
Rank
Order
QuestionandCorrect
Respo
nse
Probability
ofRecall
Respo
nse
Latency
Propo
rtion
ofErrors
Con
fidenceJudg
ments
Peer
Judg
ments
Judg
eCorrs
MNrc
Nri
RLc
RLi
Ec
Eo
MCJ c
CJ i
Nci
MNpj
r
294
291
WHATIS
THENAMEOFTHETOWN
THROUGH
WHICH
LADY
GODIVA
SUPPOSEDLY
MADEHER
FAMOUSRID
E?(COVENTRY)
.000
138
16.5
.21
.79
11.7
11.7
2922
.014
0.62*
295
294
WHATIS
THELASTNAMEOFTHEFIRSTWOMAN
TO
SWIM
ACROSSTHEENGLISH
CHANNEL?(EDERLE)
.000
203
9.2
.15
.85
2.2
2.2
3019
.220
9.14
296
295
WHATIS
THELASTNAMEOFTHEFIRSTFLIER
TO
FLY
SOLO
AROUND
THEWORLD?(POST)
.000
145
19.5
.41
.59
37.9
37.9
6039
.014
5.62*
297
298
WHATIS
THELASTNAMEOFTHEMAN
WHO
WROTE
THEPOEM
“ITCOULDN’T
BEDONE”?
(GUEST)
.000
223
10.1
.19
.81
6.9
6.9
4315
.722
8.55*
298
299
WHO
WASTHERACEHORSEOFTHEYEARFORMANY
SUCCESSIV
EYEARSIN
THE19
60S?(K
ELSO)
.000
146
16.0
.49
.51
32.1
32.1
7229
.814
9.64*
299
300
WHATIS
THEHIG
HESTMOUNTA
ININ
SOUTH
AMERICA?(A
CONCAGUA)
.000
202
12.8
.33
.67
32.5
32.5
6629
.821
0.68*
Stand
arderrors
fortheprob
ability
ofrecallrang
edfrom
0to
.04.
Nrc=nu
mberof
respon
sesthat
werecorrect.Nri=nu
mberof
respon
sesthat
wereincorrect.The
totalnu
mberof
respon
sesper
questio
ncanbe
calculated
byadding
Nrcto
Nri.R
Lc=meanrespon
selatency(reactiontim
e,in
second
s)forcorrectrespo
nses.R
Li=meanrespon
selatency(reactiontim
e,in
second
s)forincorrect
respon
ses,specifically
commission
errors.The
totalnu
mberof
respon
sesthat
contribu
tedto
correctandincorrectrespon
selatenciescanbe
calculated
byadding
Nrcto
Nri.Ec=prop
ortio
nof
commission
errors.E
o=prop
ortio
nof
omission
errors.C
J c=meanconfidence
judg
mentfor
correctrespon
ses.The
totaln
umberof
respon
sesthatcontribu
tedto
themeanconfidence
judg
mentfor
correctrespon
sesis
prov
ided
incolumnNrc.CJ i=meanconfidence
judg
mentforincorrectrespon
ses(com
mission
errors).Nci=nu
mberof
respon
sesthat
contribu
tedto
themeanconfidence
judg
mentfor
incorrectrespo
nses,w
hich
reflectsthenu
mberof
confidence
judg
mentsforcommission
errors.T
hetotaln
umberof
respon
sesthatcontribu
tedto
themeanconfidence
judg
mentcan
becalculated
byadding
Nrcto
Nci.N
pj=nu
mberof
respon
sesthatcontribu
tedto
themeanpeer
judg
ment.Judg
eCorrr=Pearson
’srcorrelationbetweenconfidence
judg
mentsandpeer
judg
ments.
aSignificantly
high
erprob
ability
ofrecallin
2012
than
in19
80,p<.000
2.bSignificantly
lower
prob
ability
ofrecallin
2012
than
in19
80,p<.000
2.*Significant
correlation,
p<.05.
The
1980
norm
sinclud
edon
eadditio
nalqu
estio
n:“W
hatisthecapitalof
Czechoslovakia?”(Pragu
e).Thisqu
estio
nwas
notinclud
edbecauseitisou
tdated
andhasno
correctansw
er.
Behav Res (2013) 45:1115–1143 1135
Tab
leA2
Propo
rtions
ofandconfidence
incommission
errors,forerrors
with
aprop
ortio
nof
.05or
greaterof
thetotalrespon
ses
2012
RankOrder
QuestionandCorrect
Respo
nse
Com
mission
(s)
Propo
rtionOut
ofCom
mission
sPropo
rtionOut
ofTotal
Respo
nses
Con
fidence
8WHATIS
THENAMEOFA
DRIED
GRAPE?(RAISIN
)PRUNE
.69
.08
86.5
26WHATIS
THENAMEOFAN
INABILITY
TO
SLEEP?(INSOMNIA
)APNEA
.51
.09
48.7
28WHATIS
THENAMEOFTHELARGESTOCEAN
ON
EARTH?
(PACIFIC)
ATLANTIC
.78
.22
52.2
30WHATIS
THENAMEFORA
CYCLONETHATOCCURSOVER
LAND?(TORNADO)
HURRICANE
.48
.09
70.9
32WHATIS
THENAMEOFTHEBIRD
THATCANNOTFLY
AND
ISTHELARGESTBIRD
ON
EARTH?(O
STRICH)
PENGUIN
.33
.10
60.2
34WHATIS
THENAMEOFTHELIZARD
THATCHANGESITSCOLOR
TO
MATCH
THESURROUNDIN
GS?(CHAMELEON)
IGUANA
.40
.14
63.5
35WHATIS
THENAMEOFTHETHICK
LAYEROFFA
TON
AWHALE?
(BLUBBER)
FLUB/FLUBBER
.43
.07
42.2
37WHATIS
THENAMEOFAYOUNG
SHEEP?(LAMB)
CALF
.27
.06
24.8
38WHATIS
THELARGESTPLANETIN
THESOLARSYSTEM?(JUPITER)
SUN
.29
.11
77.5
42WHATIS
THENAMEOFA
DRIED
PLUM?(PRUNE)
RAISIN
.43
.12
41.5
43IN
WHICH
SPORTDOESA
RID
ERON
HORSEBACK
HIT
ABALL
WITH
HIS
MALLET?(POLO)
CROQUET
.40
.08
34.7
46WHATIS
THENAMEOFTHEPOKERHAND
INWHICH
ALLOFTHE
CARDSAREOFTHESAMESUIT?(FLUSH)
STRAIG
HT
.51
.13
40.9
47IN
WHICH
SPORTIS
THESTA
NLEY
CUPAWARDED?(H
OCKEY)
SOCCER
.30
.13
45.4
49OFWHICH
COUNTRY
ISBAGHDAD
THECAPITAL?(IRAQ)
AFGANISTA
N.74
.29
61.1
50WHATIS
THENAMEOFTHELIQ
UID
PORTIO
NOFWHOLEBLOOD?
(PLASMA)
WATER
.29
.05
29.7
51WHATIS
THENAMEOFTHECITY
INITALY
THATIS
KNOWN
FOR
ITSCANALS?(V
ENICE)
FLORENCE
.32
.08
48.6
52WHATIS
THENAMEOFTHESPEARLIK
EOBJECTTHATIS
THROWN
DURIN
GATRACK
MEET?(JAVELIN
)POLE/POLEVAULT
.17
.05
50.0
56WHATIS
THELASTNAMEOFTHEMAN
WHO
SHOWED
THAT
LIG
HTNIN
GIS
ELECTRIC?(FRANKLIN
)EDISON
.52
.18
63.2
58WHATIS
THENAMEOFDEERMEAT?(V
ENISON)
JERKEY
.20
.06
46.1
60WHATIS
THENAMEOFTHEOCEAN
THATIS
LOCATED
BETWEEN
AFRICA
AND
AUSTRALIA
?(INDIA
N)
PACIFIC
.52
.24
40.0
61WHATIS
THELASTNAMEOFTHESIN
GERWHO
RECORDED
“HEARTBREAK
HOTEL”AND
“ALLSHOOK
UP”?
(PRESLEY)
ELV
IS.47
.10
85.9
64WHATBRAND
OFCIG
ARETTEWASFIRSTTO
HAVETHEFLIP-TOP
BOX?(M
ARLBORO)
CAMEL
.70
.22
31.0
65WHATKIN
DOFMETA
LIS
ASSOCIATED
WITH
A50
TH
WEDDIN
GANNIV
ERSARY?(G
OLD)
SILVER
.52
.19
36.2
66WHICH
TYPEOFSNAKEDO
ASIA
NSNAKE-CHARMERSUSE?(COBRA)
RATTLESNAKE
.59
.17
43.3
69WHATIS
THECAPITALOFNEW
YORK?(A
LBANY)
NEW
YORK/NEW
YORK
CITY
.57
.29
65.3
70KID
NEY
.36
.17
49.3
1136 Behav Res (2013) 45:1115–1143
Tab
leA2
(con
tinued)
2012
RankOrder
QuestionandCorrect
Respo
nse
Com
mission
(s)
Propo
rtionOut
ofCom
mission
sPropo
rtionOut
ofTotal
Respo
nses
Con
fidence
WHATIS
THENAMEOFTHEORGAN
THATPRODUCESIN
SULIN
?(PANCREAS)
72WHATIS
THENAMEOFTHEEXTIN
CTREPTILESKNOWN
AS
“TERRIBLELIZARDS”?
(DIN
OSAURS)
DRAGON
.26
.05
20.6
74WHICH
BREED
OFCATHASBLUEEYES?(SIA
MESE)
CALICO
.24
.06
36.9
75WHATIS
THELASTNAMEOFTHESECOND
U.S.PRESID
ENT?
(ADAMS)
JEFFERSON
.39
.16
44.0
78WHATIS
THELASTNAMEOFTHEMAN
WHO
PROPOSED
THE
THEORY
OFRELATIV
ITY?(EIN
STEIN
)NEWTON
.58
.12
46.5
80WHATIS
THELASTNAMEOFTHEFIRSTSIG
NEROFTHE
“DECLARATIO
NOFIN
DEPENDENCE”?
(HANCOCK)
JEFFERSON
.51
.23
44.6
82WHATIS
THEWORD
THATMEANSA
NAUTICALMILEPER
HOUR?(K
NOT)
MPH
.24
.06
47.8
83WHATIS
THENAMEFORTHEASTRONOMICALBODIESTHAT
ENTERTHEEARTH’S
ATMOSPHERE?(M
ETEORS)
METEORITES
.26
.11
52.8
84WHATIS
THELONGESTRIV
ERIN
SOUTH
AMERICA?(A
MAZON)
NILE
.61
.18
48.2
85WHATIS
THENAMEOFTHEAUTOMOBILEIN
STRUMENTTHAT
MEASURESMILEAGE?(O
DOMETER)
SPEEDOMETER
.48
.19
47.4
86WHATITALIA
NCITY
WASDESTROYED
WHEN
MOUNT
VESUVIU
SERUPTED
IN79
A.D.?(POMPEII)
ROME/ROMA
.27
.07
30.9
87WHATIS
THELASTNAMEOFBATMAN’S
SECRETID
ENTITY
INTHEBATMAN
COMICS?(W
AYNE)
CLARK/CLARK
KENT
.40
.07
46.7
88WHATIS
THELASTNAMEOFTHEMYTHICALGIA
NT
LUMBERJA
CK?(BUNYAN)
JACK
.34
.08
22.8
89WHATIS
THENAMEOFTHECOMPA
NY
THATPRODUCES
“BABY
RUTH”CANDY
BARS?(N
ESTLE)
HERSHEY
.50
.19
40.1
MARS
.31
.12
53.5
90WHATIS
THENAMEOFSOCRATES’MOSTFA
MOUS
STUDENT?(PLATO)
ARISTOTLE
.53
.18
57.5
91WHATIS
THENAMEOFTHETHREE-LEAFCLOVERTHATIS
THEEMBLEM
OFIRELAND?(SHAMROCK)
CLOVER
.59
.14
33.2
92OFWHICH
COUNTRY
ISBUENOSAIRESTHECAPITAL?
(ARGENTIN
A)
SPA
IN.26
.13
25.7
94WHATIS
THENAMEOFTHEMOUNTA
INRANGEIN
WHICH
MOUNTEVERESTIS
LOCATED?(H
IMALAYAS)
APPA
LACIA
N.34
.12
29.1
95WHATIS
THEUNIT
OFSOUND
INTENSITY?(D
ECIBEL)
HERTZ
.33
.17
39.4
97WHATIS
THEUNIT
OFELECTRICALPOWERTHATREFERS
TO
ACURRENTOFONEAMPEREATONEVOLT
?(W
ATT)
VOLT
/VOLT
AGE
.20
.06
33.9
99IN
WHICH
GAMEAREMEN
CROWNED?(CHECKERS)
CHESS
.17
.06
43.8
100
WHATIS
THELASTNAMEOFTHEMAN
WHO
ASSASSIN
ATED
PRESID
ENTJO
HN
F.KENNEDY?(O
SWALD)
BOOTH
.30
.08
58.8
101
WHATIS
THENAMEOFBATMAN’S
BUTLER?(A
LFRED)
ROBIN
.16
.05
15.1
Behav Res (2013) 45:1115–1143 1137
Tab
leA2
(con
tinued)
2012
RankOrder
QuestionandCorrect
Respo
nse
Com
mission
(s)
Propo
rtionOut
ofCom
mission
sPropo
rtionOut
ofTotal
Respo
nses
Con
fidence
102
WHICH
COUNTRY
WASTHEFIRSTTO
USEGUNPOWDER?(CHIN
A)
BRITAIN
/ENGLAND
.31
.17
31.3
103
WHATIS
THENAMEOFAN
AIRPLANEWITHOUTAN
ENGIN
E?(G
LID
ER)
JET
.20
.06
20.5
104
WHATIS
THENAMEOFTHENORTH
STA
R?(POLARIS)
NORTH/NORTH
STA
R.23
.05
9.5
105
WHATIS
THEONLY
WORD
THATTHERAVEN
SAYSIN
EDGAR
ALLEN
POE’S
POEM
“THERAVEN”?
(NEVERMORE)
DEAD/DEATH
.21
.08
19.2
106
FORWHICH
COUNTRY
ISTHEYEN
THEMONETA
RY
UNIT?(JAPA
N)
CHIN
A.87
.53
53.1
107
INWHATEUROPEAN
CITY
ISTHEPA
RTHENON
LOCATED?(ATHENS)
ROME
.51
.20
46.2
108
WHATIS
THENAMEOFTHEFURRYANIM
ALTHATATTA
CKS
COBRA
SNAKES?(M
ONGOOSE)
BEAR
.17
.06
23.8
109
FORWHICH
COUNTRY
ISTHERUPEETHEMONETA
RY
UNIT?
(INDIA
)FRANCE
.19
.05
18.6
110
WHATIS
THELASTNAMEOFTHEMAN
WHO
FIRSTSTUDIED
GENETIC
INHERITANCEIN
PLANTS?(M
ENDEL)
DARWIN
.42
.09
33.7
113
INWHICH
GAMEARETHESTA
NDARD
PIECESOFSTA
UNTON
DESIG
N?(CHESS)
MONOPOLY
.32
.05
13.1
114
WHATAREPEOPLEWHO
MAKEMAPSCALLED?(CARTOGRAPHERS)
GEOGRAPHER
.19
.08
32.2
117
INWHICH
CITY
ISTHEU.S.NAVALACADEMY
LOCATED?(A
NNAPOLIS)
WASHIN
GTON
.16
.06
19.6
118
WHATIS
THENAMEOFTHELIG
HTESTWOOD
KNOWN?(BALSA)
OAK
.27
.12
20.7
119
WHATIS
THELASTNAMEOFTHEBOXERWHO
LATERBECAME
KNOWN
ASMUHAMMAD
ALI?
(CLAY)
ALI
.53
.13
23.4
120
WHATISLAND
ISTHELARGESTIN
THEWORLD
EXCLUDIN
GAUSTRALIA
?(G
REENLAND)
HAWAII
.21
.13
22.8
121
WHATIS
THENAMEOFTHESMALLJA
PANESESTOVEUSED
FOROUTDOORCOOKIN
G?(H
IBACHI)
GRILL
.37
.12
31.5
125
INWHATANCIENTCITY
WERETHE“H
ANGIN
GGARDENS”
LOCATED?(BABYLON)
GREECE
.21
.08
31.8
126
WHATAREPEOPLECALLED
WHO
EXPLORECAVES?(SPELUNKERS)
EXPLORERS
.31
.14
14.3
128
WHATIS
THECAPITALOFKENTUCKY?(FRANKFORT)
LOUISVILLE
.32
.11
57.4
129
WHATIS
THENAMEOFAN
ILLEGALMOVEBYA
BASEBALL
PITCHERTHATRESULT
SIN
ALLRUNNERSADVANCIN
GONE
BASE?(BALK)
BALL
.21
.09
54.1
132
WHICH
SPORTUSESTHETERMS“STONES”AND
“BROOMS”?
(CURLIN
G)
BROOMBALL
.16
.08
39.9
133
WHATIS
THEPROPERNAMEFORA
BADMIN
TON
BIRD?
(SHUTTLECOCK)
BIRD/BIRDIE
.92
.45
44.8
134
WHATIS
THELASTNAMEOFTHEAUTHORWHO
WROTE
“OLIV
ERTWIST”?
(DICKENS)
TWAIN
.27
.05
34.7
136
WHATIS
THELASTNAMEOFTHEMAN
WHO
INVENTED
THE
PHONOGRAPH?(EDISON)
BELL
.55
.13
53.3
138
INWHICH
CITY
ISHEATHROW
AIRPORTLOCATED?(LONDON)
HEATHROW
.32
.08
20.0
139
WHATIS
THECAPITALOFJA
MAICA?(K
INGSTON)
JAMAICA
.30
.05
16.8
1138 Behav Res (2013) 45:1115–1143
Tab
leA2
(con
tinued)
2012
RankOrder
QuestionandCorrect
Respo
nse
Com
mission
(s)
Propo
rtionOut
ofCom
mission
sPropo
rtionOut
ofTotal
Respo
nses
Con
fidence
140
WHICH
PLANETWASTHELASTTO
BEDISCOVERED?(N
EPTUNE)
PLUTO
.84
.65
57.7
143
WHATIS
THECAPITALOFCHILE?(SANTIA
GO)
CHILE
.41
.08
22.4
146
WHATIS
THENAMEOFTHEFOUNTA
ININ
ROMEIN
TO
WHICH
COIN
SARETHROWN
FORGOOD
LUCK?(TREVI)
YOUTH
.31
.10
25.8
147
WHATWASTHELASTNAMEOFTHEMAN
WHO
WASPRESID
ENT
DIRECTLY
AFTERJA
MESMADISON?(M
ONROE)
JEFFERSON
.20
.08
30.5
148
WHATIS
THELASTNAMEOFTHEASTRONOMERWHO
PUBLISHED
IN15
43HIS
THEORY
THATTHEEARTH
REVOLV
ESAROUND
THESUN?(COPERNICUS)
GALILEO
.51
.25
60.0
149
WHATIS
THELASTNAMEOFTHECRIM
INALWHO
WAS
KNOWN
AS“SCARFA
CE”?
(CAPONE)
MONTA
NA
.35
.13
86.0
151
WHATIS
THECAPITALOFDENMARK?(COPENHAGEN)
DENMARK
.26
.05
18.2
153
INWHICH
CITY
ISMICHELANGELO’S
STA
TUEOFDAVID
LOCATED?(FLORENCE)
ROME
.56
.36
41.5
154
WHATWASFRANK
LLOYD
WRIG
HT’S
PROFESSIO
N?(A
RCHITECT)
WRITER/W
RITIN
G.19
.09
17.2
155
OFWHICH
COUNTRY
ISNAIROBITHECAPITAL?(K
ENYA)
AFRICA
.18
.06
29.4
156
WHATIS
THENAMEOFTHEHILLBILLY
FAMILY
THATHAD
AFA
MOUSFEUD
WITH
THEMCCOY
FAMILY?(H
ATFIELD)
BEVERLY
/BEVERLY
HILLBILLY
.26
.06
31.2
158
WHATIS
THELASTNAMEOFTHEFIRSTPERSON
TO
COMPLETE
ASOLO
FLIG
HTACROSSTHEATLANTIC
OCEAN?(LIN
DBERGH)
AIRHEART/EARHART
.51
.19
47.1
160
WHATIS
THENAMEOFTHEROMAN
EMPERORWHO
FID
DLED
WHILEROMEBURNED?(N
ERO)
CAESAR
.49
.12
35.3
161
WHATIS
THECITY
INWHICH
THEBASEBALLHALLOFFA
MEIS
LOCATED?(COOPERSTOWN)
CHICAGO
.25
.10
22.6
162
WHATIS
THENAMEOFTHEUNIT
OFMEASURETHATREFERS
TO
ASIX
-FOOTDEPTH
OFWATER?(FATHOM)
LEAGUE
.20
.06
57.5
163
WHATIS
THELASTNAMEOFTHESCIENTISTWHO
DISCOVERED
RADIU
M?(CURIE)
RADIU
M.26
.05
3.1
166
WHATIS
THELASTNAMEOFTHECRIM
INALWHO
WASKILLED
BY
FBIAGENTSOUTSID
EOFA
CHICAGO
MOVIE
THEATER?
(DILLIN
GER)
CAPONE
.27
.05
44.5
167
WHATIS
THENAMEOFTHESIN
GERWHO
POPULARIZED
ADANCEKNOWN
ASTHE“T
WIST”?
(CHECKER)
ELV
IS.52
.16
33.3
168
OVERWHICH
RIV
ERIS
THEGEORGEWASHIN
GTON
BRID
GE?
(HUDSON)
MISSISSIPPI
.24
.09
30.2
169
WHATIS
THELASTNAMEOFTHEMAN
WHO
INVENTED
DYNAMITE?(N
OBEL)
DYNAMITE
.44
.11
16.0
170
WHATIS
THENAMEOFTHECHIN
ESERELIG
ION
FOUNDED
BY
LAO
TSE?(TAOISM)
BUDDHISM
.60
.25
35.2
172
WHATIS
THENAMEOFTHENAVIG
ATIO
NIN
STRUMENTUSED
ATSEATO
PLOTPOSITIO
NBY
THESTA
RS?(SEXTA
NT)
COMPA
SS
.42
.23
36.5
176
FORWHICH
COUNTRY
ISTHEDRACHMATHEMONETA
RY
UNIT?(G
REECE)
RUSSIA
.19
.06
31.3
Behav Res (2013) 45:1115–1143 1139
Tab
leA2
(con
tinued)
2012
RankOrder
QuestionandCorrect
Respo
nse
Com
mission
(s)
Propo
rtionOut
ofCom
mission
sPropo
rtionOut
ofTotal
Respo
nses
Con
fidence
178
WHATIS
THELONGESTRIV
ERIN
ASIA
?(YANGTZE)
NILE
.36
.14
39.3
181
OFWHICH
COUNTRY
ISBUDAPESTTHECAPITAL?(H
UNGARY)
INDIA
.48
.21
30.4
182
WHO
ISKNOWN
AS“T
HEFA
THEROFGEOMETRY”?
(EUCLID
)PYTHAGORAS
.30
.09
30.9
184
WHATIS
THELASTNAMEOFTHECOMPOSERWHO
WROTE
THEOPERA
“DON
GIO
VANNI”?(M
OZART)
GIO
VANNI
.25
.05
24.4
185
WHATIS
THELASTNAMEOFTHEAUTHOROFTHEJA
MES
BOND
NOVELS?(FLEMIN
G)
BOND
.37
.06
6.8
186
WHATWASTHELASTNAMEOFBUFFA
LO
BILL?(CODY)
BILL
.35
.09
36.7
187
WHATIS
THELASTNAMEOFTHEAUTHORWHO
WROTE
UNDERTHEPSEUDONYM
OFMARK
TWAIN
?(CLEMENS)
TWAIN
.53
.09
15.4
190
WHATIS
THELASTNAMEOFTHEMAN
WHO
BEGAN
THE
REFORMATIO
NIN
GERMANY?(LUTHER)
HITLER
.83
.44
58.9
192
WHATWASTHENAMEOFTHEAPOLLO
LUNARMODULE
THATLANDED
THEFIRSTMAN
ON
THEMOON?(EAGLE)
APOLLO
.22
.08
17.3
193
WHATIS
THELASTNAMEOFTHECOSMONAUTWHO
WAS
THEFIRSTPERSON
TO
ORBIT
AROUND
THEEARTH?(G
AGARIN
)ARMSTRONG
.27
.08
34.2
201
INWHICH
COUNTRY
ISANGELFA
LLSLOCATED?(V
ENEZUELA)
CANADA
.16
.06
20.9
202
WHATIS
THECAPITALOFCANADA?(O
TTA
WA)
TORONTO
.28
.20
49.8
203
WHATIS
THELASTNAMEOFTHETWENTY-FIRSTU.S.
PRESID
ENT?(A
RTHUR)
BUSH
.14
.07
21.7
204
WHATWASTHENAMEOFTHEGOLDFISH
INTHESTORY
OF
PIN
OCCHIO
?(CLEO)
GOLDIE
.23
.06
12.6
207
WHATIS
THECAPITALOFAUSTRALIA
?(CANBERRA)
SYDNEY
.79
.50
80.3
208
WHATIS
THELASTNAMEOFTHEARTISTWHO
PAIN
TED
“THEPERSISTENCEOFMEMORY”?
(DALI)
DAVIN
CI
.24
.05
11.4
209
WHATIS
THELASTNAMEOFTHEMAN
WHO
INVENTED
THE
TELEGRAPH?(M
ORSE)
BELL
.40
.16
59.6
211
WHATIS
THENAMEOFTHESUBSTA
NCEDERIV
ED
FROM
AWHALETHATIS
USED
TO
MAKEPERFUME?(A
MBERGRIS)
BLUBBER
.64
.29
36.4
213
WHATWASTHENAMEOFTHECLOWN
ON
THE“H
OWDY
DOODY”TELEVISIO
NSHOW?(CLARABELL)
BOZO
.42
.08
25.5
215
WHATIS
THELASTNAMEOFTHEMOVIE
ACTORWHO
PORTRAYED
SPA
RTA
CUS?(D
OUGLAS)
BUTLER
.23
.06
53.8
217
WHATIS
THELASTNAMEOFTHEUNIO
NGENERALWHO
DEFEATED
THECONFEDERATEARMYATTHECIV
ILWAR
BATTLEOFGETTYSBURG?(M
EADE)
GRANT
.29
.13
66.7
218
WHATIS
THENAMEOFTHEAVENUETHATIM
MEDIATELY
FOLLOWS
ATLANTIC
AVENUEIN
THEGAMEOFMONOPOLY
?(V
ENTNOR)
PACIFIC
.40
.15
26.2
233
WHATIS
THENAMEOFTHERIV
ERTHATRUNSTHROUGH
ROME?(TIBER)
NILE
.25
.06
21.6
236
WHO
WASTHEFIRSTRULEROFTHEHOLY
ROMAN
EMPIRE?
(CHARLEMAGNE)
CAESAR
.55
.26
38.5
1140 Behav Res (2013) 45:1115–1143
Tab
leA2
(con
tinued)
2012
RankOrder
QuestionandCorrect
Respo
nse
Com
mission
(s)
Propo
rtionOut
ofCom
mission
sPropo
rtionOut
ofTotal
Respo
nses
Con
fidence
242
WHATIS
THENAMEOFTHEBRIG
HTESTSTA
RIN
THESKY
EXCLUDIN
GTHESUN?(SIRIU
S)
NORTH/NORTH
STA
R.58
.41
47.1
246
WHATIS
THENAMEOFTHEBASEBALLPLAYERWITH
THEHIG
HEST
LIFETIM
EBATTIN
GAVERAGEIN
THEMAJO
RLEAGUES?(COBB)
BABE/BABERUTH/RUTH
.71
.48
40.0
248
WHATIS
THELASTNAMEOFTHEMOSTPOPULARPIN
-UP
GIRLOFWORLD
WARII?(G
RABLE)
MONROE
.40
.17
46.9
249
WHATIS
THENAMEOFTHELARGESTDESERTON
EARTH?
(ANTA
RTICA)
SAHARA
.82
.65
63.9
256
WHATIS
THELASTNAMEOFTHEIN
VENTOROFTHE
STEAMBOAT“C
LERMONT”?
(FULT
ON)
CLERMONT
.54
.12
15.1
259
WHATIS
JOHN
KENNETH
GALBRAITH’S
PROFESSIO
N?(ECONOMIST)
WRITER
.21
.05
14.5
262
WHATIS
THELASTNAMEOFTHEMAN
WHO
SAID
“IONLY
REGRETTHATIHAVEBUTONELIFETO
LOSEFORMY
COUNTRY”?
(HALE)
WASHIN
GTON
.34
.09
13.3
265
WHATIS
THENAMEOFTHEMOUNTA
INRANGETHAT
SEPA
RATESASIA
FROM
EUROPE?(U
RAL)
HIM
ALAYAS
.34
.17
56.4
266
WHATIS
THELASTNAMEOFTHEBOXERWHO
WASKNOWN
ASTHE“M
ANASSA
MAULER”?
(DEMPSEY)
ALI
.48
.11
23.1
268
WHATIS
THELASTNAMEOFTHEBASEBALLPLAYERWHO
PITCHED
APERFECTGAMEIN
THE19
56WORLD
SERIES?(LARSEN)
RUTH
.63
.23
28.9
272
WHATIS
THELASTNAMEOFTHEMAN
WHO
CREATED
THE
COMIC
STRIP
“WOODY
WOODPECKER”?
(LANTZ)
DISNEY
.27
.05
28.8
273
WHATIS
THENAMEOFTHEIN
STRUMENTUSED
TO
MEASURE
WIN
DSPEED?(A
NEMOMETER)
BAROMETER
.47
.19
43.3
281
WHATIS
THENAMEOFTHEFIRSTMOVIE
TO
RECEIV
ETHE
ACADEMYAWARD
FORBESTPICTURE?(W
INGS)
TITANIC
.43
.10
29.4
284
WHATIS
THELASTNAMEOFTHEBOXERWHO
WON
THE
BOXIN
GTITLEFROM
JOHN
L.SULLIVAN?(CORBETT)
ALI
.42
.18
31.2
289
WHATWASTHELASTNAMEOFTHEACTORWHO
PORTRAYED
DR.WATSON
INTHESHERLOCK
HOLMESSERIES?(BRUCE)
LAW
.36
.09
65.0
291
WHATIS
THENAMEOFA
NUMBERTWO
WOOD
INGOLF?(BRASSIE)
DRIV
ER
.22
.11
52.2
295
WHATIS
THELASTNAMEOFTHEFIRSTWOMAN
TO
SWIM
ACROSSTHEENGLISH
CHANNEL?(EDERLE)
SMITH
.33
.05
1.2
296
WHATIS
THELASTNAMEOFTHEFIRSTFLIERTO
FLY
SOLO
AROUND
THEWORLD?(POST)
AIRHEART/EARHART
.48
.20
52.4
298
WHO
WASTHERACEHORSEOFTHEYEARFORMANY
SUCCESSIV
EYEARSIN
THE19
60’S?(K
ELSO)
SEABISCUIT
.60
.29
40.8
299
WHATIS
THEHIG
HESTMOUNTA
ININ
SOUTH
AMERICA?
(ACONCAGUA)
ANDES
.24
.08
37.6
Com
mission
respon
sesandmeanconfidence
judg
mentsin
commission
respon
sesareprov
ided
forthosequ
estio
nswith
consistenciesin
errors
for.05or
greaterou
tof
thetotalrespon
ses.When
available,thetopthreecommission
errors
areprov
ided;otherw
ise,thetopon
eor
twocommission
errors
areprov
ided.
Behav Res (2013) 45:1115–1143 1141
References
Anastasi, J. S., Rhodes, M. G., & Burns, M. C. (2000). Distinguishingbetween memory illusions and actual memories utilizing phenom-enological measurements and explicit warnings. American Jour-nal of Psychology, 112, 1–26. doi:10.2307/1423458
Barber, S. J., Rajaram, S., & Marsh, E. J. (2008). Fact learning: Howinformation accuracy, delay and repeated testing change retentionand retrieval experience. Memory, 16, 934–946. doi:10.1080/09658210802360603
Butler, A. C., Fazio, L. F., & Marsh, E. J. (2011). The hypercorrectioneffect persists over a week, but high confidence errors return.Psychonomic Bulletin & Review, 18, 1238–1244. doi:10.3758/s13423-011-0173-y
Butterfield, B., & Metcalfe, J. (2001). Errors committed with high-confidence are hypercorrected. Journal of Experimental Psychol-ogy: Learning, Memory, and Cognition, 27, 1491–1494.doi:10.1037/0278-7393.27.6.1491
Cosentino, S., Metcalfe, J., Butterfield, B., & Stern, Y. (2007). Objec-tive metamemory testing captures awareness of deficit in Alz-heimer’s disease. Cortex, 43, 1004–1019. doi:10.1016/S0010-9452(08)70697-X
Dodson, C. S., Bawa, S., & Krueger, L. E. (2007). Aging, metame-mory, and high-confidence errors: A misrecollection account.Psychology and Aging, 22, 122–133. doi:10.1037/0882-7974.22.1.122
Fazio, L. K., & Marsh, E. J. (2008). Slowing presentation speedincreases illusions of knowledge. Psychonomic Bulletin & Re-view, 15, 180–185. doi:10.3758/PBR.15.1.180
Frenda, S. J., Nichols, R. M., & Loftus, E. F. (2011). Current issues andadvances in misinformation research. Current Directions in Psy-chological Science, 20, 20–23. doi:10.1177/0963721410396620
Gallo, D. A. (2010). False memories and fantastic beliefs: 15 years ofthe DRM illusion. Memory & Cognition, 38, 833–848.doi:10.3758/MC.38.7.833
Hanley, J. R. (2011). Why are names of people associated with somany phonological retrieval failures? Psychonomic Bulletin &Review, 18, 612–617. doi:10.3758/s13423-011-0082-0
Kelley, C. M., & Jacoby, L. L. (1996). Adult egocentrism: Subjectiveexperience versus analytic bases for judgment. Journal of Mem-ory and Language, 35, 157–175. doi:10.1006/jmla.1996.0009
Koriat, A., & Ackerman, R. (2010). Metacognition and mindreading:Judgments of learning for self and other during self-paced study.Consciousness and Cognition, 19, 251–264. doi:10.1016/j.concog.2009.12.010
Loftus, E. F. (1997). Memory for a past that never was. CurrentDirections in Psychological Science, 6, 60–65. doi:10.1111/1467-8721.ep11512654
Loftus, E. F., & Hoffman, H. G. (1989). Misinformation and memory:The creation of new memories. Journal of Experimental Psychol-ogy: General, 118, 100–104. doi:10.1037/0096-3445.118.1.100
MacDonald, S. W. S., Dixon, R. A., Cohen, A. L., & Hazlitt, J. E.(2004). Biological age and 12-year cognitive change in olderadults: Findings from the Victoria Longitudinal Study. Gerontol-ogy, 50, 64–81. doi:10.1159/000075557
Mansueti, L., de Frias, C. M., Bub, D., & Dixon, R. A. (2008). Exploringcognitive effects of self reported mild stroke in older adults: Selec-tive but robust effects on story memory. Aging Neuropsychologyand Cognition, 15, 545–573. doi:10.1080/13825580701858216
Table A3 Questions for which the correct response has changed from the 1980 norms
2012 Rank Order Question 1980 Correct Response 2012 Correct Response
Questions for which the 1980 response was incorrect
16 WHAT IS THE NAME OF A GIANT OCEAN WAVE CAUSED BYAN EARTHQUAKE?
TIDALa TSUNAMI
89 WHAT IS THE NAME OF THE COMPANY THAT PRODUCES“BABY RUTH” CANDY BARS?
CURTISSb NESTLE
140 WHICH PLANET WAS THE LAST TO BE DISCOVERED? PLUTOb NEPTUNE
229 WHAT IS THE LAST NAME OF THE FIRST AMERICAN AUTHORTO WIN THE NOBEL PRIZE FOR LITERATURE?
HENRYa LEWIS
249 WHAT IS THE NAME OF THE LARGEST DESERT ON EARTH? SAHARAa ANTARTICA
250 WHAT IS THE LAST NAME OF THE JOCKEY WITH THE MOSTLIFETIME WINNERS IN HORSE RACING?
SHOEMAKERb BAZE
– WHAT IS THE CAPITAL OF CZECHOSLOVAKIA? PRAGUEc
Questions for which the 1980 response is still correct, but participants provided alternative responses that are also correct
30 WHAT IS THE NAME FOR A CYCLONE THAT OCCURS OVERLAND?d
TORNADO HURRICANE
66 WHICH TYPE OF SNAKE DO ASIAN SNAKE-CHARMERS USE? COBRA VIPER
74 WHICH BREED OF CAT HAS BLUE EYES? SIAMESE HIMALAYAN
83 WHAT IS THE NAME FOR THE ASTRONOMICAL BODIES THATENTER THE EARTH’S ATMOSPHERE?d
METEOR METEORITE
103 WHAT IS THE NAME OF AN AIRPLANE WITHOUT AN ENGINE? GLIDER PAPER, MODEL
108 WHAT IS THE NAME OF THE FURRYANIMAL THAT ATTACKSCOBRA SNAKES?
MONGOOSE HONEY BADGER
259 WHAT IS JOHN KENNETH GALBRAITH’S PROFESSION? ECONOMIST PROFESSOR
289 WHAT WAS THE LAST NAME OF THE ACTOR WHO PORTRAYEDDR. WATSON IN THE SHERLOCK HOLMES SERIES?
BRUCE LAW
a The 1980 response was incorrect. b The 1980 response was correct at the time, but is now incorrect. c Outdated question: Czechoslovakia is nolonger a country, so there is no correct response. d The wording of the question is somewhat ambiguous, so the alternative response could beconsidered correct.
1142 Behav Res (2013) 45:1115–1143
Marsh, E. J., Balota, D. A., & Roediger, H. L., III. (2005). Learningfacts from fiction: Effects of healthy aging and early-stage de-mentia of the Alzheimer type. Neuropsychology, 19, 115–129.doi:10.1037/0894-4105.19.1.115
Marsh, E. J., Meade, M. L., & Roediger, H. L., III. (2003). Learningfacts from fiction. Journal of Memory and Language, 49, 519–536. doi:10.1016/S0749-596X(03)00092-5
Metcalfe, J., & Finn, B. (2011). People’s hypercorrection of high-confidence errors: Did they know it all along? Journal of Exper-imental Psychology: Learning, Memory, and Cognition, 37, 437–448. doi:10.1037/a0021962
Metcalfe, J., & Finn, B. (2012). Hypercorrection of high confidenceerrors in children. Learning and Instruction, 22, 253–261.doi:10.1016/j.learninstruc.2011.10.004
Murayama, K., & Kuhbandner, C. (2011). Money enhances memoryconsolidation—but only for boring material. Cognition, 1, 120–124. doi:10.1016/j.cognition.2011.01.001
Nelson, T. O., Leonesio, R. J., Shimamura, A. P., Landwehr, R. F., &Narens, L. (1982). Overlearning and the feeling of knowing.Journal of Experimental Psychology: Learning, Memory, andCognition, 8, 279–288. doi:10.1037/0278-7393.8.4.279
Nelson, T. O., & Narens, L. (1980). Norms of 300 general-informationquestions: Accuracy of recall, latency of recall, and felling-of-knowing ratings. Journal of Verbal Learning and Verbal Behav-ior, 19, 338–368. doi:10.1016/S0022-5371(80)90266-2
Nickerson, R. (1999). How we know and sometimes misjudge whatothers know: Imputing one’s own knowledge to others. Psycholog-ical Bulletin, 125, 737–759. doi:10.1037/0033-2909.125.6.737
Roediger, H. L., III, & McDermott, K. B. (1995). Creating falsememories: Remembering words not presented in lists. Journalof Experimental Psychology: Learning, Memory, and Cognition,21, 803–814. doi:10.1037/0278-7393.21.4.803
Schwartz, B. L. (2001). The relation of tip-of-the-tongue states andretrieval time. Memory & Cognition, 29, 117–126. doi:10.3758/BF03195746
Singer, M., & Tiede, H. L. (2008). Feeling of knowing and duration ofunsuccessful memory search.Memory & Cognition, 36, 588–597.doi:10.3758/MC.36.3.588
Weinstein, Y., & Roediger, H. L., III. (2010). Retrospective bias in testperformance: Providing easy items at the beginning of a testmakes students believe they did better on it. Memory & Cogni-tion, 38, 366–376. doi:10.3758/MC.38.3.366
Winne, P. H., & Muis, K. R. (2011). Statistical estimates of learners’judgments about knowledge in calibration of achievement. Meta-cognition and Learning, 6, 179–193. doi:10.1007/s11409-011-9074-8
Woltz, D. J., Gardner, M. K., & Gyll, S. P. (2000). The role of attentionprocesses in near transfer of cognitive skills. Learning and Indi-
Behav Res (2013) 45:1115–1143 1143
vidual Differences, 12, 209–251. doi:10.1016/S1041-6080(01)00038-3