when can diversity trump ability?
DESCRIPTION
When Can Diversity Trump Ability?. Scott Page, Lu Hong, John Miller. Wisdom of the Crowd Information Aggregation. On Who Wants to be a Millionaire , the lifeline is correct 2/3 of the time. The audience is correct 9/10 times!. Goldcorp Challenge. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/1.jpg)
When Can Diversity TrumpAbility?
![Page 2: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/2.jpg)
Scott Page, Lu Hong, John Miller
![Page 3: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/3.jpg)
Wisdom of the CrowdInformation Aggregation
On Who Wants to be a Millionaire, the lifeline is correct 2/3 of the time.
The audience is correct 9/10 times!
![Page 4: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/4.jpg)
Goldcorp Challenge
In 1999 CEO Rob McEwen instructed his geologists to release all geological records to the public. The “Goldcorp Challenge” offered $575k to anyone who could find the gold and drew 1,200 people from 50 countries.
Results:•110 sites identified 50% new, 80% produced gold.•8 million ounces found.•Company value up from $100 million to $9 billion.
![Page 5: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/5.jpg)
Galton’s Steer
At the 1906 West of EnglandFat Stock and Poultry Exhibition, 787 people guessed the weight of a steer. Francis Galton collected the data and found the average guess was 1,197 pounds. The actual weight of the steer was 1,198 pounds.
![Page 6: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/6.jpg)
Accuracy of Group Predictions
![Page 7: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/7.jpg)
Computing the Squared Error
(Variance)
![Page 8: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/8.jpg)
Computing the Crowd’s Diversity
![Page 9: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/9.jpg)
Diversity Prediction Theorem
1 = 39 - 38
![Page 10: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/10.jpg)
In the case of Galton’s steer, the collective accuracy was approximately 1, the average accuracy was 2,956 and the diversity was 2,955. This means that individuals missed by about 55 or 60 pounds each. The fairgoers owe their collective accuracy more to their remarkable diversity than to the prescient individual abilities.
![Page 11: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/11.jpg)
When Diversity Matters
• If Average Error is small, the task is easy. Diversity doesn’t help.
• Group-think and deference to experts reduce the quality of the decisions.
![Page 12: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/12.jpg)
Cognitive Diversity Matters in Problem
Solving
Page Distinguishes:
Diversity in Perspective
Diversity in Heuristics
![Page 13: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/13.jpg)
Sum to Fifteen (Herb Simon, Nobel Prize in
Economics)
One player randomly chosen to go first. Alternate turns selecting cards.
The winner is the first player who has exactly 3 cards which sum to 15.
![Page 14: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/14.jpg)
![Page 15: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/15.jpg)
Picnic Basket Game
• Nachos (N)• Eggs (E)• Sausage (S)• Water (W)• Hot Dogs (H)• Vinegar (V)• Lemons (L)• Raisins (R) Goal is to Collect all 3
Copies of One Food Item
![Page 16: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/16.jpg)
Tic Tac Toe
![Page 17: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/17.jpg)
Perspectives• Trig functions
If y = sin(x), is x a) an angle b) a distance around the unit circle c) a position on the real axis?
• Coordinate Systems: Cartesian, Polar, Spherical
• Functional representations: recursive, parametric, vector
![Page 18: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/18.jpg)
Mendeleyev’s Periodic Table
![Page 19: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/19.jpg)
Einstein and BohrEvery Tuesday from 3:00 to 4:00 in the afternoon, Niels Bohr and Albert Einstein would play duets together when they were both at Princeton.
Einstein would play the violin and Bohr would play the piano.
How would the history of science be different if Einstein had played the discrete instrument and Bohr the continuous instrument?
![Page 20: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/20.jpg)
![Page 21: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/21.jpg)
Differing Perspectives
![Page 22: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/22.jpg)
![Page 23: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/23.jpg)
Perspectives
• When people see a problem from the same perspective, they are likely to get stuck on the same local peaks.
• New perspectives can clarify or muddy. Sum to 15 can be seen as Tic Tac Toe or as the Unpacking Game.
![Page 24: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/24.jpg)
Heuristics
• Process by which solutions are found within a perspective. Problem Solving Techniques.
• Calculus • Do the Opposite (Castanza Rule Princeline.com)• Error Allowing Heuristics (Explore vs Exploit)
Simulated Annealing (aka Brainstorming)
![Page 25: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/25.jpg)
IQ Test Question or 1+1=3
In each sequence, replace the X with the unique number that makes the sequence logically
consistent.
•Sequence 1: 1 4 9 16 X 36•Sequence 2: 1 2 3 5 X 13•Sequence 3: 1 2 6 X 1806
![Page 26: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/26.jpg)
• Sequence 1: 1 4 9 16 25 36
Square
• Sequence 2: 1 2 3 5 8 13 Differences 1 2 3 5
• Sequence 3: 1 2 6 X 1806
![Page 27: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/27.jpg)
1+1 = 3 or maybe 4
Sequence 3: 1 2 6 X 1806 42Differences and Squares 2 – 1 = 12
6 – 2 = 22
X – 6 = 62
1806 – X = 422
![Page 28: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/28.jpg)
• Perspectives are ways of seeing the problem. They create different landscapes.
• Heuristics are ways of constructing solutions.
• The more productively a perspective organizes reality, the more heuristics people can create to work in that perspective.
![Page 29: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/29.jpg)
• Innovations can arise from rearranging the box with a new perspective or from exploring parts of the box that have been ignored with new heuristics.
• Diverse perspectives are more likely to lead to breakthroughs; diverse heuristics are more likely to leader to iterative improvements.
![Page 30: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/30.jpg)
Multiple Perspectives and Heuristics are
Essential
We Now Work in Teams
![Page 31: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/31.jpg)
…and when working in teams…
![Page 32: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/32.jpg)
![Page 33: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/33.jpg)
Selecting Talent (how we think about
who’s good)
Scores vs Toolkits
![Page 34: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/34.jpg)
Two Views
of Ability
![Page 35: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/35.jpg)
Under what conditions does diversity trump
ability?
![Page 36: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/36.jpg)
![Page 37: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/37.jpg)
![Page 38: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/38.jpg)
![Page 39: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/39.jpg)
Page’s Initial Experiments
![Page 40: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/40.jpg)
Condition #1 “Calculus Condition”
All Problem Solvers are Smart
(relevant cognitive skills)
All problem solvers can move theball up or, at least, keep itat the same level.
![Page 41: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/41.jpg)
Condition #2
The Problem is Difficult
No individual problem solver always locates the global
optimum
![Page 42: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/42.jpg)
Condition #3 Diversity
Any solution other than the global optimum is not a local optimum for some non-zero percentage of problem solvers.
When one agent gets stuck, thereis always another agent that can
find an improvement using a different perspective or heurisitic.
The intersection of all local maxcontains only the global max.
![Page 43: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/43.jpg)
Condition #4Good-sized collections drawn at random from large population of potential problem solvers.
The initial population of problem solvers must be large and the collections of problem solvers
working together must contain more than a handful of problem solvers.
![Page 44: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/44.jpg)
Diversity Trumps Ability Theorem
Given conditions 1-4, a randomly selected collection of problem
solvers outperforms, on average,
a collection of the best individual problem solvers. (in practice, a.s.)
![Page 45: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/45.jpg)
The Theorem
![Page 46: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/46.jpg)
![Page 47: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/47.jpg)
The Basic Idea of the Proof
![Page 48: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/48.jpg)
Making a Difference: Applying the Logic of
Diversity• The best problem solvers likely have similar
perspectives and heuristics. The random problem solvers bring diverse ways of thinking.
• The best problem solvers all get stuck at the same place. The random problems solvers don’t.
• Academy of Mangement Perspecitves, Nov. 2007, page 11
![Page 49: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/49.jpg)
Making a Difference: Applying the Logic of
Diversity
The best problem solvers likely have similar perspectives and heuristics. The random problem solvers bring diverse ways of thinking.
The best problem solvers all get stuck at the same place. The random problems solvers don’t.
Scott Page, from Academy of Management Perspectives, Nov. 2007, page 11
![Page 50: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/50.jpg)
Making a Difference: Applying the Logic of
Diversity
The logic of the theorem does not imply the irrelevance of ability. …Ability still matters, but so does diversity.
And, as the theorem shows, once an ability threshold has been met, diversity matters more than ability.
Scott Page, from Academy of Management Perspectives, Nov. 2007, page 11
![Page 51: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/51.jpg)
Problems of Diversity
Communication(Problem solvers with diverse perspectives may have difficulty
understanding each other)
Misunderstanding and Mistrust
Less comfortable atmosphere(We are all more comfortable with like-minded individuals
If people do not believe in the value of diversity, then when part of a diverse team, they are not as likely to produce good outcomes.)
![Page 52: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/52.jpg)
Final Thoughts from Scott Page
Our individual abilities are not likely to growth much anytime soon.
Our collective diversity can grow.
Diversity is our best hope to solve problems and to create innovations.
![Page 53: When Can Diversity Trump Ability?](https://reader036.vdocuments.mx/reader036/viewer/2022070405/56813f43550346895da9f06d/html5/thumbnails/53.jpg)
ReferencesScott Page, The Difference, Princeton University Press, 2007.
Scott Page, Making the Difference: Applying a Logic of Diversity, Academy of Mangement Perspecitves, Nov. 2007. (Google Scott Page Academy of Mangement )
Lu Hong and Scott Page, Groups of diverse problem solvers can outperform groups of high-ability problem solvers , PNAS November 16, 2004 vol. 101 no. 46 16385–16389. (Google Hong and Page)
Scott Page, Diversity and Complexity, Princeton University Press, 2011.
John Miller and Scott Page, Complex Adaptive Systems, Princeton University Press, 2007.