users play cards, we keep score, magic results!
DESCRIPTION
These are the slides from our STC2011 presentation on using Microsoft's product reaction cards in our usability testing sessions. We are making a shorter version of this talk at UPA in June.TRANSCRIPT
![Page 1: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/1.jpg)
Users play cards We keep score Magic results!
Carol Barnum and Laura Palmer
The Usability Center @ Southern Polytechnic
www.usability.spsu.edu
![Page 2: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/2.jpg)
• Microsoft introduces the cards in 2002– varies their use in 2004
• A few others report in
• We get on board in 2006
• We've been crazy about them ever since
• We share what we have learned
• We give you the tools to do it yourself
Microsoft plays their hand
2usability.spsu.edu STC Summit 2011
![Page 3: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/3.jpg)
Your presenters
Carol Barnum Laura Palmer
3usability.spsu.edu STC Summit 2011
![Page 4: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/4.jpg)
ISO defines the key elements in usability
U testing gives great results for 2 out of 3
We’re here to talk about desirability
4usability.spsu.edu STC Summit 2011
![Page 5: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/5.jpg)
Can’t get no…
But, we’ve tried….and we’ve tried….
SATISFACTION
5usability.spsu.edu STC Summit 2011
![Page 6: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/6.jpg)
Microsoft tackles the problem
1. Faces Questionnaire
2. Product Reaction Cards
118 Cards
6 Faces
6usability.spsu.edu STC Summit 2011
![Page 7: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/7.jpg)
After Microsoft?
A small oasis of reports shows variations on the theme
7usability.spsu.edu STC Summit 2011
![Page 8: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/8.jpg)
We decided to give the cards a try
8usability.spsu.edu STC Summit 2011
![Page 9: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/9.jpg)
How we deal
Slide 9usability.spsu.edu STC Summit 2011
![Page 10: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/10.jpg)
Putting the “meta” in analysis
2006…..ongoing
Studies from a variety of industries and interfaces
10usability.spsu.edu STC Summit 2011
![Page 11: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/11.jpg)
Teaching the teachers
18 cards…..17 positive, 1 negative
11usability.spsu.edu STC Summit 2011
![Page 12: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/12.jpg)
Got reservations?
PRC = 93% positive + 7% negativeSUS = 82
Themes: ease‐of‐use, comprehensibility, familiarity, speed
12usability.spsu.edu STC Summit 2011
![Page 13: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/13.jpg)
Calling the cable company
January41% +21% 38%‐
Neutral’s good in our industry!
Negative Neutral PositiveAnnoyingBoringDifficultDistractingFrustratingImpersonalInconsistentNot valuablePoor QualityToo technicalUncontrollable
ExpectedFamiliarSterile
AccessibleBusiness‐likeComprehensiveConvenientDesirableEasy‐to‐useHelpfulStraight‐forward
Repeated PositivesPredictable = 3Friendly = 2Usable = 2
13usability.spsu.edu STC Summit 2011
IVR
![Page 14: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/14.jpg)
Six weeks later: the cable company
85% +11%4% ‐
IVR APOSITIVE NEUTRAL NEGATIVE
48% +12%40% ‐
14usability.spsu.edu STC Summit 2011
IVR BPOSITIVE NEUTRAL NEGATIVE
![Page 15: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/15.jpg)
Changing planes
IVR
SUS = 8779%+ PRC
15usability.spsu.edu STC Summit 2011
![Page 16: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/16.jpg)
Clear for takeoff
21% - PRC
16usability.spsu.edu STC Summit 2011
![Page 17: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/17.jpg)
It’s not easy being green
International “green” initiative
March 2010 = SUS = 5242% PRC positive
October 2010 = ☺SUS = 7382% PRC positive
17usability.spsu.edu STC Summit 2011
March 2011 = ☺☺SUS = 96100% PRC positive
![Page 18: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/18.jpg)
Movin’ on up
Positives: 24 50 43
18usability.spsu.edu STC Summit 2011
1.0 2.0 2.1
![Page 19: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/19.jpg)
Negative choices decline to zero
Negatives: 33 11 0
19usability.spsu.edu STC Summit 2011
2.0 2.1 01.0
![Page 20: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/20.jpg)
Weather or not
3 TV weather sites
0
10
20
30
40
Positive Negative PositiveNegative
PositiveNegativeStation A
Station BStation C
26/13 39/5 24/17
20usability.spsu.edu STC Summit 2011
![Page 21: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/21.jpg)
“B”cause we like you
Repeats within and between
Blanks are just as telling as choices
21usability.spsu.edu STC Summit 2011
![Page 22: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/22.jpg)
“C” you later
What Station B isn’t!
22usability.spsu.edu STC Summit 2011
![Page 23: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/23.jpg)
C’mon…give it a try
Slide 23usability.spsu.edu STC Summit 2011
![Page 24: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/24.jpg)
Our concluding thoughts
24usability.spsu.edu STC Summit 2011
![Page 25: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/25.jpg)
Compare, Contrast and Combine
Slide 25usability.spsu.edu STC Summit 2011
![Page 26: Users Play Cards, We Keep Score, Magic Results!](https://reader034.vdocuments.mx/reader034/viewer/2022051514/5481d9cfb07959600c8b4628/html5/thumbnails/26.jpg)
Questions? Now or later?
Carol Barnum Laura Palmer
26usability.spsu.edu STC Summit 2011