identifying and compensating for biases in user feedback
DESCRIPTION
Identifying and Compensating for Biases in User Feedback. A Case Study Team Chartreuse . Walkthrough. PayR is an iPhone app which aids restaurant goers in splitting bills. Split Bill Evenly. Split Bill by Item. A Model of Design. Gather. Analyze. Implement. External Input. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/1.jpg)
Identifying and Compensating for Biases in User Feedback
A Case StudyTeam Chartreuse
![Page 2: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/2.jpg)
WalkthroughPayR is an iPhone app which aids restaurant goers in
splitting bills.
Split Bill Evenly Split Bill by Item
![Page 3: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/3.jpg)
A Model of Design
Processing of Data
Gather Analyze Implement
External Input Design
Representations
![Page 4: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/4.jpg)
Design Process
Concept Development
Initial Feedback
FormalAnalysis
Final Review
User Studies
PersonasValues
Idea GenerationPaper Prototypes
User Feedback
Interpretation
Concept SelectionRedesign
Cognitive WalkthroughHeuristic Evaluation
Interpretation
Redesign
User FeedbackExperiment
Interpretation
Final Design
Gather
Analyze
Implement
![Page 5: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/5.jpg)
Categories of Bias
Background, Personal Preferences, Values, Technical Experience
Intended use of product, Context of meals, How bills
are paid
Purpose of feedback, Location of session,
Relations among participants, Prototype
issues
Who The Person Is
What The Product is Used For
Context Of Feedback Session
![Page 6: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/6.jpg)
PAPER PROTOTYPE
![Page 7: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/7.jpg)
Paper Prototype
• Context– Detailed Feedback vs General
Feedback– Paper Prototype is “slower”
than Software Prototype• Who
– Active Feedback vs Passive Feedback
![Page 8: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/8.jpg)
HEURISTIC EVALUATION
![Page 9: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/9.jpg)
Inconclusive
Rewarding
Scope
Severity
BIG
small
Low High
Trivial
![Page 10: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/10.jpg)
![Page 11: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/11.jpg)
![Page 12: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/12.jpg)
FINAL REFINEMENT
![Page 13: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/13.jpg)
Tip Selection Experiment
• Four Test Cases– Slider snaps to 1% increments– Slider snaps to 5% increments– Slider snaps to values that make each
person’s tip convenient to pay with cash– Slider snaps to tip values that make
each person’s total bill convenient to pay with cash
• Observed ability to select desired tip amount and time taken to select desired tip
![Page 14: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/14.jpg)
-Scenario based walkthrough of prototype
- Non-Scenario based tip selection experiment
Babson Interview
-Babson student
-Non Designer
-Complementary Personality
-Non-iPhone user
-Final Prototype-Close Friend-Conducted at Babson in a friendly situation
Who The Person Is
What The Product is Used For
Context Of Feedback Session
![Page 15: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/15.jpg)
Observations
Who Struggled with draging and
keyboard layouts Technical
Issues
Personality
Scenarios
Usability Test Tip Experiment
Did not suggest interface changes despite struggling
Context Who
Context Tip selector did not afford
sliding on computer
Context Feedback based on what
he was told to do, not what he wanted to do.
Let user identify “What’s Important”
Who Context
Who Focuses on whether it works not how well it
works
![Page 16: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/16.jpg)
Results• Identified 18
instances of “Analysis of External Input”
• Categorized based on the main bias corrected for
Context What
Who
![Page 17: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/17.jpg)
What The Product is Used For
• 5 Instances– Heavily influenced by use of
scenarios• Main Sources of Bias– Occurred in “Tip
Experiment”• Merged results towards
scenarios- based on observations
WhatIntended use of product,
Context of meals, How bills are paid
![Page 18: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/18.jpg)
Who The Person Is
• 8 Instances– Influenced by use of scenarios
• Main Sources of Bias– Technical Knowledge
(iPhone Specific)– Background of Individual
(Designer vs Non-designer)• Merged results towards that
of personas
WhoBackground, Personal Preferences, Values, Technical Experience
![Page 19: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/19.jpg)
Context of Feedback Session
• 11 Instances• Main Sources of Bias– Type of Prototype– Platform of Prototype
(Computer vs iPhone)– Purpose of Feedback– Location of session
ContextPurpose of feedback, Location of session,
Relations among participants, Prototype
issues
![Page 20: Identifying and Compensating for Biases in User Feedback](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568163f2550346895dd576bc/html5/thumbnails/20.jpg)
Identifying and Compensating for Biases in User Feedback
A Case StudyTeam Chartreuse