whoa! did you see that? collaborative data collection and analysis
TRANSCRIPT
![Page 1: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/1.jpg)
Collaborative Data Collection And Analysis
#UXPABOS15@KyleSoucy
UsableInterface.com
Whoa !Did you see that?
![Page 2: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/2.jpg)
you don’t own the data
![Page 3: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/3.jpg)
The team does
![Page 4: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/4.jpg)
what’s at Risk?
![Page 5: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/5.jpg)
Incomplete Data
![Page 6: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/6.jpg)
Rashomon effect: Contradictory interpretations of the same event by different people.
![Page 7: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/7.jpg)
![Page 8: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/8.jpg)
Not everyone can attend every session
Image source: http://www.kramerelectronics.com/images/news/sap_labsimage1.jpg
![Page 9: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/9.jpg)
1. Share Observations
2. Prioritize issues
observer debrief Goals
![Page 10: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/10.jpg)
benefits
![Page 11: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/11.jpg)
No massive generalizations
![Page 12: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/12.jpg)
Immediate insights list
![Page 13: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/13.jpg)
Usability Tes,ng
Report
![Page 14: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/14.jpg)
![Page 15: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/15.jpg)
Note taking
![Page 16: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/16.jpg)
give assignments
![Page 17: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/17.jpg)
"Usability testing is like getting a drink from a fire hydrant…" - Carolyn Snyder
![Page 18: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/18.jpg)
observation, inference,
and opinion
![Page 19: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/19.jpg)
Observation
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
"The participant typed, ‘science fiction’
in the search box.”
![Page 20: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/20.jpg)
Inference
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
"The participant doesn’t like to use
the navigation.”
![Page 21: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/21.jpg)
Opinion
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
"The navigation is not noticeable.”
![Page 22: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/22.jpg)
Ways to Take NotesEveryo
ne should
use the same tool
&/or method.
![Page 23: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/23.jpg)
Notes Grid
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
![Page 24: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/24.jpg)
Why? Because this doesn’t work...
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
![Page 25: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/25.jpg)
And neither does this...
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
![Page 26: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/26.jpg)
Theme Analysis grid
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
![Page 27: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/27.jpg)
Or, rainbow spreadsheet
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpgImage source: http://www.smashingmagazine.com/2013/04/11/rainbow-spreadsheet-collaborative-ux-research-tool/
![Page 28: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/28.jpg)
Pick List
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
![Page 29: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/29.jpg)
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
sticky notes
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
![Page 30: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/30.jpg)
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
Live Shared
Note Taking
![Page 31: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/31.jpg)
![Page 32: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/32.jpg)
debriefing
![Page 33: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/33.jpg)
when to debrief?
After every 3-6 sessions.
Don’t wait ‘til the end.
![Page 34: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/34.jpg)
Prepare
![Page 35: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/35.jpg)
Ways to debrief
![Page 36: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/36.jpg)
round-robin or lead + additions
![Page 37: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/37.jpg)
It’s not just about the findings...
implications matter
![Page 38: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/38.jpg)
Wish for, how to, what if
H2 make these box entry areas clearer; H2 make it obvious they’re exclusive; Wif we only allowed one way to search for repair info?
![Page 39: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/39.jpg)
Observation: The user didn’t realize they were notlogged in and couldn’t access documents they wanted.
Implications:
- “W4 a way the user can access documents without logging in.”
- “H2 make the log in link more visible.”
- “Wif we didn’t force the user to log in?”
Example
![Page 40: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/40.jpg)
Blue sky thinking
![Page 41: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/41.jpg)
“If we can really understand the problem, the answer will come out of it, because the answer is not separate from the problem.”
- Jiddu Krishnamurti
![Page 42: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/42.jpg)
Affinity Diagraming
![Page 43: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/43.jpg)
Affinity Diagraming
1. Put observations on post-its
2. Put post-its on the wall
3. Group similar items
4. Name each group
5. Vote on most important groups
![Page 44: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/44.jpg)
Image source: http://www.dailymail.co.uk/femail/article-2344654/Carrie-Bradshaw-jealous-Man-uses-8-000-Post-notes-spring-surprise-wedding-proposal-girlfriend.html
![Page 45: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/45.jpg)
“There is a good way to break up with someone, and it doesn’t involve a post-it!” - Carrie Bradshaw
observe
Kyle Soucy
![Page 46: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/46.jpg)
So... can you believe that last person couldn’t find the ‘submit’ link.
Informal Discussion
![Page 47: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/47.jpg)
key to complete
data collection and analysis...
![Page 48: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/48.jpg)
Collaboration
![Page 49: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/49.jpg)
Learn more...Book:
Paper Prototypingby Carolyn Snyder
Yes, really.
There’s an
amazing chapt
er
on analysis
!
Articles:
Making it easy to collect the data you want to collecthttp://usabilitytestinghowto.blogspot.com/2008/07/making-it-easy-to-collect-data-you-want.html
by Dana Chisnell
Making sense of the data: Collaborative data analysishttp://usabilitytestinghowto.blogspot.com/2010/04/making-sense-of-data-collaborative-data.html
by Dana Chisnell
Engaging Study Observers: An Overlooked Step in User Researchhttp://uxpamagazine.org/engaging-study-observers/
by Stephanie R. Fishel-Brown, Emily J. Schroeder
A Collaborative Lean UX Research Toolhttp://www.smashingmagazine.com/2013/04/11/rainbow-spreadsheet-collaborative-ux-research-tool/
by Tomer Sharon
The Road To Recommendationhttp://www.uie.com/articles/recommendation/
by Jared Spool
![Page 50: Whoa! Did You See That? Collaborative Data Collection and Analysis](https://reader034.vdocuments.mx/reader034/viewer/2022052509/55aee0141a28abce1f8b485b/html5/thumbnails/50.jpg)
www.usableinterface.com
@kylesoucy
Thank you.
/usableinterface