Download - Remote Prototype Testing Case Study
Webinar:
How To: Remote Prototype Testing
Webinar Overview & Goals
1. Brief Introductions
2. What do we mean by Remote Prototype Testing?
3. When is Remote Prototype Testing useful?
4. Case study:
How to set up, design a Remote Prototype Test
What results can you expect?
5. Takeaways, Q&A
Introductions
Alfonso de la Nuez
Founder & CEO
at UserZoom
Kim Oslob
Dtor. Client Services
at UserZoom
4 quick facts about UserZoom
Leading SaaS company specializing in Remote UX Testing
Our obsession is to help businesses create excellent Customer Experiences
Our software solution includes 8 different tools to run Remote UX Research
Around for about 9 years, offices in Sunnyvale (CA), Cheshire (UK) and Barcelona (Spain)
50% of Fortune’s Most Admired Companies!!!
Some accomplishments
Before we begin, let’s take a quick poll to get to know you better…
What do we mean by Remote Prototype Testing?
Typical scenario for UX Pros
Sure we’d love to run testing, but…
UX & Usability research tends to be expensive
Time is not on our side
Target audiences are all around
Budget issues anyone???
• Hundreds of users agree to participate in a study
• In their natural context
• From geographically spread locations
• Users try to complete tasks (or goals) + answer questions
• No human moderation needed
• Our browser bar connects users’ browsers with a server
Remote Unmoderated Testing
What we mean by Remote Prototype Testing
What you can test with Remote Prototype Testing
Of course, low and high fidelity wireframes/prototypes
…but also:
Mock-ups
Images
Multimedia
Advantages and benefits or Remote Prototype Testing
Advantages and benefits
Cost-effective
Advantages and benefits
Quick, agile
You can gather feedback in a matter of hours
Advantages and benefits
Stats!
You can test with large samples
Advantages and benefits
Geographic representation
Your audience may be anywhere!
Advantages and benefits
Unbiased feedback
Advantages and benefits
Detailed feedback, results
However, not to be used when…
Getting highly qualitative data
In-person interviews are important
Note: Not all research
goals can be met
Remote testing and Agile Development
Characteristics: Speed Iterative Requirement
analysis Design User testing
Remote Testing is here to help!
Types of Remote Testing projects
Types of Remote Testing projects
Task-based surveys (Remote Usability)
Types of Remote Testing projects
Click Testing
Types of Remote Testing projects
Timeout Testing
Types of Remote Testing projects
Tree Testing
Types of Remote Testing projects
Multimedia surveys
Let’s take poll #2 now!
Case Study
Examples of Prototyping Tools
Case Study Explanation
• With each tool, Axure and Just In Mind, we ran a 30 user remote usability study
• The Axure study featured a low-fidelity prototype for an e-commerce company
• The Just In Mind study featured a high-fidelity prototype for a banking company
• Both vendors generate hosted, trackable prototypes
30
Axure Study Initial Questionnaire
1. How often do you shop for clothing online?
11/1/2011
31
Axure Study Task - Find Shoes
Add a pair of women's shoes to your shopping cart. When you are done, click "I'm Finished".
Starting page:
11/1/2011
32
Axure Study Clickstream
Note: We can validate success by URL
Page click-throughs on Axure prototypes are trackable with UserZoom
33
Axure Study Click Heatmap
The large red “heat” indicator shows a majority of people clicked there to begin the the task finding the pair of women’s shoes.
34
Axure Study Task - Find Shoes
Task Effectiveness & Efficiency
11/1/2011
35
Axure Study Task - Success Questionnaire
1. Please indicate how easy it was for you to find the shoes:
11/1/2011
36
Axure Study Task - Abandon Questionnaire
1. Please select the reason(s) why you chose to abandon or were not able to complete this task: (check all that apply)
11/1/2011
37
Just In Mind Study
Now let’s look at the Just In Mind Prototype Study
38
Just In Mind Study Initial Questionnaire
1. How often do you manage your banking online?
11/2/2011
39
Just In Mind Study Task - Find Credit Card
Find the annual fee amount on the PremierPass Rewards Credit Card. When you are done, click "I'm Finished".
Starting Page:
11/2/2011
40
Just In Mind Study Clickstream
41
Just In Mind Study Click Heatmaps
42
Just In Mind Study Task - Find Credit Card
Task Effectiveness
11/2/2011
43
Just In Mind Study Task - Validation Questionnaire
1. What is the annual fee for the PremierPass Card?
11/2/2011
44
Just In Mind Study Task - Success Questionnaire
1. Please indicate how easy it was for you to find the annual fee amount:
11/2/2011
Some takeaways…
1. You don’t need a live website to run remote testing
2. Many benefits to remote prototype testing, including reduced costs, speed, etc.
3. Remote Prototype Testing in Agile Dev: A great fit!
4. There are various types of remote testing projects, not just remote usability, when developing prototypes
5. Make sure the tool used generates trackable prototypes
6. The detailed of the data collected is AWESOME and very actionable, plus you can do iterative testing too!
More info? Check out our How-To articles on www.userzoom.com!
Q&A
Please don’t go yet! Let’s take the final poll…
Thanks so much for your time!
Check out our upcoming news and events at www.userzoom.com
Sunnyvale (USA)
440 N. Wolfe Rd. Sunnyvale,CA 94085 Phone: +1 (408) 524 7445 Contact: Alfonso de la Nuez
Barcelona (Spain)
Av. Diagonal 419 3º 2ª 08008 Barcelona Phone: +34 93 414 7554 Fax: +34 93 209 8380 Contact: Xavier Mestres
Cheshire (UK)
Booths Park. Chelford Road, Knutsford, Cheshire WA16 8GSPhone: + 44 (0)1565 759890Cell: + 44 (0)7900 472 920Contact: Arthur Moan