everybody lies: rapid cadence research & usability testing

Will Evans @semanticwill

Yana Kuchirko@mslogophiliac

“When usability is inherent in the products we use, it’s invisible.We don’t think about it. But we

know it’s there.”

Will Evans | Manager, User Experience Design 2

Defining Usability:

- International Organization of Standardization


Critical ElementsSpecific Context:

Specific Users:

Specific Goals:


Effective:

Efficient:

Engaging:

Error Tolerant:

Easy to Learn:

The 5 E’s of Usability


Evaluation of Product


Formative

Summative

Types of Usability Testing


#AgileUX Process at TheLadders


Establish Test Goals


What to test:

Where to test:

How to test:

Determine The Process of Testing


Define the “Core” Audience


Developing “Personas”


Sample Persona: ‘Todd’


Recruit Participants


Create “real” testing scenarios


Determine type of feedback


Creating Questionnaires

• Allows people to rate overall experience


Creating Questionnaires


Prepare a test schedule


Write a Test Plan


“We are testing the product, not you.”


Moderator’s Script


Being an Effective Moderator

• Open-ended, non-leading questions beginning with “what” or “how” (never “why”!)


Think-aloud Process

• Why the participant is taking an action

• What they think about the process• What they expect to happen

(matching user mental model to system model)


Understanding Your User

• Users are people with a goal which the product needs to support

• People are in a hurry to reach their goal and they rarely read text until they come across content that matches their goal


“We finished testing. Now what does it all mean?”


What Did We See?


What Does It Mean?


Triangulation Analysis


What Should We Do About It?


Types of Severity Scales


Making Recommendations


Framing Findings: Key Considerations

• Will audience already believe changes are needed or must you convince them?


Writing a Report

04/07/23 Will Evans | Manager, User Experience Design 37

Sample Report

Thanks!

Will Evans is Manager, Experience Design for TheLadders in New York City with 15 years industry experience in interaction design, information architecture, and user experience strategy. His experiences include directing UX for social network analytics and terrorism risk modeling at AIR Worldwide, UX Architect for Gather.com, and UX Architect for travel search engine Kayak.com. He worked at Lotus/IBM where he was the senior information architect, and for Curl – a DARPA-funded MIT project when he was at the MIT Laboratory for Computer Science.

His passions include design and critical theory, postmodernism, information visualization, psychology, neuroscience, and wine. He lives in New York, NY, drinks far too much coffee, wears only black, and was Design Co-Chair for the IxDA Interaction10 conference in Savannah, Georgia in February, 2010. He also served on the board of directors of the Information Architecture Institute leading marketing and events.

everybody lies: rapid cadence research & usability testing

Technology