USABILITY TESTING

Lauralee Flores, M.S.

FORMAL VS. DISCOUNT Formal

More precise

More time consuming

More costly

Mathematical (statistical) results

Discount

Quicker

Less Costly

Not as precise

COGNITIVE WALKTHROUGH

“Think Aloud” “Cognitive Walkthrough”

Provides lots of process data

Relatively small number of test users (~5)

Many useful quotes for the report and presentation

COGNITIVE WALKTHROUGH, cont.

Prompting the user

Thinking aloud is unnatural

Impacts performance measures

Responding to user’s questions with a question

RUNNING YOUR TESTPrepare scenarios and test plan

Typical of the product during actual use

Tests important users goals

RUNNING YOUR TEST, cont.

Selecting participants

3-5 participants

Typical or actual users or as close as you can get to them

Avoid using friends and family

Do practice run through to iron out any bugs in your test plan

LOGISTICSRunning the Test

You should be the facilitator & observer

You and the participant should be the only ones speaking (the “computer” shouldn’t say anything)

Give instructions

Introductions

LOGISTICS, cont. Running the Test (cont.)

Get someone to be the “computer”

Knows the system logic (which actions result in which consequences)

simulates the responses (without explanation)

THE RESULTSThe observers notes & impressions

Interpreting user behavior

Lots of problems in the same area?

Confusion or problem with high priority tasks?

User expectations not met?

Expectations often lead to good design ideas

ETHICAL ASPECTS Respect user emotions and well-being

Don’t give positive reactions to successful tasks

Remain neutral

ETHICAL ISSUES, cont. Interrupting

When user is speaking

When user is trying to complete a task

Users should feel comfortable

Do not laugh at user

Feelings of inadequacy

Explain your not testing them they are helping you test the product

Confidentiality

THE REPORT The usability method

Defined

Methodology reported

Executive Summary

Findings

Recommendations

THE REPORT, cont. Unresolved

Other things to include:

Pictures

User Quotes