Transcript
Page 1: UXPA Boston Card Sorting

IA Issues? Online Card Sorting is Not Enough.

Andrew Schall, Principal ResearcherKey Lime Interactive

Page 2: UXPA Boston Card Sorting

Principal Researcher & Sr. Director, Key Lime Interactive

Past President, UXPA Washington DC

Co-author, Eye Tracking in User Experience Design

Andrew Schall

Founder & President, UXPA South Florida

Page 3: UXPA Boston Card Sorting

What’s covered in the next 45 minutes Why card sorting? Online card sorting: The good, bad, & ugly In person card sorting: Going old school Hybrid card sorting method: The best of both worlds Q & A

Page 4: UXPA Boston Card Sorting

A super quick review of card sorting

Page 5: UXPA Boston Card Sorting

Understanding how your users think about the organization of content

If your users can’t find the information that they are seeking, it might as well not be there at all.

Page 6: UXPA Boston Card Sorting

The card sorting research methodCard sorting is a technique that can help gain insights into how your users think about the organization of your content. This user research method can be performed using an online tool or in person using physical cards.

Need to learn more about card sorting? Read this book:

Page 7: UXPA Boston Card Sorting

What we learn from card sorting Which items participants think should be grouped together What to call each collection of grouped items How many categories participants think the items should be

grouped into

Page 8: UXPA Boston Card Sorting

Online Card Sorting

Page 9: UXPA Boston Card Sorting

Moving from physical to digital

Page 10: UXPA Boston Card Sorting

Easy methods to recruit participants

Page 11: UXPA Boston Card Sorting

Convenient method for capturing data

Page 12: UXPA Boston Card Sorting

Automated data aggregation and visualization

Page 13: UXPA Boston Card Sorting

The benefits of online card sorting

Online card sorting has become a very convenient and common way to collect this information from users.

Recruit 24/7 – participants can complete the activity on their schedule from anywhere.

Fast and easy data collection – card sort software is relatively easy to use and straightforward for most participants.

Large sample size – it is easy to quickly obtain a large sample size for statistical analysis.

Page 14: UXPA Boston Card Sorting
Page 15: UXPA Boston Card Sorting

Who you think your participant is

Page 16: UXPA Boston Card Sorting

Who your participant really is

Page 17: UXPA Boston Card Sorting

Online card sorting tells you what, but not whyCollecting data on how your users sort items into categories tells you what they did, but not why they did it.

Page 18: UXPA Boston Card Sorting

Quantitative results can be inconclusive

Page 19: UXPA Boston Card Sorting

Online survey to the rescue!

Page 20: UXPA Boston Card Sorting

Quotes from actual study participants

“It’s good” “Fine” “Clear” ”No questions” “Confusing” “Didn’t understand some of the cards” “I didn’t know what was meant by _______” “I wasn’t sure where to put the _____ card” “Activity took WAY too long!” “I’m not getting paid enough to do this.”

Less than helpful qualitative responses

Page 21: UXPA Boston Card Sorting

In Person Card Sorting

Page 22: UXPA Boston Card Sorting

Old school card sorting

Page 23: UXPA Boston Card Sorting

In person card sorting method

Typically scheduled for an hour and are conducted one-on-one with a facilitator.

Sessions are typically recorded with an overhead camera capturing the table with the cards.

Participants are provided with physical materials that include: Cards labeled with the name of each item to be sorted Pens or markers for making notes Sometimes color-coded stickers for further annotations such as

priority/importance

Page 24: UXPA Boston Card Sorting

Physical cards are intuitive

Page 25: UXPA Boston Card Sorting

More flexibility

Page 26: UXPA Boston Card Sorting

Higher engagement

Page 27: UXPA Boston Card Sorting

Benefits of in person card sorting

Understand participant’s thought process – Think aloud protocol can be used to have the participant explain why they are sorting cards in a certain way.

Observe nonverbal responses – Do they appear deep in thought, confused or frustrated? Do they visibly hesitate to place a card or create a label for a category?

Provide motivation – Card sorting is a laborious and mentally demanding task. Participants often lose motivation to complete the activity. The facilitator can provide encouragement to the participant to keep going.

Page 28: UXPA Boston Card Sorting

Scheduling logistics

Page 29: UXPA Boston Card Sorting

Lots of manual data entry

Page 30: UXPA Boston Card Sorting
Page 31: UXPA Boston Card Sorting

Hybrid Card Sorting

Page 32: UXPA Boston Card Sorting

A hybrid approach

Start with an online open card sort study to see general trends in how users sort items and for a higher sample size

Follow up with an in-person study with a smaller sample size to understand participants’ thought process including insights into how they would use the content.

Don’t forget to iterate! Card sorting (or tree testing) should be done to validate any changes that you make to your IA.

Page 33: UXPA Boston Card Sorting

Good research means asking the right questions

Page 34: UXPA Boston Card Sorting

What does this mean to you?

Asking about the meaning of cards and categories (if closed) Suggestions for improving labels

Page 35: UXPA Boston Card Sorting

How is this relevant to you?

Asking about the relative importance of content items Context of use – In what situations would they need to access this

information, and how often?

Page 36: UXPA Boston Card Sorting

Why would you group these together?

Inquire about thought process of how items are related to each other Sensing level of uncertainty, confusion or frustration

Page 37: UXPA Boston Card Sorting

In summary

Don’t exclusively rely on online card sorting for your IA research needs! Use the power of think aloud to learn from your card sort participants. Consider a hybrid approach to gain the benefits of both

online/unmoderated and in person/moderated card sorting. Don’t forget to iterate. You should validate the changes that you make

to an IA based on card sorting results.


Top Related