team - stanford university · changes in prototype test methodology test results discussion about...

19

Upload: others

Post on 15-Jul-2020

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,
Page 2: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Team

Christian White Michael Peterson Filippa Karrfelt Nathan Schager

Page 3: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Presentation overview

● Changes in prototype

● Test methodology

● Test results

● Discussion about changes

Page 4: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Prototype changes

Page 5: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Prototype Changes

Page 6: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Participants

Zina, Julia, Sam, Austin, Toni

Page 7: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Apparatus

● Xcode iPhone simulator on computer

● Audio and screen recordings with

quicktime, skype screensharing

● Tests on campus and remotely if needed

Page 8: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Procedure

● About Sign Along

● The test process

● App on Xcode simulator

● Description of task

Page 9: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Simple Task

As a concertgoer, find a concert you would like to attend.

Looking for:● Login● Search and select concert● Functionality of home and menu buttons

Page 10: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Medium Task

As a concertgoer, vote on your favorite interpreter submission for a concert you want to attend.

Looking for:● The voting feature● Interaction with the interpreter submissions● Design and usability of the events page

Page 11: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Complex Task

As an interpreter, upload a video submission for an event you would like to interpret at.Looking for:● Login● Interpreter functionality● Design and usability of the event screen● Uploading and submitting interpretation

Page 12: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Test Measures

● Errors / confusions

● How long users spent watching interpreter videos

● Time to complete complex task

Page 13: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Results: Simple Task

Errors / confusions:

● Want a search bar for events

● Confused that menu button goes to the sign in page

● Liked scrolling through list of events, wished for

Indication that the tab could expand

Page 14: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Results: Medium Task

Time watching submissions:

● Zina: 10s + 11s + 13s (watched all 3)

● Julia: didn’t watch interpreter videos

● Sam: 1m + 20s (watched 2 of 3)

● Toni: 5s + 10s (watched 2 of 3)

Errors/confusions:

● Voting confirmation

● Video fast forward

Page 15: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Results: Complex Task

Time to complete task:

● Time varied greatly based on confusion with selecting

track - varied from 20s to 2m

Errors / confusions:

● Expected there to be a recording when selecting play

● Option to upload (from Youtube) or record

● Confused that a specific track had to be selected to

get to upload screen - no visual indication

Page 16: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Takeaways from Testing

Make the tasks not as similar

UI for voting and uploading needs additional clarification

Allow a dedicated upload button at the top, rather than navigating to it

Allow users to navigate video playback more easily

Page 17: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Discussion: Changes in Interface

From interview with ADA Coachella:

● Fulfilling a need: concert networks

● They need to find certified interpreters in areas where they have upcoming events, and a way to asses interpreters in order to pick the best one for the event.

Page 18: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Discussion: Changes in Interface

From the user tests:

● Search bar for events

● Better voting UI (notified that voted)

● Clarify and change the way that interpreters upload and submit video

● Better way to fast forward in interpretation submission

Page 19: Team - Stanford University · Changes in prototype Test methodology Test results Discussion about changes. Prototype changes. Prototype Changes. Participants Zina, Julia, Sam, Austin,

Summary of Talk