Usability test of ballot paper prototypes for tablet - design iterationsUniversity of BaltimoreDrew DaviesDana ChisnellKathryn SummersMegan McKeever

November 11-14, 2012

Iteration 1

Iteration 2 Localizes the ballot for the testing location.

Iteration 3Reorients to vertical from horizontal, getting ready for tiny screens.

Instructions to voters

Iteration 1 Appears after the title screen. Text comes from NIST research.

Iteration 2 Corrects emphasis in the first paragraph.

Iteration 3 Added illustration, which did not seem to help.

Iteration 4Moved from horizontal to vertical changes the proportions, which feels different.

Iteration 5Added a simpler illustration back into the vertical version.

Help versionHere we added a pointer to the supplemental content that acts like context help.

Straight party voting

Iteration 1 The NIST ballot includes straight-party.

Iteration 2 Expands explanation of straight-party voting.

Iteration 2, selected state

Iteration 3 Paring down the instructions substantially.

Iteration 4 Simplifying wording, and adding paragraph breaks.

Iteration 5Vertical layout enforces order. We added (i) buttons for supplemental content.

Vote for 1

Iteration 1 Showing the number of choices remaining was helpful.

Iteration 1, selected state

Iteration 2 Correcting the instructions for changing votes.

Iteration 3 Removing most instructions and adding entry to supplemental content.

Leads to information about the contest

Position statements from the candidates

Information about marking the ballot for this contest

Supplemental content, iteration 1

Supplemental content, iteration 1

Supplemental content, iteration 1

Iteration 4Vertical, with minimal instructions.

Supplemental content, iteration 2In addition to going vertical, we added simplified illustrations.

Supplemental content, iteration 2

Multi-candidate contests

Iteration 1

Iteration 1, selected state Avoiding a testing artifact, we changed party names.

Iteration 2 Correcting the instructions for changing votes.

Iteration 2, content scrolled down

Iteration 2, content scrolled to end

Iteration 3Vertical format, minimal instructions.

Iteration 3, content scrolled

Iteration 4

Iteration 4, scrolledWe still have questions about how scrolling should work.

Judge retention contests

Iteration 1

Iteration 2 Changing the order of and shortening instructions.

Iteration 3Vertical, minimalist.

Referenda

Iteration 1 Note “Yes” or “No.”

Iteration 2, and selected state

Iteration 3 Correcting the instructions on changing votes. Switching to “For” and “Against.” The literature is unclear about whether it’s better than “Yes” and “No.”

Iteration 4Staying with “For” and “Against” for the vertical version posed no problems.

Ballot measures

Iteration 1

Iteration 2 Correcting the instructions on changing votes.

Iteration 3 Localizing the state the ballot measure applies to.

Iteration 4Pared-down instructions, and room for a question that can be answered “Yes” or “No.”

Write-ins

Iteration 1 Instructions from the NIST study.

Iteration 1

Iteration 2Vertical version, with minimal instructions, focusing on what would invalidate the vote.

Iteration 2

Supplemental content, iteration 1Touching the (i) leads to the instructions that used to be on the surface screen.

Reviewing votes

Iteration 1

Iteration 1, scrolled down (page 2)

Note the use of the word, “choices”

Note the use of the word, “choices”

Iteration 1, scrolled down (page 3)

Iteration 1, scrolled to the end

Iteration 2Vertical format, with wording change in the scroll button.

Iteration 2, scrolled down (page 2)

Iteration 2, scrolled down (page 3)

Iteration 2, scrolled down (page 4)

Iteration 3, scrolled down (page 4)

Iteration 4, scrolled down (page 2)Revelation! “Choices” means there are still more choices to make. Wording changes both in the title and the button label.

Iteration 4, scrolled down (page 3)The wording changes and simple instructions helped participants understand the purpose and use of the Review.

Supplemental content, iteration 1

Changing a vote

Iteration 1

Iteration 2Changing the button label to telegraph the navigation.

Iteration 3

Iteration 4

Casting the vote

Iteration 1

Iteration 1

Iteration 2We’re hoping that the vertical format will scale well to tiny screens.

Iteration 2

18 participants4 days16 versions

Next: Usability testing of digital prototypesmid-January 2013