Adam Emfield

Philip Jones

Ryan McGarry

* Seven Years of Microsoft Word: Evolving Interfaces and Usability

*Changes in Word

*Microsoft Word 2007 introduced new interface paradigm (the “Ribbon”) to organize options differently*Many claim the newer version slows them down, making it

harder to find familiar menu choices that have been reorganized

* Task-based layout

*Word 2010 tweaks 2007, adds Backstage View

*Our Study

*Tested for empirical confirmation of anecdotal evidence*Data from Word 2003, 2007, and 2010 beta

*Each version tweaks method of formatting text, tracking changes/working with comments, and accessing printing options

*Methods

*Participants had ”moderate” or more experience with 2003, 2007*No experience required with 2010 beta

*Given standardized instructions

*Asked to perform specific tasks

*Formatting text, header

*Adding reader comments

*Changing printing options

*Information Gathering

*Data collected with screen capture software*Observation with minimal interaction

*Recorded verbalizations to gain insight into user perceptions*Verbal protocol analysis

*Task Analyses

*Verbal protocol analysis

*KLMs*Task x Version

*Timeline analyses*High resolution due to small task time

*Hypotheses

*We predicted that some tasks with new, logical menu locations would be faster in 2007

*e.g. Changing formatting, double-spacing text

*Other tasks with a longer workflow faster in 2003

*e.g. Adding comments

*Word 2010 beta will improve upon ‘File’ menu operations (compared to 2007), all else constant

*e.g. Print, Save

*Results

*KLM

*KLM Times

Task 1 Task 2 Task 30.00

20.00

40.00

60.00

80.00

100.00

120.00

140.00

160.00

Expected Task Duration by Version

200320072010

Tim

e (

sec)

*Timeline Analysis

*Timeline: Task 1

Time (s) 2003 2007 2010

2   Edit Header Edit Header Edit Header

    35.7 34 36.7

         

         

10        

         

         

         

         

20        

         

         

         

         

30        

         

         

      Double-Space Document  

    Double-Space Document 11.3 Double-Space Document

40   7.7   11.3

         

         

    Format Title Page in APA Format    

    21.7 Format Title Page in APA Format  

50     24 Format Title Page in APA Format

        30.7

         

         

         

60        

         

         

         

    Insert Page Break    

70   5.7    

      Insert Page Break  

    2.7  

     

     

80   Insert Page Break

    5.3

84    

Time (s) 2003 2007 2010

2   Turn on Track Changes Turn on Track Changes Turn on Track Changes

    5.5 7 6.5

         

   

Correct Spelling Errors and Duplicate Words

 

Correct Spelling Errors and Duplicate Words10 

Correct Spelling Errors and Duplicate Words    144.5 43.5

      78.5  

         

         

20        

         

         

         

         

30        

         

         

         

         

40        

         

         

         

         

50        

         

        Accept Changes in Introduction

        6.5

         

60       Read Comments in Methods Section

        9

         

         

         

70       Add Comments to Methods Section

        23.5

         

         

         

80        

         

         

         

         

90     Accept Changes in Introduction  

      10  

       

       

       

100     Read Comments in Methods Section

      8.5

       

       

      Add Comments to Methods Section

110     25

       

       

       

       

120      

       

       

       

       

130      

       

     

     

     

140    

     

     

     

     

150    

     

    Accept Changes in Introduction

    9.5

     

160    

     

    Read Comments in Methods Section

    8.5

     

170    

    Add Comments to Methods Section

    30

     

     

180    

     

     

     

     

190    

     

     

     

     

200    

*Timeline: Task 2

*Timeline: Task 3

Time (s) 2003 2007 2010

2  Select Print Select Print Select Print

    3.7 4.3 4.7

    Select Desired Printer Select Desired Printer Select Desired Printer

    5.3 4.3 6.3

10    Edit Advanced Options  

    Edit Advanced Options 48 Edit Advanced Options

    46.3   39.7

         

         

20        

         

         

         

         

30        

         

         

         

         

40        

         

         

         

         

50        

         

        Print Specific Pages

        5.3

         

60   Print Specific Pages Print Specific Pages Turn Off Collate

    4 4.3 6

    Turn Off Collate (2.3) Turn Off Collate (2)  

    Select Print Select Print Select Print

    1.7 2 10.3

70   

     

74    

*Verbal Protocol Analysis

*Issues

*Reading comprehension

*180 WPM on a monitor* Ziefle, M. (1998), Effects of display resolution on visual performance, Human Factors, 40(4),

555–568.

*Confounds

*Final Thoughts

*VPA: greater frustration with 2007 associated with greater experience ratio with 2003 (vs. 2007)

*Minimal changes between 2007, 2010 beta

*Users with 2010 experience likely to prefer 2007/2010 over 2003