USABILITY TESTING REPORT Assignment 8 SI 622: Needs Assessment and Usability Evaluation Mark Newman, Winter 2013 April 23, 2013 Team 10: The Finding Aides Jianqi Chen Jess Durham Sharona Ginsberg JJ Pionke Ziwei Xie Word Count: 4000

2

Executive Summary This report presents the results and analysis of usability testing conducted for the Bentley Historical Library. Usability testing allowed our team to better understand interaction between users and the library’s website. Researchers use the site for a diverse range of tasks, but each ultimately depends on searching or browsing for material, and our goal was to simulate these tasks and have the results generate new findings and recommendations, or to confirm or correct findings and recommendations in previous reports. We asked five participants, ranging from advanced to novice technical researchers, to search for materials or information contained within the Bentley website. The users were given a chance to reflect on their experience by filling out a post-test questionnaire, and we used the testing notes and questionnaires to formulate the following findings and recommendations: Findings

The website does not comply with web standards and causes complications as users attempt to navigate the site.

No attempt has been made for the website to accommodate diverse users or to educate novice users.

The search feature is limited and does not conform to user expectations. The website does not take into account any issues of accessibility or language

barriers. The website is not organized for user needs and presents unclear language and

categorical distinctions that do not makes sense to users. Recommendations

Comply with web standards and modify links accordingly. Incorporate elements of information literacy, especially those unique to the

Bentley, to educate and guide novice users through the site. Change the Quick Links box to present frequently used features of the site. Improve the search function. Research accessibility standards and apply them to the site. Add a glossary and make language clearer. Consolidate information so that users don’t have to make distinctions until after

they find what they are looking for. Present a main page with less information that leads users to primary tasks.

3

Introduction Bentley Historical Library Established in 1935, the Bentley Historical Library is the campus archive of the University of Michigan and is located on its North Campus. It serves as a key archival repository for the state of Michigan, and its user base ranges from those associated with the University to anybody seeking information on Michigan and wider topics. The website is the main access point for both those unable to physically visit the archive and those on-site conducting research. The website has seen little change since its creation in the mid-1990s. It is used primarily to access and learn about the Bentley’s collections and to gain information on donating materials. It provides logistical information related to the physical site, policies and procedures, finding aids and search tools, and links to exhibits and digital collections. There are three main types of users of the Bentley’s website:

Advanced researchers, including professionals (researchers-for-hire, research assistants), students, reference desk workers, etc.

Amateur researchers, including genealogists and other lay people conducting research for their own needs.

Donors A major challenge in the design and function of the Bentley’s website is that it must accommodate a very diverse user base while managing a massive amount of information and resources that the users almost universally find appealing. The content of the site is not the focus of the study, but rather the ability for users to access the wide range of materials at their disposal. Key Questions The key questions driving our survey research were essentially the same as those driving our user interviews:

Who are the users and what tasks do they set out to accomplish? What are the needs of the users? Is the website meeting those needs? What features do users rely upon the most?

In general, our tests aimed to move beyond the interview and survey data to further analyze users’ needs, the ways users interact with the Bentley website, and the way users feel about these interactions. The testing also set out to discover if there were certain aspects of the website that users had considerable difficulty with, what aspects of their

4

interaction with the site was positive or negative, and if these feelings and experiences were shared by many different users. Specifically, we were interested in gathering practical evidence on what we found during user interviews and surveys to see in action their feelings about elements such as the site content, navigation, homepage, site architecture, and site appearance. Our overall goal was to confirm or correct previous findings, gather further evidence to support our assessment of the site, and to discover additional findings. This report examines the tests we conducted and presents our findings and recommendations supported by the evidence gathered through observation.

5

Methodology Overview We conducted five user tests over the weekend of April 13-14, 2013. Each participant was shown five tasks to be conducted on the Bentley’s website. They were instructed to narrate their actions as if they were the commentator of a sporting event, and to feel free to be critical of the site and share their feelings without restraint. Informed consent was obtained. The moderator and two observers sat alongside the participant and silently watched and logged notes. Our team did not record the test with audio or video, as we had two sets of complete notes and the moderator’s partial notes to document the proceedings. Task Generation In the weeks prior to the tests we analyzed a set of tasks prepared by a member of our team. We considered the level of difficulty of the tasks, the path for successful completion, and if the task reflected our goals for this study. Additional tasks were added and created by other team members to better represent the various potential users we have identified. Tasks

Task 1: Using the Bentley Image Bank, find a picture of the Detroit opera house. Task 2: In the Toy Papers, what were the years of the materials from the

Spectrum Center that he donated? Task 3: Find the "A Queer Timeline" Exhibit and the picture of Einstein in the

1890s-1950s subsection. Task 4: Find Jane Cochrane's death notice (alumni). Task 5: Find the full text of Lyndon Johnson’s Great Society speech.

See full task script in Appendix B. Participant Selection and Recruitment We attempted to find people who had not used the Bentley before. We used our individual social networks to solicit volunteers for the usability test. Our recruiting plan was to find people who fit the user profile of the Bentley:

Advanced researchers, including, students, reference desk workers, etc. Amateur researchers, including genealogists and other lay people conducting

research for their own needs. Donors

6

Following each participant’s submission of available times on scheduling website whenisgood.com, two sessions were blocked off with three tests in each session. Different team members were present for each day of tests. The participants were:

Test 1: Male, 29, graduate student in archives, experience: advanced Test 2: Female, Early 20s, graduate student in health management, novice Test 3: Female, 26, library instructional technologist, advanced Test 4: Female, 27, graduate student in archives, experience: intermediate Test 5: Female, 21, undergraduate student (junior in political science), novice

Physical Setup Participants met members of our team at the North Quad academic elevators and were taken to an unoccupied floor where we had access to a meeting room. The environment prevented the risk of disruption and was conducive to concentration. Team members flanked the participants and silently watched the proceedings. Tests were conducted on a team member's Mac laptop. Form fields and caches were cleared between each test to provide a neutral platform for their use of the website. Questionnaire Our team gave participants a post-test questionnaire that they filled out online in our presence. We considered a pre-test questionnaire, but during the piloting phase of our test design and preparation, we did not find it was a useful tool to provide information. There were no questions worth asking prior to testing, and we found the post-test questionnaire more than adequate. Participants were able to reflect upon their experience using the site in extensive detail, and provided information that might have gone unobserved by our team note-takers. See full text of questionnaires in Appendix D. Analysis Session Following the test sessions, our team met to review our notes and observations from the previous weekend. Each testing unit summarized and explained the events of their test session to the members who were not present. We collectively reviewed our notes and made a list of significant items contained in each set of notes. Next we discussed each of these items and combined overlapping observations to narrow down definite issues or topics that would transform into findings. Our findings emerged from an analysis of these topic sets, and then we extended our recommendations from the list of findings.

7

Findings and Recommendations Summary Results The Bentley website has an impressive amount of information and resources, but users had significant problems searching and navigating the site and were over-reliant on search functions that were often incapable of providing the necessary assistance to conduct their research. During the testing, we found that users were presented with organization, language, and categorical distinctions that did not make sense to users, particularly novice ones; additionally, the site does not accommodate those with any accessibility issues and expects more proficiency from users than most possess. Our findings summarized:

The website does not comply with web standards and causes complications as users attempt to navigate the site.

No attempt has been made for the website to accommodate diverse users or to educate novice users.

The search feature is limited and does not conform to user expectations. The website does not take into account any issues of accessibility or language

barriers. The website is not organized for user needs and presents unclear language and

categorical distinctions that do not makes sense to users. Findings & Recommendations Finding 1: The website does not comply with web standards and causes complications as users attempt to navigate the site. As we found in our other studies, particularly in our heuristic evaluation, the website fails in its compliance with basic web standards. The mechanical elements of the site are not designed according to any established standards, and this haphazard functioning confuses users as they attempt to navigate the site. All users had difficulty returning to the main page, and almost every user used the browser’s back button exclusively to return. Users had difficulty determining what text was a link and whether that link led to an internal or external site; most notably, users often did not understand that Mirlyn and its search function were an external site and not a part of the Bentley. There is no standardized visual element to indicate any of the paths the links take users, or their type and function. Many users only discovered links by hovering over the block of text on the main site. When they were unable to find material, they often returned to the same page without knowing whether it had been visited before. Additionally, types of files are not properly indicated: In task 5 users attempted to access the full text of Johnson’s Great

8

Society speech, but there was nothing incorporated into the link to indicate it was a downloadable PDF. Recommendation 1: Comply with web standards and modify links accordingly. A review of web standards is greatly needed. Considerable work should be done to make the links more functional and understandable. All links should be a single color that is different from the regular text. Links should change color upon hover and having been clicked. There needs to be an indication whether the links lead to internal or external sites. Finally, on every page it should be obvious how to return to the main page. Finding 2: The website does not accommodate diverse users or how to educate novice users. The Bentley misses an opportunity to educate their broad range of users by focusing on internal priorities and perhaps assuming that the average user is more familiar with archival research than they really are. The serious consequence of these assumptions and oversight is that the Bentley may be pushing away potential users because of its complicated language and lack of clarity in language and organization. In their reflection of the test, one user observed, “I did not see any links or buttons or anything that notified me where I could get help with the website or talk to a librarian.” Another user similarly noted that what they found missing in the site was “someone more experienced in its use to guide me through would be helpful, Maybe some sort of online tutorial?” While taking the test, a novice user typed a phrase into the Mirlyn search on the main page and upon seeing the results asked, “What does ‘Mirlyn’ mean?” before returning to the search. This question indicated a lack of familiarity with the Bentley and affiliate university research destinations, which the website makes no attempt to define and explain for novice users. Recommendation 2A: Incorporate elements of information literacy, especially those unique to the Bentley, to educate and guide novice users through the site.

There needs to be a clear explanation of what the Bentley Historical Library is directly on the main page. Users are unlikely to seek out and read an “about” page buried within the site. A guide on how to do research, and a guide specific to the Bentley, should be accessible easily through the main page. Additionally, a glossary of common terms would help to clarify common sources of confusion and misunderstanding. One user said during testing that they did not know what each of the search options were, or the collections and organizations they searched. Upon seeing a finding aid, a technically advanced user asked: “Am I supposed to find this stuff in the Bentley?” and following another browsing through the aid, added, “I have no idea what this does.” It is assumed that users know what a find aid is, but in reality they do not and instead require assistance and education that should be provided as a basic service.

9

Recommendation 2B: Change the Quick Links box to present frequently used features of the site. As it stands, the Quick Links box refers to pages that are rarely needed or visited by users, and it should instead provide links to the most frequently visited pages on the site. Users generally overlooked the box as many thought the Facebook link (which was referred to as “too large” by several users) indicated it was a social media box. Quick links would be an ideal location for links to a help page, and one user even noticed the absence of such a link and thought it would be desirable to have a quick link to a help page. Finding 3: The search feature is limited and does not conform to user expectations. As noted in previous findings, users find it overwhelming to read the block of texts and links on the main page and therefore rely heavily on the search features of the site. As one user abandoned a path they had taken through the site and returned to the search page, they explained, “I don’t really know where else to do.” To return to the search, they had to make their way back to the home page, as the search bar does not appear through the site and its pages. Upon seeing their search results, or immediately opting for an “Advanced Search”, users were disappointed to find that rather than a place to narrow down and manipulate results, they only received an expanded view of what appeared in the box on the main page. Users expressed their disappointment by saying, “I wish the advanced search actually allowed me to enter additional search fields” and “I thought advanced search was going to show more criteria for searching.” Also, the appearance of a Google Custom Search icon often led users to believe they were searching Google externally; they were unclear of the relationship between the search options and their respective hosts. Recommendation 3: Improve the search function. We have identified several methods to improve the search function of the site.

Make the search bar more prominent and display it on every page.

Make the Bentley search the default search option.

Add an ability to manipulate search results.

Either eliminate or change Advanced Search.

Clarify that users are on the Bentley website and not an external site.

10

As described in our finding, each of these recommendations offers a solution to common complaints and challenges that faced the users. With so much dependency on the search capabilities of the site, users require greater control, flexibility, and visibility in their interactions with the search bar. Finding 4: The website does not take into account any issues of accessibility or language barriers. Beyond assumptions made about the experience level of users, the site also assumes that users are fully capable, free of disability, and native English speakers as evident in its design. There are no accommodations made for those with any visual impairment, and the site does not meet relevant standards. For example, the amount of text on the main page would be unwieldy in the face of a screen reader and renders the site exclusive to disabled users. Similarly, the site does not consider the language wall we discovered when observing our two non-native English-speaking participants. They relied heavily on keywords and often sought definitions to frequent terms such as “genealogy” that English speakers would take for granted. Recommendation 4A: Research accessibility standards and apply them to the site. To make adjustments with disability in mind, research will need to be conducted into standards. We recommend consulting the university’s web access team at http://www.umich.edu/webaccess. Recommendation 4B: Add a glossary and make the language clearer. The simple addition of a glossary of terms, perhaps included under Quick Links, would assist those less familiar with English and by extension the cultural context of concepts such as genealogical research. Finding 5: The website is not organized for user needs and presents unclear language and categorical distinctions that do not makes sense to users. Users of the Bentley’s website need to be able to better understand the categories and distinctions between research avenues on the site from the main page. We found during testing that users did not understand what they were searching for until they finally found it after exhaustive efforts. Task 4 did the most to reveal this issue, as the location of necrology files of alumni makes sense to staff at the Bentley, but it is not logical to users of the site. Those conducting genealogical research will find death records spread across the site in multiple places and there is no way to know which path to take until it is taken.

11

Two users pointed out that they assumed a link to the University of Michigan history would refer to “buildings” or “architecture.” Genealogists and novice users are often unable to specify what they are looking for, so clarification needs to occur upfront and through the search interface as it filters results. As one user noted, “While it is convenient to have links to so many resources and collections on the main page, it can feel a bit cluttered. It can also seem confusing when you're not sure what the next step should be.” Organization of the site needs to reflect user needs and not those of the organization, as we have pointed out in previous reports. Recommendation 5A: Consolidate information so that users don’t have to make distinctions until after they find what they are looking for. The categorical divisions made on the main page do little to guide users in their search, with one user calling the links “not that obvious” and another exhibited during testing that the “information categories are all so general” and that, notably, there were then too many links within the genealogy page and he had no ability to differentiate between them and know where to go. The categories on the main page and the search should consolidate information in a way that is clear to users from the first step, as this one is the most important and challenging. Recommendation 5B: Present a main page with less information that leads users to primary tasks. This recommendation has been made in prior reports, and remains one of the most significant changes necessary for the site. The volume of evidence gathered from previous reports and the usability testing, support the high level of its importance. The number of links needs to be reduced drastically, as most users ignored them entirely during their tasks. One user explained, “The overall design is really poor with very little hierarchy. I didn't know where to go first and the browsing categories looked like a wall of text and I didn't even want to browse them.” During testing this user made a deliberate attempt to browse the links upon realizing how dependent she was on the search bar. She ultimately returned to searching via the site engine. Categories and links should be made more effective through selectivity and varied emphasis.

12

Discussion There were some flaws in our test design and problems that presented themselves not in the piloting and preparation, but as the participants took the test. Some of the tasks were not completely clear to participants in their objective, for example they did not know which opera house photo fulfilled the first task; however, some tasks were intentionally unclear. We did not call task 4’s file target a “necrology file” as the website does, but used the term “death record” to illuminate the difficulty participants have in deciphering the language used by the Bentley. Our participant poll was limited, but in some ways this issue could not be avoided. We wanted people who have not used the site and had to choose those who were not the primary target audience of the website. We could not solicit through the Bentley as those found would most likely have associations with, and prior usage of, the site; additionally, this recruitment challenge ultimately eliminated donors, amateurs such as genealogists, and professional genealogists. Some of the participants were not native English speakers and it was often difficult to tell if they were challenged by or could not complete the task because of the website, the design of the task, or misunderstanding of the language used in the task script. We wrote out a definition of genealogy as we knew this word, and the practice of family history research by Americans, would not be familiar. Other than this description, we were not sure which words the two participants would not understand.

Conclusion The results of these tests primarily confirm our findings and recommendations from previous reports, but supply our team with data to provide a more compelling and nuanced case for changes needed for the website to perform better for users. We had taken note of flaws in the links, the organization, language used, and search function and learned much from seeing users face-to-face with these issues and problematic elements of the website. Hearing their commentary of the interaction process, as well as recording their reflections through a post-test questionnaire, enabled a better understanding of the website and its users. There are aspects of the site that participants found appealing, such as the search engine on the home page, but positivity is inevitably outweighed by complaints, such as the disappointment in the “advanced search” and the lack of the search bar’s appearance elsewhere in the site. As one user noted during their test: “The collection is good, but the interface is not.” The Bentley’s site ultimately allows users to find most of what they seek, but these tests reveal that the process and paths to this research material could benefit from significant changes.

13

Appendix A

Session Script My name is ____________ and I will be the moderator for today. This is _________ and ___________. They will be observing and taking notes. Pay no attention to them whatsoever. Today, I’ll be working from a script so my instructions to all of our participants are the same. We are studying how people use the Bentley web site. Today I will ask you to use the site to do a variety of “tasks” and will observe you while you do them. Don’t worry about how fast you are going; we don’t have to get through any particular number of them. Please try to think out loud as you work. Please know we are testing the web site, not you. There is no such thing as a wrong answer or action. Our team had nothing to do with the site’s design. You won’t hurt our feelings if you like or dislike something. We need to know what you really think. I will hand you written tasks and observe your progress. Please read the task out loud and then start working when you’re ready. At the point when you think you have completed a task, please say you are done. It is OK to ask me questions. However, I might not answer them right away because we want to simulate the conditions of you using with the site without assistance. If you get completely stumped, say so, and I may be able to give hints at that time. Go ahead and read the first task aloud.

14

Appendix B

Task Scripts Task 1: Your English literature class has been talking about Shakespeare's plays, including their production. Discussion turns to the old custom of having men play women's parts. The professor tells a story about how UM used to have an opera troupe where the men dressed as women and would do chorus line kicks. Using the Bentley Image Bank, please find a picture of the Detroit opera house. Task 2: You are helping the Spectrum Center at UM document its history. You know that James Toy was a key figure in the early years of queer history at UM. James Toy has given a substantial collection to the Bentley. Part of his papers includes Spectrum Center materials. Using the Bentley Website, what are the years of the papers that are from the Spectrum Center that he donated? Task 3: You’ve been reading up on Einstein and have discovered that he had quite a bit of whimsy. A friend has told you that there is a picture of him holding a puppet of himself. Find the picture of Einstein located in the “A Queer Timeline” exhibit. Task 4: Your Great Aunt Jane Cochrane was one of the first women to attend the University of Michigan. You want to know more about her and her life at UM. Please find her death notification. Task 5: Your political philosophy class has been studying the great speeches by Presidents past. You've been assigned Lyndon Johnson's "The Great Society" speech. The books that contain the speech in Shapiro and Hatcher are checked out. You know that the Bentley has many publications. Please find "The Anatomy of a Speech: Lyndon Johnson's 'Great Society' address".

15

Appendix C

Consent Form

UNIVERSITY OF MICHIGAN

CONSENT TO BE PART OF A RESEARCH STUDY

1. GENERAL INFORMATION ABOUT THIS STUDY AND THE RESEARCHERS

1.1 Study title:

Usability Study for the Bentley Historical Library website

1.2 Names, degrees, and affiliations of the researchers conducting the study: Jianqi Chen, Jessica Durham, Sharona Ginsberg, JJ Pionke, Ziwei Xie MSI Graduate Students, School of Information, University of Michigan

2. PURPOSE OF THIS STUDY

2.1 Study description: This study aims to evaluate the website of the Bentley Historical Library with regards to usability and attention to user needs. The data our group collects will be analyzed to understand what users expect from the website, what type of tasks they perform, and how users feel the Bentley website currently meets or does not meet their needs. We hope to determine how the website may be altered or improved in order to create a pleasant and efficient experience for users.

3. INFORMATION REGARDING STUDY PROCEDURES

16

3.1 Description of involvement If you agree to participate in this study, you will be asked to complete a number of tasks that make use of the website at various levels of difficulty. Members of our research team will observe your actions, make notes, and ask follow up questions in order to gather data about the thoughts and feelings you experience during the test. 3.2 Length of participation The length of the study is approximately 1 hour at maximum.

4. INFORMATION ABOUT RISKS AND BENEFITS

4.1 Risks & discomforts of participation This study poses no risk to your privacy and confidentiality. Further, the risk of physical harm is negligent and no different from any risk associated with ordinary use of a personal computer.

4.2 Measures to be taken to minimize risks and discomforts Data records will be maintained on researchers’ password protected computers, to which only the project investigators will have access. Data will only be presented anonymously and will never be reported along with your identifying information. Participants may choose to discontinue participation in the study for any reason and at any time.

4.3 Expected benefits to study participants or to others

Although you may not receive direct benefit from your participation, others may

ultimately benefit from the knowledge obtained in this study.

5. FINANCIAL INFORMATION

5.1 Costs to study participant resulting from participation

There are no financial costs associated with this study.

17

5.2 Payments to study participants

Participants will be given a $10 Starbucks gift card as compensation for their time and

involvement in the study.

6. CONFIDENTIALITY OF SUBJECT RECORDS

University of Michigan policies require that private information about you be protected. This is especially true for your personal information. On the other hand, sometimes the law allows or requires others to see your information. The information given below describes how your privacy and the confidentiality of your research records will be protected in this study.

6.1 Protection of privacy

We will not place your name on any of the information we collect from you. The only

information we will collect will be the notification ratings obtained during the study.

Notification ratings refer to the information provided by each participant regarding the

suitability of a notification to a given situation.

You will not be identified in any reports on this study. Records will be kept

confidential to the extent provided by federal, state, and local law. However, the

Institutional Review Board or university officials responsible for monitoring this study

may inspect these records.

The data collected during this study will be kept on password-protected computers in

the researchers’ locked offices and on devices securely stored in the researchers’ offices.

The data collected and all data forms used will not contain any information that could

be used to identify you. Instead, the forms and retained database will only contain a

code number, linked to the participant’s identity by a key. This key will be kept

separately from the data and will only be accessible by the research staff.

6.2 Sharing of information Signing this form does not give the researchers your permission to obtain, use, or share your personal information nor the personal information of anyone else. As noted just

18

above, the only information we will collect will be the preference data collected during your trials; we will not seek any additional personal information.

6.3 Information retention and disposition

As a rule, the researchers will not continue to use or disclose information about you, but will

keep it secure until it is destroyed. In certain instances, it may be necessary for information

about you to continue to be used or disclosed, even after you have canceled your permission or

the study is over. Examples of such situations include:

To avoid losing study results that have already included your information.

To provide limited information for research, education, or other activities. (This

information would not include your name or any other personal information that could

allow others to know who you are.)

To help University and government officials make sure that the study was conducted

properly.

7. CONTACT INFORMATION

Please contact the researchers listed below to: Obtain more information about the study Ask a question about the study procedures Leave the study before it is finished Express a concern about the study

Principal Investigator: Sharona Ginsberg Mailing Address: 1589 King George Blvd, Ann Arbor, MI 48104 E-mail sginsbe@umich.edu Telephone: 201-452-4654 Faculty Advisor: Mark Newman Mailing Address: Telephone:

You may also express a concern about a study by contacting the Institutional Review Board: University of Michigan Institutional Review Board Behavioral Sciences

540 East Liberty Street Suite 202

19

Ann Arbor, MI 48104-2210 Telephone: 734-936-0933 Fax: 734-998-9171 e-mail: irbhsbs@umich.edu

When you call or write about a concern, please provide as much information as possible,

including the name of the researcher, the IRB number (at the top of this form), and details

about the problem. This will help University officials to look into your concern. When

reporting a concern, you are not required to give your name.

8. VOLUNTARY NATURE OF PARTICIPATION

Your participation in this project is voluntary. Even after you sign the informed consent document, you may decide to leave the study at any time without penalty or loss of benefits to which you may otherwise be entitled. Furthermore, you may skip or refuse to answer any survey question without affecting your study compensation.

9. CONSENT

Your signature in the next section indicates that you have received copies of all of this "Consent to be Part of a Research Study" document. (Note: In addition to the copy you receive, copies of this document will be stored in a separate confidential research file.)

Research Subject:

I understand the information printed on this form. I have discussed this study, its risks and

potential benefits, and my other choices with Sharona Ginsberg. My questions so far have been

answered. I understand that if I have more questions or concerns about the study or my

participation as a research subject, I may contact one of the people listed in Section 9 (above). I

understand that I will receive a copy of this form at the time I sign it and later upon request.

Signature of Subject: Date:

Name (Print legal name): DOB:

20

Appendix D

Post-Test Questionnaire 622 Post Usability Test Questionnaire Thank you for taking the usability test with us. This is a post usability test questionnaire. Please take your time and be honest. Remember, we are not the design team and you won't hurt our feelings with your answers.

21

Q1 What is your career designation? Professional (eg Professor, Lawyer, Doctor) (1)

Trade (eg Plumber, Carpenter, Electrician) (2)

Student (eg High School, Undergraduate, Graduate) (3)

Retired (4)

Other (5) ____________________

Q2 What is your age? 18 - 25 (1)

26 - 30 (2)

31 - 35 (3)

36 - 40 (4)

41 - 45 (5)

46 - 50 (6)

51 - 55 (7)

56 + (8)

Q3 What is your gender? Male (1)

Female (2)

Transgender (3)

Other (4)

Q4 How do you define your computer skills? Basic (eg turn on the computer, email, Google) (1)

Intermediate (eg Social Media, RSS feeds, Blogs) (2)

Advanced (eg Own Website, Blogger, Some Coding Skills) (3)

Expert (eg Coder) (4)

Other (5) ____________________

Q5 How much time you usually spend on the internet in a given week for any reason from any kind of device? 0 - 5 hours (1)

6 10 hours (2)

11 - 15 hours (3)

16 - 20 hours (4)

21 - 25 hours (5)

26 - 30 hours (6)

31 - 35 hours (7)

40 + hours (8)

Q6 Have you used other historical library or archival websites?

22

Yes (1)

No (2)

Q7 Which ones have you used and what did you think of them? Q8 How would you describe the Bentley website to someone who has the same level of computer experience? Please use complete sentences. Q9 What were some of the aspects of the Bentley website that you found appealing or easy to use? Q10 What did you find difficult to use or unappealing about the Bentley website? Q11 Were you able to find support/help from the website when you felt confused? Yes (1)

Kind of (2)

No (3)

Other (4) ____________________

Q12 What kind of information do you wish had been present to help you move around the website or find what you were looking for? Q13 How easy was it to navigate the Bentley website? Very Difficult (1)

Difficult (2)

Somewhat Difficult (3)

Neutral (4)

Somewhat Easy (5)

Easy (6)

Very Easy (7)

Q14 What is your favorite feature of the Bentley website? Q15 Do you have any suggestions for improvement for the Bentley website?

23

Appendix E

Questionnaire Results

1. What is your career designation?

# Answer

Response %

1 Professional (eg Professor, Lawyer, Doctor)

1 20%

2

Trade (eg Plumber, Carpenter, Electrician)

0 0%

3

Student (eg High School, Undergraduate, Graduate)

4 80%

4 Retired

0 0%

5 Other

0 0%

Total 5 100%

Other

2. What is your age?

# Answer

Response %

1 18 - 25

2 40%

2 26 - 30

3 60%

3 31 - 35

0 0%

4 36 - 40

0 0%

5 41 - 45

0 0%

6 46 - 50

0 0%

7 51 - 55

0 0%

8 56 +

0 0%

Total 5 100%

24

3. What is your gender?

# Answer

Response %

1 Male

1 20%

2 Female

4 80%

3 Transgender

0 0%

4 Other

0 0%

Total 5 100%

4. How do you define your computer skills?

# Answer

Response %

1

Basic (eg turn on the computer, email, Google)

0 0%

2

Intermediate (eg Social Media, RSS feeds, Blogs)

3 60%

3

Advanced (eg Own Website, Blogger, Some Coding Skills)

2 40%

4 Expert (eg Coder)

0 0%

5 Other

0 0%

Total 5 100%

25

5. How much time you usually spend on the internet in a given week

for any reason from any kind of device?

# Answer

Response %

1 0 - 5 hours

0 0%

2 6 10 hours

0 0%

3 11 - 15 hours

0 0%

4 16 - 20 hours

1 20%

5 21 - 25 hours

0 0%

6 26 - 30 hours

2 40%

7 31 - 35 hours

0 0%

8 40 + hours

2 40%

Total 5 100%

6. Have you used other historical library or archival websites?

# Answer

Response %

1 Yes

5 100%

2 No

0 0%

Total 5 100%

7. Which ones have you used and what did you think of them?

Text Response

Library of Congress: It was such a vast collection that it was sometimes difficult to find narrow, specific items. I used the 'Ask a Librarian' service to help find what I needed. Naval History and Heritage Command Website: Some parts of the site are incomplete and do not work correctly.

The library link through Ctool. It's convenient and it can lead me to quite a lot recourses.

I've used the lib.umich.edu website quite frequently and I enjoy it a lot.

I've used other site in the University of Michigan Library system like the Clements, and other University Archives sites. I consider them to be very usable, informative and well designed for the most part.

Usually the homepage is not attractive enough. There are too many pictures or words.

Statistic Value

Total Responses 5

26

8. How would you describe the Bentley website to someone who

has the same level of computer experience? Please use complete

sentences.

Text Response

The site is fairly intuitive and I had a moderate amount of difficulty in using it at the beginning. After a time, it became easier to use and adapt to it. Every library/archal website has certain quirks that others do not, so it is merely a matter of getting used to the differences between them.

Bentley also has quite a lot information you may need. However, you have to find it by spending more time.

It's pretty disappointing.

The Bentley website is usable and gets the job done, although I think some redesign is necessary, especially since the image banks and census data is hard to peruse through. The classification and cataloguing system needs a little bit of work. Overall though, someone with the same level of computer experience would be able to use the website efficiently enough to complete given tasks.

This website looks very academic and boring. But for people unfamiliar with the website, it would be hard for them to find the information.

Statistic Value

Total Responses 5

9. What were some of the aspects of the Bentley website that you

found appealing or easy to use?

Text Response

Being able to engage in a general catalog search of the Bentley's collections was extremely helpful in finding what I needed. If this was not present, trying to find specific items with very little detail on hand can be difficult. The site also makes clear that there are always profesionals on hand to help you understand the site and make your way through it.

The quick search link on the up right corner.

The search box once I figured it out.

I found the search engine in the top right corner to be highly useful for the tasks I was given to complete. The usability of being able to go from searching just through Mirlyn, through the image bank, through the entire Bentley website, etc was a feature that I found most appealing. To be able to refine a search based on the medium or outcome that is desired was incredibly useful.

There is a search bar on the top of the homepage. So I can put in what I need to find.

27

Statistic Value

Total Responses 5

10. What did you find difficult to use or unappealing about the

Bentley website?

Text Response

While it is convenient to have links to so many resources and collections on the main page, and can feel a bit cluttered. It can also seem confusing when you're not sure what the next step should be.

The home page, especially the lower part, has so many words. I feel difficult to find the information I need. Actually, I rarely use the links when I do the usability test.

The overall design is really poor with very little hierarchy. I didn't know where to go first and the browsing categories looked like a wall of text and I didn't even want to browse them. Nothing on the page stood out and the overall design could use a facelift.

The census data and image bank seemed to have the most problems, especially with being able to find records. Searching for Jane Cochrane's death notification was difficult, and the record that did exist of her had little to no useful information. A more refined search for her death lead to a list of names that weren't in alphabetical order and for those who didn't know the exact year of her death, scrolling through a large list of names was inconvenient. Perhaps some redesign is necessary in this regard.

Yes. The divisions of the catalogue are not clear enough. Sometimes, I do not know the task belonging to which catalogue.

Statistic Value

Total Responses 5

11. Were you able to find support/help from the website when you

felt confused?

# Answer

Response %

1 Yes

0 0%

2 Kind of

4 80%

3 No

0 0%

4 Other

1 20%

Total 5 100%

Other

I never saw a link or spot saying I could get additional support

28

12. What kind of information do you wish had been present to help

you move around the website or find what you were looking for?

Text Response

Having someone more experienced in its use to guide me through would be helpful. Maybe some sort of online tutorial?

clear guiding information...

I wish the advanced search actually allowed me to enter additional search fields. I also wish the categories on the homepage were better organized and more appealing looking so that I would actually want to use them.

I would have liked to know the exact name of the opera house, or perhaps some more descriptive data about a specific image. Even though the search result gave only 7 records, it was hard to discern which was correct given the information given both in person and located on the website.

Some obvious instructions teaching me how to use the website.

Statistic Value

Total Responses 5

13. How easy was it to navigate the Bentley website?

# Answer

Response %

1 Very Difficult

0 0%

2 Difficult

0 0%

3 Somewhat Difficult

4 80%

4 Neutral

0 0%

5 Somewhat Easy

1 20%

6 Easy

0 0%

7 Very Easy

0 0%

Total 5 100%

29

14. What is your favorite feature of the Bentley website?

Text Response

Having the general catalog search function on the home page is extremely helpful.

The color is warm...

The banner image was okay?

The search engine was highly useful for all the tasks that were given, and easily on the main page.

There are lots of resources on this website.

Statistic Value

Total Responses 5

15. Do you have any suggestions for improvement for the Bentley

website?

Text Response

Streamline the front page and increase the size of the MIRLYN catalog search box/function. There is also no link or button to labeled "Help" or "Need help?"

Make the home page more user-friendly. More simple will be better.

Yes. The website currently has very poor UX. As a user, I had no idea where to go first and this would be helped if the website had some design elements that created a hierarchy of content. The browse categories and links were in very boring fonts and did not stand out to me at all. Actually, they turned me off from using them. I would first off recommend using something more visually appealing for the categories, whether it be images, different headers or what. I also feel like the wall of links is so uninteresting that I look right over it. Maybe add some more interactive navigation to help users browse these categories much more easily. Finally, I did not see any links or buttons or anything that notified me where I could get help with the website or talk to a librarian.

Some more alphabetization and descriptive metadata would be useful for the image bank, so users don't have to click through several images to find the one they are looking for. Some census data cleanup would also be useful.

They can make it more user-friendly. Like simplified the homepage to a simply search box with fewer headlines because the main function for this website is to search information.

Statistic Value

Total Responses 5

30

Appendix F

Blank Log

CODES:

USER TIME CODE COMMENTS

C-UserCommentE-Error!-CriticalIncidentP-PromptedbyModeratorF-UserFrustrationCO-UserConfusionQ-UserQuestionS-StarttimeoftaskE-Endtimeoftask

31

Appendix G Individual Notes Jianqi Chen

CODES:

C - User Comment E - Error ! - Critical Incident P - Prompted by Moderator F - User Frustration CO - User Confusion Q - User Question S - Start time of task E - End time of task

USER Task TIME CODE COMMENTS

1 1 13:12 The user is very clear of where to go, he clicks Bentley image bank link on the front page, and go to search for Detroit Opera House immediately

13:14 Finish immediately, 1. clear know where to go, 2. without any extra efforts

2 13:14 CO He tries to find something in the great number of links, he uses the Home > Research Tools > Subject Guides And Indexes to find out the links and UM archive, but he is not sure where to go.

13:16 He finally finds it.

32

Though the beginning of this task is not as clear as what it begins, but he finished it without any efforts.

3 13:18 He initially tries to use Research Tools > Subject Guides to search，and then he give up an choose the exhibit

13:20 He found Queer, things goes smoothly after that

A smooth task without any efforts

4 13:20 He found this task is really intesting. He go to univesity of Archive and try to find something in search tool in order to find something related with topic

Then he finally gave it up and go to the Genealogy

CO There are too many links on the Genealogy and he does not know where to go , he just stay and click the different links

CO The informaiton categories are all so general, he become more and more confused after trying to click diversified buttons

33

He complain that there are no place to make a general search, and searching them one by one is so annoyed.

He is trying to find out the important important date and death, and then he find a click called newspaper, and then he clicks in

He finally try to find out the results by search bar on front page.Then he failed

Then he finds univerityhistory, and then vioiec women's voices,he finally find that person, but he only finds it attend year.

Then he tries to use Mirlin, but still does not work.

P He goes to Genealogy file to fnd aunt'sname,and finally find it.

He comments that after receivinghelp，things makesense， but beginning it is so confused for so many categories and entrance of information

5 13:34 He use the search guide， and there is nothing in the index

34

He find it a little bit confused because it is definitely not the question of

13:38 He tries to use MIRLYN catalog to search,if there are no answers then he just give it up

Overall Experience: 1. can be simpler, but for someone having the links on the front page can be clicked on directly The overall page is a littl bit confusing.

The history of um and michigan, if I can find it in general library, I can find it directly.

Like to find the informaton with narrow scale, he seems to be unlikely to find out theserh results with 1000 results, which is so large

U2 1 15:04 clear know that she is going to find an image, banck, but the lins in the front page makes her frustated, and he sudentl find a one on the left quick guide and type in the name

35

2 15:06 Looked at the task for ten of seconds, and not feel that what to look up in the website,I think she is trying to find out the key words

She then put key words directly in MIRLYN catalog, then so many answers comes out. confused then she is trying to find out an filter.

The result of her key words is so many, she tries to find something filter, but the results are so confused, it Is not like google, which she is familiar with.

She finds out the record of the collection, but she is very confused, she is not sure that she has sucessfully find out the collection.

CO She hovers the electronic collection for many times ( which is correct answer)but she did not chosoe that one, because the address is too long.

CO She does not sure about whether she sucessfully understand the meaning of tasks, and also she is not sure about the different years,

3 15:19

After many hints from moderator, she finds it sucessfully. But she complains that there are a lot of informaiton to be found.

36

U3

Choose exhibition directly on the front page, and sucessfully find a Queer Timeline, and then seens have no idea of what links to click on later,

She clicks different links on the page try to find something

CO

She initially think that after she clicked on the Queer Timeline, she feel all the things should be there, but now she feels a lot of informaiton is hidden, thus she should try each link one by one, in order to find out the answer

4 15:23 P She did not click on the year because she think it is about the year

P does not sure about theShe did not understand the meaning of tasks, and also she is not sure about the different years,

After she gets the tip, she tires to use Genelotgy to find out the specific link, and she found it.

She then click on Names of Family Members. And try to scroll up and down find the answers.

She though she can click in the name of answer after she chosen the name of family mambers category. But then she cannot, so, she just find out some links to be clicked on one by one, to try a luck.

37

P She clicks the University of Michigan Information ,and then she gives it up, she think none of the children links can hel her to find the answer, those seems to be the informaiton of publication.

15:30 P She is tring to find out the search bar ,and then she find out the Necrology, but she did not know the meaning, after she know the mearning of Necrology, she is quite sure of the answer.

5 15:31

She uses Mirlin Clasics, to find informaiton of the whole library. She type in the key words, but she is not sure where to download the pdf version.

p She clicks the expand, and she think she is done

She complains that there are so many things to be cliked on, she think the whole library is filled with a lot of useful resources, but she still think that it is OK for her to be confirmed that she can finished a ta

38

U3 1 12:12 She complains about the whole website is filled with the links and category, she wants pictures

She think it is not good but not bad. She find that Bentley does not provide her with a comprehensive inforation to be pumped out

The design is not good for her, on the home page there are so many links

Search is most convenient for her, but in Bentley website she cannot find the correct answer

not sure how to go back to the home page

2 12:15 GO to search directly, click bentley websute, the google results makes her confused, not sure whethert she is in bentley,

12:28 search again add the name

39

3 12:20

Use the link to search keyword and then find it is so hard, and then click the search aid,

And then based on her own kwowledge she finds the right year to be clicked on

4 12:30 Go to basic search use mriln, and then fin dit is wrong, and then soon return use the bentley, and find there are so many results

Try t look fr some filter, but then fail, and then, try to add more words in key words search to narrow down the choice

Abd then find only one asnwer, the links are too many, and use window searchl

And then back, and try to find he aunt name, and the results are to many then give it up.

Think it is the ann arbor death records, and then find it is no answer

Click the women's voice which is the right answer but the big bunch of links, confused

40

And then find the name but cannot tell the death year, only the attend the year

CO And then go back to search bar again,really have to idea of where to go.

CO quite sure it should be in the voice of women, but cannot find

Start gain in the home page, and use searh bar again, of mirlin seems to have nothing inside

A loss use the genelogy again, and not sure which link should be clikec on the left and then click the important death, birth link on the right.

P NOT sure which link should be clicked on. And

P CLICK THE RECORDS OF GROUP and then find ther is the necrology file index just hide in th contents

12:45 F Find the right answer

41

5 12:45 There are too any links, and need to be brows

use the serch bar, bentley to search the name directly

And get the results are so many, and then try to add the word, add th lecture name,

and go to the right page.

The links are not that obvious, finally find it, feel it a lot easier

Comments:She is the user who likes to use the links so much

The link of university OF MiCHIGAN HISTORY, she is not sure that what it is inside, and it can be the architecture, but also it cannot the people, she is not sure whether the aunt is relavant

she is not clear of what kind of results she will get.

42

She used a lot of search feature, the bentley website should be in the first one, and should be the default but each time she have to click it and narrow down the results.

Looking at this website is challnge, the links are heavy

The facebook logo is so many, and also the quick link is so large.

The image bank which is in th search bar did not catch up her attention

And also the links are so many she cannot remember the name once more

The collection is good, but just does not like the interface.

Jess Durham

CODES: C - User Comment E - Error ! - Critical Incident P - Prompted by Moderator F - User Frustration CO - User Confusion Q - User Question S - Start time of task E - End time of task

43

USER TIME CODE COMMENTS

User 1 12:18 S Task 1 / Looks for keyword "images" - looks through each section heading. Scrolls through each one to find "Access to Collections"

12:19 Quick search to find exactly what looking for. Search: "opera troupe university of michigan". Too many words - no results explanation. Goes back and tries "opera house". Thinks about refining.

12:20 Results either don't show opera house, doesn't know which one she is looking for.

12:21 Not sure what opera house you’re wanting to be found.

12:22 Going to assume its Detroit Opera House. Not sure but assumes if they had an opera troupe they would find it there.

12:23 Good enough. Moves on.

12:23 S Task 2

44

CO User accidentally clicks wrong thing but couldn't figure out what to look for.

12:24 Notices that the image bank is in the search engine at the top.

Goes to main search: Searches queer. Not sure how else to refine it. Goes make to main page to try again, but can't find how to go back.

12:26 Google custom search: finds Jim Toy. Searches through document result to find Spectrum Center.

Re-reads questions. Goes back to pdf result and wonders if words in bold are connected to the collection.

12:27 Checks out other result. Goes back to pdf and assumes the last assumption was correct. Says they are done. Closes tabs.

12:28 Task 3

Goes immediately to exhibits. On exhibit page uses browser search to find the word "queer" - leads to queer timeline.

45

Goes to sources and finding aids. Clicks on Collections by topic and goes to 1890s - 1950s. Assumed time of Einstein. If wasn't familiar, wouldn't have known where to click.

12:30 Task 4

Quick search in Mirlyn from home page. Doesn't realize in Mirlyn until results come up and surprise.

General search results - too many (14). Tries to refine. Jane Cochrane. One result for funeral home record.

Does browser search through Dolph Funeral Home Records. Browser name search. Finds nothing.

Goes back. Returns to results.

Back to Benley genealogy page. "I thought there would be a search."

Names of family members. Ann Arbor Township. "How do I actually search these.?" Tries first few hits at search results page was at earlier.Assumes first few would be most likely. Not what she wants.

46

Hits back button to go back. Gets a result under Women's Voices, and gets information but frustrated there is no link to this record task asks for.

Goes back to search page. "I don't really know where else to go." Jane cochrane "death" notification. Thinks that naming the record will help. Yields same results as simple name search.

"Why am I just going in a circle. I must not be finding the right page. Maybe what I'm searching for is not something that is searchable."

Goes back to home page.Browses through available links. Clicks on genealogy link. Goes back to page that came across before. Clicks on important dates. Reads through description of funeral records. Clicks on links embedded in the text. Opens finding aid. Asks "Am I supposed to find this stuff in the Bentley?" Clicks browse here. "I have no idea what this does." "This looks like a dead end." Goes back to Dolph Funeral Home and clicks link to finding aid. "Oh, not an actual online thing. I don't know. I'm feeling very dumb right now. I'm just in a big circle here."

12:40 Goes back to important dates after she clicks on University of Michigan link and immediately thinks it has nothing she is looking for. Browser search for "death" at important dates page.

Reads through descriptions of collections listed on important dates page. Clicks on important dates again. Takes her back to Ann Arbor Township Records. "This takes me back to where I was before. This is so frustrating."

Reads through descriptions again. Looks through other township records. Searches Lima Township for Jane Cochrane - there is a table.

12:43 "How are you feeling right now?" - "I feel like I've walked over it 4 times and 'Im just not getting there."

47

Back to University of Michigan link. Clicks on records and groups. Here are death indexes. Search engine: enters name and finds result.

12:45 Task 5

Doesn't want to even look through the links." I just want to search, but let me try one of these." Tries to read through links and says moments later "I'm just going to search."

Searches for Lyndon Johnson. "Cool" - gets a lot of results. Refines and searches "The Great Society". Clicks on first link. Reads through description. Sees link and clicks on it "I think I found it."

12:47 Follow-up questions.

Task 4: University of Michigan link doesn't seem like it would have anything to do with genealogy and death records - about "buildings" etc.

Task 2: I found things about Spectrum Center and timeline - wasn't sure it was the correct timeline. Maybe I should have searched for Jim Toy more. Results aren't what I was expecting.

Search feature: I feel like if I was searching for library stuff, I would go to that website, not the Bentley. Thought advanced search was going to show more criteria for searching. Disappointing on several accounts.

48

There is no hierarchy. Confused by Facebook link - why just as big and on top as search engine. Thought icon too big. Didn't even look at quick links - thought it was a social media box. There are a million things listed under each section. Doesn't want to read through them. For them to be "quick browsing" - it wasn't as all.

General feelings: If I were a student, I'm be frustrated. Navigation was frustrated, but it was the first time I'd used it. Compared to main UM and search box, how intuitive. Step down. That's what is missing. Using lesser than search engine.

User 2 1:37 Task 1

Quick search for "shakespeare opera house". No results - brings up search fields. Limits search to Shakespeare. No results. Tries opera house.

Opera house yields 7 results. Clicks on Hill's opera house because the key words indicated it could be the correct result. Clicks on Littlefield opera house. "Is there a name for the opera house?" Question confuses her. I think I'm done.

1:40 Task 2

Goes to quick search - Mirlyn catalog. Searches for "spectrum center" - One full record. Browses. Not what looking for. Goes back and searches for "James Toy" and gets several results. Clicks on James Toy papers link. I think I'm done.

1:42 Task 3

49

Goes back to main page. Searches from quick search in Bentley Image Bank - "queer timeline". No results. Changing search to entire website. Clicks on link to A Queer Timeline. Opens up PDF but immediately assumes not what looking for. Looking for a link that will take to actual pictures of the exhibit.

Returns to search results and reads through results. Goes back to search and enters Einstein. Immediately finds.

1:45 Task 4

1:47 Searches Bentley website for "Jane Cochrane death" from quick result. Goes to result with Dolph funeral table and manually browses through entry by scrolling. "Not in alphabetical order, that would really help."

1:47 Clicks on names of family members from bar on the left. Browses through collection description and chooses important date. Clicked on link for alphabetical listing to change display of same table.

Clicks on search and tries her name. One result. Goes back to Women's Voices. Scrolls through and finds her name. Clicks on both entries. Same result appears.

Tries search result entry again "Jane Cochrane death notification" - chooses to skip to last task.

1:51 Task 5

50

Quick search for whole site "Anatomy of a speech" - clicks on publications result and scrolls.

1:53 Goes back to main page to search Mirlyn. Same input. Click on link to research guide. Result and says found it.

Search decision: For the search knew wanted to check it out - searched through Mirlyn because that's where I would get it. For Opera House used image bank because looking for specific image. Einstein was a general search.

Search features: Liked that you could refine and choose different systems. For images hard to tell what each image was. Refinement might be helpful.

Task 4: Anything expecting to find? Make test easier? The record I pulled up would be useful to have more information.

Anything unexpected/do differently? No, I don't think so.

Would be fine with using it for research.

Did not consider the links - assumed search would find it.

51

Search results were frustrating but not out of the ordinary.

User 3 2:51 Task 1

Browsing through the main page. Notices quick search. Sees Bentley image bank. Looking through task directions for keywords to search. Searches for "the opera house" and gets the 7 results.

Clicks on link. Thinks it looks like an opera house so finished with first task.

2:53 Task 2

From main page glimpses at text, but goes to quick search and uses Bentley website. "James Toy" - scrolls through links. Clicks on Bentley findings aids list with his name in the segment of names on this page.

In the finding aids, clicks on his name and the papers finding aid. Finds link to Spectrum Center on left hand column and entry opens. Considers task complete.

2:58 Task 3

52

Main page. Clicks on exhibits - browses through options on page and says "I would like to have a quick search box on this page too."

Clicks on A Queer Timeline and and then sources - does not see option that looks like what she wants. Clicks on date range and photo appears.

3:02 Task 4

Types her name in search box - Mirlyn. Clicks on link to 13 results. Asks what "Mirlyn" means. Then decides to go back.

At main page adds "Death" and Online Finding Aids. No results. Goes back. Tries website.

Clicks on Dolph Funeral Home Records. Scrolls through table looking for name. Would like name to be highlighted in search results. Gives up on task. Doesn't know how to find it.

3:06 Task 5

3:08

Main page. MIRLYN catalog because asking to find the books. Searches for "the anatomy of a speech: lyndon johnson" Full record result. Finds link to digital library. Hathi site search. Clicks record link and clicks on link to Worldcat library.

53

Hardest tasks: They did not give a lot of details. Years of book and other information. Depends on myself to search for these things. Website does not give me a lot of help. I have to find it.

Task 4: Does not know why library website would have death information. I don't like this website - a lot of headlines in the middle. For a library website, most people use to find books. Not many people will pay attention to these things. They occupy too much space on the home page.

Anything do differently? I usually use Google Academic. Lots of resources in the website. Easy to use. You can only simply enter in keywords and you get many results.

Search box: Not familiar with catalogs - does not know what each represents.

Using for research: Does not know what website is for. Cannot give more information.

Ziwei Xie

CODES: C - User Comment E - Error ! - Critical Incident P - Prompted by Moderator F - User Frustration CO - User Confusion Q - User Question S - Start time of task E - End time of task

USER TIME CODE COMMENTS

U03 T1 13:37 S Search for "Shakespare opera house"--> no result--> advanced search--> no result--> change key word to "opera house"--> click--> click--> reread the task

54

U03 13:40 E Done

U03 T2 13:41 S Search in Mirlyn--> change key words--> brosing results--> click

13:42 E Done

U03 T3 13:43 S Search in image bank--> search in bentley website--> click

13:44 P what are you looking for

13:44 Back to homepage--> search

55

13:45 E Done

U03 T4 13:45 S Search in Bentley website--> click--> browsing images--> look for the name--> look for family members--> look for import dates--> search the name--> result

13:50 Q "I can't find her death"

13:50 Search " death notification"

13:51 E Give up

U03 T5 13:51 S Search in Bentley website--> results in publication--> search in Mirlyn

56

Q "Where is the get in"

13:53 E Done

U05 T1 14:51 S

Q Which is the category for pictures?

Search in Bentley website

14:53 E Done

57

U05 T3 14:58 S Search in Bentley website--> looking the list of exhibits

14:58 C I prefer a search box at the right of this page

14:59 E Done

U05 T4 15:03 S Browsing the home page--> search

CO What does the Mirlyn mean?

Search "death"--> online finding aids--> go back to home page--> search in bentley website

C There are so many names. I prefer it highlights the keyword in this page.

58

15:06 E Give up

U05 T2 14:54 S

Q " Is this search catelogy belong to bentley website"

Search in Bentley website--> finding aids

F I don't know how to find him in the list

F Why there are so many names

14:58 E Done

59

U05 T5 15:06 S Search in Myrlyn--> find an electronic version--> find one in a library

15:07 E Done