university metadata and retrieval: the death of the library catalog?

School of Information Studies, Faculty of Arts and Education

University Metadata and Retrieval:The Death of the Library Catalog?

Ying-Hsang LiuDC-2016, Copenhagen, Denmark

14 October 2016

School of Information Studies, Faculty of Arts and Education

Outline

• Background• Research Question• Relevant Studies• Summary of Eye-Tracking Study• Implications for Search Interface Design

School of Information Studies, Faculty of Arts and Education

Dr Liu’s research research interest lies in the area of user-centred design and evaluation of information retrieval systems.

Current research projects

• Natural Search User Interfaces for Complex Biomedical Search• Computational Intelligence for Complex Structured Data• Understanding the Role of Social Media in Disaster Management

Ying-Hsang Liu

School of Information Studies, Faculty of Arts and Education

Background: Vickery (1970)• Can we yet say that the benefit received is

commensurate with the effort of construction? … Even if controlled retrieval language and thesauri are useful, is their uncontrolled proliferation equally useful? (Vickery, 1970, pp. 136-137)

• Vickery, B. C. (1970). Document description and representation. Annual Review of Information Science and Technology, 6, 113-140.

School of Information Studies, Faculty of Arts and Education

Background (cont’d)

• Information retrieval researchers’ views: Salton, Sparck Jones

• Relative to automatic subject indexing, manual indexing is not cost-effective (Calhoun, 2006)

• Calhoun, K. (2006). The changing nature of the catalog and its integration with other discovery tools. Retrieved from https://www.loc.gov/catdir/calhoun-report-final.pdf

School of Information Studies, Faculty of Arts and Education

Research Question• Usefulness of controlled vocabularies• Svenonius (1986)

• Factors affecting the usefulness of controlled vocabularies, including the nature of the vocabulary, subject discipline, IR system, the skill of indexers and searchers and user requirements

• Svenonius, E. (1986). Unanswered questions in the design of controlled vocabularies. Journal of the American Society for Information Science, 37(5), 331-340

School of Information Studies, Faculty of Arts and Education

Relevant Studies• Hider et al. (2016)• Search effectiveness significantly

improved after reindexing

• Hider, P., Dalgarno, B., Bennett, S., Liu, Y.-H., Gerts, C., Daws, C., . . . Macaulay, R. (2016). Reindexing a research repository from the ground up: Adding and evaluating quality metadata. Australian Academic & Research Libraries, 47(2), 61-75.

School of Information Studies, Faculty of Arts and Education

Figure 1. System performance of initial and final queries by precision.

Published in: Philip Hider; Barney Dalgarno; Sue Bennett; Ying-Hsang Liu; Carole Gerts; Carla Daws; Barbara Spiller; PruMitchell; Robert Parkes; Raylee Macaulay; Australian Academic & Research Libraries 2016, 47, 61-75.DOI: 10.1080/00048623.2016.1204589Copyright © 2016 Australian Library & Information Association

School of Information Studies, Faculty of Arts and Education

Figure 2. System performance of initial and final queries by recall.

Published in: Philip Hider; Barney Dalgarno; Sue Bennett; Ying-Hsang Liu; Carole Gerts; Carla Daws; Barbara Spiller; PruMitchell; Robert Parkes; Raylee Macaulay; Australian Academic & Research Libraries 2016, 47, 61-75.DOI: 10.1080/00048623.2016.1204589Copyright © 2016 Australian Library & Information Association

School of Information Studies, Faculty of Arts and Education

Relevant Studies: Liu (2010a)• Liu (2010a)• Search experience overall has an overall

positive effect on the recall measure

• Liu, Y.-H. (2010a). A meta-analysis of the effects of search experience on search performance in terms of the recall measure in controlled IR user experiments. In F. Scholer, A. Trotman, & A. Turpin (Eds.), Proceedings of the Fifteenth Australasian Document Computing Symposium (pp. 105-110). Melbourne, Australia: School of Computer Science and IT, RMIT University.

School of Information Studies, Faculty of Arts and Education

Relevant Studies: Liu (2010a)

School of Information Studies, Faculty of Arts and Education

Relevant Studies: Liu (2010b)• Liu (2010b)• Assess the potential search effectiveness

of MeSH terms

• Liu, Y.-H. (2010b). On the potential search effectiveness of MeSH (Medical Subject Headings) terms. In Proceedings of the Third Symposium on Information Interaction in Context (IIiX '10) (pp. 225-234). New York: ACM.

School of Information Studies, Faculty of Arts and Education

Relevant Studies: Liu et al. (2016)

School of Information Studies, Faculty of Arts and Education

Visual Search Behaviour

School of Information Studies, Faculty of Arts and Education

GazeSpot on Search Interface

School of Information Studies, Faculty of Arts and Education

Search Interfaces and Gaze

School of Information Studies, Faculty of Arts and Education

BeeSwarm Visualisation of Cognitive Styles

The video is available at:

https://vimeo.com/182044662#t=203s

School of Information Studies, Faculty of Arts and Education

Implications for Interface Design• Search interfaces have significant effect on

eye gaze behavior for complex search tasks• Experienced searchers attracted to suggested

keywords, displayed alongside each document

• Domain experts and analytic users attracted to suggested keywords, displayed under a search box

School of Information Studies, Faculty of Arts and Education

Questions or comments?

Thank You!

Email: yingliu@csu.edu.auWeb: http://csusap.csu.edu.au/~yingliu