quantitative evidence

Project URL – http://www.libqual.org

TM

QUANTITATIVE EVIDENCEAuckland, NZApril 5, 2005

Presented by:

Colleen CookBruce Thompson

“22 Items and The Box….”

Why the Box is so Important About 40% of participants provide open-ended

comments, and these are linked to demographics and quantitative data.

Users elaborate the details of their concerns. Users feel the need to be constructive in their

criticisms, and offer specific suggestions for action.

“…and Five Ancillary Items”Either Zero or Five Ancillary items are

selected to address local or consortial concerns Items from the initial LibQUAL+TM item

pool. Items written by previous consortial

groups.

Some MeasurementIntegrity Evidence

Empathy

InformationControl

Responsiveness

Symbol

Utilitarian space

Assurance

Scope of Content

Ease of Navigation

Self-Reliance

Library as Place

LibraryServiceQuality

Model 3

Refuge

Affect of Service

Reliability

Convenience

Timeliness

Equipment

alpha By Language

By LanguageService Info. Lib as

Group n Affect Control Place TOTALAmerican (all) 59,318 .95 .91 .88 .96British (all) 6,773 .93 .87 .81 .94French (all) 172 .95 .90 .89 .95

alpha by University Type

By University TypeService Info. Lib as

Group n Affect Control Place TOTALComm Colleges 4,189 .96 .92 .89 .974 yr Not ARL 36,430 .95 .91 .88 .964 yr, ARL 14,080 .95 .90 .87 .96Acad Health 3,263 .95 .92 .90 .96 

Service Affect (n = 71,170 English) SA20APER .80541 .22199 .27521SA07APER .80338 .27236 .20993SA17APER .79655 .20844 .22793SA04APER .77062 .29258 .17694SA15APER .73437 .34646 .24299SA23APER .73391 .34359 .27896SA01APER .71589 .29773 .16972SA12APER .71541 .32229 .25528SA10APER .68825 .35941 .28090

Service Affect

Library as Place

Library as Place (n = 71,170 English) LP13APER .26213 .25710 .80013 LP05APER .20412 .15920 .73601 LP09APER .27765 .24869 .72631 LP24APER .26672 .34873 .72148 LP19APER .19630 .28102 .70295

Information Control

Information Control (n = 71,170 English) IA18APER .29824 .73480 .28164PC11APER .29045 .71111 .19999IA03APER .24482 .70341 .18989PC25APER .21770 .68760 .22736PC21APER .41572 .65615 .30096PC02APER .37847 .63860 .16559PC16APER .33439 .61598 .36448IA14APER .28759 .58521 .39295

Validity Correlations

Validity Correlations Serv_Aff Info_Con LibPlace TOTALperServ_Aff 1.0000 .7113 .5913 .9061 Info_Con .7113 1.0000 .6495 .9029 LibPlace .5913 .6495 1.0000 .8053 TOTALper .9061 .9029 .8053 1.0000ESAT_TOT .7286 .6761 .5521 .7587 EOUT_TOT .5315 .6155 .4917 .6250  

LibQUAL+™ Implementation

Interpretation:Mean Perceived Scores (n=34)

6.0000

6.2000

6.4000

6.6000

6.8000

7.0000

7.2000

6.0000 6.2000 6.4000 6.6000 6.8000 7.0000 7.2000

2001 Data

2002 D

ata

LibQUAL+™ 2004 SummaryColleges or UniversitiesAmerican English

(n = 69,449)

LibQUAL+™ 2004 SummaryAcademic Law InstitutionsAmerican English

(n = 4,092)

LibQUAL+™ 2004 SummaryAcademic Health SciencesAmerican English

(n = 3,664)

LibQUAL+™ 2004 SummaryHospitalsAmerican English

(n = 1,024)

LibQUAL+™ 2004 SummaryColleges or UniversitiesUndergraduates – American English

(n = 37,661)

LibQUAL+™ 2004 SummaryColleges or UniversitiesGraduates – American English

(n = 16,750)

LibQUAL+™ 2004 SummaryColleges or UniversitiesFaculty – American English

(n = 11,755)

LibQUAL+™ 2004 SummaryColleges or UniversitiesStaff – American English

(n = 3,283)

Score Norms

Norm Conversion Tables facilitate the interpretation of observed scores using norms created for a large and representative sample.

LibQUAL+™ norms have been created at both the individual and institutional level

Institutional Norms for PerceivedMeans on 25 Core Questions

Note: Thompson, B. LibQUAL+ Spring 2002 Selected Norms, (2002).

LibQUAL+™ InteractiveInstitution Statistics

YEAR (REQ.) – defaults to current year of the survey; controls the Master List (dynamic)

Master List of Institutions

All

Clear

• OVERALL – defaults to OVERALL

• Dimension (3)

mindesperadeq sup

SUBMIT

VARIABLES - Default to perceived

Results Page: This page generates a graph, Summary Statistics, Your Statistics, and Norms (including users’ norm values); restates information entered into the form

4 items included in this

drop-down menu

Your List

INSTITUTION TYPE

SAVED LISTS

CONSORTIA

LANGUAGE ADD

ADD

ADD

ADDLanguage (s) will be determined based on

selection (s) from the Master List of Institutions; dynamic

User selects an institution from the Master List, the selection is then added to “Your List”. To avoid duplicate choices, the selection from the Master List will disappear once added to “Your List”.

Other parameters can be added below (institution type, language, consortia, and/or SAVED LISTS).

Consortia, based on

current year; dynamic

1)

2)

SAVEText here stating that this section is optional and may be added to “Your List” to narrow down results.

Text box for user to name and save search parameters

for future searches.

LibQUAL+™ InteractiveMulti-Variable Statistics

On this page, users will have the capability to build their own spreadsheet, using the options provided the use can set search parameters to obtain desired results.

VARIABLE – defaults to overall

MIN, DES, PER, ADEQ, SUP OR LANGUAGE – defaults to perceived or American English

QUESTIONS (22)

MIN, DES, PER, ADEQ, or SUP – defaults to perceived or American English

This option will only appear if the user

selects “questions” in the VARIABLE menu.

Results Page: This page generates Summary Statistics, “Your Statistics”, and a table listing the users’ results in accordance with the parameters entered in the forms above, along with a key to explain what the variables are.

YEAR (REQ.) – defaults to current year of the survey; controls the Master List (dynamic)

Master List of Institutions

All

Clear

Your List

User selects an institution from the Master List, the selection is then added to “Your List”. To avoid duplicate choices, the selection from the Master List will disappear once added to “Your List”.

Other parameters can be added below (institution type, language, consortia, and/or SAVED LISTS).

1)

SAVE

INSTITUTION TYPE

SAVED LISTS

CONSORTIA

LANGUAGE ADD

ADD

ADD

ADDLanguage (s) will be determined based on

selection (s) from the Master List of Institutions; dynamicConsortia,

based on current year;

dynamic

Text box for user to name and save search parameters

for future searches.

2)

Institution Type based on current

year; dynamic

This page will consist of 3 data columns similar to the one displayed here.

In Closing

LibQUAL+™ methodology focuses on success from the users point of view (outcomes)

Demonstrates that a web-based survey can handle large numbers; users are willing to fill it out; and survey can be executed quickly with minimal expense

LibQUAL+™ requires limited local survey expertise and resources

Analysis available at local and inter-institutional levels Many opportunities for using demographics to discern

user behaviors

LibQUAL+™ Resources

LibQUAL+™ Website:http://www.libqual.org

Publications: http://www.libqual.org/publications

Events and Training: http://www.libqual.org/events

LibQUAL+™ Bibliography: http://www.coe.tamu.edu/~bthompson/servqbib

LibQUAL+™ Procedures Manual: http://www.libqual.org/Information/Manual/index.cfm