student-centered value research assessment activities of the unt libraries sian brannon, ph.d....
TRANSCRIPT
![Page 1: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/1.jpg)
STUDENT-CENTERED VALUE RESEARCHAssessment activities of the UNT Libraries
Sian Brannon, Ph.D. Kathleen Murray, Ph.D.
UNT LibrariesMay 2, 2013
![Page 2: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/2.jpg)
Four Bold Goals
Does not mention
“assessment”
![Page 3: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/3.jpg)
Libraries’ Strategic Plan 2011-2015GOAL THREE:
SCHOLARLY OUTCOMES ASSESSMENT
Establish an assessment program that evaluates contributions to student and faculty success, organizational performance, and progress in meeting strategic goals.
![Page 4: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/4.jpg)
Assessment Workgroup
The Assessment Work Group will serve as a library-wide coordinating group for assessment activities.
![Page 5: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/5.jpg)
The BUBBLE
![Page 6: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/6.jpg)
Inputs Driving Assessment
![Page 7: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/7.jpg)
Internal Reporting
![Page 8: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/8.jpg)
External Reporting
![Page 9: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/9.jpg)
Evaluating Programs and Services
![Page 10: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/10.jpg)
Institutional Value
![Page 11: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/11.jpg)
UNT LIBRARIES: STUDENT-CENTERED VALUE RESEARCHMeasuring the Libraries’ contribution to UNT’s strategic goals
![Page 12: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/12.jpg)
12
Topics• Data Collection: UNT
• Library Impact Areas• Surrogate Measures
• Data Collection: UNT Libraries• Impact Opportunities• Initial Programs
5/2/13
![Page 13: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/13.jpg)
13
Academic Library Data• Libraries: “Rich tradition of data collection”
• Inputs & process measurements• Outputs, including use statistics• Satisfaction feedback• Service quality data
• Problem: “Inputs and outputs no longer resonate with many higher education stakeholders.”
5/2/13
![Page 14: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/14.jpg)
14
Challenge• Demonstrate library value to external audiences through:
• Outcomes-based approaches• Contributions to institutional goals
• Must differentiate “outcomes” from traditional “internal” measures of:• Inputs / outputs• Service quality• Satisfaction
5/2/13
![Page 15: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/15.jpg)
15
UNT Strategic Goals
1. Excellent Education
2. Expanded Research
3. Management Excellence
4. Community Outreach
5/2/13
Areas of Library Impact Should Map to
UNT Goals
![Page 16: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/16.jpg)
16
Potential Library Impact AreasLibrary Impact Areas
Student enrollment
Student retention & graduation
Student success
Student achievement
Student learning
Student experience
Faculty research productivity
Faculty grants
Faculty teaching
Institutional reputation or prestige
5/2/13
“The Research Agenda lays out 10 specific areas of library value within the context of an institutional mission and/or outcomes.” (ACRL, p. 17)
![Page 17: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/17.jpg)
17
Data Collection: UNTAreas of Library Impact Surrogate Measures
Student learning outcomes • Learning assessments• Faculty judgments
Student retention & graduation
• Fall-to-fall retention• Graduation rates
Student achievement • GPA• Professional/educational test scores
Faculty teaching • Integration of library resources & services into syllabi, lectures, labs, etc.
• Faculty/librarian or student affairs professional/librarian instructional collaborations
Operational efficiency • ROI• Service rates• Expenses incurred pre-and post-
implementation
5/2/13
![Page 18: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/18.jpg)
18
Data Collection: UNT Libraries• Macro-level data
• Library as a whole• Unique to special collections
5/2/13
• Library expenditures• Collection value• Collection use, physical and
online• Space use• Service use • Library rankings• Librarian staffing levels • Librarian skills; participation in
professional development
![Page 19: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/19.jpg)
19
Data Collection: UNT Libraries• Individual behavioral data
• Students• Faculty
5/2/13
• Circulation counts • Tutorial logins• Resources logins: instruction,
class pages, reserve readings• Swipe cards on building, library
instruction classrooms • Self-reported usage • Self-reported time saved
“No higher education professionals care more deeply about privacy and confidentiality . . . than librarians. Once sufficient protections are in place, librarians can use individual student data to not only gain evidence of academic library value, but also find ways to increase that value.” (ACRL, p. 43)
![Page 20: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/20.jpg)
20
Library Impact ProgramsPLANNING TEMPLATE
1. UNT Goal(s)
2. Library Service & Resources• Program Description & Timeline• Collaborators• Cost
3. Data Collection• Library• UNT• Other
4. Impact Analysis• Measurements• Areas for Improvement/Modification
5. Communication of Results• Internal: Library, Administration,
Faculty• External: Publications, Conferences
5/2/13
![Page 21: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/21.jpg)
21
1. Student learning outcomes
2. Student retention & graduation
3. Student achievement
4. Faculty teaching
5. Operational efficiency
5/2/13
Impact Opportunities
![Page 22: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/22.jpg)
22
Efficacy of Peer-Led Group Tutoring on Academic Success
5/2/13
Institutional Focus Areas Dimensions Measured
Student learning outcomes • Learning assessments
Student retention & graduation
• Course withdrawal rates• Graduation rates
Faculty teaching • Integration of library resources into course
Areas of Library Impact on Institutional
Mission
• Student retention & graduation
• Student learning
Indicators of Library Impact
(UNT Data)
• Learning assessments
• Course withdrawal rates
• Graduation rates
Evidence of Library’s Role
(Library Programs)
• SPHS 3030 peer tutoring space
• Survey construction & evaluation
• Attendance data analysis
Library Data Collection
(Library Data)
• Survey data: Individuals
• Card swipe data: Individual attendance
Correlations, connections, relationships
![Page 23: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/23.jpg)
23
Impact of Library Instruction for Undergraduate Students
5/2/13
Institutional Focus Areas Dimensions Measured
Student retention & graduation
• Fall-to-fall retention• Graduation rates
Faculty teaching • Faculty/librarian instructional collaborations• Integration of library resources into course
Areas of Library Impact on Institutional
Mission
• Student retention & graduation
• Faculty teaching
Indicators of Library Impact
(UNT Data)
• Fall-to-fall retention
• Graduation rates• Faculty/librarian
instructional collaborations
Evidence of Library’s Role
(Library Programs)
• ENGL 1310 library services instruction
• ENGL 1320 research instruction
Library Data Collection
(Library Data)
• Learning assessments
• Card swipe data: Individuals
• Resource use
Correlations, connections, relationships
![Page 24: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/24.jpg)
24
Willis Library 24-hour Student Lab5/2/13
Institutional Focus Areas Dimensions Measured
Student achievement • GPA
Student retention & graduation • Fall-to-fall retention• Graduation rates
Operational efficiency • ROI• Service rates• Expenses incurred pre-and post-implementation
Areas of Library Impact on Institutional
Mission
• Student retention & graduation
• Operational efficiency
Indicators of Library Impact
(UNT Data)
• GPA• Fall-to-fall
retention• Graduation
rates
Evidence of Library’s Role
(Library Programs)
• Space optimization
• System usage data gathering
• Cost analysis
Library Data Collection
(Library Data)
• Service usage• ROI• Expenses
incurred pre- and post-implementation
• Card swipe data• Resource use
Correlations, connections, relationships
![Page 25: STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062518/56649e205503460f94b0bd7f/html5/thumbnails/25.jpg)
25
Closing• Utilize: “Rich tradition of data collection”• Address the problem: “Inputs and outputs no longer
resonate with many higher education stakeholders.”• Demonstrate library value to external audiences through:
• Outcomes-based approaches• Contributions to institutional goals
5/2/13