student-centered value research
Post on 22-Feb-2016
Embed Size (px)
DESCRIPTIONStudent-Centered Value Research. Assessment activities of the UNT Libraries. Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013. Four Bold Goals. Does not mention “assessment”. Libraries’ Strategic Plan 2011-2015. GOAL THREE: SCHOLARLY OUTCOMES ASSESSMENT - PowerPoint PPT Presentation
Student-Centered Value Research
Student-Centered Value ResearchAssessment activities of the UNT LibrariesSian Brannon, Ph.D. Kathleen Murray, Ph.D.UNT LibrariesMay 2, 20131Four Bold GoalsDoes not mention assessment2Libraries Strategic Plan 2011-2015GOAL THREE: SCHOLARLY OUTCOMES ASSESSMENT
Establish an assessment program that evaluates contributions to student and faculty success, organizational performance, and progress in meeting strategic goals.
3Assessment WorkgroupThe Assessment Work Group will serve as a library-wide coordinating group for assessment activities.
5Inputs Driving Assessment
8Evaluating Programs and Services
10UNT Libraries: Student-Centered Value ResearchMeasuring the Libraries contribution to UNTs strategic goalsTopicsData Collection: UNTLibrary Impact AreasSurrogate MeasuresData Collection: UNT LibrariesImpact OpportunitiesInitial Programs5/2/1312Academic Library DataLibraries: Rich tradition of data collectionInputs & process measurementsOutputs, including use statisticsSatisfaction feedbackService quality dataProblem: Inputs and outputs no longer resonate with many higher education stakeholders.
5/2/131313ChallengeDemonstrate library value to external audiences through:Outcomes-based approachesContributions to institutional goalsMust differentiate outcomes from traditional internal measures of:Inputs / outputsService qualitySatisfaction5/2/1314UNT Strategic Goals1.Excellent Education2.Expanded Research3.Management Excellence4.Community Outreach5/2/1315Areas of Library Impact Should Map to UNT Goals
Potential Library Impact AreasLibrary Impact AreasStudent enrollmentStudent retention & graduationStudent successStudent achievementStudent learningStudent experienceFaculty research productivityFaculty grants Faculty teachingInstitutional reputation or prestige5/2/1316The Research Agenda lays out 10 specific areas of library value within the context of an institutional mission and/or outcomes. (ACRL, p. 17)
16Data Collection: UNTAreas of Library ImpactSurrogate MeasuresStudent learning outcomesLearning assessmentsFaculty judgmentsStudent retention & graduationFall-to-fall retentionGraduation ratesStudent achievementGPAProfessional/educational test scoresFaculty teachingIntegration of library resources & services into syllabi, lectures, labs, etc.Faculty/librarian or student affairs professional/librarian instructional collaborationsOperational efficiencyROIService ratesExpenses incurred pre-and post-implementation5/2/131717Data Collection: UNT LibrariesMacro-level dataLibrary as a wholeUnique to special collections5/2/1318Library expendituresCollection valueCollection use, physical and onlineSpace useService use Library rankingsLibrarian staffing levels Librarian skills; participation in professional development
Data Collection: UNT LibrariesIndividual behavioral dataStudentsFaculty5/2/1319Circulation counts Tutorial loginsResources logins: instruction, class pages, reserve readingsSwipe cards on building, library instruction classrooms Self-reported usage Self-reported time savedNo higher education professionals care more deeply about privacy and confidentiality . . . than librarians. Once sufficient protections are in place, librarians can use individual student data to not only gain evidence of academic library value, but also find ways to increase that value. (ACRL, p. 43)Library Impact ProgramsPLANNING TEMPLATE1.UNT Goal(s)2. Library Service & ResourcesProgram Description & TimelineCollaboratorsCost3.Data CollectionLibraryUNTOther4.Impact AnalysisMeasurementsAreas for Improvement/Modification5. Communication of ResultsInternal: Library, Administration, FacultyExternal: Publications, Conferences5/2/132020Student learning outcomesStudent retention & graduationStudent achievementFaculty teachingOperational efficiency5/2/1321Impact Opportunities
Efficacy of Peer-Led Group Tutoring on Academic Success5/2/1322Institutional Focus AreasDimensions MeasuredStudent learning outcomesLearning assessmentsStudent retention & graduationCourse withdrawal ratesGraduation ratesFaculty teaching Integration of library resources into course Areas of Library Impact on Institutional MissionStudent retention & graduationStudent learningIndicators of Library Impact(UNT Data)Learning assessmentsCourse withdrawal ratesGraduation ratesEvidence of Librarys Role (Library Programs)SPHS 3030 peer tutoring spaceSurvey construction & evaluationAttendance data analysisLibrary Data Collection (Library Data)Survey data: IndividualsCard swipe data: Individual attendanceCorrelations, connections, relationships22Impact of Library Instruction for Undergraduate Students5/2/1323Institutional Focus AreasDimensions MeasuredStudent retention & graduationFall-to-fall retentionGraduation ratesFaculty teaching Faculty/librarian instructional collaborationsIntegration of library resources into course Areas of Library Impact on Institutional MissionStudent retention & graduationFaculty teachingIndicators of Library Impact(UNT Data)Fall-to-fall retentionGraduation ratesFaculty/librarian instructional collaborationsEvidence of Librarys Role (Library Programs)ENGL 1310 library services instructionENGL 1320 research instructionLibrary Data Collection (Library Data)Learning assessmentsCard swipe data: IndividualsResource useCorrelations, connections, relationships23Willis Library 24-hour Student Lab5/2/1324Institutional Focus AreasDimensions MeasuredStudent achievementGPAStudent retention & graduationFall-to-fall retentionGraduation ratesOperational efficiencyROIService ratesExpenses incurred pre-and post-implementationAreas of Library Impact on Institutional MissionStudent retention & graduationOperational efficiencyIndicators of Library Impact(UNT Data)GPAFall-to-fall retentionGraduation ratesEvidence of Librarys Role (Library Programs)Space optimizationSystem usage data gatheringCost analysisLibrary Data Collection (Library Data)Service usageROIExpenses incurred pre- and post-implementationCard swipe dataResource useCorrelations, connections, relationships24ClosingUtilize: Rich tradition of data collectionAddress the problem: Inputs and outputs no longer resonate with many higher education stakeholders.Demonstrate library value to external audiences through:Outcomes-based approachesContributions to institutional goals