writing an effective assessment plan administrative and academic support units february 2015
TRANSCRIPT
Writing an Effective Assessment PlanAdministrative and Academic Support UnitsFebruary 2015
What is Assessment?Plan: Define your mission,
identify outcomes, and
develop measures and performance
targets
Do: Conduct your work in
accordance with division and unit strategic plans.
Check: Measure your
progress against performance targets and
analyze results.
Act: Use what you've learned.
Revise or reinforce your plans, make
improvements, change your measures or targets as needed.
Step 1: Define your mission
•Three or four lines of text that clearly and concisely communicate WHAT you do, WHY you do it, and HOW you do it
•“The mission of (name) is to (purpose) by providing (functions) to (stakeholders). These (services, etc.) contribute to the university’s mission by….”
Step 1: Define your mission (cont.)•Is it brief? Distinctive?•Does it clearly state the purpose?•Does it indicate the primary function?•Does it say who the stakeholders are?•Does it clearly support the university’s
mission?
Step 2: Identify outcomes•Operational outcomes
▫End result for (on impact on) a customer/stakeholder or the institution that is a consequence of your work.
▫Directly related to the mission and key responsibilities; stable from year to year
▫Describes ends, not the means; “big-picture”▫Beneficiary + action verb + benefit=outcome
“Eligible employees will have the information they need to make appropriate decisions regarding employee benefits packages.”
Step 2: Identify outcomes
•Strategic outcomes▫Reflect future expected results based on a
planned activity▫Written in future tense, closely tied to
strategic goals, consistent with operational outcomes “Over the next year, the Registrar’s office will improve
student access to services by expanding hours of operation.”
Step 2: Identify Outcomes
•Learning outcomes▫Relate to student learning▫Describe the key knowledge, skills, or
abilities that students attain as a result of a learning experience.
▫“Upon successful completion of ---, students will <action verb>.” Must be observable, measurable. “Students will identify correct academic requirements
for their major.”
Which should I use?
•It depends. Can use a combination of the three.
•Check:▫Are they aligned with the mission
statement?▫Are they important to the
university/division and reflect key results?▫Is it possible to collect accurate and
reliable data?▫Can they be used to identify areas to
improve?
Step 3: Measure outcomes• First: Develop measures
▫Must relate to the outcome directly and clearly▫Must be objective and avoid structural bias▫The process is documented, systematic, and
impartial.▫What are you already doing?▫Direct v. indirect
Direct measures examine actual results. Indirect measures examine perceptions related to
that outcome. Must use multiple measures to examine each
outcome, one of which should be direct.
Step 3: Measure outcomes
•Institutional Data Sources▫MAYS (Students)▫MAYS (Faculty and Staff)▫CIRP Freshman Survey▫NSSE▫Graduating Student Survey▫Alumni Survey▫Factbook▫Great Places to Work
Step 3: Measure outcomes
•Second: Set targets▫How do you define success? What is the
minimum result that will represent achievement of the outcome?
▫Should be challenging but realistic
Step 4: Collect data
•Look at what you already collect.•Plan: What kind of data is needed? What
needs to be done? Who is responsible? When and how will it be collected?
Step 5: Analyze results• What do these results mean for your unit?• Why did you/did you not reach your target?• What does this tell you about
strengths/weaknesses?• Which strategies were successful?• What will you do differently going forward?
▫Each issue that is identified needs to have an action plan to improve performance. If 100% target was achieved, how will you raise the bar?
▫What resources will be needed, who is responsible, when will actions take place?
Planning Data Collection Reporting
September
October November December January-May
June-July
Division: Using the university’s strategic plan, develops and presents to units goals for current year onwards.
Unit: Develops or revises assessment plan for current year, sends plan to Division.
Division: Compiles and reviews unit plans and send division-wide plan to PIE. Formulates appropriate budget requests, based on strategic plan and assessment results from previous year.
University: PIE reviews plans and sends feedback to divisions.
University: UAC reviews previous year’s assessment reports and sends feedback to Division.
Division: Communicates feedback to units.
University: UBC reconciles budget requests with projected budget
Unit: Responds to feedback as required.
Unit: Implements current year assessment plans, collects data, and analyzes results. Units may also collect data at other points during the academic year, as appropriate.
University: PIE forwards results of institutional surveys to units
Unit: Prepares assessment report and forwards results to Division.
Division: Compiles units' assessment reports and analyzes results; sends report to UAC (July 31).
Previous Academic Year Current Academic YearOutcomes Planned Improvement Progress on Implementing
Improvement
Outcome 1:Relates to divisional goals:
Method 1: (Each outcome should be assessed using at least two measures, and at least one of these measures should be a direct measure.)
Target: Results: (Detailed discussion of results, charts, tables, etc. can be included in the “analysis” section below.)
Method 2: Target: Results:
Analysis of Results and Implications: (List all data sources used, discuss the results for each method used, describe what analysis of the results indicates, and provide and other relevant information.)
Planned Improvements: (List specific actions intended to improve the unit’s effectiveness. Each result should have an associated improvement. If 100% of the target has been met, what will the unit do to reach the next level?)
Unit Assessment Report 2014-2015