how to close the loop for slo/plo assessment · plo: gather information and formulate conclusions...
TRANSCRIPT
![Page 1: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/1.jpg)
How to Close the Loop for SLO/PLO Assessment:
Presented ByOffice of Strategic Planning and Assessment
(SPA)
Closing the Loop for SLO/PLO Assessment
![Page 2: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/2.jpg)
Table of Contents
Report on the Actual Results
Interpret the Data
Make Recommendations (Future Tense)
Implement Recommendations (in the
real world)
Report on Implementation (Past Tense)
![Page 3: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/3.jpg)
Report on the Actual Results
1. Report the % meeting criteria (group success)2. State if the targeted outcome was met or not(CA: Results of the target outcome. Was the student learning outcome met?)
Example 1
PLO: Identify and describe the use of various ceramic materials, production methods, and firing processes. (Art)
Target Outcome: 70% of students enrolled will pass the final exam in the capstone course.
Actual Results: 85% of the students in the capstone course passed the final exam, exceeding the target.
![Page 4: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/4.jpg)
Report on the Actual Results
1. Report the % meeting criteria (group success)2. State if the target was met or not(CA: Results of the target outcome. Was the student learning outcome met?)
Example 2
PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention plan. (Occupational Therapy Assistant)
Target Outcome: 80% of students should score a 3 and 100% should score a 2 or above on a scale of 1-3).
Actual Result: 54% of the students scored a 3 (Excellent) and 100% of the students scored a 2 Satisfactory). The target was partially met.
![Page 5: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/5.jpg)
Interpreting Data
1. Explain what factors contributed to the results. 2. Address why the target was met or not met?
Example 1PLO: Identify and describe the use of various ceramic materials, production methods, and firing processes. (Art)Target Outcome: 70% of students enrolled will pass the final exam for the capstone course.Actual Results: 85% of the students in the capstone course passed the final exam, exceeding the target.
Interpretation of Data: Further analysis of the data indicated that 15% of the students (16 students) did not meet the outcome, and out of these 16 students, 10 students didn’t describe the firing processes adequately. This raised the questions about the teaching method and assessment method. Is verbal explanation of the firing processes sufficient? What is the best way to test students’ mastery of firing processes?
![Page 6: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/6.jpg)
Making Recommendations Based on Interpretation
Interpretation of Data: Further analysis of the data indicated that 15% of the students (16 students) did not meet the outcome, and out of these 16 students, 10 students didn’t describe the firing processes adequately. This raised the questions about the teaching method and assessment method. Is verbal explanation of the firing processes sufficient? What is the best way to test students’ mastery of firing process?
Recommendations: 1. Use visual aid to
explain the firing process;
2. Use video to demonstrate the firing process;
3. Test students’ mastery of the firing processes by having students display their ceramic art work that is produced by students’ applying firing processes.
![Page 7: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/7.jpg)
Interpret the Data
Example 2
PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention plan. (Occupational Therapy Assistant)
Target Outcome: 80% of students should score a 3 and 100% should score a 2 or above on a scale of 1-3).
Actual Result: 54% of the students scored a 3 (Excellent) and 100% of the students scored a 2 Satisfactory). The target was partially met.
Interpretation of Data: Faculty discussed the actual results and found that students who failed to score “3” failed to demonstrate critical thinking skills when designing the intervention plan, which prompted the necessity to implement critical thinking activities in OTHA2302.
![Page 8: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/8.jpg)
Making Recommendations Based on Data
Interpretation of Data: Faculty discussed the actual results and found that students who failed to score “3” failed to demonstrate critical thinking skills when designing the intervention plan, which prompted the necessity to implement critical thinking activities in OTHA2302.
Recommendations: Faculty will design student critical thinking activities and incorporate these activities in OTHA2302.
![Page 9: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/9.jpg)
Types of Recommendations
Recommendation Types Examples
Instructional Strategies (1). Adjust course delivery to teach the course using a topics-based approach and make it more engaging by incorporating active learning strategies and case studies to increase retention of concepts.(2). We would like to incorporate more hands on activity in lab to reinforce learning.
Curriculum Changes (1). Add more relevance and pertinence to the biology non-majors’ curriculum so that non-majors can use the basic concepts in biology to better understand social issues related to the environment and public health. (2). We would like to add a research paper in the course, showing uses of the information in real life.(3). Require uniform amount of time to teach the learning outcome (e.g. 45 minutes).
![Page 10: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/10.jpg)
Types of Recommendations
Recommendation Types Examples
Student support (1). Continue to advise and motivate students: encourage attendance and encourage completion of coursework.(2).Offer tutoring during office hours
Teacher Development (1). We would like to provide professional development for faculty on collaborative learning.(2). Implement faculty mentoring system
Assessment Method
(1). Using one capstone project to evaluate all PLOs may not be adequate. We will add simulation questions that simulate the state exams to assess each PLO.(2). We will revise the grading rubric to target more discrete skills so that we can identify which area is most challenging to students.
![Page 11: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/11.jpg)
Implement Recommendations
Recommendations made based on data interpretation need to be
implemented during the subsequent assessment cycle.
Ways to implement recommendations include the following:
A. Make the recommendation a departmental requirement;
B. Form a taskforce to complete the recommended project;
C. Implement the recommendation in the classroom;
D. Other activities.
![Page 12: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/12.jpg)
Report on Implementation
Example 1 (Departmental Activity and Chair’s Requirement)The recommendation, “Provide professional development to adjunct faculty with regard to the course content standards set by the department and require them to abide by the standards,” was implemented by the chair who organized the professional development event and also communicated the requirements to the adjunct faculty in Fall 2013.
Report on the implementation by specifying what recommendation was implemented in what way and by when;
Use past tense.
![Page 13: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/13.jpg)
Report on Implementation
Example 2 (Faculty Classroom Activity):The recommendation, “Faculty will design student critical thinking activities and incorporate these activities in OTHA2302,” was implemented by Faculty who designed and implemented the critical thinking activities in OTHA2302 in Fall 2013.
![Page 14: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/14.jpg)
Report on Implementation
Example 3 (Taskforce Activity):A taskforce was formed with full-time and part-time faculty representatives to address the recommendation, “Revise the grading rubric to target more discrete skills so that we can identify which area is most challenging to students.” The revised rubric was adopted in Fall 2013. Using the revised rubric, the faculty was able to identify the “translation process” to be the most challenging area for students, so instruction was adjusted to focus more on teaching the “translation process.”
![Page 15: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/15.jpg)
Participants’ Activity
Based on the scenario of data interpretation, please make recommendations and report on the implementation:
Scenario 1: The accounting faculty at a campus found that some aspects of the accounting cycle proved to be difficult to students. Faculty believed that lack of critical thinking skills might have contributed to the difficulty in understanding the accounting cycle concepts.
RecommendationReport on Implementation
(at the end of subsequent year)
![Page 16: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/16.jpg)
Participants’ Activity
Based on the scenario of data interpretation, please make recommendations and report on the implementation:
Scenario 2: The Math faculty found that students who failed the exam were online students who failed to complete all the practice exercises.
RecommendationReport on Implementation
(at the end of subsequent year)
![Page 17: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/17.jpg)
Do’s and Don’ts When Making
RecommendationsDo’s
1.Include faculty in the discussion about data and make recommendations;
2. Ensure the implementation of recommendations and document the implementation.
![Page 18: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/18.jpg)
Do’s and Don’ts When Making
RecommendationsDon’ts
1. Don’t make recommendations that indicate no action:• Continue to monitor• The team was happy with the 95% success rate.• We do not feel there are improvements needed at this time for this
objective.• At the moment, no specific improvements are recommended,
since the students are already learning the material. Of course, we are always willing to think of new ways to improve student learning, and we will take advantage of opportunity. Continue with the assignment to evaluate again.
![Page 19: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/19.jpg)
Do’s and Don’ts When Making
RecommendationsDon’ts
2. Don’t include recommendations that are too general to be measured or implemented:
• Continued improvement of curriculum and assessment and updating course materials to keep aligned with current economic trends.
• Expand focus on this learning outcome.• Continue effective instruction strategy for this outcome.• We are reviewing new methods and techniques and class
structure.• Keep content rigorous.• Objectives were met. Will continue teaching strategy and adjust
if warranted in the future.
![Page 20: How to Close the Loop for SLO/PLO Assessment · PLO: Gather information and formulate conclusions regarding the client's needs and priorities to develop a client centered intervention](https://reader035.vdocuments.mx/reader035/viewer/2022081606/5e6752ba079d30195b23c319/html5/thumbnails/20.jpg)