owd 2012- 4 -four years of learning analytics in practice- john campbell
TRANSCRIPT
![Page 1: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/1.jpg)
Analytics in Practice:An Institutional Perspective
John P. Campbell
Associate Vice President – Academic Technologies
Purdue University
![Page 2: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/2.jpg)
About Purdue
![Page 3: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/3.jpg)
In the beginning…
![Page 4: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/4.jpg)
Data rich, information poor
![Page 5: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/5.jpg)
http://www.youthareawesome.com/wp-content/uploads/2010/10/wheres-waldo1.jpg
Challenge: How do you find the student at risk?
![Page 6: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/6.jpg)
http://www.youthareawesome.com/wp-content/uploads/2010/10/wheres-waldo1.jpg
Challenge: How do you find the student at risk?
![Page 7: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/7.jpg)
Our Focus
Signals detects early warning signs and provides interventions for students who may not be performing to the best of their abilities before they reach a critical point in their class.
![Page 8: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/8.jpg)
Signals ApproachStudent Preparation
+
Student Engagement/Effort
+
Student Performance
Messages
+
interventions
![Page 9: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/9.jpg)
QUICK VIDEO ON WHAT COURSE SIGNALS IS & HOW IT WORKS
http://bit.ly/signalsdemo
![Page 10: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/10.jpg)
Signals after 5 YearsFall 2007 Cohort Retention Rate
Number of Signals Courses
Cohort Size 1 Year 2 Year 3 Year 4 Year 5 Year Average SAT
Score
No Courses 5,071 83.34% 73.04% 70.34% 68.92% 68.74% 1155
At least 1 1,629 96.44% 93.80% 89.93% 88.03% 86.80% 1130
1 instance 1,377 96.44% 93.32% 89.18% 87.00% 86.49% 1134
2 or more 252 96.43% 96.43% 94.05% 93.65% 88.49% 1103
![Page 11: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/11.jpg)
Four & Five Year Graduation Rates
Fall 2007 Cohort Graduation Rate
Number of Signals Courses
Cohort Size 4 Year 5 Year Average
SAT Score
No Courses 5,071 42.06% 61.39% 1155
At Least 1 Course 1,629 43.52% 74.34% 1130
![Page 12: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/12.jpg)
Faculty-centered approach
![Page 13: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/13.jpg)
QUICK VIDEO ON FACULTY PERCEPTIONS OF COURSE SIGNALS
http://bit.ly/SignalsFaculty
![Page 14: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/14.jpg)
Actionable by the student
![Page 15: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/15.jpg)
Student Perceptions• 89% of students that experienced Signals had a positive
experience • 86% of students said that the benefits outweigh the
drawbacks in Signals • 73% said they would like Signals in every course• 61% of students felt they got a higher grade in a course
because of Signals• 58% of students said they sought more help because of
the personalized interventions• 74% of students believed that their motivation was
directly affected by Signals
![Page 16: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/16.jpg)
Student perceptions• “It was an interesting concept to use a stoplight to let me
know how my progress was going. Just the simple color change was enough for me to know how I was doing in the class.”
• “Seeing green motivated me to continue to maintain my positive progress in the class, and once I saw yellow, I knew I had to increase my efforts to do better in the class.”
![Page 17: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/17.jpg)
Student Perceptions
• “It was nice knowing my overall grade and progress in the class at the beginning, middle, and end of the course and allowed me to step up my effort before it was too late to help my grade significantly”
• “It made me feel like the instructor was aware of me and was interested in my progress.”
• “Signals helped me become more motivated towards the class and I raised my grade 20 points!”
![Page 18: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/18.jpg)
How does a campus build capacity?
![Page 19: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/19.jpg)
Institutional Challenge: Leaders
![Page 20: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/20.jpg)
Institutional Challenge: Silos
![Page 21: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/21.jpg)
Institutional Challenge: Focus on Actionable Intelligence
![Page 22: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/22.jpg)
Institutional Challenge: Team
![Page 23: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/23.jpg)
Institutional Challenge: Lost Opportunities
![Page 24: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/24.jpg)
New Possibilities• Using data that exists on campus• Taking advantages of existing programs• Bringing a “complete picture” beyond
academics• Focusing on the “Action” in “Actionable
Intelligence”
![Page 25: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/25.jpg)
How to Begin – My Advice• Actionable intelligence• Moving research to practice• Fostering change in institutional culture• Understanding the limitations and risks• Take a long term view• Be part of a community
![Page 26: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/26.jpg)
How to Begin – My Advice• Keep it simple• Start with some manual steps before
developing/purchasing the “ultimate” system
• Have a diverse team• Don’t forget the faculty and students as
part of the process
![Page 27: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/27.jpg)
SoLAR Annual Conference• 8-12 April, 2013• University of Leuven in Leuven, Belgium.
![Page 28: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/28.jpg)
Final Thought: Obligation of Knowing
![Page 29: OWD 2012- 4 -Four years of learning analytics in practice- John Campbell](https://reader033.vdocuments.mx/reader033/viewer/2022052905/5584f4eed8b42a82618b52a8/html5/thumbnails/29.jpg)
Thank YouJohn P. Campbell
Associate Vice President – Academic Technologies
Purdue University
http://www.itap.purdue.edu/learning/tools/signals/