issues, challenges, and lessons learned when scaling up a learning analytics intervention
DESCRIPTION
Steven Lonn, Stephen Aguilar, Stephanie D Teasley This paper describes an intra-institutional partnership between a research team and a technology service group that was established to facilitate the scaling up of a learning analytics intervention. Our discussion focuses on the benefits and challenges that arose from this partnership in order to provide useful information for similar partnerships developed to support scaling up learning analytics interventions. Paper Link: http://dl.acm.org/citation.cfm?id=2460343&CFID=274779637&CFTOKEN=44349477&conferenceID=112TRANSCRIPT
![Page 1: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/1.jpg)
http://www.flickr.com/photos/standhere/3870316206/
Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention
Steven Lonn@stevelonn
Stephen Aguilar@stephenaguilar
Stephanie D. Teasley@stephteasley
USE LabUniversity of Michigan
USE Labwww.umich.edu/~uselab
slideshare.net/stevelonn
![Page 2: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/2.jpg)
http://www.flickr.com/photos/standhere/3870316206/
On the “road” to scale...
USE Labwww.umich.edu/~uselab
![Page 3: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/3.jpg)
http://www.flickr.com/photos/jmr-holdit/8158512809/ USE Labwww.umich.edu/~uselab
![Page 4: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/4.jpg)
Goal: Help “at risk” engineering students succeed
Problem: Advisors can’t help until it’s “too late”
Solution: Early warning system for advisors
USE Labwww.umich.edu/~uselab
![Page 5: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/5.jpg)
http://www.flickr.com/photos/jmr-holdit/8158512809/http://www.flickr.com/photos/dominicmeily/7056121879/
USE Labwww.umich.edu/~uselab
![Page 6: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/6.jpg)
http://www.flickr.com/photos/jmr-holdit/8158512809/http://www.flickr.com/photos/dominicmeily/7056121879/
USE Labwww.umich.edu/~uselab
![Page 7: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/7.jpg)
http://www.flickr.com/photos/jmr-holdit/8158512809/http://www.flickr.com/photos/dominicmeily/7056121879/
USE Labwww.umich.edu/~uselab
![Page 8: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/8.jpg)
http://www.flickr.com/photos/jmr-holdit/8158512809/
STUDENTEXPL RER
USE Labwww.umich.edu/~uselab
![Page 9: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/9.jpg)
http://www.flickr.com/photos/jmr-holdit/8158512809/
STUDENTEXPL RER
How do we scale?
USE Labwww.umich.edu/~uselab
![Page 10: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/10.jpg)
http://www.flickr.com/photos/29233640@N07/5473068648/ USE Labwww.umich.edu/~uselab
![Page 11: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/11.jpg)
http://www.flickr.com/photos/worldmirror/4696444162/ USE Labwww.umich.edu/~uselab
![Page 12: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/12.jpg)
http://www.flickr.com/photos/worldmirror/4696444162/
New DatabaseExtract, Transform, and
Load (ETL)Presentation Layer
USE Labwww.umich.edu/~uselab
![Page 13: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/13.jpg)
http://www.flickr.com/photos/jan_k/428083570/
Usability Gaps
USE Labwww.umich.edu/~uselab
![Page 14: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/14.jpg)
http://www.flickr.com/photos/jan_k/428083570/ USE Labwww.umich.edu/~uselab
![Page 15: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/15.jpg)
http://www.flickr.com/photos/jan_k/428083570/ USE Labwww.umich.edu/~uselab
![Page 16: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/16.jpg)
http://www.flickr.com/photos/jan_k/428083570/ USE Labwww.umich.edu/~uselab
![Page 17: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/17.jpg)
http://www.flickr.com/photos/jan_k/428083570/ USE Labwww.umich.edu/~uselab
![Page 18: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/18.jpg)
http://www.flickr.com/photos/jan_k/428083570/ USE Labwww.umich.edu/~uselab
![Page 19: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/19.jpg)
Calculation Gaps
http://www.flickr.com/photos/kag2u/3731515838/ USE Labwww.umich.edu/~uselab
![Page 20: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/20.jpg)
http://www.flickr.com/photos/kag2u/3731515838/ USE Labwww.umich.edu/~uselab
![Page 21: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/21.jpg)
http://www.flickr.com/photos/kag2u/3731515838/ USE Labwww.umich.edu/~uselab
![Page 22: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/22.jpg)
http://www.flickr.com/photos/ideanorth/3772047574/
Access Gaps
USE Labwww.umich.edu/~uselab
![Page 23: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/23.jpg)
http://www.flickr.com/photos/ideanorth/3772047574/USE Labwww.umich.edu/~uselab
![Page 24: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/24.jpg)
Performance Gaps
http://www.flickr.com/photos/veggiefrog/3435380297/ USE Labwww.umich.edu/~uselab
☞ Crashing the LMS is not so good
![Page 25: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/25.jpg)
Automatization Gaps
http://www.flickr.com/photos/iowahighways/8028390293/ USE Labwww.umich.edu/~uselab
☞Advisor = Student / Cohort data needs to be added to data warehouse
![Page 26: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/26.jpg)
Alternate Routes
http://www.flickr.com/photos/ncreedplayer/6232200657/ USE Labwww.umich.edu/~uselab
![Page 27: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/27.jpg)
http://www.flickr.com/photos/standhere/3870316206/
Challenge(s) Possible Solution(s)
Institutional Governance & Resources
Benefits all partnersKeep communicating
Usability Gaps Flexibility & TrainingModifications where poss.
Calculation Gaps Nimble tweaksSoftware adjustments
Automatization Gaps New auto processes with new data fields
Access Gaps Work-aroundsData / Policy changes
Performance Gaps Accurate load testing w/peak scenarios
USE Labwww.umich.edu/~uselab
![Page 28: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/28.jpg)
http://www.flickr.com/photos/standhere/3870316206/
Lessons fromOur Road
Lessons forYour Road?
USE Labwww.umich.edu/~uselab
![Page 29: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/29.jpg)
Acknowledgements
http://www.flickr.com/photos/acmace/4519643728/
Student Explorer TeamAmine BoudaliaAndrew KrummGierad LaputSungJin NamR. Joseph Waddington
M-STEM Academies Partners
LSA Academic File Partners
USE Labwww.umich.edu/~uselab
![Page 30: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention](https://reader034.vdocuments.mx/reader034/viewer/2022051608/5455b8ecb1af9fcf338b4a02/html5/thumbnails/30.jpg)
Contacts
http://www.flickr.com/photos/acmace/4519643728/
Steven [email protected]@stevelonn
Stephen [email protected]@stephenaguilar
Stephanie D. [email protected]@stephteasley
USE Labwww.umich.edu/~uselab
Slides: slideshare.net/stevelonn