mooc evaluation
DESCRIPTION
Evaluation and learnings of the first Dutch MOOC: Introduction to Communication Science.TRANSCRIPT
The rise of the MOOC’sFrom heaven on earth to both feet on the ground
Dr. Arie K. den Boon, University of Amsterdam
Faculty of Social and Behavioural SciencesUniversity of Amsterdam
2
Arie den Boon 20 years UvA
Psychology, Baschwitz Institute, Communication Science 20 years commercial world
Media research, Founder/CEO Daphne CM (2001-2009) Since 2010: UvA
Coaching Master students CS Program manager MOOC’s
for FSBS UvA
Inspiration for the first Dutch MOOC
Online course Artificial Intelligence by Sebastian Thrun and Peter Norvik (Stanford University) in 2011 Very inspirational Intense participation of students New dimension to education Enrolled: 160.000, Certificate: 23.000
5
Plus University of Amsterdam
since September 2013
8
Back to the first MOOC, 2011.We can and should do that too! Objectives:
Learn what works, why and how by running a
MOOC ourselves Feed an ongoing debate with facts Manage reputation (Branding) Decrease the number of wrong study choices
Group discussion 1: what would you do?
What are the most important reasons for you personally to make a MOOC?
What are the most important reasons for your institution to make a MOOC?
9
10
Introduction to Communication Science
Platform: http://mooc.uva.nl 1e wave: Feb – April 2013 2e wave: 12 Sept – 31 Oct 8 weeks 56 online videos Exam and
certificate
Didactical model
Follow the example of the first MOOC Key elements
Restructure the existing off line course Facilitate learning by graphical elements that
structure the content and provide hooks Enrich the course by facilitating participation in
discussions11
Timeline
12
Lobbying
Feb2012
May2012
July2012
Sep2012
Nov2012
Feb2013
Equipment Filming 1st week ready
3 wks, platform Kick off
Funding
Planning and Budget
Faculty: 40k€ Communication Science: 20k€ UvA: 20k€
New MOOC’s cost between 40k€ and 50k€
13
15
Introduction to Communication Science, examples
https://www.youtube.com/watch?v=QhGPbjxy2F8 https://www.youtube.com/watch?v=S7CN9Trw43w https://www.youtube.com/watch?v=pRePffOpdjs https://www.youtube.com/watch?v=R2QcKwfljSc
Learning 1: Was it worth doing?
Impact on debate on online learning Lots of learning's Impact on reputation of CS and UvA Can be used for study choices of high school
students preparing for higher education
Learning 2: It is different…
Didactical model different Drop out rate large: 80%-95% Large number of students have passed the exam Participation is a good predictor of success Students enrich course beyond level of in hall
lectures No formal credits can be given
18
Learning 3: Social interaction important
Forum increased quality of the course Rich communication environment needed
Social interaction can work out in a positive or a negative way No classical teacher student model Moderation needed
20
Forum
21
…chronisch ziek, deels aan huis gebonden, beperkt studie budget. Maar dan wil ik ook vermelden: enthousiast, zeer gemotiveerd, gepassioneerd over het onderwerp, mijn wereldje wordt weer wat groter…
Apologies for adding to your avalanche of emails, but I just wanted to say how much I enjoyed the MOOC. … I worked in radio journalism for nine years with the BBC …
Now, since I'm very interested in the content itself, I'd be happy to enroll in the follow up course! Is it going to happen any time soon (provided I pass the exam, of course)? Congrats again for work well done!
22
OK. This is just AMAZING ! Thanks guys !!!!
Learning 4: Help of the audience
Design turned out to be very important Many small bugs, but lots of recommendations
to improve Nobody objected to the imperfections, as we
were encouraging suggestions for improvements
23
Learning 5: Learn from YouTube, not from Disney Important:
Charisma, engagement, authenticity Graphics, design Online discussions
Less important: Perfection of video and audio Talking head of lecturer (is not broadcasting, but
stimulates discussion!)24
25
Evaluation 1: Higher appreciation than in offline course The course fulfilled its promise: 95% I enjoyed this course: 92% The course was challenging 70% The course was interesting 95% UvA should provide more MOOC’s 97%
n = 717
Welke didactische methode hanteren we? Voorbeeld: 10 punten Huib Tabbers Beter Onthouden
Niet passief maar actief leren Niet stampen maar spreiden Niet opnieuw bestuderen maar ophalen uit geheugen
Beter Begrijpen Laat uitleggen Laat vragen stellen Laat het tastbaar maken Laat lezen, laat bezinken, laat ophalen
Beter Toepassen Focus op aanpak i.p.v. op oplossing Afnemende ondersteuning i.p.v. gelijkblijvende ondersteuning Variatie i.p.v. eenvormigheid
Wat vinden we tegenwoordig van belang in onderwijs? Vaardigheden:
Kunnen samenwerken in teams Problemen kunnen oplossen Goede interpersoonlijke relaties
27
Group Discussion 2: what are the problems of MOOC’s?
What are the most important problems of MOOC’s?
How can we solve these problems?
28
29
Evaluation 2: For whom? Professionals: 63% Female: 59% Age group: 25+
n=943, MOOC survey
n=943, MOOC survey
30
Where do they come from?
n=943, MOOC survey
31
Reach and activity
About 100.000 cumulative views 17.767 people watched first video 5.467 subscribers 3.424 active participants 717 participated in exam 531 received certificate
32
Free publicity: TV news at 8 PM, press, radio, magazines, blogs, social media
33
34
Possitive reactions from students and opinion leaders: Forum, Facebook, Twitter
Group Dicussion 3: Success and failure
What are the most important success and fail factors of MOOC’s? What are the Do’s?
What are the Don’ts?
35
New MOOC plans within the University of Amsterdam Use more platforms
Coursera, UvA/VU Sakai, iTunes U, etc. Use MOOC’s for introductory programmes,
deficiencies, “schakel”-programmes Use other MOOC’s in a flipped classroom Use MOOC’s for efficiency reasons Use MOOC’s for branding purposes
36
Mooc’s are here to stay change
Thank you
37