ta 6 aug 2013 andrewng-coursera publictransformingassessment.com/sites/default/files/... ·...

13
Webinar Series This session GMT 10PM 6 August 2013 The Online Revolution: Education for Everyone - MOOCs Andrew Ng (Stanford University & Co-founder Coursera). Hosts Professor Geoff Crisp, Dean Learning and Teaching, RMIT University [email protected] Dr Mathew Hillier, Teaching and Educational Development Institute, University of Queensland [email protected] 1 The Online Revolution: Andrew Ng & Daphne Koller Stanford University & Coursera The Online Revolution: Education for Everyone 2 Courses from Top Universities 3 30 of the top 60 universities worldwide (Academic Ranking of World Universities) The #1 or #2 ranked university in 14 countries. Courses from Top Universities 4

Upload: others

Post on 10-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

Webinar Series

This session GMT 10PM 6 August 2013

The Online Revolution: Education for Everyone - MOOCs

Andrew Ng (Stanford University & Co-founder Coursera).

Hosts

Professor Geoff Crisp, Dean Learning and Teaching, RMIT University

[email protected]

Dr Mathew Hillier, Teaching and Educational Development Institute, University of Queensland

[email protected]

The Online Revolution:

Andrew Ng & Daphne KollerStanford University & Coursera

The Online Revolution:

Education for Everyone

2

Courses from Top Universities 3

• 30 of the top 60 universities worldwide (Academic Ranking of World Universities)

• The #1 or #2 ranked university in 14 countries.

Courses from Top Universities 4

Page 2: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

400400

Coursera

400400

5

100,000100,000

Coursera

100,000100,000

6

I'm a single mom 39 years old with two college

boys... I've been trying to get back to college for

my masters and want to learn more about

computers. Looking forward to this class!

(Jenny Ramirez)

7

Coming from a middle class family from a

small town in India. Never had the luck and

guidance to reach Stanford for education.

Guess what? God has sent the opportunity Guess what? God has sent the opportunity

right across my door step! Heartfelt thanks to

the great team and teachers who made this

happen! (Akash Goswami)

8

Page 3: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

393 courses

83 Universities

4.0 million students

13 million enrollments

9

# u

sers

on

sit

e

100K

50K

Course Begins

Timeline# u

sers

on

sit

e

50K

vv

Real Course 10

THE STUDENT

EXPERIENCE11

Modern sequencing

methods (11 min)

History: The

Human Genome

Project (12 min)

Modern GenomicsGenes and alleles

(10 min)

Basic Genetics

Refresher (OPTIONAL)

Mendelian

inheritance

(13 min) Genetic testing in

the commercial

world (11 min)

Commercial Genomics

(OPTIONAL)

Genomic

economics (8

min)

Personalized

medicine (13 min)

What is DNA?

(12 min)

Protecting privacy

(9 minutes)

Case study: direct-

to-consumer

genetics (12 min)

Case study:

family planning

(13 min)

Personalized LearningPersonalized Learning 12

Page 4: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

Retrieval Practice Improves Learning"Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

J. Karpicke, J. Blunt. Science (2011).

0.8

0.7

0.6

0.5

Study

0.4

0.3

0.2

0.1

0.0

Repeated

Study

Retrieval

Practice

Practice is CriticalPractice is Critical 13 Autograded Homeworks and ExercisesAutograded Homeworks and Exercises 14

Multiple choice

Short answer (regular expression) Math expressionsShort answer (regular expression) Math expressions

Autograded Homeworks and ExercisesAutograded Homeworks and Exercises 15

Structured data Computer programs

Autograded Homeworks and ExercisesAutograded Homeworks and Exercises 16

Page 5: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

Coursera

Colleen Lee, Ethan Fast, Alex Aiken

Autograded Homeworks and ExercisesAutograded Homeworks and Exercises 17

Which of the following statements are true? Check all that apply.

� Archduke Franz Ferdinand of Austria started WWII.

� The allied troops landed in Normandy on D-Day.

� WWII started in 1939

� Trench warfare was invented during WWII.

Coursera

� Trench warfare was invented during WWII.

Personalization and MasteryPersonalization and Mastery 18

Which of the following statements are true? Check all that apply.

Correct options:

� WWII started in 1939

� WWII lasted about 6 years

� Many troops from the UK fought in WWII.

� The allied troops landed in Normandy on D-Day.

Coursera

Incorrect options:

� WWII ended in 1944

� Many troops from Switzerland fought in WWII.

� Archduke Franz Ferdinand of Austria started WWII.

� Trench warfare was invented during WWII.

Randomization and MasteryRandomization and Mastery 19

Which of the following statements are true? Check all that apply.

Correct options:

� WWII started in 1939

� WWII lasted about 6 years

� Many troops from the UK fought in WWII.

� The allied troops landed in Normandy on D-Day.Which of the following statements are true? Check all that apply.

� Many troops from the UK fought in WWII.

� WWII ended in 1944

Which of the following statements are true? Check all that apply.

� WWII started in 1939

� The allied troops landed in Normandy on D-Day.

� Archduke Franz Ferdinand of Austria started WWII.

� Trench warfare was invented during WWII.

Coursera

Incorrect options:

� WWII ended in 1944

� Many troops from Switzerland fought in WWII.

� Archduke Franz Ferdinand of Austria started WWII.

� Trench warfare was invented during WWII.

Randomization and MasteryRandomization and Mastery

Which of the following statements are true? Check all that apply.

� Many troops from Switzerland fought in WWII.

� WWII started in 1939

� WWII lasted about 6 years

� Archduke Franz Ferdinand of Austria started WWII.

� WWII ended in 1944

� The allied troops landed in Normandy on D-Day.

� Trench warfare was invented during WWII.

20

Page 6: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

• Mastery-based score improvements correlate with future

performance

– 3 points improvement � 1 point in next starting score Martin Odersky

EPFL

Benefits of Mastery (Scala, EPFL)Benefits of Mastery (Scala, EPFL) 21

405060708090

100

Stu

de

nt

Gra

de

“The Impact of Self-and Peer-Grading on Student Learning”.

P. Sadler, E. Good. Educational Assessment (2006).

Peer Grade 010203040

0 10 20 30 40 50 60 70 80 90 100

Teacher Grade

Stu

de

nt

Gra

de

Open-Ended WorkOpen-Ended Work 22

405060708090

100

Stu

de

nt

Gra

de

“The Impact of Self-and Peer-Grading on Student Learning”.

P. Sadler, E. Good. Educational Assessment (2006).

Peer Grade

Self Grade

010203040

0 10 20 30 40 50 60 70 80 90 100

Teacher Grade

Stu

de

nt

Gra

de

Open-Ended WorkOpen-Ended Work 23

LaPtabel

laptop table

DuoSlim

portable device holder

Neo-WD

space-efficient workdesk

Karl Ulrich

Wharton, UPenn

Ramaswamy Venkatachalam

Gujarat, India

Paul Mendoza

Manila, Philippines

Aranzazu Hurtado Ruiz

Madrid, Spain

Creative, open-ended homework via peer gradingCreative, open-ended homework via peer grading 24

Page 7: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

CourseraPeer GradingPeer Grading 25

Analysis by:

Matthew Salganik & Mitch Duneier

Princeton University Sociology Dept.

Mitch Duneier

Princeton

Peer Grading Accuracy (Soc101, Princeton)Peer Grading Accuracy (Soc101, Princeton) 26

The Humanities, Sciences, Engineering, Business, BThe Humanities, Sciences, Engineering, Business, B 27

High

School

11.8%

Associate

8.2%

Masters

36.7%

Doctoral

5.4%

North

America

35.2%Asia

21.4%

South

America

8.8%

Africa

3.6%

Oceania

2.8%

Bachelors

42.8%

36.7%

Europe

28.2%

21.4%

Non-Traditional Population 28

Page 8: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

Sociology 101 Student Map

Global community of learners 29

Students

CourseraDiscussions 30

Community TA

Class re-runs and Community TAs 31

MiamiNigeriaAustin, Texas

Czechoslovakia

Vietnam

Russian speaking students

San Francisco HCI-Class Study Group

GuatemalaAthens KenyaNepal

Minnesota

A multilingual universal

study group

Arabic speaking students

speaking students

Student Study Groups 32

Page 9: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

Signature Track Courses 33 Signature Track 34

First

lectures

posted

STATISTICS

& ANALYTICS35

Dan MacFarland“These lessons have been much

harder to focus on (at least for me),

because there was no talking face.”

“These lessons have been much

harder to focus on (at least for me),

because there was no talking face.”

Student Group A Student Group B

Data: Learn how students learn 36

Page 10: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

Wrong answers submitted

for machine learning class

programming assignment

New Window into Human Learning 37

Lecture

Achievement Score

"The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as

One-to-One Tutoring." B. Bloom, Educational Researcher (1984).

The 2 Sigma Problem 38

Mastery Learning

Lecture

Achievement Score

"The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as

One-to-One Tutoring." B. Bloom, Educational Researcher (1984).

The 2 Sigma Problem 39

Individual

Tutoring

Mastery Learning

Lecture

Achievement Score

"The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as

One-to-One Tutoring." B. Bloom, Educational Researcher (1984).

The 2 Sigma Problem 40

Page 11: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

INSTRUCTOR

INTERFACES 41

Writing on tablet

appears on monitor

Webcam to record instructorWebcam to record instructor

Lecture Recording 42

Instructor Interfaces: Course Dashboards 43 Instructor Interfaces: Course Dashboards 44

Page 12: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

Instructor Interfaces: Course Dashboards 45 Instructor Support 46

The mind is not a vessel that

needs filling, but wood that

from Ian Kidd's translation of Essays

needs filling, but wood that

needs igniting.Plutarch

47

• High-quality online content

• Produced locally or adopted from

another institution.

• High-touch interaction with local

instructor

• Active learning, problem solving,

personal attention to students

The Best of Both Worlds 48

Page 13: TA 6 Aug 2013 AndrewNg-Coursera publictransformingassessment.com/sites/default/files/... · "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping."

58%

50%

41%40%

50%

60%

70%

80%

90%

"Improved Learning in a Large-Enrollment Physics Class."

L. Deslauriers, E. Schelew, and C. Wieman. Science (2011).

0%

10%

20%

30%

40%

Lecture

Attendance Engagement Learning

Igniting Minds 49

58%

50%

41%

81%85%

74%

40%

50%

60%

70%

80%

90%

"Improved Learning in a Large-Enrollment Physics Class."

L. Deslauriers, E. Schelew, and C. Wieman. Science (2011).

0%

10%

20%

30%

40%

Lecture

Active Learning

Attendance Engagement Learning

Igniting Minds 50

Education for Everyone 51

Webinar Series

Webinar End

Please refer to http://transformingassessment.com for the session recording

With Thanks from your hostsWith Thanks from your hosts

Professor Geoff Crisp, Dean Learning and Teaching, RMIT University

[email protected]

Dr Mathew Hillier, Teaching and Educational Development Institute, University of Queensland

[email protected]

52