do quizzes matter?
DESCRIPTION
General Psychology is the largest of UNM’s 20 “killer” courses for lower division undergraduate students. Before the Pew Grant for Redesign (2001), 41% of students failed to attain a grade of C or better. Goals: (1) Improve success while (2) lowering cost (49% after redesign) - PowerPoint PPT PresentationTRANSCRIPT
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • [email protected]
General Psychology is the largest of UNM’s 20 “killer” courses for lower division
undergraduate students.
Before the Pew Grant for Redesign (2001), 41% of students failed to attain a grade of
C or better.
Goals: (1) Improve success while
(2) lowering cost (49% after redesign)
Solutions: (1) Programmed Self-Instruction (PSI)?
(2) Consolidation of sections
General Psychology is the largest of UNM’s 20 “killer” courses for lower division
undergraduate students.
Before the Pew Grant for Redesign (2001), 41% of students failed to attain a grade of
C or better.
Goals: (1) Improve success while
(2) lowering cost (49% after redesign)
Solutions: (1) Programmed Self-Instruction (PSI)?
(2) Consolidation of sections
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • [email protected]
Do Quizzes Matter?
WebCT Quizzes Instead of PSI? 3 Quizzes per week 20 Questions per quiz Timed (20 min) Unlimited repeats Highest score counts 1 Point per question
3 Quizzes per week 20 Questions per quiz Timed (20 min) Unlimited repeats Highest score counts 1 Point per question
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • [email protected]
Required vs.Optional Quizzes: Effects on Course Grades
21% 27% 15% 37%8% 19% 16% 57%0%
20%
40%
60%
A B C to C+ C- or lessGrade
S02-001 Quizzes Required
S02-002 Quizzes Optional
Do (Required) Quizzes Matter?
Students performed better when quizzes were required (top). With required quizzes (far left), Students who received course grades of A received higher quiz scores and attempted more quizzes than students who received other grades; A students took less time to complete quizzes than B or C students. When quizzes were optional (near left), few students performed as well on quizzes (or exams) than students in the section where quizzes were required.
Per
cent
age
of S
tude
nts
QuickTime™ and aGraphics decompressor
are needed to see this picture.
QuickTime™ and aGraphics decompressor
are needed to see this picture.
Nu
mb
er
Att
em
pts
Ave
. D
ura
tion
(m
in)
Quizzes Required Quizzes Optional
QuickTime™ and aGraphics decompressor
are needed to see this picture.
Weekly Mastery Quizzes Weekly Mastery Quizzes
Hig
h S
core
Spring 2002: Same Instructor
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • [email protected]
Do (Required) Quizzes Matter?Psych 105 Grades · Spring 2005
43%
27%
10%
20%
10%
22%18%
50%
0%
20%
40%
60%
A B C to C+ C- orbelow
Sec 1 (Quizzes Required)Sec 2 (Quizzes NOT Required)
Cla
ss P
erce
ntag
eSpring 2005: Different Instructors
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • [email protected]
Do (Required) Quizzes Matter?C
lass
Per
cent
age
Total Exam Points by Total Quiz Points(Quizzes Required; S05)
0
200
400
600
800
1000
1200
0 200 400 600 800 1000Total Quiz Points (1000)
Total Exam Points (1280)Total Exam Points by Total Quiz Points (S05)
Linear Trend (Correlation, r = .91)
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • [email protected]
Do Quizzes Matter?Total Exam Points by Total Quiz Points F05
0
200
400
600
800
1000
1200
0 200 400 600 800 1000Quiz Points
Exam Points
r = .93
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • [email protected]
Do Quizzes Matter?Pre- vs. Posttest Scores by Course Grade F05
3732 31 33
62
45 45
21
0
20
40
60
80
A B C C- & BelowCourse Grade
Pretest
Posttest
Ave
rag
e S
core
(8
0 Q
ue
stio
ns)
Average Pretest and Posttest scores; quizzes required. During the first two weeks, students who took the Pretest received extra credit for taking a computer version of the Final Exam (they did not know it was the Final); the Posttest was the Final Exam (week 17).
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • [email protected]
Do Quizzes Matter?Passing Grades for Psych 105
59%
71%
63%
77%74%
78% 77% 77%80% 81%
73% 75%
41%
29%
37%
23%26%
22% 23% 23%20% 19%
27%25%
0%
20%
40%
60%
80%
F00Tradi-tional
F01Pilot
S02 F02 S03 F03 S04 F04 S05 F05 S06 F06
Semester
C or AboveC- or Below (& Ws)
Percentage of students receiving grades of C or better in General Psychology 105.001, fall 2000 through spring 2006. Fall 2000 was taught in a traditional manner; i.e., students attended lectures, read the textbook, and took exams. Beginning with the pilot study in fall, 2001, students were required to complete three sets of mastery quizzes per week (approximately 45 quizzes, total).
Percentage of students receiving grades of C or better in General Psychology 105.001, fall 2000 through spring 2006. Fall 2000 was taught in a traditional manner; i.e., students attended lectures, read the textbook, and took exams. Beginning with the pilot study in fall, 2001, students were required to complete three sets of mastery quizzes per week (approximately 45 quizzes, total).
Cla
ss P
erce
ntag
e