let icarus fly - california state university · let icarus fly multiple measures in assessment and...
TRANSCRIPT
![Page 1: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/1.jpg)
Let Icarus FlyMultiple Measures in Assessment and the
Reimagination of Student Capacity
California State University Graduation Initiative 2025 SymposiumOctober 12, 2017
Craig HaywardSenior Consulting Researcher
The RP [email protected]
Alan K. K. ChanSenior Data Scientist
Educational Results [email protected]
John J. HettsSenior Director of Data ScienceEducational Results Partnership
[email protected] @jjhetts #LetIcarusFly
![Page 2: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/2.jpg)
Daedalus and Icarus
![Page 3: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/3.jpg)
Three snapshots of backed up, leaky educational pipeline
![Page 4: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/4.jpg)
What do these have in common? As students move between segments (compared to when they move within
segments)
– Disproportionately likely to repeat, go backwards
o Even after success!
– Standardized tests frequent gatekeeper/proxy
– Repetition yields _at best_ moderate improvement in performance in repeated and subsequent course
– Disproportionate impact on underrepresented populations
– Substantial real and opportunity costs to repeat courses successfully completed
![Page 5: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/5.jpg)
Possible explanations Students struggle to develop math and English competencies
Collectively, we struggle to teach math and English competencies
Transitions and mistrust
Methods of assessment of readiness are flawed/incomplete
Repetition of level is ineffective (and costly)
– Especially for students that successfully completed
![Page 6: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/6.jpg)
Transitions and intersegmental trust Within systems: highly reliable progression after
successful completion
HS to CSU– 38% repeat previously completed coursework, ~60%
African Americans, 45% of Hispanics
HS to CCC transition– ~3/4 repeat ≥ 1 level, ~1/2 repeat ≥ 2 levels of math
– African Americans & Hispanics ~60% more likely,
Female students ~20% more likely
Noyce Foundation report– Algebra in 8th grade, ~2/3 repeat including 50% of
students with B or better
– Algebra in 7th grade advance to Geometry in 8th grade
3%7%
12%
31%
19%15% 14%
0%
5%
10%
15%
20%
25%
30%
35%
Jump ≥ 2 levels
Jump 1level
Normalprogress
Repeatlevel
Repeat2 levels
Repeat3 levels
Repeat ≥4
levels
HS to CCC Math transition
![Page 7: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/7.jpg)
Transitions and the incomplete standardized proxy
Standardized tests are held out as a way for us to know the “truth” about student preparation/readiness
– “Can’t possibly know what’s going on behind the intersegmental veil”
Regularly lead to vastly different intersegmental rates of progression
– Why?
– One key reason – single instance, single method standardized tests typically weak predictor of subsequent performance
![Page 8: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/8.jpg)
From Hodara, M., & Cox, M. (2016), Developmental education and college readiness at the University of Alaska: http://bit.ly/HSGPAAK
![Page 9: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/9.jpg)
From Hodara, M., & Cox, M. (2016), Developmental education and college readiness at the University of Alaska: http://bit.ly/HSGPAAK
![Page 10: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/10.jpg)
Variance in college level Math grades explained by various assessments - NC
Adapted from Bostian (2016), North Carolina Waves GPA Wand, Students Magically College Ready adapted from research of Belfield & Crosta, 2012 – see also Table 1: http://bit.ly/Belfield2012 (cf also Scott-Clayton, 2012)
1.7%3.6%
1.4% 2.3%4.8%
.0% .0% .1%3.2% 2.9% 2.6% 1.4%
17.6%
0%
5%
10%
15%
20%
![Page 11: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/11.jpg)
Variance in college level English grades explained by various assessments - NC
Adapted from Bostian (2016), North Carolina Waves GPA Wand, Students Magically College Ready adapted from research of Belfield & Crosta, 2012 – see also Table 1: http://bit.ly/Belfield2012 (cf also Scott-Clayton, 2012)
.2% 1.4% 2.0% 1.7%.0% .3% .0% .2% .5% .8% 2.0% 1.2%
13.7%
0%
5%
10%
15%
20%
![Page 12: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/12.jpg)
Std. tests increasingly confounded w/SES (Geiser, 2015) http://bit.ly/Geiser2015
![Page 13: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/13.jpg)
Repetition doesn’t improve outcomes/student trajectories Regression discontinuity designs compare
students on either side of cut score Developmental education should have
significant positive impact
Valentine, Konstantopoulos, & Goldrick-Rab(2017) meta-analysis: http://bit.ly/ValentineRD2017
Placement in developmental education has“effects that are negative, statistically significant, and substantively large” for:
– gateway course completion– college credits earned– degree/transfer
![Page 16: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/16.jpg)
IES Report on impact of placement into Developmental Education
Assignment to development education has no significant positive & some
negative impacts for moderately (at least two of: HSGPA >2.5, one course above
Algebra 2, SAT or ACT equivalent > 840) and strongly prepared students (see Table
A: http://bit.ly/IESRemedial) on:
– completing college-level course in discipline
– number of college credits completed
– completion of four-year degree
– exiting college in first two years without a degree
![Page 17: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/17.jpg)
Methods to improve student completion of college level English and Math
Improve accuracy of assessment through multiple measures
Redesign developmental education from sequential to corequisite
Combined approach
![Page 18: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/18.jpg)
Why are multiple measures important in assessment?
Basic assessment/measurement theory:
– When you measure something you get:
o True score (thing you care about)
o Systematic error (regular error or bias in measurement)• Single method increases vulnerability
o Random error (temporary errors)• Single instance increases vulnerability
![Page 19: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/19.jpg)
Why is the use of multiple measures important in assessment?
Methodological gold standard of assessment
– To minimize systematic and random error, triangulate to true
score through assessment across different:
o methods of assessment (how)
o context of assessment (who/where)
o content domains (what)
o time (when)
![Page 20: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/20.jpg)
MULTIPLE MEASURES ASSESSMENT PROJECT
Decision trees revolutionize placement
![Page 21: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/21.jpg)
![Page 22: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/22.jpg)
An Engineering Decision Tree“Does it move?”
![Page 23: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/23.jpg)
A B ZZ A BB Z A
A B AB A B
AAA BBB
ZZZ
Increasing Homogeneity with each split
Branch
Internal Node
Leaf Node
Root Node
![Page 24: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/24.jpg)
Multiple Measures Assessment Project
• Collaborative effort of CCCCO, Common Assessment Initiative (CAI), Cal-PASS Plus (Educational Results Partnership & San Joaquin Delta College), RP Group
• Identify, analyze, & validate multiple measures data• Including HS data, noncognitive data, & self-reported HS data
• Focus on predictive validity (success in initial and gateway course)• Engage ~70 pilot colleges to conduct local replications, test models, pilot
use in placement, and provide feedback
bit.ly/MMAP2017
![Page 25: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/25.jpg)
Statistics Decision Tree for Direct Matriculants
![Page 26: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/26.jpg)
![Page 27: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/27.jpg)
Transfer Level Course Direct Matriculants Non-Direct MatriculantsPre-CalculusPassed Algebra II (or better)
HS 11 GPA >=3.4 OR
HS 11 GPA >=3.0 AND enrolled in Calculus
HS 12 GPA >=3.3 OR
HS 12 GPA >=3.0 AND (C or better in Calculus OR Algebra CST ≥ 340)
StatisticsPassed Algebra I (or better)
HS 11 GPA >=3.0 OR
HS 11 GPA >=2.3 AND Pre-Calculus C (or better)
HS 12 GPA >=3.0 OR
HS 12 GPA >=2.6 AND Pre-Calculus (C or better)
College-level English HS 11 GPA >=2.6 HS 12 GPA >=2.6
MMAP Transfer-Level Placement Recommendations
bit.ly/RulesMMAP bit.ly/MMAPPlacementMatrix
![Page 29: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/29.jpg)
Types of Placement Error
• Overplacement: Student is placed above their ability to succeed. Highly visible.
• Underplacement: Student could have been successful at a higher level than where placed. Tends to be invisible.
• Total placement error is minimized when over- and underplacement are balanced.
• Current placement systems tend to result in much greater underplacement error (i.e., false negatives).
![Page 30: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/30.jpg)
How can we compare placement methods?
• Accuracy: proportion of students correctly predicted to be successful or to be unsuccessful.
• Other Classification Metrics: Positive predictive value, Sensitivity, Specificity, etc.
• 1 year throughput rate (gateway momentum): number of students successfully completing gatekeeper course at the end of a course sequence within 1 year divided by the number of students in the initial cohort.
• Underrepresented Minority Placement Rate: Equity and disproportionate impact are major considerations when evaluating performance of placement systems
![Page 31: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/31.jpg)
Managing Errors in Identifying Student Capacity Trade off in specificity vs. sensitivity
– Consider consequences of false positives vs. false negatives
High sensitivity– “…correctly detect students who are capable of succeeding in the college-level course.”– Avoid false negative of incorrectly telling a student that they will fail– Increase sensitivity when false negatives are problematic
High specificity – “…correctly detect students who are not going to succeed in the college-level course.”– Avoid false positive of telling a student who will fail that they will succeed – Increase specificity when concerned about false positives
It is easier to identify students who will succeed than those who will fail
![Page 32: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/32.jpg)
High School
11th Grade Assessment
Early Start
Standardized Testing (SAT, ACT, AP) Senior Experience or
Junior Year Standardized Testing
CSU Entry Exams (Math, English)
College course while
in HS
CSU Freshman
year
Multiple Opportunities to Achieve and Demonstrate Academic Preparation
![Page 33: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/33.jpg)
Pattern of evidence replicates with CSU
A number of CSU campuses have renewed participation in
CalPASS Plus, facilitating replication of this research
– Evidence strongly suggests far more students likely to succeed
using two different methods
o Categorization and regression tree data mining
o Item Response Theory
![Page 34: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/34.jpg)
![Page 35: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/35.jpg)
![Page 36: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/36.jpg)
Multiple Measures Using Item-Response Theory
Map high school course performance, college course performance, and student ability on the same standardized scale
Estimate ability of incoming students using high school grades
Predict the most likely grade in future college-level course
HS Algebra 1 HS Geometry
HS Algebra 2 College Pre-Calculus
0 = F1 = D2 = C3 = B4 = A
![Page 37: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/37.jpg)
Math Models High school
– Algebra I
– Geometry
– Algebra II
– Trigonometry
– Pre-Calculus
– Calculus I
– Calculus II
– Statistics
First course taken in college
– College-level courses in pathway
– Developmental courses in pathway
![Page 38: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/38.jpg)
![Page 39: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/39.jpg)
![Page 40: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/40.jpg)
![Page 41: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/41.jpg)
![Page 42: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/42.jpg)
English Models High school
– English 9
– English 10
– English 11
– English 12
– Expository Writing
– AP English Language
– AP English Literature
First course taken in college– First-year requirement
– First-year requirement prerequisites (college-level)
– Developmental courses
![Page 43: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/43.jpg)
![Page 44: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/44.jpg)
![Page 45: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/45.jpg)
Converging bodies of evidence from accelerated and corequisite developmental education
Two to five times transfer-level course completion– Especially when using alternative math pathways
Comparable or higher success rates Works across demographic groups & placement levels Tremendous equity implications
Corequisites:• http://bit.ly/2015ALP (Coleman, 2015)• http://alp-deved.org• http://bit.ly/CCACoreq• http://bit.ly/Kalamkarian2015 (Kalamkarian, Raufman, &
Edgecombe, 2015)• http://completecollege.org/wp-content/uploads/2016/07/Serving-
the-Equity-Imperative-Final.pdf• http://completecollege.org/wp-content/uploads/2016/01/TBR-
CoRequisite-Study-Update-Fall-2015-pages-2.pdf
Accelerated Developmental Education• http://bit.ly/RPCAP• http://bit.ly/CAPEval• http://bit.ly/RPAcceleration
![Page 46: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/46.jpg)
![Page 47: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/47.jpg)
Putting it all together:Multiple Measures and Corequisite Support
Mathematics at Cuyamaca College
Disjunctive placement (higher of test-based
placement or multiple measures based placement –
adapted from Phase 1 MMAP recommendations
– Algebra I with C or better plus HSGPA ≥ 2.8:
Statistics with corequisite support
– Algebra II with C or better and HSGPA ≥ 2.8:
College algebra or higher w/corequisite support
– Other MMAP placement recommendations for
higher placement without support
English at Skyline College Phased transition over three years
– Accelerated developmental education at one
level below
– Then MMAP implementation of English
placement recommendations and corequisite
developmental education courses
Adapted from MMAP Webinar: Implementing and Improving Your MMAP Process - Examples from Pilot Colleges, available at http://bit.ly/WebinarsMMAP
For more, please see recent publications by the California Acceleration Project:Leading the Way: http://bit.ly/CAPCuyamaca and Up to the Challenge: http://bit.ly/CAPChallenge
![Page 48: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/48.jpg)
Transfer level placement by year/method in Math at Cuyamaca
36%
9%
21%27% 24%
79%
49%
62% 62% 62%
90%
73%
85% 84% 84%
0%10%20%30%40%50%60%70%80%90%
100%
Asian AfricanAmerican
Hispanic White All
Fall 2015(Any transfer)Fall 2016(STEM ONLY)Fall 2016(STEM + Statistics)
![Page 49: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/49.jpg)
Gateway momentum in Math at Cuyamaca
4%
19%
36%
23%
56%
70%66% 67%
0%
10%
20%
30%
40%
50%
60%
70%
80%
Three+ LevelsBelow
Two LevelsBelow
One Level Below All
Completion of transfer-level math before and after change by assessment level
Fall 2013 Cohort(Transfer Math in 2 years)
Fall 2016 Cohort(Transfer math completion 1 semester w/support)
33%
6%
15% 16% 15%
75%
55%
65%
76%69%
0%
10%
20%
30%
40%
50%
60%
70%
80%
Asian AfricanAmerican
Hispanic White All
Completion of transfer-level math before and after change by ethnicity
Fall 2013 Cohort(Transfer Math in 2 years)
Fall 2016 Cohort(Transfer math completion 1 semester w/support)
![Page 50: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/50.jpg)
Gateway momentum in English at Skyline
47%40%
14%
80%
17%
3%0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
Transfer-Level One Level Below Two Levels Below
English placement by level and cohort
Fall 2013 Fall 2016
67% 65%69%
0%
10%
20%
30%
40%
50%
60%
70%
80%
Successful rate by cohort and course type
Fall 2013Transfer Level(f/Datamart)
F2015-S2017(traditional)
F2015-2017(w/support)
![Page 51: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/51.jpg)
Summary The evidence strongly suggests that:
we have been collectively underestimating students’ capacity
we should put far more trust in efforts of our students and educational colleagues
students, especially moderately successful HS students, should be allowed to progress normally as they transition between segments
fairer, holistic, and more accurate assessment combined with alternative approaches to providing support to students that actually need it hold tremendous promise for helping our students succeed
we need to remember Daedalus’ second instruction to Icarus as well
It’s just as important not to fly too low.
![Page 52: Let Icarus Fly - California State University · Let Icarus Fly Multiple Measures in Assessment and the Reimagination of Student Capacity. California State University Graduation Initiative](https://reader030.vdocuments.mx/reader030/viewer/2022040922/5e9c8cf6c6dc4b5661627a40/html5/thumbnails/52.jpg)
Thank you!John HettsEducational Results [email protected] cell
Alan ChanEducational Results [email protected](916) 498-8980
Craig HaywardRP [email protected]
The Fierce Urgency of Now “We are now faced with the fact that tomorrow is
today. We are confronted with the fierce urgency of
now. In this unfolding conundrum of life and history,
there "is" such a thing as being too late. This is no
time for apathy or complacency. This is a time for
vigorous and positive action.”
– Dr. Martin Luther King, Jr.
Contact Information