setting a college-readiness cut score for the crmt

13
Setting a college- readiness cut score for the CRMT CRMT Working Group August 19, 2009 1:30-3:30 Pilot test summary Current MPT-I placement cut scores Group

Upload: prentice

Post on 19-Jan-2016

57 views

Category:

Documents


0 download

DESCRIPTION

Setting a college-readiness cut score for the CRMT. CRMT Working Group August 19, 2009 1:30-3:30. Pilot test summary Current MPT-I placement cut scores Group discussion. 2008-2009 CRMT Pilot Study. Purpose. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Setting a college-readiness cut score for the CRMT

Setting a college-readiness cut score for the CRMT

CRMT Working GroupAugust 19, 20091:30-3:30

Pilot test summary

Current MPT-I placement cut scores

Group discussion

Page 2: Setting a college-readiness cut score for the CRMT

Purpose

2008-2009 CRMT Pilot Study

To relate MPT test scores to subsequent course grades to assist in setting CRMT college readiness cut score

Research Questions

How does student performance on the MPT-G compare to performance on the MPT-I?

How well do student test scores predict student grades?

Page 3: Setting a college-readiness cut score for the CRMT

Method

2008-2009 CRMT Pilot Study

Students at four-year universities took the MPT-G (n = 557) or the MPT-I (n = 692) for placement into courses

Students at other campuses were offered the opportunity to use test scores for placement at four-year universities

Tests administered between October 2008 and June 2009

Edmonds CC (n = 89)

Spokane Falls CC (n = 137)

TESC (n = 34)

21 high schools (n = 2220)

Page 4: Setting a college-readiness cut score for the CRMT

Results

2008-2009 CRMT Pilot Study

Test Reliability

Both the MPT-G and MPT-I showed excellent internal consistency ( = .84 and .85, respectively)

Test Difficulty

The MPT-G was more difficult than the MPT-I (Mns = 18.4 and 20.4, respectively; percentage equivalents = 52.6% and 58.3%)

Page 5: Setting a college-readiness cut score for the CRMT

2008-2009 CRMT Pilot Study

Test Difficulty (continued)

The difference in test difficulty was observed for all three educational sectors, but was most pronounced at four-year institutions

Average total score by test type and institution type

Results

Page 6: Setting a college-readiness cut score for the CRMT

2008-2009 CRMT Pilot Study

Test Difficulty (continued)

Students enrolled or enrolling in college level courses scored 6 points higher than students taking courses below college level

Average total score by test type and course level

Results

Page 7: Setting a college-readiness cut score for the CRMT

2008-2009 CRMT Pilot Study

Course Grades

MPT-G and MPT-I scores were significantly correlated with subsequent math course grades both at high schools and four-year schools (r .4)

Results

Page 8: Setting a college-readiness cut score for the CRMT

2008-2009 CRMT Pilot Study

Course Grades (continued)

Students who passed their math course (grade 2.0) tended to have scored significantly higher on the MPT than did students who did not pass

Results

Average total score by course level and grade (four-year schools)

Page 9: Setting a college-readiness cut score for the CRMT

2008-2009 CRMT Pilot Study

Course Grades (continued)

The probability of passing a course generally increased with total test score

Results

Observed rates of success in non-precalculus/calculus college level courses as a function of total test score (four-year schools)

Page 10: Setting a college-readiness cut score for the CRMT

2008-2009 CRMT Pilot Study

Course Grades (continued)

The probability of passing a course generally increased with total test score

Results

Observed rates of success in non-precalculus/calculus college level courses as a function of total test score (four-year schools)

Page 11: Setting a college-readiness cut score for the CRMT

Conclusions

2008-2009 CRMT Pilot Study

Both tests show good discriminant validity in the superior performance of students taking college level math courses over those in pre-college level courses

Both tests show good predictive validity by the significant correlations between total test scores and mathematics course grades

Both the MPT-G and MPT-I show excellent reliability

Page 12: Setting a college-readiness cut score for the CRMT

Current Intermediate Math Placement Test (MPT-I) Placement Cutoffs (July 2009)Placement Cut Score Central Eastern UW-S Wash St Western

30 206202

Calculus for Arch.Business Calculus

25 118 Accel precalc

23 211200105

Elem teachers Finite mathPrecalculus

107 Elem functions

21 120 Precalculus

20 251201

Elem teachersFinite math

381156114

K-12 teachersAlg for businessPrecalculus

19 154 Precalculus 2

18 153 Precalculus 1

17 115 Liberal arts 111107

Business Liberal arts

240 Stats intro

15 114 Alg concepts 212210205

Stats introMath introStat’l thinking

112107101

Alg functionsMath reasoningElem teachers

12 104 Intermed alg

4 103 Alg intro

0 100.1 Algebra 100 Comb 103/104 98 Intermed alg 101 Elem alg review 10699

Quant reasoningAlg intro

Page 13: Setting a college-readiness cut score for the CRMT

Current Intermediate Math Placement Test (MPT-I) Placement Cutoffs (July 2009)Placement Cut Score Central Eastern UW-S Wash St Western

30 206202

Calculus for Arch.Business Calculus

25 118 Accel precalc

23 211200105

Elem teachers Finite mathPrecalculus

107 Elem functions

21 120 Precalculus

20 251201

Elem teachersFinite math

381156114

K-12 teachersAlg for businessPrecalculus

19 154 Precalculus 2

18 153 Precalculus 1

17 115 Liberal arts 111107

Business Liberal arts

240 Stats intro

15 114 Alg concepts 212210205

Stats introMath introStat’l thinking

112107101

Alg functionsMath reasoningElem teachers

12 104 Intermed alg

4 103 Alg intro

0 100.1 Algebra 100 Comb 103/104 98 Intermed alg 101 Elem alg review 10699

Quant reasoningAlg intro