national conference on acceleration - postsecondary research

44
National Conference on National Conference on Acceleration Acceleration Presentation by Presentation by Thomas Bailey, The Community College Research Center Thomas Bailey, The Community College Research Center Donna McKusick, The Community College of Baltimore Donna McKusick, The Community College of Baltimore County County June 24 th , 2010 Tremont Hotel, Baltimore

Upload: others

Post on 02-May-2022

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: National Conference on Acceleration - Postsecondary Research

National Conference on National Conference on Acceleration Acceleration

Presentation by Presentation by

Thomas Bailey, The Community College Research CenterThomas Bailey, The Community College Research Center

Donna McKusick, The Community College of Baltimore Donna McKusick, The Community College of Baltimore CountyCounty

June 24th, 2010 Tremont Hotel, Baltimore

Page 2: National Conference on Acceleration - Postsecondary Research

WelcomeWelcomeParticipants in the Discussion

College FacultyCollege Administrators Research Organizations

Advocacy GroupsPublic Policy Organizations

Page 3: National Conference on Acceleration - Postsecondary Research

A Framework: A Framework: Increasing college completionIncreasing college completion

◦ AACC/League: 50% more by 2020

◦ Gates: Double the percentage of students who earn a postsecondary degree by age 26

◦ MHEC: Increase by 20% the number of certificates and degrees by 2012

Page 4: National Conference on Acceleration - Postsecondary Research

Why is this so important? Why is this so important?

Annual Earnings

No high school diploma - $18, 734High school diploma - $27,915Associates degree- $38,200Bachelors degrees - $51,206Advanced degree -$74,602

Source: 2004 Census

Page 5: National Conference on Acceleration - Postsecondary Research

Another angle on Economic EquityAnother angle on Economic Equity

Page 6: National Conference on Acceleration - Postsecondary Research

The Developmental Education The Developmental Education ConnectionConnection

Nearly 60% of all community college students place in developmental education

And how do they do?

Page 7: National Conference on Acceleration - Postsecondary Research

A National Focus on A National Focus on Developmental Education Developmental Education

Began with AtD

Has resulted in increased research on outcomes

Cost of developmental education

Is developmental education broken?

Page 8: National Conference on Acceleration - Postsecondary Research

Referrals to Levels of Dev. Ed.

Math - Full Sample

3 levels below19%

2 levels below16%

1 level below24%

Not referred

41%

Reading - Full Sample3 levels below

3%2 levels below

7%

1 level below23%

Not referred

67%

Page 9: National Conference on Acceleration - Postsecondary Research

0.2

.4.6

.81

‐50 ‐25 0 25 50CPT Score Relative to Math Cutoff

OutcomeE[Y|Z=z]

Outcomes for remedial students

Outcomes for non -remedial students

Local treatment effect

00.1

0.2

0.3

0.4

0.5

‐50 ‐25 0 25 50Assessment Score Relative to Cutoff

StudentOutcome Outcomes for

college ready students

Local treatment effect

Outcomes for remedial students

Page 10: National Conference on Acceleration - Postsecondary Research

Completion of First College‐Level Course and Retention by CPT Score and Subject

0.2

.4.6

.81

‐50 ‐40 ‐30 ‐20 ‐10 0 10 20 30CPT Score Relative to Math Cutoff

Estimated Discontinuity (Math ITT Table 4) = ‐0.061(0.013)Outcome: Completion of First College‐Level Course

0.2

.4.6

.81

‐50 ‐40 ‐30 ‐20 ‐10 0 10 20 30CPT Score Relative to Math Cutoff

Estimated Discontinuity (Math ITT Table 4) = ‐0.021(0.011)Outcome: Fall‐to‐Fall Retention

0.2

.4.6

.81

‐50 ‐40 ‐30 ‐20 ‐10 0 10 20 30CPT Score Relative to Reading Cutoff

Estimated Discontinuity (Reading ITT Table 4) = ‐0.068(0.008)

0.2

.4.6

.81

‐50 ‐40 ‐30 ‐20 ‐10 0 10 20 30CPT Score Relative to Reading Cutoff

Estimated Discontinuity (Reading ITT Table 4) = ‐0.009(0.008)

Page 11: National Conference on Acceleration - Postsecondary Research

0.2

.4.6

-50 -40 -30 -20 -10 0 10 20 30CPT Score Relative to Math Cutoff

Estimated Discontinuity (Math ITT Table 5) = -0.019(0.008)Outcome: Transfer to SUS

0.2

.4.6

-50 -40 -30 -20 -10 0 10 20 30CPT Score Relative to Math Cutoff

Estimated Discontinuity (Math ITT Table 5) = -0.030(0.008)Outcome: Degree Completion

0.2

.4.6

-50 -40 -30 -20 -10 0 10 20 30CPT Score Relative to Reading Cutoff

Estimated Discontinuity (Reading ITT Table 5) = -0.019(0.004)

0.2

.4.6

-50 -40 -30 -20 -10 0 10 20 30CPT Score Relative to Reading Cutoff

Estimated Discontinuity (Reading ITT Table 5) = -0.029(0.004)

Transfer to State University System and Degree Completion by CPTScore and Subject

Page 12: National Conference on Acceleration - Postsecondary Research

Performance in First College‐level CourseOnce enrolled in gatekeeper, students who had skipped developmental 

education did about as well as those who took dev ed.

See Table 13. Excludes those with missing recommendations.

Page 13: National Conference on Acceleration - Postsecondary Research

What Does This Say About What Does This Say About Assessment?Assessment?

No obvious cutoff pointConfusion about what it means to be “college ready”Assessments are not good predictors of future success in collegeDo not provide enough diagnostic information?

Page 14: National Conference on Acceleration - Postsecondary Research

Implications for EffectivenessImplications for EffectivenessDev ed does not improve outcomes for students who score just below the cutoffSome students who skip dev ed do as well in college courses as those who don’t skipWe know little about the effectiveness of services for students far from the cutoff scores, but few complete the sequenceCurrent system neglects the academic needs of weaker “college level” students

Page 15: National Conference on Acceleration - Postsecondary Research

Achieving the Dream DatabaseAchieving the Dream Database

250,000 studentsAll first time (in the college) degree seeking students (full or part time)57 colleges in CT, FL, NC, NM, OH, PA, TX, VA, WANot representative of all CCs—similar to large, urban institutions with lower funding per student

Page 16: National Conference on Acceleration - Postsecondary Research

Not enrolled18%

3 levels below

Not Completed25%

Not enrolled16%

2 levels below

Not completed12%

Completed16%

Enroll

Pass

Referred to Lev. 3 46824

Not enrolled7%

1 level below

Enroll

PassNot completed

6%

Enroll

In‐Order Course Completion and Enrollment for Math Remediation

82%

57%

41%

29%

22%

Page 17: National Conference on Acceleration - Postsecondary Research

Not enrolled31%

3 levels below

Not completed13%

Not enrolled17%

2 levels below

Not completed4%

Completed22%

Enroll

Pass

Referred to Lev. 3

7987

Not enrolled10%

1 level below

Enroll

PassNot completed

4%

Enroll

In‐Order Course Completion and Enrollment for Reading Remediation

39%

56%

69%

35%

25%

Page 18: National Conference on Acceleration - Postsecondary Research

E3, no C3,exit

R=3

3

2

1

GK

Exit withoutever enrolling

C3, exit

C3, E2, no C2, exit

C3, C2,exit

C3, C2, E1,no C1, exit

C3, C2, C1, exit

C3, C2, C1E GK, exit

No E3, skip to 2

No E3, skip to 1

No E3, skip to GK

E2, no C2,skip to 1

E1, no C1,skip to GK

C2, skip to GK

E2, no C2, skip to GK

E3, no C3, E2

E3, no C3, E GK

E3, no C3, E1C3, skip to 1

C3, skip to GK

C GKNot enroll, skip

Enroll, then skip

Complete, then skip

Page 19: National Conference on Acceleration - Postsecondary Research

Enrollment and Progression Patterns Among Achieving the Dream Students

Math

42%

40%

38%

40%

42%

31%

18%

29%

16%

29%

44%

33%

0% 20% 40% 60% 80% 100%

3 levels below

2 levels below

1 level below

Total

Ref

erre

d to

Not Enrolled Not Passed Completed

Page 20: National Conference on Acceleration - Postsecondary Research

Enrollment and Progression Patterns Among Achieving the Dream Students

Reading

57%

42%

38%

41%

21%

21%

13%

16%

22%

36%

48%

44%

0% 20% 40% 60% 80% 100%

3 levels below

2 levels below

1 level below

Total

Ref

erre

d to

Not Enrolled Not Passed Completed

Page 21: National Conference on Acceleration - Postsecondary Research

Student Progression by Enrollment and Gatekeeper in Math 

Math - Full Sample

18%

26%

38%

28%

24%

13%

11%

42%

32%

18%

31%

5%

10%

17%

11%

2%

4%

6%

4%

8%

15%

21%

16%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

3 levels below

2 levels below

1 level below

Total

Ref

erre

d to

Never enrolled Not re-enrolled Not completed dev GK Not enrolled GK Not passed GK Passed

Page 22: National Conference on Acceleration - Postsecondary Research

Student Progression by Enrollment and Gatekeeper in Reading 

Reading - Full Sample

31%

28%

37%

35%

26%

15%

6%

21%

21%

13%

16%

7%

11%

13%

12%

3%

6%

9%

8%

12%

18%

28%

24%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

3 levels below

2 levels below

1 level below

Total

Ref

erre

d to

Never enrolled Not re-enrolled Not completed GK Not enrolled GK Not passed GK Passed

Page 23: National Conference on Acceleration - Postsecondary Research

Conclusions about SequencesConclusions about Sequences

Fewer than 50% complete their referred sequences in 3 yearsMany leave without failing coursesMany sequence completers do not enroll in gatekeeper coursesSuccess rates in college level courses of dev ed completers is misleadingly positive

Page 24: National Conference on Acceleration - Postsecondary Research

Accelerate RemediationAccelerate Remediation• Too many opportunities to leave• Improved diagnostic power of assessments will

allow more efficient interventions• Distinction between developmental and “college

ready” students is arbitrary and based on a dubious system of assessment and placement

• Combine college level and developmental instruction (help “college ready” students as well)—ALP

• Compressed schedules—CCD• Summer bridge programs—Texas and CUNY

Page 25: National Conference on Acceleration - Postsecondary Research

National Initiatives: National Initiatives: Developmental Education Initiative Developmental Education Initiative

◦ Funded by Gates and Lumina◦ 15 community colleges, all from Achieving the

Dream◦ http://www.deionline.org/about/

The aim of this project is to determine the mix of policy and practices—and the level of resources required—to generate large improvements in outcomes in a significant portion of the student body.

Page 26: National Conference on Acceleration - Postsecondary Research

National Initiatives: National Initiatives: Developmental Education Initiative Developmental Education Initiative

◦ Strategies

Page 27: National Conference on Acceleration - Postsecondary Research

National Initiatives: National Initiatives: Complete College America Complete College America ◦ http://www.completecollege.org/

◦ founded to focus solely on dramatically increasing the nation’s college completion rate through state policy change, and to build consensus for change among state leaders, higher education, and the national education policy community.

◦ “Targeting, Tailoring, Time.”

Page 28: National Conference on Acceleration - Postsecondary Research

National Initiatives: National Initiatives: Getting Past GoGetting Past Go

Part of The Education Commission of the States

http://www.ecs.org/html/docs/GettingPastGosummary.pdf

seeks to leverage developmental education at postsecondary institutions as a critical component of state efforts to increase college attainment rates

Page 29: National Conference on Acceleration - Postsecondary Research

Other PlayersOther PlayersCommunity College Research Center -Transforming Community Colleges to Accelerate Success for Low-Income Young Adults- Gates fundedMDRC– Learning Communities Demonstration ProjectNational Center for Post-Secondary Research – assessment and college readinessMDC- Achieving the DreamJobs for the Future- working with the Developmental Education Initiative

Page 30: National Conference on Acceleration - Postsecondary Research

Acceleration Acceleration ◦ A more direct, efficient, and effective

pathways to the credit course experience◦ Does not necessarily mean less instruction or

less time◦ A more intense experience◦ Focus on priorities◦ A more flexible approach for students who

are borderline developmental

Page 31: National Conference on Acceleration - Postsecondary Research

Contextualization Contextualization ◦ Content more directly related to the college

or training experience◦ An approach that encourages transfer◦ An approach that is meaningful and that

motivates the learner

Page 32: National Conference on Acceleration - Postsecondary Research

Personal Personal SupportSupport◦ Addresses the whole learner◦ Recognizes that the non-cognitive, affective

domain is critical for effective developmental education: motivation, executive functioning, self-efficacy◦ Recognizes the social dimension of learning◦ Is intrusive

Page 33: National Conference on Acceleration - Postsecondary Research

ModelsModels

Blended levelsSeven plus seven- sequential compressedMainstreamingLearning communitiesRestructured coursesAdjunct coursesCritical thinking courses

Page 34: National Conference on Acceleration - Postsecondary Research

What We All Need to UnderstandWhat We All Need to Understand

Nothing happens without correct placement

◦ Definition of college readiness◦ Multiple measures◦ Content validity and connection to

instruction◦ Predictive validity◦ Reliability

Page 35: National Conference on Acceleration - Postsecondary Research

What We All Need to UnderstandWhat We All Need to Understand

We must be careful with our placement policies

◦ Understand both the positive effects◦ Balance with the negative effects

Page 36: National Conference on Acceleration - Postsecondary Research

What We All Need to UnderstandWhat We All Need to Understand

The curriculum must be useful and meaningful

◦ We can’t afford to teach skills and strategies in isolation◦ The world knowledge deficit◦ A topsy-turvy curriculum?

Page 37: National Conference on Acceleration - Postsecondary Research

What We All Need to UnderstandWhat We All Need to Understand

Boutique models will not change the face of developmental education

◦ Simplicity◦ Scalability◦ Best options for the greatest number of

students

Page 38: National Conference on Acceleration - Postsecondary Research

What We All Need to UnderstandWhat We All Need to Understand

Pedagogy counts

◦ The most perfect model taught by the unskilled teacher will not work◦ Chickering’s seven principles◦ Global Skills for College Completion

Page 39: National Conference on Acceleration - Postsecondary Research

What We All Need to UnderstandWhat We All Need to Understand

Skills are only half of the game

◦ The roles of motivation, executive functioning, and self-efficacy are critical to success◦ Brain research

Page 40: National Conference on Acceleration - Postsecondary Research

What We All Need to UnderstandWhat We All Need to Understand

Passing developmental courses is not enough

◦ Students must pass sequences◦ Students must gateway courses◦ The role of retention

Page 41: National Conference on Acceleration - Postsecondary Research

There is no silver bullet for the There is no silver bullet for the majority of developmental studentsmajority of developmental students

Complexity of situationDifferentiated instruction

Page 42: National Conference on Acceleration - Postsecondary Research

What We All Need to UnderstandWhat We All Need to Understand

It is rocket science!

◦ Diverse studentsDemographics, skills, backgrounds

◦ Faculty have challengesTime and money to researchAdjunct faculty Respect

Page 43: National Conference on Acceleration - Postsecondary Research

What We All Need to UnderstandWhat We All Need to Understand

◦ All students begin hoping to finish

◦ Many students begin with a belief that something is wrong with themselves or wrong with the system

Page 44: National Conference on Acceleration - Postsecondary Research

What We All Need to UnderstandWhat We All Need to Understand

Institutions must work together to form solutions

If we don’t, others will find solutions for us