where does it hurt redux? using coordinating board data to identify and improve real retention...

25
Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community College District Arlington, Texas February 22 - 25, 2005 27th Annual Conference of the Texas Association for Institutional Research

Upload: sabrina-mason

Post on 27-Dec-2015

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Where Does It Hurt Redux?Using Coordinating Board Data to Identify and Improve Real Retention Problems

Thomas K. Martin, Ph.D.Collin County Community College District

Arlington, Texas

February 22 - 25, 2005

27th Annual Conference of the

Texas Association for Institutional Research

Page 2: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Student Retention Defined• “Retention” has many meanings: e.g., persistence to

degree/certificate attainment, persistence to educational goal attainment, persistence from term-to-term, course completion, etc.

• For purposes of this presentation, “retention” is discussed within the context of course completion and refers to students who were enrolled in courses on a given term’s census date and who were still enrolled on the last day of the term.

• Operationally, “retention rate” refers to the proportion of student contact hours enrolled at the end of a given term relative to the number enrolled on the term’s census date as reported on the CBM-004 and the CBM-006.

Page 3: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Conceptual Model of Course Completion

Course Completion

Examples of InputsCollege Readiness (+)

Commitment (+)Time Conflicts (-)

Quality of Instruction (+)Educational Goals (+/-)

Examples of OutputsProgram Completion (+)

Baccalaureate Attainment (+)Successful Employment (+)

Time to Completion (-)Student Satisfaction (+)

1

2

3

n

Inputs

1

2

3

n

Outputs

Page 4: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Coordinating BoardRetention Data

atCollin County

Community College District

Page 5: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

THECBRaw Course Completion Data

Page 6: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

SPSS Syntax File

Page 7: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Fall 2000-2003CCCCD-TexasComparison

Page 8: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Soooooo What?

Now that I’ve done all this work, what good does it do?

Page 9: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

CCCCDFive-Year Program

and Service Evaluation

Page 10: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Task Force Position Name

Task Force Chair Chris Morgan

Department Chair Casey McClure

Full-Time Faculty Brian Allison

Full-Time Faculty Sabine Madriguera

Part-Time Faculty Kimberly Harris

Internal-Review Task Force: Music

Page 11: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Task Force Position Name

Chair Tony Airhart (PE Professor)

Full-Time Faculty Lynn Jones (Political Science)

Full-Time Faculty Scott Yarbrough (English)

Part-Time Faculty Debi Henderson (Marketing)

Staff Member J’Anna Mann (Division Secretary, Math & Natural Sciences)

Recent orCurrent Student

Vanessa Testoni

Community Member Dana Keith

Interim Dean(ex-officio)

Gaye Cooksey

External-Review Task Force: Computer Science

Page 12: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Table of Contents

EXECUTIVE SUMMARY . . . . . . . . . . . . . . . . . . . . . . . . 4EVALUATION SECTIONS. . . . . . . . . . . . . . . . . . . . . . . 5A. Strategic Plan . . . . . . . . . . . . . . . . . . . . . . . . . .5B. Enrollment . . . . . . . . . . . . . . . . . . . . . . . . . . . 11C. Curriculum . . . . . . . . . . . . . . . . . . . . . . . . . . . 19D. Faculty. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27E. Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . 31F. Student Outcomes . . . . . . . . . . . . . . . . . . . . . 35G. Assessment Activity . . . . . . . . . . . . . . . . . . . . 46STRENGTHS AND WEAKNESSES . . . . . . . . . . . . . . . 56RECOMMENDATIONS AND SUGGESTIONS . . . . . . . 56OPEN MEETING . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

Page 13: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Comparison of Music Contact Hour Completion Rates to Statewide Rates by CIP Code

CIP Code

Fall 2000 Completion Rates (%)

Fall 2001 Completion Rates (%)

Fall 2002 Completion Rates (%)

Three-Year Average

State CCCCD

State CCCCD State CCCCD

State CCCCD

50.0902 82% 77% 84% 78% 85% 79% 84% 78%

50.0903 87% 88% 89% 88% 90% 88% 89% 88%

50.0904 78% 72% 82% 72% 82% 83% 81% 76%

50.0905 88% 83% 83% 76% 83% 86% 85% 82%

50.0906 na na na na 82% 82% 82% 82%

50.0907 73% 51% 75% 83% 73% 66% 74% 67%

50.0908 78% 79% 85% 88% 82% 94% 82% 87%

50.0909 87% 86% 89% 89% 87% 92% 88% 89%

Page 14: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Analysis of Contact Hour Completion Rates: The Good News

• 500903 (Music - General Performance); 500905 (Musicology & Ethnomusicology); and 500909 (Music Business Management & Merchandising): State and CCCCD averages are similar and are considered consistent.

• 500906 (Music Conducting): CCCCD offers one conducting course each year and it has only met once since the data were recorded. Therefore, the sample is small. Still, the statewide and CCCCD averages are very close and considered consistent.

• 500908 (Music - Voice & Choral/Opera Performance): CCCCD rates are higher than the state average, and are considered acceptable by the department. Some difference in the statewide and CCCCD rates may be due to the size of CCCCD’s choral program and which may attract more serious students than other institutions.

Page 15: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Analysis of Contact Hour Completion Rates: The Bad News

• 500902 (Music History & Literature): Over the past three years, completion rates at CCCCD are below the state average despite CCCCD’s trend of increasing course completion rates. The statewide completion rate in this CIP is also increasing, possibly at a faster rate than CCCCD’s.

• 500904 (Music Theory & Composition): In music theory and composition, CCCCD completion rates are lower. This may be due to the fact that many music students at CCCCD were not accepted into four-year institutions to pursue their music studies. Since there is no entrance requirement for students wishing to pursue music studies at CCCCD it might be that some were not ready for college-level music theory and composition study.

• 500907 (Music - Piano & Organ Performance): CCCCD enrollment is small and volatile. Consequently, completion rates have varied both below and above the state averages.

Page 16: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Weaknesses• The most glaring weakness of the Department of Music is in

allocation of resources and facilities. As the Department has experienced growth in enrollment and quality the resources available to the Department as well as classroom space, practice studios, equipment and performance space has not been sufficient to sustain the expanding enrollment.

• Music Faculty commonly teach courses that are one hour credit courses but require the same amount of preparation and participation as three hour courses. The Music Department faculty is not compensated for these “labs” at the same level as lecture courses. Therefore faculty must teach more contact hours to satisfy teaching load requirements. This is different from other institutions as well as other departments within CCCC. This adds unequal time required of the Music Faculty in relation to their class loads.

• The Music Department lack the support personnel for marketing and promotion of events and qualified lab supervision.

Page 17: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Recommendations• CCCCD upgraded and allocated facilities for other Fine Arts

programs such as Theater and Art. It, therefore, it becomes necessary to do the same for the Music Department. A plan for additional classroom, practice rooms, storage space, labs and performance space for the Music Department needs to be developed with a time line for completion.

• The Music Department should review how other departments compensate faculty that teach one hour courses and adopt a method that is consistent with other departments and institutions. Music faculty require more time outside of class for rehearsals and performances as well as individual instruction. A smaller class load will enhance the quality of instructional time.

• Budget resources should be allocated to provide personnel for the marketing and promotion of the Music Department or duties within the Fine Arts Division reassigned to aid the faculty with this area of need. Brochures, flyers, tickets and publicity should be available for each function of the department. Qualified lab assistants should be provided for lab activities. Students are not qualified to answer questions or provide direction that is needed in the labs.

Page 18: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Comparison of Real Estate Contact Hour Completion Rates to Statewide Rates by CIP Code

CIP Code

Fall 2000 Completion Rates (%)

Fall 2001 Completion Rates (%)

Fall 2002 Completion Rates (%)

Three-Year Average

State CCCCD

State CCCCD State CCCCD

State CCCCD

52.1501 86% 93% 86% 96% 82% 94% 85% 94%

Page 19: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Analysis of Contact Hour Completion Rates

• The completion rate far exceeds the state average.

Page 20: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Weaknesses

• None. This program has no significant weaknesses.

Page 21: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Strengths

• The faculty is outstanding, both full-time and part-time.

• There has been outstanding program success. This shows up in measuring student enrollment growth; in student success on the state exams and in acquiring employment; student completion rates; student retention; and student satisfaction.

• Exceptional flexibility in scheduling of courses and in the variety of course offerings.

Page 22: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Recommendations

• None.

Page 23: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

Back toSoooooo What?Never ask a question you don’t

want to hear the answer to!

Page 24: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

. . . but,

. . . if you don’t start moving,

you’ll never get anywhere.

Page 25: Where Does It Hurt Redux? Using Coordinating Board Data to Identify and Improve Real Retention Problems Thomas K. Martin, Ph.D. Collin County Community

For Questions, Follow-Up, or Copies of any Data Files, SPSS

Syntax Files, SPSS System Files, or Summary Data . . .

. . . contactTom Martin

[email protected]