The Board of Governors The Board of Governors Motion on Assessment: An Motion on Assessment: An

UpdateUpdate

Mark Wade LieuMark Wade Lieu

Academic Senate forAcademic Senate for

California Community California Community CollegesColleges

Board MotionBoard MotionThe Chancellor is directed to begin the process of The Chancellor is directed to begin the process of

evaluating the implementation of a evaluating the implementation of a system-wide system-wide uniform, common assessmentuniform, common assessment with multiple with multiple measures measures of all community college studentsof all community college students in in consultation with the Community College League of consultation with the Community College League of California, Academic Senate and other community California, Academic Senate and other community college partners for consideration and adoption by college partners for consideration and adoption by the Board of Governors by not later than November the Board of Governors by not later than November 2007. This evaluation shall be in concert with the 2007. This evaluation shall be in concert with the System Strategic Plan and implementation process. System Strategic Plan and implementation process. In addition, and integral to the above, the In addition, and integral to the above, the Chancellor shall study policy strategies for Chancellor shall study policy strategies for consideration by the Board of Governors in the consideration by the Board of Governors in the following areas: non-barrier access, student success, following areas: non-barrier access, student success, early assessment, orientation, prerequisites, failure early assessment, orientation, prerequisites, failure to participate, funding, exemptions.to participate, funding, exemptions.

Consultation CouncilConsultation Council

Convened task force with wide Convened task force with wide representationrepresentation

Chaired by the Academic SenateChaired by the Academic SenateReviewed recent literatureReviewed recent literatureUsed available systemwide dataUsed available systemwide dataConducted survey to obtain Conducted survey to obtain

additional dataadditional data

Board of GovernorsBoard of Governors

Approved the recommendations of Approved the recommendations of the Task Force at its January 2008 the Task Force at its January 2008 meetingmeeting

Asked for an update on progress at Asked for an update on progress at its July 2008 meetingits July 2008 meeting

Provided no financial support to Provided no financial support to carry out the recommendationscarry out the recommendations

Mandatory AssessmentMandatory Assessment

Credit OnlyCredit Only

N=1,415,26N=1,415,2699

DirectedDirected ExemptedExempted Not Not ReceivedReceived

Placement Placement AssessmentAssessment

983,838983,838 431,431431,431

(30.5%)(30.5%)92,729 92,729 (9.4%)(9.4%)

OrientationOrientation 950,791950,791 464,478464,478

(32.8%)(32.8%)239,437 239,437 (25.1%)(25.1%)

CounselingCounseling 977,895977,895 437,374437,374

(30.9%)(30.9%)560,075560,075

(57.3%)(57.3%)

Credit OnlyCredit Only

N=1,415,26N=1,415,2699

DirectedDirected Exempted Exempted (not (not including including AA+)AA+)

Not Not ReceivedReceived

Placement Placement AssessmentAssessment

983,838983,838 216,248216,248

(15.3%)(15.3%)92,729 92,729 (9.4%)(9.4%)

OrientationOrientation 950,791950,791 249,295249,295

(17.6%)(17.6%)239,437 239,437 (25.1%)(25.1%)

CounselingCounseling 977,895977,895 222,191222,191

(15.7%)(15.7%)560,075560,075

(57.3%)(57.3%)

CostCost

Placement for Assessment: Placement for Assessment: $452,598$452,598

Counseling: between $1.6 Counseling: between $1.6 million and $112 millionmillion and $112 million

RecommendationRecommendation

The State should fully fund The State should fully fund mandatory matriculation mandatory matriculation services in order to allow services in order to allow colleges to implement exemption colleges to implement exemption policies based on maximizing policies based on maximizing student success rather than on student success rather than on financial limitations. financial limitations. Matriculation funding should Matriculation funding should receive annual COLA and growth receive annual COLA and growth funding. funding.

StatusStatus

Unlikely that anything will Unlikely that anything will happen with this in the near happen with this in the near future due to the dismal future due to the dismal budget forecast for the coming budget forecast for the coming yearsyears

Messaging to HSMessaging to HS

Previous Matriculation Previous Matriculation Assessment/Placement Task Assessment/Placement Task Force supported use of the EAPForce supported use of the EAP

Literature cites as an important Literature cites as an important strategystrategy

Assessment in HSAssessment in HS

MathMath English English WritingWriting

English English ReadingReading

ESLESL

% testing % testing in HSin HS

11.6211.62 12.1512.15 12.6012.60 5.355.35

% testing % testing at collegeat college

84.2184.21 84.9484.94 84.9284.92 93.6093.60

RecommendationRecommendation

The system should provide the The system should provide the resources to provide increased resources to provide increased opportunities for assessment opportunities for assessment testing in high schools along testing in high schools along with information to increase with information to increase awareness of college awareness of college expectations.expectations.

StatusStatus

Messaging efforts to high school Messaging efforts to high school students are being conducted by students are being conducted by the System, through the the System, through the Statewide Career Pathways Statewide Career Pathways project, through the Basic Skills project, through the Basic Skills Initiative, and through other state Initiative, and through other state efforts.efforts.

Foundations may be interested in Foundations may be interested in helping with this effort.helping with this effort.

Legislation being considered re: Legislation being considered re: EAPEAP

Assessment TestsAssessment Tests

MathematicsMathematics 42: MDTP42: MDTP 41: Accuplacer41: Accuplacer 19: COMPASS19: COMPASS

Assessment TestsAssessment Tests

English WritingEnglish Writing 37: Accuplacer37: Accuplacer 26: Writing Sample26: Writing Sample 22: COMPASS22: COMPASS 15: CTEP15: CTEP

Assessment TestsAssessment Tests

English ReadingEnglish Reading 46: Accuplacer46: Accuplacer 23: COMPASS23: COMPASS 16: CTEP16: CTEP

Assessment TestsAssessment Tests

ESLESL 47: CELSA47: CELSA 31: Writing Sample31: Writing Sample 22: COMPASS22: COMPASS 17: Accuplacer17: Accuplacer 14: Other homegrown test14: Other homegrown test

RecommendationRecommendation

Given the limited number of Given the limited number of commercial tests used in the commercial tests used in the system, a comparability table system, a comparability table should be developed for the should be developed for the test results from these tests. test results from these tests. This effort would facilitate the This effort would facilitate the intra-institutional use of intra-institutional use of student assessment testing student assessment testing data.data.

StatusStatus

Although appealing on a Although appealing on a superficial level, actually quite superficial level, actually quite complicated to achieve, complicated to achieve, especially without any especially without any resources.resources.

RecommendationRecommendation

The system should support the The system should support the efforts of the California efforts of the California Community College Community College Assessment Association to Assessment Association to develop an ESL assessment develop an ESL assessment test available for statewide test available for statewide use. use.

StatusStatus

The CCCAA has received funding The CCCAA has received funding from the System Office to from the System Office to examine the feasibility of the examine the feasibility of the project, and CCCAA is interested project, and CCCAA is interested in expanding the scope to include in expanding the scope to include English and mathematics as well. English and mathematics as well.

The CCCAA is also exploring The CCCAA is also exploring funding for the project with funding for the project with foundations.foundations.

Accepting ResultsAccepting Results

MathematicsMathematics Always: 24%Always: 24% Under certain conditions: Under certain conditions:

63.9%63.9% Never: 12%Never: 12%

Accepting ResultsAccepting Results

English WritingEnglish Writing Always: 10.1%Always: 10.1% Under certain conditions: Under certain conditions:

75.3%75.3% Never: 14.6%Never: 14.6%

Accepting ResultsAccepting Results

English ReadingEnglish Reading Always: 13.5%Always: 13.5% Under certain conditions: Under certain conditions:

72.9%72.9% Never: 13.5%Never: 13.5%

Accepting ResultsAccepting Results

ESLESL Always: 8.9%Always: 8.9% Under certain conditions: Under certain conditions:

50.5%50.5% Never: 40.6%Never: 40.6%

RecommendationRecommendation

A statewide system for the A statewide system for the sharing of assessment testing sharing of assessment testing data should be established. data should be established. This system would facilitate This system would facilitate the portability of assessment the portability of assessment testing data and the intra-testing data and the intra-institutional use of student institutional use of student assessment testing data.assessment testing data.

StatusStatus

There is nothing in place on There is nothing in place on which such an effort can which such an effort can piggyback at this time.piggyback at this time.

Common AssessmentCommon Assessment

Common Assessment Common Assessment Instrument(s)Instrument(s)

Common Cut ScoresCommon Cut ScoresCommon CurriculumCommon Curriculum

RecommendationRecommendation

The system should support a The system should support a pilot project which explores pilot project which explores how the course outcomes of how the course outcomes of Freshman Composition, the Freshman Composition, the course one level below course one level below Freshman Composition, and Freshman Composition, and the course one level above the course one level above Freshman Composition, align Freshman Composition, align across community colleges. across community colleges.

StatusStatus

In the process of contacting In the process of contacting English department faculty English department faculty concerning established SLOs. concerning established SLOs. 40+ colleges have responded 40+ colleges have responded to an email inquiry, and almost to an email inquiry, and almost 20 colleges have already 20 colleges have already submitted SLOs.submitted SLOs.

Have submitted proposal to Have submitted proposal to WestEd for content analysis.WestEd for content analysis.

RecommendationRecommendation

The Task Force should be continued, The Task Force should be continued, with support from the System Office with support from the System Office and the Board of Governors, in and the Board of Governors, in order to address further assessment order to address further assessment issues such as noncredit assessment issues such as noncredit assessment and placement, validation of and placement, validation of prerequisites, multiple measures. prerequisites, multiple measures. The Task Force should identify and The Task Force should identify and prioritize further research to prioritize further research to support future recommendations. support future recommendations.

Next StepsNext Steps

Pre-requisites is a related Pre-requisites is a related issue in that it imposes issue in that it imposes requirements for addressing requirements for addressing preparation. Given the preparation. Given the complexity of establishing pre-complexity of establishing pre-requisites, we would like to requisites, we would like to know the impact of advisories know the impact of advisories on student enrollment on student enrollment behavior.behavior.

Next StepsNext Steps

Research on student Research on student assessment and consequent assessment and consequent enrollment behavior – perhaps enrollment behavior – perhaps can be funded through outside can be funded through outside foundationfoundation

Investigate research that may Investigate research that may already be completed through already be completed through the ARCC or the Basic Skills the ARCC or the Basic Skills InitiativeInitiative

ConclusionConclusion

While assessment for While assessment for placement is an important part placement is an important part of guiding students into of guiding students into appropriate course work, it is appropriate course work, it is not the most important not the most important element to examine when we element to examine when we consider helping students to consider helping students to succeed.succeed.