Report to the Board of Higher Education | March 16, 2010

The Vision Project

The Vision Project seeks to: Articulate the most important contributions of public higher

education to the Commonwealth Engage all public campuses in achieving these contributions Hold public higher education accountable for a high level of

achievement in this work Generate greater appreciation of and support for public

higher education

In sum, the goal of the Vision Project is to demonstrate that public higher education can act in a unified and focused way to ensure the future well-being of the Commonwealth and that we are ready to hold ourselves accountable for results to the people of the state.

Goals

The Vision Project

State Context Weak public perceptions of importance/contributions of

public higher education

History of modest financial support for our public campuses

National Context Concern that US is losing ground in competitiveness Calls for more accountability; Opportunities for support

Responsibility of BHE to set overall directions for public higher education

Background: Why the Vision Project?

The Vision Project

Secretary’s Retreat: August 2009BHE Retreat: September 2009 Initial BHE Meeting Discussion:

October 2009

Purpose of Today’s Presentation

Background: History of Vision Project

The Vision Project

Progress Since OctoberRichard Freeland, Commissioner

The MetricsJonathan Keller, Associate Commissioner for Research, Planning, and Information Systems

Strategic DirectionsAundrea Kelley, Deputy Commissioner for P-16 Policy and Collaborative InitiativesFrancesca Purcell, Associate Commissioner for Academic and P-16 PolicyDavid McCauley, Deputy Commissioner for Workforce Development Patricia Crosson, Senior Policy Advisor

Institutional PerspectivesJohn Sbrega, on behalf of Community CollegesRichard Gurnon, on behalf of State CollegesMarcellette Williams, on behalf of University of Massachusetts

Wrap-up and Next StepsRichard Freeland, Commissioner

Structure of Presentation

The Vision Project

Work with college presidents to shape/refine project

Forging a partnership with UMass

Outreach to other stakeholders Campus leaders: Faculty union leaders, institutional

research professionals Government leaders: Executive branch, Legislature, U.S. DOE Civic leaders: Massachusetts Business Alliance for Education,

Boston Chamber, MassINC Private higher education: AICUM

Organizing DHE to support project

Fundraising activities

Activities Since October 2009

The Vision Project

*****

We will produce the best-educated citizenry and workforce in the nation.

We will be a national leader in research

that drives economic development.

*****

The Vision

The Vision Project

National Leadership in Education College-going rates of high school graduates Graduation and student success rates Alignment of degree production with key areas of

workforce need Academic achievements on campus-level and national

assessments of learning

Comparable learning outcomes among different ethnic/racial, economic and gender groups

National Leadership in Research Level of research expenditures Level of licensing income

Key Outcomes

The Vision Project

MetricsAnnual report to the Commonwealth

Other Elements of Vision Project

Jonathan Keller

The Vision Project: Outcome #1 Metrics

Percent of 18- to 24-year-olds enrolled in college by race, with multi-state comparisons▪ Source: National Center for Higher Education Management

Systems Ratio of MA residents attending college out of state to

non-residents attending college in MA (“net migration”), with multi-state comparisons ▪ Source: Integrated Postsecondary Data System

College enrollment of MA public high school graduates by race, gender, income level, in state/out-of-state and public/private college ▪ Source: MA Department of Elementary and Secondary Education

College-level assessment scores of recent high school graduates enrolling in public higher education ▪ Source: DHE

College-Going Rates of HS Graduates

The Vision Project: Outcome #2 Metrics

State Colleges/University▪ Six-year state college/university graduation rates from initial

institution by race and gender, with multi-state comparisons ▪ Source: Integrated Postsecondary Data System

▪ Six-year state college/university graduation rates from any institution in the system, state or anywhere in the United States ▪ Source: DHE

Community Colleges▪ Current national standard measure of 150% time completion rates for

degrees/certificates for community colleges by race and gender, with multi-state comparisons ▪ Source: Integrated Postsecondary Data System

▪ More inclusive “student success” rates using “Maryland Model” and “Achieving the Dream”, both of which include transfer and “still-enrolled” data, with some multi-state comparisons

▪ Source: DHE and Jobs for the Future

Graduation and Student Success Rates

14

The Vision Project: Outcome #3 MetricsProduction of Graduates in Key Areas of Workforce Need

Number/share of degrees produced in business, education, health, STEM and other key occupational areas with national comparisons▪ Source: IPEDS, Donahue Institute

Number/share of degrees conferred in key occupational areas compared to forecasted growth in Massachusetts ▪ Source: IPEDS/ Commonwealth Corporation

Student persistence and degree completion in business, education, health and STEM fields, by race and gender ▪ Source: DHE

Number and percent of graduates employed, and/or continuing their educations in Massachusetts▪ Source: A system-wide measure is not currently available, but the

DHE is endeavoring to collaborate with the Department of Revenue to merge relevant data in fulfillment of this important indicator.

15

The Vision Project: Outcome #4 MetricsAcademic Achievements on Assessments of Learning

Pass rates on a broad range of professional licensure tests, i.e., MTEL, CPA, NCLEX and other allied health licensures, with multi-state comparisons ▪ Source: Appropriate licensure and testing agencies

Pass rates on a broad range of graduate school entrance examinations, i.e., GRE, MAT, MCAT and LSAT, with multi-state comparisons ▪ Source: Appropriate licensure and testing agencies

A working group on student learning outcomes and assessments is examining potential assessments of student learning that allow for comparability with peers in other states. Where possible, assessment results will be presented by race, gender and major.

Aundrea Kelley, Francesca Purcell, David McCauley, Patricia Crosson

The Vision Project: Strategic Directions

Goal: College Participation Increase the proportion of recent high school graduates

enrolling in college with comparable rates among different groups

Current Status Determination of metrics

Future Activity Review data with study group Prioritize issues that emerge from data analysis Recommend strategies to address priorities Share best practices

College-Going Rates of HS Graduates

The Vision Project: Strategic Directions

Goal: College Readiness Increase the proportion of students who begin college

coursework without the need for remediation and with comparable rates among different groups

Current Status Cross-agency workgroup; priority recommendations

Future Activity Revive school-to-college data reporting Refine and communicate college readiness definition and

agenda Advance school to college curricular alignment Incentivize rigorous course taking in high school Expand early college opportunities

College-Going Rates of HS Graduates

The Vision Project: Strategic Directions

Goal More students graduating more efficiently while also closing

attainment gaps for traditionally underserved populations, without compromising academic standards.

Current Status Campus efforts Statewide policy and practices

Future Activity Support effective campus and statewide work Reform existing or identify new state-level policies and practices Review annual graduation and student success goals Leverage participation in national initiatives for direction and

support

Graduation and Student Success Rates

20

The Vision Project: Strategic DirectionsProduction of Graduates in Key Areas of Workforce Need

Goal Increase production of graduates in high-demand fields such

as STEM and allied health

Current Status Expand higher education/employer statewide partnerships in

STEM and health that incorporate best practices and national trends

Promote higher education and workforce/economic development regional collaborations

Engage with state agencies and workforce/employer stakeholders to align policies, resources and data

Develop “shared risk” approaches for workforce partnerships

21

The Vision Project: Strategic DirectionsProduction of Graduates in Key Areas of Workforce Need

Future Activity Form a state-level permanent structure of higher

education/employer/ government stakeholders to clarify core, stable workforce needs

Identify number and fields of degrees needed to meet historical and projected shortages

Implement tested, scaled-up strategies to increase the participation of minority and under-represented groups in high-growth professions

22

The Vision Project: Strategic DirectionsAcademic Achievements on Assessments of Learning

Goal: Work with campuses to: Support strong campus-based, faculty-led programs of learning

outcomes assessment that result in program improvement Review, modify, or reaffirm DHE policies and practices that ensure

the continued excellence of campus programs and effective accreditation relationships with NEASC

Examine approaches that result in comparable learning achievements among students of different race/ethnicity, gender, and socio-economic status

Identify and implement metrics that allow colleges and the DHE to compare student learning, by segment, with peer institutions and other states

Identify and implement metrics that allow for public accountability

23

The Vision Project: Strategic DirectionsAcademic Achievements on Assessments of Learning

Current Status Two metrics identified:▪ Pass rates on a broad range of professional licensure tests▪ Pass rates on a broad range of graduate school entrance

examinations The challenges of evidence-based learning assessment in

higher education:▪ Lack of agreement about best measures▪ No “one size fits all” solutions▪ Tension between assessment for improvement and assessment

for accountability▪ Early stage of national effort to build comparability across

campuses, states and nations▪ Different approaches to public accountability

24

The Vision Project: Strategic DirectionsAcademic Achievements on Assessments of Learning

Current Status Working Group on Student Learning Outcomes and

Assessment ▪ Phase 1: Focus on campus-based programs▪ Review literature and national best practice on learning

outcomes, assessment measures, organizational arrangements▪ Survey and review of campus programs▪ Review of CAGUE Report and President’s Comments on CAGUE▪ Report to Commissioner by end of May 2010

▪ Phase 2: Focus on state-level policy and practices▪ Review literature and best practice for state system activity▪ Review assessment approaches and metrics that allow for

comparability and public accountability▪ Report to Commissioner by end of December 2010

25

The Vision Project: Strategic DirectionsAcademic Achievements on Assessments of Learning

Future Activity Will be planned as result of reports from Working Group

on Student Learning Outcomes and Assessment but will probably include:▪ Ongoing mechanisms for DHE/campus/NEASC collaborations▪ Ongoing implementation activities including efforts to find

financial support for best practice initiatives

John Sbrega, Richard Gurnon, Marcellette Williams