massachusetts department of elementary & secondary education 1 college and career readiness...

Massachusetts Department of Elementary & Secondary Education

1

College and Career Readiness Webinar Series:

College and Career Readiness

Data Tools

District and School Profiles


2

About the C&CR Webinar SeriesSeptember Sept 15, 2015 Edwin: EWIS and Post Secondary

Reportshttp://www.doe.mass.edu/conference/?ConferenceID=8169

October Oct 13, 2015 9th Grade Transition http://www.doe.mass.edu/conference/?ConferenceID=8170

November Nov 17, 2015 Labor Market Information http://www.doe.mass.edu/conference/?ConferenceID=8171

January Jan 12, 2016 Individual Learning Plans http://www.doe.mass.edu/conference/?ConferenceID=8172

February Feb 9, 2016 Graduation Rates http://www.doe.mass.edu/conference/?ConferenceID=8173

March March 8, 2016 Career Development Education http://www.doe.mass.edu/conference/?ConferenceID=8174

April April 13, 2016 Maximizing Graduation Coaches and Other Adult Advocates

http://www.doe.mass.edu/conference/?ConferenceID=8175

May May 10, 2016 Early College Pathways http://www.doe.mass.edu/conference/?ConferenceID=8176


















3

Welcome!

Please type your question or comment in the chat window at any point during the presentation

All phones will be muted PowerPoint slides will be sent to all registered

participants


4

Goals for the Session

Understanding of the nature of data

Introduction to college and career readiness data tools offered by ESE

“Information is a beacon, a cudgel, an olive branch, a deterrent--all depending on who wields it and how.” Steven Levitt


5

The Nature of things…

Qualitative data are everything that refers to the quality of something. For example, a description of experiences, observations and interviews are all qualitative data.

Quantitative data are data that refers to a number. The numbers of students, test scores, anything that can be added, multiplied, subtracted or divided.

Simply put, data is information that helps in our decision making.

http://schoolofdata.org/handbook/courses/appendix/glossary/

http://schoolofdata.org/handbook/courses/appendix/glossary/


6

What is the Cycle of Inquiry?


7

Making the Data Dance Data is a tool…

Data can help inform our decisions…

Behind the data are real human beings…

Use data to tell the story…

Data is our friend…


8

School Profiles: http://profiles.doe.mass.edu/Graduation rates, MCAS results, discipline data

Edwin Analytics: https://gateway.edu.state.ma.us/ Early Warning Indicator System (EWIS) reportsPostsecondary Readiness and Success reports

Success After High School DART:http://www.doe.mass.edu/apa/dart/SAHS.xlsx 5-year trend lines for individual high schools

Overviews of College & Career Readiness

related data tools

http://profiles.doe.mass.edu/

https://gateway.edu.state.ma.us/

http://www.doe.mass.edu/apa/dart/SAHS.xlsx


9

Profiles


10

First, a quick look at Profiles


Profiles are a great way to find basic information about schools and districts and also acts as an access point to a great deal of other publicly available data.



11

Edwin Analytics


12

What is Edwin Analytics? Goes beyond but includes reports previously available in the

Education Data Warehouse (EDW) A state-level platform that provides a more comprehensive view

of students, teachers, schools, districts and the state; Timely and actionable information that empowers educators and

informs better decision making at every level Tools and resources that will help educators improve teaching,

learning, school readiness and education outcomes

New reports are constantly being added


13

Out of the many reports in Edwin Analytics, today we are focusing on…

Identifying current students in grades 1-12 who may be at risk of missing key educational targets (Early Warning Indicator System (EWIS) reports)

Identifying how your former students did after they graduated from your school/district (Postsecondary Readiness and Success)


14

Early Warning Indicator System (EWIS)


15

What are Early Warning Indicators?

Methodological way of looking at students and their likelihood of meeting specific academic goals

Traditionally implemented at the high school level to help predict which students are most likely to drop out

Tool for educators to better design and target student interventions in a timely way


16

Grade Groupings & Goals

=Age Groups

Grade Level

s

Academic Goals (expected student outcomes

for each age group)

2013-14 Statewide Results for Goal

Early Elementary

Grades 1-3

Reading by the end of third grade: Reaching proficient or advanced on 3rd grade ELA MCAS

57%

Late Elementary

Grades 4-6

Middle school ready: Reaching proficient or advanced on 6th grade ELA and math MCAS

54%

Middle Grades

Grades 7-9

High school ready: Passing grades on all 9th grade courses

78%

High School

Grades 10-12

High school graduation: Meeting all local and state graduation requirements

85%

Use when setting school and district

goals!


17

EWIS Key Concepts Provides risk level information for all students

based on prior year data

The risk levels are not based on a student’s relative likelihood for reaching an academic goal when compared with other students

Individual indicators in the risk model are not reflective of the level of risk - taken together, the indicators (data points) collectively form a risk level

Only includes data from existing statewide collections (SIMS, SSDR and SCS) and state assessments (MCAS and ACCESS)


18

EWIS is / is not…

=

The Massachusetts EWIS is… The Massachusetts EWIS is not…

A tool to better target interventions and supports at the individual, small group, and whole school levels.

A “life sentence” or a reason to label students.

A systematic way to flag students that need to be further examined to determine what additional support are necessary.

A diagnostic tool that provides details on the exact reason(s) why a student is at risk for not meeting an expected academic goal.

Related to measures that are included in the state’s school and district accountability system (PPI), but is not itself an accountability measure.

An accountability measure.

Based on data and risk models that the Department will reexamine each year to continually improve the system.

A stagnant system that will remain exactly the same in future years.


19

Edwin Analytics: EWIS Reports

There are Five EWIS reports in Edwin: EWIS District View (EW301) EWIS Student List (EW601) EWIS Graphical View (EW302) EWIS Risk Level Indicator Analysis (EW317) EWIS Subgroup Analysis (EW318)

All can be filtered numerous way (e.g., selecting specific

schools, grade levels, student subgroups)


20

EW301: District Overview


21

School Name

Grade

Last Name

First Name

SASIDRisk Level

Attend Rate

Suspension

Retained

School

Move

Low Incom

e

SPED Level

Gender

Urban Reside

nce

Overage

Title1 Schoolwide

ACCESS for ELLs

ELA MCAS 2014

Math MCAS 2014

Math Course

Perf

ELA Course

Perf

Sci Course

Perf

SS Course

Perf

Non-Core

Course Perf

Previous

Year Risk Level

Race/Ethnic

ityELL

ELL Progra

m

Special

Education

Placement

Any High School

9 Aardvark

Arnold High 98% 0 No No Free None Female Yes No Yes 1.8 - - Pass Pass Pass Pass Pass N/A Hispanic or Latino

Y Enrolled in sheltered English immersion

Not a Special Education Student, age 6-21

Any High School

9 Bailey Billy High 90% 0 No No Free Moderate

Female Yes Yes Yes None Needs Improvement

Warning

Pass Pass Fail Fail Fail High White N N/A Full Inclusion special education services outside the general education classroom less than 21% of the time

Any High School

9 Colorado

Carlos High 88% 0 No No Reduced

None Female Yes No Yes 2.6 - - Pass Pass Pass Pass Pass N/A White Y Enrolled in sheltered English immersion

Not a Special Education Student, age 6-21

Any High School

9 Denton Daisy High 99% 0 No No Free None Male Yes Yes Yes None Proficient

Needs Improvement

Pass Pass Fail Pass Fail High Hispanic or Latino

N N/A Not a Special Education Student, age 6-21

Any High School

9 Everett Elena High 74% 0 No Yes Free None Female Yes No Yes None Needs Improvement

Warning

Pass Pass Pass Pass Fail High White N N/A Not a Special Education Student, age 6-21

EW601: The Student LevelStudent ID info Indicators in the risk model Student info


22

EW302: Graphical View


23

EWIS Risk Level Indicator Analysis (EW317)A tool to analyze specific attendance, behaviors, and course Early Warning Indicator System (EWIS) indicators for students in each risk level for a selected grade.

EWIS Subgroup Analysis (EW318)Provides educators with aggregate student risk levels of not achieving their next educational outcome as determined by the Early Warning Indicator System (EWIS) by student subgroups within a District

THE NEWEST EWIS TOOLS!


24

Insert EW 318 Screen shot


25

Insert EW317 Screen shot

Sample of larger amount of data


26

Postsecondary Outcome Reports


27

Postsecondary Outcomes of Public High School Students

Collecting and analyzing data about what college-bound students actually do after graduating high school helps district and school leaders assess the effectiveness of their programs in developing graduates who are college ready.

The data for these reports are drawn from existing ESE data sources such as SIMS, SCS and MCAS as well as College Board (for SAT) , the Mass. Dept. of Higher Education HEIRS system and the National Student Clearinghouse.


How did our students do after graduating?

The Three Basic Reports: Postsecondary Outcomes of Public HS Graduates:

All Institutions (CR301) Postsecondary Outcomes of Public HS Graduates:

MA Public Institutions Only (CR302)

Postsecondary Outcomes of Public HS Graduates:Academic Preparation (CR303)

28


Comparing the Three ReportsPotential Questions CR301 CR302 CR30

3

How many graduates go on to postsecondary? X X XWhat type of institutions (4-year/2-year, private/public) do graduates attend?

X X X

Which specific institutions did students attended? How many went to each?

X X

What are the enrollment rates of students who complete MassCore or AP coursework compared to those who don’t?

X X X

What are the persistence and degree obtainment rates of students who complete MassCore or AP coursework?

X

What is the postsecondary experience of students from a specific subgroup? (CVTE, ELL, SWD, high needs, etc)

X X X

What percentages of students enroll in and complete remedial courses?

X X

In what remedial subjects to do students enroll? XWhat are the MCAS scores of students who take remedial coursework in math and reading?

X X

How many credits, on average, do public high school graduates earn in their first year of college?

X X

29

Use when setting

school and district goals!


30

How many high school graduates enroll in postsecondary education?

… at MA public institutions?

On top: data from CR301; on bottom: data from CR302

Drill down to student level records


31

What Types of Institutions are Your Students Attending?


32

What does persistence look like across subgroups?

How many return for a 2nd year?


33

Where did students enroll? (Anywhere in the US)

This data from CR301See CR302 for MA Public Institutions Only


34

What are enrollment rates of students who complete AP or

MassCore?


35

Of those in MA public postsecondary,

what % enroll in remedial courses?

In which subjects?

Data from CR302


36

How many of your graduatesobtain a degree?


37

… and this is just the beginning of what we can do!

We could also explore… What is the relationship between

MCAS scores and the type of institution where students enroll? (4-year, 2-year, public, or private)

What is the postsecondary experience of students from a specific subgroup (CVTE, ELL, students with disabilities, high needs, etc)?


38

Several additional new Edwin Analytics reports may assist schools and districts in analyzing post-secondary data for program improvement.

CR304 Postsecondary Outcomes of Public HS Graduates View by MA Public Postsecondary Institution: Details postsecondary enrollment, achievement, and outcomes of MA public graduating students from a fall enrollment class in a specific MA public postsecondary institution. It also contains details by “feeder” MA public high schools. (Postsecondary data source: MA Department of Higher Education)

CR321 CVTE Graduate Pathway Summary: MA Public Postsecondary: Details postsecondary enrollment, outcomes, and continuation of vocational field of study for MA public school graduates who were CVTE concentrators and who enrolled in a MA public postsecondary institution. (Postsecondary data source: MA Department of Higher Education)

Additional Post-Secondary Reports

https://gateway.edu.state.ma.us/EdwinAnalytics/servlet/Gateway?cv.header=false&b_action=cognosViewer&ui.action=run&ui.object=/content/folder%5B@name='Edwin%20Analytics'%5D/folder%5B@name='K-12%20MA'%5D/report%5B@name='CR321'%5D&ui.name=CR321&run.outputFormat=&run.prompt=true




39

Two other reports are available on the Student tab for those who have been granted access to student-level data:

CR608 Student High School Academic Preparation and Postsecondary Experience: This source provides student-level high school academic experience, postsecondary enrollment, and outcomes for students graduating from MA public schools and enrolling in public or private postsecondary institutions.. (Postsecondary data source: National Student Clearinghouse)

CR601 Student Progress towards MassCore: While not specific to postsecondary education, this report displays a list of high school students and their progress towards completing the MassCore recommended program of study. It identifies students who are falling behind, enables drill-drown to investigate course completion for specific students, and is available for all students in grades 9-12.

Student Level Data


40

For more information… Watch the Edwin website for updates, including materials and professional

development opportunities: www.doe.mass.edu/Edwin

Follow Edwin on Twitter! @ Edwin_DESE

Questions can be submitted to: [email protected]

If you need access to Edwin Analytics – contact your district directory administrator (List is available at http://www.doe.mass.edu/infoservices/data/diradmin/list.aspx)

EWIS use workshop day: October 1: http://www.surveygizmo.com/s3/2307782/Early-Warning-Indicator-System-EWIS-Workshop-10-1-15

Early warning implementation guide available at http://www.doe.mass.edu/edwin/analytics/ewis.html

http://www.doe.mass.edu/Edwin

mailto:[email protected]

http://www.doe.mass.edu/infoservices/data/diradmin/list.aspx

http://www.surveygizmo.com/s3/2307782/Early-Warning-Indicator-System-EWIS-Workshop-10-1-15

http://www.surveygizmo.com/s3/2307782/Early-Warning-Indicator-System-EWIS-Workshop-10-1-15

http://www.doe.mass.edu/edwin/analytics/ewis.html


41

Success After High School DART Detail


The District Analysis and Review Tools (DARTs) turn the Department's vast amount of data into valuable, easily consumable information.

The DARTs offer snapshots of district and school performance, allowing users to easily track select data elements over time, and make sound, meaningful comparisons to the state or to "comparable" organizations.

DARTs are free and available to the public on the ESE website

What is the DART?

46


43

What is the Success After High School DART?

The Success After High School Dart is a DART: Detail tool DART: Detail tools provide in-depth data on targeted topic

areas The Department already released DART Detail’s: Staffing and

Finance and English Language Learners to go along with the more comprehensive DART tools

The intent of the Success After High School DART is to synthesize and summarize existing information available concerning secondary and post-secondary education in a freely, well-organized, accessible format for schools, districts, non-profit organizations, researchers, families and the general public.


44

Example elements for DART Detail: Success After High School

High School Indicators: Graduation, dropout, suspension, and retention rates.

High School Performance: Students scoring proficient on MCAS, students scoring on SAT and AP tests, and participation in SAT and AP tests.

Program of Study: Students completing MassCore and Advanced Placement coursework. Students passing all ninth grade courses, Students passing 12th grade mathematics and science technology/engineering coursework.

Use when setting



45

Example elements for DART Detail: Success After High School (continued)

Post-Secondary Educational Outcomes: Students enrolling in post-secondary education, students persisting in post-secondary education, percentage of students enrolling in developmental (remedial) coursework in Massachusetts Public Colleges.

Workforce Development: Students participating in career/technical education by cluster, Students completing work based learning plans and Connecting Activities, links to other regional workforce development data.

Use when setting



46

DART for Success After High School is a publicly accessibletool that provides a snapshot of high school,postsecondary, and career development education data.

This tool allows users such as district and school staff, parents, students, workforce partners and organizations to:

Find comparable high schools based on demographic characteristics

Look at trends over several years

View school data in charts that are easy to interpret

Evaluate and reflect on schools and their progress


47

Find comparable high schools based on demographic characteristics

School Overview

2012-13 Enrol lment

SchoolGradespan

MA Level 2013 WIB Region

Tota l#

High Needs

%

Low Income

%SWD

%ELL%

Brockton - Brockton HS* 09 - 12 Level 3 Brockton Area 4,081 79.2 75.7 10.6 17.2Everett - Everett High* 09 - 12 Level 3 Metro North 1,931 76.2 69.0 12.1 9.7Holyoke - Holyoke HS* 09 - 12 Level 3 Hampden County 1,354 77.4 74.9 14.3 10.9Lowell - Lowell HS* 09 - 12 Level 3 Greater Lowell 3,099 73.5 68.3 11.3 18.3Lynn - Classical High* 09 - 12 Level 1 North Shore 1,528 83.6 79.8 13.3 11.2Lynn - Lynn English High* 09 - 12 Level 3 North Shore 1,653 82.0 79.6 12.8 10.8Malden - Malden High* 09 - 12 Level 3 Metro North 1,847 67.4 59.1 12.7 12.5Quincy - North Quincy High* 09 - 12 Level 1 South Shore 1,222 59.0 51.0 12.7 9.9Quincy - Quincy High* 09 - 12 Level 2 South Shore 1,568 61.4 53.8 14.3 7.2Revere - Revere High* 09 - 12 Level 1 Metro North 1,537 75.5 71.0 10.7 7.5Worcester - Doherty Memorial HS* 09 - 12 Level 3 Central Mass 1,333 67.9 59.3 15.3 25.8

*Schools most similar to your district in terms of grade span, total enrollment, and special populations.Orange-shaded row: Your school Blue-shaded row: Highest performing of the other 10 schools.

Comparable schools

Malden - Malden High

Select comparable school

Select your school If desired, select a "comparable" school, no school or any other school.


48

Trend over several years with easy to interpret charts

4-year cohort graduation rate

Your School

Comparable school

State

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

2008 2009 2010 2011 2012


49

“The Waterfall”


50

And recently released!

2006 Cohort 5 Year Grad for 2006 Cohort

Enroll in college (immediate fall)

Persist 1st-to-second year*

Graduate PS within 6 years**

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% State AvgCambridgeNeedham


51

The Success After High School DART is available at http://www.doe.mass.edu/apa/dart/DARTSAHS.xlsx

It is openly accessible to anyone, however it is a large file due to all the data in the file, so…

a. it is best to download it to your computer andb. won’t go through most email systems

http://www.doe.mass.edu/apa/dart/DARTSAHS.xlsx


52

Questions or comments?

massachusetts department of elementary & secondary education 1 college and career readiness...

Documents

available data

data dancedata

nature of data introduction

quantitative dataare

ccr datawise college

post secondary reportshttp

real human beingsuse

early college pathwayshttp