Massachusetts Department of Elementary & Secondary Education 1 College and Career Readiness Webinar Series: College and Career Readiness Data Tools District.

Download Massachusetts Department of Elementary & Secondary Education 1 College and Career Readiness Webinar Series: College and Career Readiness Data Tools District.

Post on 16-Jan-2016

214 views

Category:

Documents

0 download

TRANSCRIPT

Tools to be CCR Data-Wise

College and Career Readiness Webinar Series:

College and Career Readiness Data Tools

District and School Profiles

#Massachusetts Department of Elementary & Secondary Education About the C&CR Webinar SeriesSeptemberSept 15, 2015Edwin: EWIS and Post Secondary Reportshttp://www.doe.mass.edu/conference/?ConferenceID=8169OctoberOct 13, 20159th Grade Transitionhttp://www.doe.mass.edu/conference/?ConferenceID=8170NovemberNov 17, 2015Labor Market Informationhttp://www.doe.mass.edu/conference/?ConferenceID=8171JanuaryJan 12, 2016Individual Learning Planshttp://www.doe.mass.edu/conference/?ConferenceID=8172FebruaryFeb 9, 2016Graduation Rateshttp://www.doe.mass.edu/conference/?ConferenceID=8173MarchMarch 8, 2016Career Development Educationhttp://www.doe.mass.edu/conference/?ConferenceID=8174AprilApril 13, 2016Maximizing Graduation Coaches and Other Adult Advocateshttp://www.doe.mass.edu/conference/?ConferenceID=8175MayMay 10, 2016Early College Pathwayshttp://www.doe.mass.edu/conference/?ConferenceID=8176#Massachusetts Department of Elementary & Secondary Education Welcome!Please type your question or comment in the chat window at any point during the presentationAll phones will be mutedPowerPoint slides will be sent to all registered participants

#Massachusetts Department of Elementary & Secondary Education Goals for the SessionUnderstanding of the nature of data

Introduction to college and career readiness data tools offered by ESE

Information is a beacon, a cudgel, an olive branch, a deterrent--all depending on who wields it and how. Steven Levitt#Massachusetts Department of Elementary & Secondary Education 5The Nature of things Qualitative dataare everything that refers to the quality of something. For example, a description of experiences, observations and interviews are all qualitative data.

Quantitative dataare data that refers to a number. The numbers of students, test scores, anything that can be added, multiplied, subtracted or divided.

Simply put, data is information that helps in our decision making.Massachusetts Department of Elementary & Secondary Education 6

What is the Cycle of Inquiry?Massachusetts Department of Elementary & Secondary Education Making the Data DanceData is a toolData can help inform our decisionsBehind the data are real human beingsUse data to tell the storyData is our friend

#Massachusetts Department of Elementary & Secondary Education School Profiles: http://profiles.doe.mass.edu/Graduation rates, MCAS results, discipline data

Edwin Analytics: https://gateway.edu.state.ma.us/ Early Warning Indicator System (EWIS) reportsPostsecondary Readiness and Success reports

Success After High School DART:http://www.doe.mass.edu/apa/dart/SAHS.xlsx 5-year trend lines for individual high schools

Overviews of College & Career Readiness related data tools#Massachusetts Department of Elementary & Secondary Education Profiles9

Massachusetts Department of Elementary & Secondary Education 9First, a quick look at Profiles10http://profiles.doe.mass.edu/

Profiles are a great way to find basic information about schools and districts and also acts as an access point to a great deal of other publicly available data.Massachusetts Department of Elementary & Secondary Education Edwin Analytics11

Massachusetts Department of Elementary & Secondary Education 11What is Edwin Analytics?Goes beyond but includes reports previously available in the Education Data Warehouse (EDW)A state-level platform that provides a more comprehensive view of students, teachers, schools, districts and the state;Timely and actionable information that empowers educators and informs better decision making at every levelTools and resources that will help educators improve teaching, learning, school readiness and education outcomesNew reports are constantly being added

#Massachusetts Department of Elementary & Secondary Education Out of the many reports in Edwin Analytics, today we are focusing onIdentifying current students in grades 1-12 who may be at risk of missing key educational targets (Early Warning Indicator System (EWIS) reports)

Identifying how your former students did after they graduated from your school/district (Postsecondary Readiness and Success)

#Massachusetts Department of Elementary & Secondary Education Early Warning Indicator System (EWIS)14Massachusetts Department of Elementary & Secondary Education 14What are Early Warning Indicators?Methodological way of looking at students and their likelihood of meeting specific academic goals Traditionally implemented at the high school level to help predict which students are most likely to drop outTool for educators to better design and target student interventions in a timely way

#Massachusetts Department of Elementary & Secondary Education Grade Groupings & Goals=

Age GroupsGrade Levels Academic Goals (expected student outcomes for each age group)2013-14 Statewide Results for GoalEarly ElementaryGrades 1-3Reading by the end of third grade: Reaching proficient or advanced on 3rd grade ELA MCAS57%Late ElementaryGrades 4-6Middle school ready: Reaching proficient or advanced on 6th grade ELA and math MCAS54%Middle GradesGrades 7-9High school ready: Passing grades on all 9th grade courses78%High SchoolGrades 10-12High school graduation: Meeting all local and state graduation requirements85%Use when setting school and district goals!#Massachusetts Department of Elementary & Secondary Education Districts shared that the EWII data were helpful, but also requested indicator data at earlier grade levels and throughout high school

Conducted an extensive literature review of the research on indicators for early warning systemsIdentified and tested possible indicators for the risk models based on those recognized in the research and data that are collected and available from the Departments data systemTested the indicators and risk models on previous school years

16EWIS Key ConceptsProvides risk level information for all students based on prior year dataThe risk levels are not based on a students relative likelihood for reaching an academic goal when compared with other studentsIndividual indicators in the risk model are not reflective of the level of risk - taken together, the indicators (data points) collectively form a risk level Only includes data from existing statewide collections (SIMS, SSDR and SCS) and state assessments (MCAS and ACCESS)

#Massachusetts Department of Elementary & Secondary Education 17EWIS is / is not=

The Massachusetts EWIS isThe Massachusetts EWIS is notA tool to better target interventions and supports at the individual, small group, and whole school levels. A life sentence or a reason to label students.A systematic way to flag students that need to be further examined to determine what additional support are necessary.A diagnostic tool that provides details on the exact reason(s) why a student is at risk for not meeting an expected academic goal. Related to measures that are included in the states school and district accountability system (PPI), but is not itself an accountability measure. An accountability measure.Based on data and risk models that the Department will reexamine each year to continually improve the system.A stagnant system that will remain exactly the same in future years. #Massachusetts Department of Elementary & Secondary Education Districts shared that the EWII data were helpful, but also requested indicator data at earlier grade levels and throughout high school

Conducted an extensive literature review of the research on indicators for early warning systemsIdentified and tested possible indicators for the risk models based on those recognized in the research and data that are collected and available from the Departments data systemTested the indicators and risk models on previous school years

18Edwin Analytics: EWIS ReportsThere are Five EWIS reports in Edwin:EWIS District View (EW301)EWIS Student List (EW601)EWIS Graphical View (EW302)EWIS Risk Level Indicator Analysis (EW317)EWIS Subgroup Analysis (EW318)

All can be filtered numerous way (e.g., selecting specific schools, grade levels, student subgroups)

#Massachusetts Department of Elementary & Secondary Education 20

EW301: District OverviewMassachusetts Department of Elementary & Secondary Education 21School NameGradeLast NameFirst NameSASIDRisk LevelAttend RateSuspensionRetainedSchool MoveLow IncomeSPED LevelGenderUrban ResidenceOverageTitle1 SchoolwideACCESS for ELLsELA MCAS 2014Math MCAS 2014Math Course PerfELA Course PerfSci Course PerfSS Course PerfNon-Core Course PerfPrevious Year Risk LevelRace/EthnicityELLELL ProgramSpecial Education PlacementAny High School9AardvarkArnoldHigh98%0NoNoFreeNoneFemaleYesNoYes1.8--PassPassPassPassPassN/AHispanic or LatinoYEnrolled in sheltered English immersionNot a Special Education Student, age 6-21Any High School9BaileyBillyHigh90%0NoNoFreeModerateFemaleYesYesYesNoneNeeds ImprovementWarningPassPassFailFailFailHighWhiteNN/AFull Inclusion special education services outside the general education classroom less than 21% of the timeAny High School9ColoradoCarlosHigh88%0NoNoReducedNoneFemaleYesNoYes2.6--PassPassPassPassPassN/AWhiteYEnrolled in sheltered English immersionNot a Special Education Student, age 6-21Any High School9DentonDaisyHigh99%0NoNoFreeNoneMaleYesYesYesNoneProficientNeeds ImprovementPassPassFailPassFailHighHispanic or LatinoNN/ANot a Special Education Student, age 6-21Any High School9EverettElenaHigh74%0NoYesFreeNoneFemaleYesNoYesNoneNeeds ImprovementWarningPassPassPassPassFailHighWhiteNN/ANot a Special Education Student, age 6-21EW601: The Student LevelStudent ID infoIndicators in the risk modelStudent infoMassachusetts Department of Elementary & Secondary Education 22EW302: Graphical View

Massachusetts Department of Elementary & Secondary Education 23EWIS Risk Level Indicator Analysis (EW317)A tool to analyze specific attendance, behaviors, and course Early Warning Indicator System (EWIS) indicators for students in each risk level for a selected grade.EWIS Subgroup Analysis (EW318)Provides educators with aggregate student risk levels of not achieving their next educational outcome as determined by the Early Warning Indicator System (EWIS) by student subgroups within a DistrictTHE NEWEST EWIS TOOLS!Massachusetts Department of Elementary & Secondary Education 24Insert EW 318 Screen shot

Massachusetts Department of Elementary & Secondary Education 25Insert EW317 Screen shot

Sample of larger amount of data Massachusetts Department of Elementary & Secondary Education Postsecondary Outcome Reports26Massachusetts Department of Elementary & Secondary Education 2627Postsecondary Outcomes of Public High School Students

Collecting and analyzing data about what college-bound students actually do after graduating high school helps district and school leaders assess the effectiveness of their programs in developing graduates who are college ready.

The data for these reports are drawn from existing ESE data sources such as SIMS, SCS and MCAS as well as College Board (for SAT) , the Mass. Dept. of Higher Education HEIRS system and the National Student Clearinghouse.Massachusetts Department of Elementary & Secondary Education How did our students do after graduating?

The Three Basic Reports:Postsecondary Outcomes of Public HS Graduates: All Institutions (CR301) Postsecondary Outcomes of Public HS Graduates: MA Public Institutions Only (CR302) Postsecondary Outcomes of Public HS Graduates:Academic Preparation (CR303)

28Massachusetts Department of Elementary & Secondary Education Academic Preparation = MassCore CompletionAP Course CompletionMCAS 10th Grade ELA MCAS 10th Grade MathMCAS High School Science

Comparing the Three ReportsPotential QuestionsCR301CR302CR303How many graduates go on to postsecondary?XXXWhat type of institutions (4-year/2-year, private/public) do graduates attend?XXXWhich specific institutions did students attended? How many went to each? XXWhat are the enrollment rates of students who complete MassCore or AP coursework compared to those who dont?XXXWhat are the persistence and degree obtainment rates of students who complete MassCore or AP coursework? XWhat is the postsecondary experience of students from a specific subgroup? (CVTE, ELL, SWD, high needs, etc) XXXWhat percentages of students enroll in and complete remedial courses? XXIn what remedial subjects to do students enroll?XWhat are the MCAS scores of students who take remedial coursework in math and reading? XXHow many credits, on average, do public high school graduates earn in their first year of college?XX29Use when setting school and district goals!Massachusetts Department of Elementary & Secondary Education How many high school graduates enroll in postsecondary education?

at MA public institutions?On top: data from CR301; on bottom: data from CR302

Drill down to student level records

#Massachusetts Department of Elementary & Secondary Education 31

What Types of Institutions are Your Students Attending?Massachusetts Department of Elementary & Secondary Education What does persistence look like across subgroups?How many return for a 2nd year?

#Massachusetts Department of Elementary & Secondary Education Where did students enroll? (Anywhere in the US)

This data from CR301See CR302 for MA Public Institutions Only

#Massachusetts Department of Elementary & Secondary Education What are enrollment rates of students who complete AP or MassCore?

#Massachusetts Department of Elementary & Secondary Education Of those in MA public postsecondary, what % enroll in remedial courses?

In which subjects?Data from CR302

#Massachusetts Department of Elementary & Secondary Education 16 graduates in MA public postsecondary35How many of your graduatesobtain a degree?

#Massachusetts Department of Elementary & Secondary Education and this is just the beginning of what we can do!

We could also exploreWhat is the relationship between MCAS scores and the type of institution where students enroll? (4-year, 2-year, public, or private)

What is the postsecondary experience of students from a specific subgroup (CVTE, ELL, students with disabilities, high needs, etc)?#Massachusetts Department of Elementary & Secondary Education 38

Several additional new Edwin Analytics reports may assist schools and districts in analyzing post-secondary data for program improvement.

CR304 Postsecondary Outcomes of Public HS Graduates View by MA Public Postsecondary Institution: Details postsecondary enrollment, achievement, and outcomes of MA public graduating students from a fall enrollment class in a specific MA public postsecondary institution. It also contains details by feeder MA public high schools. (Postsecondary data source: MA Department of Higher Education)

CR321 CVTE Graduate Pathway Summary: MA Public Postsecondary: Details postsecondary enrollment, outcomes, and continuation of vocational field of study for MA public school graduates who were CVTE concentrators and who enrolled in a MA public postsecondary institution. (Postsecondary data source: MA Department of Higher Education)Additional Post-Secondary ReportsMassachusetts Department of Elementary & Secondary Education 39Two other reports are available on the Student tab for those who have been granted access to student-level data:

CR608 Student High School Academic Preparation and Postsecondary Experience: This source provides student-level high school academic experience, postsecondary enrollment, and outcomes for students graduating from MA public schools and enrolling in public or private postsecondary institutions.. (Postsecondary data source: National Student Clearinghouse)

CR601 Student Progress towards MassCore: While not specific to postsecondary education, this report displays a list of high school students and their progress towards completing the MassCore recommended program of study. It identifies students who are falling behind, enables drill-drown to investigate course completion for specific students, and is available for all students in grades 9-12.

Student Level DataMassachusetts Department of Elementary & Secondary Education For more informationWatch the Edwin website for updates, including materials and professional development opportunities: www.doe.mass.edu/Edwin Follow Edwin on Twitter! @ Edwin_DESEQuestions can be submitted to: Edwin@doe.mass.edu If you need access to Edwin Analytics contact your district directory administrator (List is available at http://www.doe.mass.edu/infoservices/data/diradmin/list.aspx)EWIS use workshop day: October 1: http://www.surveygizmo.com/s3/2307782/Early-Warning-Indicator-System-EWIS-Workshop-10-1-15 Early warning implementation guide available at http://www.doe.mass.edu/edwin/analytics/ewis.html #Massachusetts Department of Elementary & Secondary Education Success After High School DART Detail41

Massachusetts Department of Elementary & Secondary Education 41

The District Analysis and Review Tools (DARTs) turn the Department's vast amount of data into valuable, easily consumable information.

The DARTs offer snapshots of district and school performance, allowing users to easily track select data elements over time, and make sound, meaningful comparisons to the state or to "comparable" organizations.

DARTs are free and available to the public on the ESE websiteWhat is the DART?46Massachusetts Department of Elementary & Secondary Education What is the Success After High School DART?The Success After High School Dart is a DART: Detail toolDART: Detail tools provide in-depth data on targeted topic areas The Department already released DART Details: Staffing and Finance and English Language Learners to go along with the more comprehensive DART toolsThe intent of the Success After High School DART is to synthesize and summarize existing information available concerning secondary and post-secondary education in a freely, well-organized, accessible format for schools, districts, non-profit organizations, researchers, families and the general public.

#Massachusetts Department of Elementary & Secondary Education 43Example elements for DART Detail: Success After High School

High School Indicators: Graduation, dropout, suspension, and retention rates.High School Performance: Students scoring proficient on MCAS, students scoring on SAT and AP tests, and participation in SAT and AP tests.Program of Study: Students completing MassCore and Advanced Placement coursework. Students passing all ninth grade courses, Students passing 12th grade mathematics and science technology/engineering coursework.Use when setting school and district goals!#Massachusetts Department of Elementary & Secondary Education 44Example elements for DART Detail: Success After High School (continued)

Post-Secondary Educational Outcomes: Students enrolling in post-secondary education, students persisting in post-secondary education, percentage of students enrolling in developmental (remedial) coursework in Massachusetts Public Colleges.Workforce Development: Students participating in career/technical education by cluster, Students completing work based learning plans and Connecting Activities, links to other regional workforce development data.Use when setting school and district goals!#Massachusetts Department of Elementary & Secondary Education 45DART for Success After High School is a publicly accessibletool that provides a snapshot of high school,postsecondary, and career development education data.

This tool allows users such as district and school staff, parents, students, workforce partners and organizations to:

Find comparable high schools based on demographic characteristics

Look at trends over several years

View school data in charts that are easy to interpret

Evaluate and reflect on schools and their progress

#Massachusetts Department of Elementary & Secondary Education Lien: Open DART for Success After High School and walk through each pointMassachusetts Department of Elementary and Secondary Education46Find comparable high schools based on demographic characteristics

Comparable schools

#Massachusetts Department of Elementary & Secondary Education Massachusetts Department of Elementary and Secondary Education47Trend over several years with easy to interpret charts

#Massachusetts Department of Elementary & Secondary Education The Waterfall

#Massachusetts Department of Elementary & Secondary Education And recently released!#Massachusetts Department of Elementary & Secondary Education

The Success After High School DART is available at http://www.doe.mass.edu/apa/dart/DARTSAHS.xlsx

It is openly accessible to anyone, however it is a large file due to all the data in the file, so

it is best to download it to your computer andwont go through most email systems#Massachusetts Department of Elementary & Secondary Education After this slide, open Excel DART SAHS and walk through the three indicators. Massachusetts Department of Elementary and Secondary Education51Questions or comments?

#Massachusetts Department of Elementary & Secondary Education After this slide, open Excel DART SAHS and walk through the three indicators. Massachusetts Department of Elementary and Secondary Education52

Recommended

View more >