Massachusetts Department of Elementary & Secondary Education College and Career Readiness Webinar Series: Tools to be CCR Data-Wise September 17, 2013

Download Massachusetts Department of Elementary & Secondary Education College and Career Readiness Webinar Series: Tools to be CCR Data-Wise September 17, 2013

Post on 16-Jan-2016

217 views

Category:

Documents

0 download

Embed Size (px)

TRANSCRIPT

<p>Tools to be CCR Data-Wise</p> <p>College and Career Readiness Webinar Series: Tools to be CCR Data-WiseSeptember 17, 2013Massachusetts Department of Elementary &amp; Secondary Education Welcome!Please type your question or comment in the chat window at any point during the presentationAll phones will be mutedPowerPoint slides will be sent to all registered participants</p> <p>#Massachusetts Department of Elementary &amp; Secondary Education About the C&amp;CR Webinar SeriesNew for the 2013-14 school year monthly webinars on a variety of college and career readiness topicsTypically held on the 3rd Tuesday of month at 2:00The October 15th webinar on topic of career development education#Massachusetts Department of Elementary &amp; Secondary Education Webinar AgendaOverviews of two College and Career Readiness related data tools that were released last winter through Edwin Analytics:Early Warning Indicator System (EWIS) reportsPostsecondary Readiness and Success reports</p> <p>Preview of the new College &amp; Career Readiness DART that will be available soon</p> <p>Q&amp;A</p> <p>#Massachusetts Department of Elementary &amp; Secondary Education Edwin Analytics5Massachusetts Department of Elementary &amp; Secondary Education 5</p> <p>Student profilesAn early warning indicator systemDashboards &amp; reportsModel curriculum unitsCurriculum mapping and Lesson planning tools Aligned to StandardsTools to assess student understanding of multiple standardsCompetency Tracking SystemAligned to standards </p> <p>High-quality digital resources to support instruction Aligned to standards</p> <p>6Massachusetts Department of Elementary &amp; Secondary Education Student Information Edwin Analytics Early Warning Indicator Other reports to answer questions educators ask on a regular basis Educator access through dashboards and through reports </p> <p>Curriculum Tools Edwin Teaching &amp; Learningaligned to the current Massachusetts Curriculum Frameworks:Model curriculum mapsModel curriculum units and the ability for districts to:create curriculum mapsmodify and/or create new curriculum units create lesson plans</p> <p>Assessment Tools Edwin Teaching &amp; LearningAbility to build and deliver interim and formative assessmentsaccess to banks of assessment itemseasy-to-use reports on assessments being deliveredresults from classroom/school /district-wide common assessments Competency Tracking System for Vocational Education</p> <p>Digital Resources Edwin Teaching &amp; Learning easy access to quality online resources to support instruction. Resources to be tagged to standards and be in various formats: To incorporate into curriculum units and lessons To help differentiate instruction To incorporate into assessments</p> <p>Edwin key take-aways: Voluntary - use components or wholeStandards Based - anchored in most current Massachusetts Curriculum Frameworks / StandardsIntegrated Data moves automatically to all services with goal of educator-one-stop-shopping Dual Service Delivery Department and cloud-based services</p> <p>6What is Edwin Analytics?What is the SAME: Education Data Warehouse (EDW) reports are still availableWhat is NEW and NOW available: Identify current students in grades 1-12 who may be at risk of missing key educational targets (Early Warning Indicator System (EWIS) reports)Identify how your former students did after they graduated from your school/district (Postsecondary Readiness and Success)</p> <p>#Massachusetts Department of Elementary &amp; Secondary Education Early Warning Indicator System8Massachusetts Department of Elementary &amp; Secondary Education 8What are Early Warning Indicators?Methodological way of looking at students and their likelihood of meeting specific academic goals Traditionally implemented at the high school level to help predict which students are most likely to drop outTool for educators to better design and target student interventions in a timely way</p> <p>#Massachusetts Department of Elementary &amp; Secondary Education MA EWIS BackgroundDepartment previously provided Early Warning Indicator Index (EWII) to predict the likelihood grade 9 students would graduateDepartment worked with American Institutes for Research (AIR) to develop the new risk models District feedback, e.g., focus groups and webinarsFirst rollout of EWIS in 2012-13 school year</p> <p>#Massachusetts Department of Elementary &amp; Secondary Education Districts shared that the EWII data were helpful, but also requested indicator data at earlier grade levels and throughout high school </p> <p>Conducted an extensive literature review of the research on indicators for early warning systemsIdentified and tested possible indicators for the risk models based on those recognized in the research and data that are collected and available from the Departments data systemTested the indicators and risk models on previous school years</p> <p>10Grade Groupings &amp; Goals=</p> <p>Age GroupsGrade Levels Academic Goals (expected student outcomes for each age group)2011-12 Statewide Results for GoalEarly ElementaryGrades 1-3Proficient or advanced on 3rd grade ELA MCAS61%Late ElementaryGrades 4-6Proficient or advanced on 6th grade ELA and Mathematics MCAS54%Middle GradesGrades 7-9Passing grades on all 9th grade courses75%High SchoolGrades 10-12High school graduation (four-year)84.7%#Massachusetts Department of Elementary &amp; Secondary Education Districts shared that the EWII data were helpful, but also requested indicator data at earlier grade levels and throughout high school </p> <p>Conducted an extensive literature review of the research on indicators for early warning systemsIdentified and tested possible indicators for the risk models based on those recognized in the research and data that are collected and available from the Departments data systemTested the indicators and risk models on previous school years</p> <p>11Key Concepts, continuedProvides risk level information for all students based on prior year dataThe risk levels are not based on a students relative likelihood for reaching an academic goal when compared with other studentsIndividual indicators in the risk model are not reflective of the level of risk - taken together, the indicators (data points) collectively form a risk level Only includes data from existing statewide collections (SIMS and SCS) and state assessments (MCAS and ACCESS)</p> <p>#Massachusetts Department of Elementary &amp; Secondary Education 12EWIS is / is not=</p> <p>The Massachusetts EWIS isThe Massachusetts EWIS is notA tool to better target interventions and supports at the individual, small group, and whole school levels. A life sentence or a reason to label students.A systematic way to flag students that need to be further examined to determine what additional support are necessary.A diagnostic tool that provides details on the exact reason(s) why a student is at risk for not meeting an expected academic goal. Related to measures that are included in the states school and district accountability system (PPI), but is not itself an accountability measure. An accountability measure.Based on data and risk models that the Department will reexamine each year to continually improve the system.A stagnant system that will remain exactly the same in future years. #Massachusetts Department of Elementary &amp; Secondary Education Districts shared that the EWII data were helpful, but also requested indicator data at earlier grade levels and throughout high school </p> <p>Conducted an extensive literature review of the research on indicators for early warning systemsIdentified and tested possible indicators for the risk models based on those recognized in the research and data that are collected and available from the Departments data systemTested the indicators and risk models on previous school years</p> <p>13Edwin Analytics: EWIS ReportsThere are three EWIS reports in Edwin:EWIS Student List (EW601)EWIS District View (EW301)EWIS Graphical View (EW302)</p> <p>All can be filtered numerous way (e.g., selecting specific schools, grade levels, student subgroups)</p> <p>#Massachusetts Department of Elementary &amp; Secondary Education EWIS Student List (EW601)What are the current risk levels of my students?What are the prior risk levels of my current students?What data points (indicators) went into the calculation to determine the risk level?</p> <p>#Massachusetts Department of Elementary &amp; Secondary Education </p> <p>#Massachusetts Department of Elementary &amp; Secondary Education EWIS District View (EW301)Which grade levels or schools have the most students that need targeted support in order to be on track to meet the next academic goal?What is the breakdown of high, moderate, and low risk levels in a particular student subgroup (e.g. among students with disabilities)?Where does the district need to focus additional resources to get students back on track for meeting the next academic goal?</p> <p>#Massachusetts Department of Elementary &amp; Secondary Education 18</p> <p>Massachusetts Department of Elementary &amp; Secondary Education 18EWIS Graphical View (EW302)How does a selected group of students compare to the district and state?What are the previous risk levels of the currently enrolled students over the past 5 years?E.g., what are the previous risk levels of my current 4th grade male ELL students?What are the risk levels of a specific student group over the past 5 years? E.g., what are the risk levels of 4th grade male ELL students each year over the last 5 years?</p> <p>#Massachusetts Department of Elementary &amp; Secondary Education 1920</p> <p>Massachusetts Department of Elementary &amp; Secondary Education 20Postsecondary Outcome Reports21Massachusetts Department of Elementary &amp; Secondary Education 21How did our students do after graduating?Three reports:</p> <p>Postsecondary Outcomes of Public HS Graduates: All Institutions (CR301) Postsecondary Outcomes of Public HS Graduates: MA Public Institutions Only (CR302) Postsecondary Outcomes of Public HS Graduates:Academic Preparation (CR303) </p> <p>22Massachusetts Department of Elementary &amp; Secondary Education Academic Preparation = MassCore CompletionAP Course CompletionMCAS 10th Grade ELA MCAS 10th Grade MathMCAS High School Science </p> <p>How many public high school graduates enroll postsecondary? </p> <p> at MA public institutions?</p> <p>On top: data from CR301; on bottom: data from CR302#Massachusetts Department of Elementary &amp; Secondary Education Where did students enroll? (Anywhere in the USA)</p> <p>This data from CR301See CR302 for MA Public Institutions Only#Massachusetts Department of Elementary &amp; Secondary Education What does persistence look like across subgroups?How many return for a 2nd year?</p> <p>Data from CR301; See CR302 for MA Public Institutions Only#Massachusetts Department of Elementary &amp; Secondary Education How many of your graduatesobtain a degree?How does that vary by subgroup?How does that vary by the type of institution where students enroll? (4-year, 2-year, public, or private)</p> <p>Data from CR301; See CR302 for MA Public Institutions Only#Massachusetts Department of Elementary &amp; Secondary Education What are enrollment rates of students who complete AP or MassCore?</p> <p>Data from CR301; See CR302 for MA Public Institutions Only#Massachusetts Department of Elementary &amp; Secondary Education Which type of institutions do they attend? </p> <p>Data from CR303#Massachusetts Department of Elementary &amp; Secondary Education Of those in MA public postsecondary, what % enroll in remedial courses? </p> <p>In which subjects?</p> <p>Data from CR302#Massachusetts Department of Elementary &amp; Secondary Education 16 graduates in MA public postsecondary29What are the MCAS scores of students who take remedial courses? </p> <p>Data from CR302#Massachusetts Department of Elementary &amp; Secondary Education 16 graduates in MA public postsecondary</p> <p>30How many credits do graduates earn in their first year of college?What about developmental credits?</p> <p>Data from CR30231Massachusetts Department of Elementary &amp; Secondary Education and this is just the beginning of what we can do!</p> <p>We could also exploreWhat is the relationship between MCAS scores and the type of institution where students enroll? (4-year, 2-year, public, or private)</p> <p>What is the postsecondary experience of students from a specific subgroup (CVTE, ELL, students with disabilities, high needs, etc)?#Massachusetts Department of Elementary &amp; Secondary Education Comparing the Three ReportsPotential QuestionsCR301CR302CR303How many graduates go on to postsecondary?XXXWhat type of institutions (4-year/2-year, private/public) do graduates attend?XXXWhich specific institutions did students attended? How many went to each? XXWhat are the enrollment rates of students who complete MassCore or AP coursework compared to those who dont?XXXWhat are the persistence and degree obtainment rates of students who complete MassCore or AP coursework? XWhat is the postsecondary experience of students from a specific subgroup? (CVTE, ELL, SWD, high needs, etc) XXXWhat percentages of students enroll in and complete remedial courses? XXIn what remedial subjects to do students enroll?XWhat are the MCAS scores of students who take remedial coursework in math and reading? XXHow many credits, on average, do public high school graduates earn in their first year of college?XX33Massachusetts Department of Elementary &amp; Secondary Education Refining your search</p> <p>34#Massachusetts Department of Elementary &amp; Secondary Education For more informationWatch the Edwin website for updates, including materials and professional development opportunities: www.doe.mass.edu/Edwin </p> <p>Follow Edwin on Twitter! @ Edwin_DESE</p> <p>Questions can be submitted to: Edwin@doe.mass.edu </p> <p>If you need access to Edwin Analytics contact your district directory administrator (List is available at http://www.doe.mass.edu/infoservices/data/diradmin/list.aspx)#Massachusetts Department of Elementary &amp; Secondary Education Coming soon: Success After High School DART Detail36Massachusetts Department of Elementary &amp; Secondary Education 36</p> <p>The District Analysis and Review Tools (DARTs) turn the Department's vast amount of data into valuable, easily consumable information.</p> <p>The DARTs offer snapshots of district and school performance, allowing users to easily track select data elements over time, and make sound, meaningful comparisons to the state or to "comparable" organizations.</p> <p>DARTs are free and available to the public on the ESE websiteWhat is the DART?37Massachusetts Department of Elementary &amp; Secondary Education What is the Success After High School DART?The Success After High School Dart is a DART: Detail toolDART: Detail tools provide in-depth data on targeted topic areas The Department already released DART Details: Staffing and Finance and English Language Learners to go along with the more comprehensive DART toolsThe intent of the Success After High School DART is to synthesize and summarize existing information available concerning secondary and post-secondary education in a freely, well-organized, accessible format for schools, districts, no...</p>