data inquiry process · focusing questions 10 question focus big picture questions all students...
TRANSCRIPT
Data Inquiry ProcessData Leadership Summit
March 2018
Today’s Slides: https://goo.gl/K8wmr8
Developed and Facilitated byWISExplore Team Members:
Mary Ann Hudziak, CESA 6 Judy K. Sargent, CESA 7
1
Session Outcomes
Awareness about . . .● Student data inquiry process● Practices data inquiry process● Relationship between student and practices data inquiry● Tools and resources for documenting data inquiry
2
Additional Support
• The tools and resources we are sharing with you today were developed by the WISExplore Team
• All resources will eventually be available to everyone in WISElearn
• Each CESA has trained WISEcoaches to help teach the complete data inquiry process from start to finish
3
Process of Inquiry
4
Illumination through Data Inquiry
Data inquiry …● Is a collaborative process● Encompasses all levels of data work● Leads to analysis of root causes and further inquiry● Informs actions for improvement and transformation
5
Data Inquiry. Given a particular question, engaging in a systematic investigation, with analysis and interpretation of the data leading to proposed hypotheses of root causes that inform improvement actions.
Critical Contexts for Data Inquiry
6
Student Data Inquiry4-Step Process
7
Student Data Inquiry Process Steps
• Question• Investigate• Clarify• Hypothesize
8
Question
9
Attainment Growth
To what levels of proficiency have
students achieved?
… currently?… in recent years?
What is the measured progress for these students?
Is the progress adequate to reach
attainment?
Focusing Questions
10
Question FocusBig Picture Questions
All students ● Schoolwide ● By grade level
Equity Gap QuestionsComparisons between student groups● Schoolwide
Content QuestionsComparisons among content skills● Schoolwide ● By grade level
Purposeful QuestioningPurposeful student data inquiry begins with important questions about student performance.
11
Question Focus Attainment Growth
Big Picture QuestionsAll students ● Schoolwide ● By grade level
To what levels of proficiency have students
achieved?
… currently?… in recent years?
What is the measured progress for these
students?
Is the progress adequate to reach attainment?
Equity Gap QuestionsComparisons between student groups● Schoolwide
Content QuestionsComparisons among content skills● Schoolwide ● By grade level
Sample Student Data Questions
12
Inquiry #1: Data Questions about ALL STUDENTS• ATTAINMENT. What are the current achievement levels of our students schoolwide and by
grade? What is the trend in student achievement levels over the past 2+ years schoolwide and for each grade?
• GROWTH. What is the progress of cohorts of students over two or more years? Is the progress adequate to reach our vision?
Inquiry #2: Data Questions about STUDENT GROUP COMPARISONS• ATTAINMENT. What is the current achievement of student groups as compared
to their counterparts? How does achievement of student groups compare to their counterparts in previous years?
• GROWTH. What is the progress of cohorts of student groups as compared to their counterparts over two or more years? Is the progress of the student group adequate to close achievement gaps?
Inquiry #3: CONTENT • ATTAINMENT. What are the current achievement levels of our students within the
content area? What is the trend in student achievement within the content area over the past 2+ years schoolwide and for each grade level?
• GROWTH. What is the progress of cohorts of students over two or more years within the content area?
Investigate
Data sources used are based on the data question and context
13
Summative Data Inquiry
- State Data Sources
- Local Interim & Summative Data Sources
Interim Data Inquiry
- Local Interim Data Sources
Teacher PLC Data Inquiry
- Local Classroom Data Sources
Follow protocols to maintain student privacy with proper access to data.
Find the Just Right Data
• When exploring the data source selected, locate the “just right data” that answers the inquiry question.
• Collaboratively determine whether the data selected helps to answer the inquiry.
14
Big Picture: Data Captures
15
Achievement Gap Data Captures
16
Content Data Captures
17
Clarify: Analyze, Summarize, Prioritize
Analyze the data. Look for …• Metrics
• % of students• Number of students• Percentile ranks
• Patterns• Comparisons• Data range• Distribution
• Trends over time (more than two years)
18
Determining Criticality
19
To determine criticality in data findings, consider…● Persistence in the data pattern● Multiple years showing a decline in student
performance (at least 3 years)● Size of differences (gap) in the numbers (larger
differences more likely to be critical)● Increasing gaps● Impact on students
Determining Criticality
20
Criticality Data Findings for Improvement
Critical data finding:Increasing gap
● In the middle school, for the past three years, the % of EcD students that reach proficiency on the ELA portion of the state assessment has been declining (from 23% in 2012 to 15% in 2015), whereas the % of non-EcD reaching proficiency has been increasing (42% in 2012 to 51% in 2015). The gap is increasing between EcD and non-EcD.
Critical data finding: Consistently
declining math achievement
● We noticed a trend and pattern in our math data. We consistently see 65% of our 3rd grade students reaching proficiency and in each subsequent grade the proficiency levels decline by 5% per year through the 6th grade. The percent of students proficient or advanced in math declined from grade to grade, from 3rd grade to 6th grade in the past four years across three different assessments.
Here are two examples of data findings from our work with schools.
Prioritize Data Findings
21
● What’s the risk for students if we don’t improve this data pattern?
● Will students’ futures be compromised?
● Study all data findings to determine their level of priority.
● Select the most urgent data finding(s) to identify the critical student problem
Propose explanations about practices that may explain the critical student data problem.
22
Hypothesize
Hypotheses about Root CausesGuidelines
23
1. Keep critical student data problem in mind
2. Pose hypotheses that suggest potential reasons for the problem statement. Be sure to use alterable factors, rather than unalterable factors, such as student characteristics.
3. Use the Fishbone process to generate hypotheses of practices in important categories.
Root Cause Worksheet
FISHBONE: Categories of Potential Root Causes
Prioritizing Root Causes
Teams engage in a prioritization process based on the HOPs in the fishbone.
Several methods can be used for prioritization of root causes.1. Voting for highest likelihood causes2. Influencer circle activity3. Other prioritization methods
25 26
Bridge to Practices Inquiry
We enter “Practices Inquiry” from the Hypotheses stage of the Student Data Inquiry.
Practice Inquiry 4-Step Process
27
Practices Inquiry
1. QUESTION. Based on our most likely hypotheses of practices, ask - what evidence do we need about this practice that will inform our next steps?
2. INVESTIGATE. Based on our question(s), study relevant practices within the school, district and in the research to gather evidence.
3. CLARIFY. Identify and summarize findings from your investigation and prioritize practices for future actions.
4. PROPOSE. Propose next steps to plan implementation based on practice priorities. 28
Question
• Investigating a practice is based on the questions we want to ask about that practice.• What is the practice we want to know more about?• Where does it occur? With whom?
• Examples of Practice Inquiry Questions:• What is the extent of co-teaching
occurring in our classrooms?• To what degree are our PLC teams
analyzing and discussing studentdata to make instructional adjustments?
• To what degree are we following ourPBIS implementation plan?
29
Investigate
30
To conduct an investigation into the selected practices, there are three important steps:1. Define the practices clearly through a practice profile.2. Develop an investigation action plan.3. Conduct the investigation and collect the data (evidence).
Clarify
What did we learn from our evidence?How can we clarify and prioritize our findings
from the investigation?
31
Clarifying Data from the Practice InvestigationsWe clarify our data to make sense of all the evidence we’ve collected. Steps for clarifying the data include ...1. Setting the tone.2. Organizing the data.3. Analyzing the data.4. Summarizing the findings.5. Prioritizing the findings.
32
Propose
What actions will we propose to improve and implement our practices?
33
Aims for Improvement
Actions• List the tasks recommended for improvement,
based on practices data findings• Provide details - who, what, when how and with
what resources
Monitoring• Indicate how the actions will be monitored• Provide:
• indicators • timelines • decision-making processes
34
Sample: “Propose” Steps
35
Data Inquiry Process for Continuous Improvement
36
Tools & Resources
37
Documenting Inquiry
It is important to document the process. Documentation provides ...● Evidence of the work for team members ● A means for continuation of the process● A tool for communication with stakeholdersData inquiry can be recorded in online templates, the WISEdash Data Inquiry Journal, or other notes and records
38
Forms in WISEdash for Districts
A tool is available in WISEdash for Districts.• Log into WISEdash for Districts• The down arrow next to the red matrix will reveal three
options • To use the documentation tool, select “Forms Manager”
39
● Follows the steps in the data inquiry process● Available in WISEdash for Districts● The user applications icon (red
matrix), located in the top right sideof WISEdash for Districts providesaccess to the Data Inquiry Journal
● Using the drop down arrow, select “ Forms Manager”● To document your work, open a new journal page (see
below) or add to an existing journal
Data Inquiry Journal
40
Additional Resources Templates to document inquiry
• Use this template to document your All Student inquiry.• Use this template to document your Equity Gaps inquiry.• Use this template to document your Content Analysis inquiry.• Use this template to document your Practices inquiry.
41 42
Thank You!
For additional assistance with the data inquiry process or any of the tools shared with you today, contact your CESA
WISEcoach email contacts