wisexplore data retreat high school
DESCRIPTION
Day 1. Billie Finco and Sherri Torkelson. WISExplore Data Retreat High School. July 2013. - PowerPoint PPT PresentationTRANSCRIPT
+WISExplore Data RetreatHigh SchoolJuly 2013
Billie Finco and Sherri Torkelson
Day 1
2
6/25/13
Used well, monitoring tools are not just for outside agencies or leaders, but for students, teachers, principals and parents, too. These tools let us know when the students are on the right path and at the right pace. The right data systems illuminate what to fix. They let us know when we need to intervene with training or support or where we need to craft a new solution to innovate.
Dr. Jerry Weast
3+ Welcome!LogisticsIntroductionsMaterials and
ResourcesSchedule
6/25/13
4+ WISExplore Retreat Materials
1. Original WISExplore Retreat materials are posted in LiveBinder.
2. Go to www.livebinders.com/play/play/899070 (password: wisexplore)
6/25/13
5+ Our ObjectivesLearn how to navigateWISEdash
Use WISEdash to analyze school data
Be introduced to the WISExplore e-learning Modules
Begin the School Improvement Planning process
6/25/13
+ 6Agenda
OpeningData Inquiry
ProcessWSAS Dashboard
InquiryHS Completion
Dashboard InquiryAttendance Inquiry
ACT Dashboard Inquiry
AP Dashboard Inquiry
Post Secondary Dashboard Inquiry
Plan Next Steps
6/25/13
Day One Day Two
7+Norms
Stay engaged Focus on uncovering/discovering/recovering Use technology respectfully Strive for equity of voice
6/25/13
8+Security and Confidentiality Roles of staff and levels
of security
6/25/13
9+ Evolution of Data Work in Wisconsin
6/25/13
10+
6/25/13
11+De
6/25/13
12+Documenting Work During The Retreat
In the past …
13+ Moving to the Digital Age Using an electronic “Fillable Form” Eventually, the Data Inquiry Process will be
embedded within the Data Warehouse for easy use. Note:
• The current Fillable Form will not function effectively on a MAC computer or iPad.
14+ Using Data to Support Continuous Improvement
The “wait” to see how students achieved is too late to make important programmatic and instructional shifts to help students responsively
Shift in Federal Requirements External accountability shifts to more “high-stakes” Educator Effectiveness drives ownership of student achievement
Shifting data sources allow for more immediate & ongoing access WISEdash Your local interim assessments
Ongoing collaborative data work is needed to drive continuous improvement Teacher PLC teams School Improvement teams
6/25/13
15Higher Standards
Incr
ease
d Ac
coun
tabi
lity
More Rigorous
AssessmentsSo how do
we move the needle on student
achievement?
+Brief Report Card Walk-Through
6/25/1316
+ Reconnect to Your Data Reality
Access your school report card online in SAFE Locate the following two documents:
6/25/13
6/25/13
+ 19
6/25/13
+ 20
6/25/13
+ 21
As you consider last year’s reality…
6/25/13
What are you wondering about this year’s data?
6/25/13
6/25/13
6/25/13
+ 25
6/25/13
Part A
Part B
21 18 22 24
+ 26
As you consider last year’s reality…
6/25/13
What are you wondering about this year’s data?
6/25/13
+ 28
6/25/13
+ 29
As you consider last year’s reality…
6/25/13
What are you wondering about this year’s data?
+ 30Other data…
6/25/13
Finco & Torkelson
+
Data RetreatData Inquiry ProcessJune 25, 2013
Data Inquiry Process
31June 2013
Finco & Torkelson
32+WISExplore Data Inquiry ProcessThe data inquiry process … Always begins with a
meaningful question
Guides teams in intentional data work by providing focus
Can be applied to any data question
Leads to identifying possible root causes
June 2013
Finco & Torkelson
33+ Question
Begin data inquiry by posing a question that is important to your school’s continuous improvement
June 2013
Finco & Torkelson
34+Pose a data question first because … It provides a clear starting point It is the first step in a process
that will lead to clear goals It will connect the data inquiry
to the vision It keeps you on track It clarifies your purpose for data
navigation The process will be both
efficient and effectiveJune 2013
Finco & Torkelson
35+Context for a Data QuestionConsiderations when posing a data question: Past performance Current data results Trends over time Changes in …
the school community school programs standards
June 2013
What do I need to know?
Finco & Torkelson
36+Categories of Data Questions Grade level questions Gap and subgroup questions Change, progress and trend questions General questions Subject area and skill questions Course, program questions Achievement questions Individual student questions
June 2013
Finco & Torkelson
37+ Shaping Data Inquiry QuestionsBIG questions…
How does achievement compare across levels?
June 2013
Add “Filter” Language to Focus the Data Inquiry How does math achievement on the WKCE compare in
7th and 8th grades for all students enrolled for a full academic year in Elm Grove Middle School during 2012-13?
Add “Related Dashboard” Language for Subgroup Comparisons
How does math achievement on the WKCE compare in 7th and 8th grades for students with disabilities as compared with nondisabled students enrolled for a full academic year in Elm Grove Middle School during 2012-13?
Finco & Torkelson
38+ Investigate
Based on the data inquiry question, navigate the appropriate dashboard to locate the data picture that best answers your question.
June 2013
Finco & Torkelson
39+Navigation: Functionality “Must-Knows”
Dashboards Filtering and clearing
filters Related Dashboards Hovering Opening up student lists Sorting student lists Individual Student Profiles
Managing layers Selecting and copying Exporting
pdfs Excel ms word
Saving to favorites Recalling favorites
June 2013
Finco & Torkelson
40+ClarifyDocumenting data observations, stating specific data findings, trends and gaps
Remembering the Data Inquiry Question, view the data picture to shape the team’s observations
Observe the data, refine and state critical data findings with supporting details.
June 2013
Finco & Torkelson
41+Data Findings With the Inquiry Data Question in mind, describe the data findings. What do you see in the data picture? What patterns do you observe?
June 2013
Well-written data findings:• Are objective – just facts, not opinions or questions• Are precise (include the data)• Are statements (complete sentences) understandable by
stakeholders• Include the test type and subject• Include the timeframe for the findings• Include the specific group of students
Finco & Torkelson
42+Sample Data FindingsNon-Examples of Data Findings• Our kids didn’t do well in reading.• The special ed students went down.• There are so many students in the red – why?
Examples of Data Findings Related to the Data Question• In 8th grade Reading on the fall 2012 WSAS, over half (54%) of
SwD scored in the minimal category, while only 11% of Students Without Disabilities scored at that same level.
• 58.5% of Students Without Disabilities were below proficient, compared to 85.7% of Students With Disabilities below proficient in reading in fall 2012 on the same test.
June 2013
No!
Yes!
Finco & Torkelson
43+ HypothesizeExamine the system
What practices, policies or procedures might be producing these results?
June 2013
Finco & Torkelson
44+Hypotheses of Practice
Posing educated guesses about school or classroom practices as possible underlying root causes for critical data findings.
June 2013
+
Finco & Torkelson
45Posing Hypotheses of Practice
June 2013
Take quiet time to think about all of the causes for the data pattern.
Translate each “cause” into a “hypothesis of practice”.
Hypotheses of practice … Are our best educated guesses about what “we” are doing or
not doing that could be contributing to the results Are guided by the data findings Are shaped by both perceptions of practices and professional
experiences in the school Are guided by research-based practices Never place blame on student or family
characteristics, or any other unalterable factors
Finco & Torkelson
46+ Example Hypotheses Is it because we have not changed our instructional
techniques as our school population has changed? Is it because we have low expectations for our special
education students? Is it because we are not using best practices in our
literacy instruction? Is it because we need to revamp our curriculum? Is it because we are not teaching our curriculum with
fidelity? Is it because our instruction is not engaging students?
June 2013
Finco & Torkelson
47+ Categorizing Your Thinking--
Hypotheses of
Practice
• Classroom Instruction & Assessment
• Instructional Planning & Preparation
• Learning Environment• Professional
Responsibilities• Human Resource
Leadership• Instructional Leadership• Organization
Management• School Climate• Collaborative Culture• Stakeholder
Relationships
June 2013
Finco & Torkelson
48+
June 2013
Finco & Torkelson
49+ Before break…
Create a data folder for today.
June 2013
My WISExplore Data Folder 2013-14
Log into WISEdash.
Finco & Torkelson
+
e Learning Module
Finco & Torkelson
51+ E-Learning Modules1. For learning 24/7 anytime anywhere
2. Eventually posted on the DPI website
3. Long-term evolving project based on dashboards
4. Can be used by … Individual educators for self-paced learning PLC teams Higher education classes
June 2013
Finco & Torkelson
52+ e-Learning Modules:
1. Overview of WISEdashin LiveBinders under WISExplore
Retreat Grounding tab
2. WSAS Inquiry Module in LiveBinders under WSAS Data Inquiry tab
June 2013
Finco & Torkelson
+
WISEdash WSAS Data Inquiry
WSAS Dasboard
Inquiry
53
June 2013
Finco & Torkelson
54+WSAS Entry Points School Report CardACHIEVEMENT (Rdng & Math)• % of Students at Proficiency
LevelsGROWTH (K-8 Rdng & Math)• Year-to-year change
compared to state
GAPS (Rdng & Math)• Gap closure for subgroups
ON-TRACK (Rdng & Math)• 3rd Grade Reading & 8th
Grade Math
Provides focus for Data Inquiry The state assessment plays a major
role in external accountability Summative assessments can
reveal internal achievement issues◦ Marginalized subgroups◦ Inadequate progress◦ Persistent low achievement June 2013
Finco & Torkelson
55+Navigation Demo
June 2013
Finco & Torkelson
56+Navigation: Functionality “Must-Knows”
Dashboards
Filtering and clearing filters
Related Dashboards
Hovering
Opening up student lists Sorting student lists Individual Student Profiles
Managing layers Selecting and
copying Exporting
pdfs Excel ms word
Saving to favorites Recalling favorites
June 2013
Finco & Torkelson
57+Thinking Ahead about “Drilling-Down” Because WISEdash allows you to
“drill down” to specific students, think ahead about the role that the WSAS plays in planning for students. State assessments are external
indicators of internal work. Compare state assessment summative
results with local assessment results – use caution when comparing fall (WKCE) data with spring local data.
Understand that the current WSAS will be implemented for one more year – in fall 2013. Therefore, these analyses help prepare staff for the upcoming new era with the Smarter Balanced Assessment in 2013-15.
Respect confidentiality. Save data in a secure data folder.
CurrentWSAS
(WKCE & WAA)
FutureSBAC
Local Assessme
nts
Local data should predict external
assessment results
June 2013
Finco & Torkelson
58+
June 2013
Finco & Torkelson
59+Navigation: Functionality “Must-Knows”
Dashboards Filtering and clearing filters Related Dashboards Hovering Opening up student lists
Sorting student lists
Individual Student Profiles
Managing layers Selecting and copying Exporting
pdfs Excel ms word
Saving to favorites Recalling favorites
June 2013
Finco & Torkelson
60+Thinking Ahead about“Drilling-Down” Because WISEdash allows you to “drill down” to
specific students, think ahead about the role that the WSAS plays in planning for students.
Respect confidentiality. Save data in a secure data folder.
Student ListsWill you need lists of …• Students who are at
minimal or basic levels?
• Students who achieve at advanced levels?
• Students who took the WAA?
Student ProfilesWill you need individual student data such as …• Standards Performance Index (SPI)
“skill” data in reading or math?
• The primary disability and educational environment?
• The language proficiency level?
June 2013
Finco & Torkelson
61+ Demo – Drilling Down intoWSAS Data
Example: Student List of math “minimal” WSAS students in a school
June 2013
Finco & Torkelson
62+Demo – Drilling Down to theStudent Profile
Example: Note yellow “tabs”
for further details for a student
Provides entire WSAS test history
Note SPI scores are “extrapolated” percent correct scores. Sort to discover lower scoring skill areas.
June 2013
Finco & Torkelson
63+WSAS Data Inquiry – Get Started Go to your Report Card questions and choose
1 related to student achievement in math or reading.
We will use this question to apply the data inquiry process to the WSAS dashboard.
June 2013
Finco & Torkelson
64+Documenting Your Work-Introducing the Fillable Form
The WISExplore “Fillable Form” is designed to help you document the data inquiry process.
To use the Fillable Form, you must use a PC rather than an iPad, or MAC platform. Also, the Fillable Form is not compatible with Google Docs.
June 2013
Finco & Torkelson
65+ The Fillable Form Leads the team through the Data Inquiry
Process Guides thinking Keeps the team on task
June 2013
Finco & Torkelson
66+We’ll Use the Fillable Form to Guideour Data Inquiry Process QUESTION
Enter your data question and select the data source
INVESTIGATE Enter WISEdash. Navigate and apply filters to find the data
picture that answers the data question.
CLARIFY Document data findings. Fill in the areas indicated on the
Fillable Form.
HYPOTHESIZE Pose and categorize hypotheses of teacher and leadership
practices related to the data findings.
June 2013
Finco & Torkelson
67+How Do I Find the Fillable Form? Replaces the largeflip charts andmiscellaneous notespreviouslyused at Data Retreats
LiveBinder: go to www.livebinders.com/play/play/899070 (password: wisexplore)
Open up the Fillable Form
June 2013
Finco & Torkelson
68+ WSAS Question Topics Which question will you start with?Common WSAS Data
Inquiry Topics (Rdng/Math)
Our Data Inquiry Question
Achievement by grade level
Achievement by grade level - trends over time
Inconsistencies in grade level achievement
Achievement differences between comparisons (gaps)
Gap Trends by Gender Gap Trends by Disability Gap Trends by
Race/Ethnicity Gap Trends by ELL Status Gap Trends by Economic
StatusJune 2013
Finco & Torkelson
69+Question What meaningful question have you
determined from the examination of your report card?
June 2013
Finco & Torkelson
70+Enter the Data Question Type the meaningful data question in the top
section of the Data Inquiry Process Form.
June 2013
Finco & Torkelson
71+Selecting the Data Source Using the Fillable Form, select the WISEdash
dashboard needed to explore the data question – for this section, we will use the WSAS WISEdash dashboard.
June 2013
Fillable Form
Finco & Torkelson
72+ Investigate
Based on the data inquiry question, navigate the WSAS dashboard to locate the data picture that best answers your question.
June 2013
Finco & Torkelson
73+Investigation Steps: Saving a Data Picture.
Find the data picture that best answers your data inquiry question.
When you find the picture, save it on the Fillable Form.
To save the picture … Copy and paste (easiest) Use a “snipping tool” or similar tool Export to pdf and save the picture in
a folder Export to Excel and copy the picture
June 2013
Finco & Torkelson
74+ClarifyDocumenting data observations, stating specific data findings, trends and gaps
Remembering the Data Inquiry Question, view the data picture to shape the team’s observations
Observe the data, refine and state critical data findings with supporting details.
June 2013
Finco & Torkelson
75+ List the Data Findings With the Inquiry Data Question in mind, describe the data findings. What do you see in the data picture? What patterns do you observe?
June 2013
Well-written data findings:• Are objective – just facts, not opinions or questions• Are precise (include the data)• Are statements (complete sentences) understandable by
stakeholders• Include the test type and subject• Include the timeframe for the findings• Include the specific group of students
Finco & Torkelson
76+Sample Data Findings
June 2013
Non-Examples of Data Findings• Our kids didn’t do well in reading.• The special ed students went down.• There are so many students in the red – why?
Examples of Data Findings Related to the Data Question• In 8th grade Reading on the fall 2012 WSAS, over half (54%) of
SwD scored in the minimal category, while only 11% of Students Without Disabilities scored at that same level.
• 58.5% of Students Without Disabilities were below proficient, compared to 85.7% of Students With Disabilities below proficient in reading in fall 2012 on the same test.
No!
Yes!
Finco & Torkelson
77+ Identify the Data Findings
June 2013
Finco & Torkelson
78+ Criticality
June 2013
How do you determine which data findings are most critical to target for improvement? Some critical patterns and trends to note:
1. Persistent low achievement over time2. Declining achievement over time3. Increasing or persistent gaps between groups of
students
Finco & Torkelson
79+ Identify the Most Critical
June 2013
Finco & Torkelson
80+ Consider Trends and Patterns
June 2013
Finco & Torkelson
81+ Any Other Data Findings?
June 2013
Finco & Torkelson
82+Prioritize High Priority. Very critical. Data findings show
persistently low results, unacceptable gaps or declining performance.
Medium Priority. Serious, but not especially critical. Some concerns in the results due to inconsistencies, mediocre performance or slow progress.
Low Priority. Not critical. Data patterns should be monitored.
June 2013
Finco & Torkelson
83+ Prioritize
June 2013
Finco & Torkelson
84+ HypothesizeExamine the system
What practices, policies or procedures might be producing these results?
June 2013
Finco & Torkelson
85+Hypothesize Getting to Root Causes
June 2013
Finco & Torkelson
86+ Hypotheses of Practice
Posing educated guesses about school or classroom practices as possible underlying root causes for critical data findings.
June 2013
Finco & Torkelson
87+Posing Hypotheses: Focus on the Data Picture
Pose the question …
What is it that we are doing or not doing that may have contributed to this picture?
June 2013
Finco & Torkelson
+Importance ofHypotheses of Practice
Thoughtful posing of hypotheses of practice will help educators determine alterable school variables that impact results.
Identifying these variables will be a vital step to the proposed strategies in the School Improvement Plan.
June 201388
We have a
problem.
Hypotheses of
Practice Proposed Strategies
Desired
Results
Finco & Torkelson
+ Posing Hypotheses of Practice
Take quiet time to think about all of the causes for the data pattern.
Translate each “cause” into a “hypothesis of practice”.
Hypotheses of practice … Are our best educated guesses about what “we” are doing or
not doing that could be contributing to the results Are guided by the data findings Are shaped by both perceptions of practices and professional
experiences in the school Are guided by research-based practices Never place blame on student or family characteristics, or
any other unalterable factorsJune 201389
Finco & Torkelson
90+ Categorizing Our Thinking--
Hypotheses of
Practice
• Classroom Instruction & Assessment
• Instructional Planning & Preparation
• Learning Environment• Professional
Responsibilities• Human Resource
Leadership• Instructional Leadership• Organization
Management• School Climate• Collaborative Culture• Stakeholder
Relationships
June 2013
Finco & Torkelson
91+ Add Hypotheses of Practice Insert the new Hypotheses of Practice (HOPs) into
the Data Inquiry Process Form (step 3). List specific actions for each HOP that would be
needed to make measured improvements. (step 4)
For each HOP, select the appropriate category of improvement. (step 5).
June 2013
Fillable Form
Finco & Torkelson
92+Completion of the Data Inquiry Process Save the data inquiry process form and all
related data pictures in the data folder. Note the three final steps that will need to
continue after the Data Inquiry Process.
June 2013
93+
June 2013
Finco & Torkelson
94+
What did you learn through this Inquiry Process?
Reflecting…
June 2013
Finco & Torkelson
+HS
Completion Dashboard
Inquiry
95
96+HS COMPLETIONEntry Points
Consider the Accountability School Report Card
Provides focus for Data Inquiry
High School Completion plays a major role in external accountability
ON-TRACK• Graduation Rate
ENGAGEMENT• Dropout Rate
GAPS (Graduation)• Gap closure for
subgroups
97+HS COMPLETION Question Topics Which question is most important to explore?
Common HS COMPLETION Data
Inquiry TopicsMy Data Inquiry Questions
What proportion of our students graduate in 4 years? … in 5 years? … in 6 years?
What are our graduation rate trends over time?
What are the patterns of students who are non-completers?
How many students graduate with alternative diplomas?
What are our graduation gaps among subgroups of students?
98+About the HS COMPLETION Dashboard Data is provided
for the previous years (not current).
Note the six summary graphs for completion and non-completion.
Use the filters to view the graduation rates for subgroups.
View year-by-year trends.
99+Thinking Ahead about“Drilling-Down”
Think ahead about graduation detail investigationsthat are important.
Some helpful “drill-down” investigations when studying “non-completers.”
1. When did they enroll in the school and when did they exit the school? How many transferred from other schools? Study their enrollment history by using the enrollment tab.
2. Who are the noncompleters? What characteristics do they share – boys? Girls? SwD? EcD? ELL? Hispanic?, etc. This is a closer look at inequities and gap issues.
3. What is the achievement level of noncompleters? How many were proficient or above? How many were minimal or basic?
4. For students with disabilities—what were their primary disabilities?
Respect confidentiality. Save data in a secure data folder.
100+
101+HS COMPLETION Data Inquiry – Get Started Go to your data inquiry HS COMPLETION
question to start. Follow the four steps.
102+Use the Fillable Form to Guidethe Data Inquiry Process
QUESTION Enter your data question and .select the data source
INVESTIGATE Enter WISEdash. Navigate and apply filters to find the data
picture that answers the data question.
CLARIFY Document data findings. Fill in the areas indicated on the
Fillable Form.
HYPOTHESIZE Pose and categorize hypotheses of teacher and leadership
practices related to the data findings.
103+
June 2013
104+
What did you learn through this Inquiry Process?
Reflecting…
Finco & Torkelson
+
Attendance
Dashboard Inquiry
105
Finco & Torkelson
106+ ATTENDANCEEntry Points School Report Card
Attendance Rate• All and lowest
attending subgroup• Chronic Absenteeism
Rate
Summer 2013
Finco & Torkelson
107+ ATTENDANCE Question Topics Which questions are most important to explore?
Common ATTENDANCE Data
Inquiry TopicsMy Data Inquiry Questions
What are the differences in attendance rates for groups of students?
Which students have chronic absenteeism?
What is the achievement level of low attending students?
Summer 2013
Finco & Torkelson
108+ About the ATTENDANCE Dashboard Use the filters to
view the attendance rates for subgroups.
View year-by-year trends.
Summer 2013
Finco & Torkelson
109+Thinking Ahead about“Drilling-Down”
Some helpful “drill-down” investigations when studying “attendance.”
1. Who are the low-attending students?
2. How do attendance patterns align with WSAS achievement patterns?
Respect confidentiality. Save data in a secure data folder.
Summer 2013
Finco & Torkelson
110+
Summer 2013
Finco & Torkelson
111+ATTENDANCE Data Inquiry – Get Started Go to your data inquiry ATTENDANCE question
to start. Follow the four inquiry steps.
Summer 2013
Finco & Torkelson
112+Use the Fillable Form to Guidethe Data Inquiry Process
QUESTION Enter your data question and select the data source
INVESTIGATE Enter WISEdash. Navigate and apply filters to find the data
picture that answers the data question.
CLARIFY Document data findings. Fill in the areas indicated on the
Fillable Form.
HYPOTHESIZE Pose and categorize hypotheses of teacher and leadership
practices related to the data findings.
Summer 2013
113+
June 2013
Finco & Torkelson
114+
What did you learn through this Inquiry Process?
Reflecting…
Summer 2013
115
June 2013