la rti conference 6.15.11 elementary handout · • data guru – helps prepare for...

6/16/2011

1

Holly A. Paczak, Ed.S.

Teams Intervening Early to Reach all Students (TIERS) Groupwww.accountabilitydata.org

LSU Health Sciences CenterHuman Development Center

Response to Intervention (RtI)

• Practice of providing high quality instruction and interventions matched to student need,

• monitoring progress frequently to make changes in instruction or goals, and

• applying child response data to important educational decisions

From: Response to Intervention: Key Terms and Acronyms, 11/2007

How Does Data Analysis “Fit” within a Response to Intervention Model?

Data QualityHow Do You Know if the Data Collected/Used is of High Quality?

Data Quality Standards

TimelyAccurateo Reliable

ConsistentObjective

o ValidCompleteCredible

SecureUsefulo Interpretableo Relevanto Transparento Accessible

Data collected, submitted, analyzed, and reported must be:

Data Routines

All About Data: The Foundation of Your RtI Plan Teams Intervening Early to Reach All Students www.accountabilitydata.org

6/16/2011

2

What Assumptions Do You Have About Data Based Decision Making (DBDM)?

•How important is DBDM to your school?

•Do you believe DBDM should be ongoing or just 3 times a year?

•Do you as principal think it is important?

•Do you make decisions about instructional practices based on data?

•Do you as teachers make decisions about students based on data?

• Core Instruction and Behavior Support

• Academic and Behavioral Goal Setting

• Changes to Students’ Services

• Where to Additional Resources

Data Informs Decisions About:

Data Based Decision MakingData Based Decision Making

Data Should be Used to Drive:

– Meetings, Instruction, School Policies & Procedures

– Root Cause Analysis leading to a hypothesis(es)

– Improvement Planning

– Evaluation (effectiveness)

IES ‘Data Use’ Practice GuideIES ‘Data Use’ Practice Guide

http://ies.ed.gov/ncee/wwc/pdf/practiceguides/dddm_pg_092909.pdf

1. Make data part of an ongoing cycle of instructional improvement

2. Teach students to examine their own data and set learning goals

3. Establish a clear vision for school-wide data use

4. Provide supports that foster a data-driven culture within the school

5. Develop and maintain a district-wide data system

There is a Process for Using Data!

Ongoing Collaboration Time

• Promote a Data Culture

• Spread the Data Responsibilities

• Use Existing Structures

• Effective Scheduling


6/16/2011

3

Who is on Your Team?

What Roles Do They Have?

What are the roles?• Presenters

– Responsible for presentation of data overview • Data Team Members

– Work with small groups during brainstorm and analysis work, as well as prioritization of questions

• Data Guru– Helps prepare for meeting-analyzes data, builds

data tables, builds data displays• Participants

– Rotating Faculty and Staff to participate in brainstorming, identify questions for digging into data, etc.

Now that your team is in place, what are we doing in all of those meetings?

Data Overview Meeting

Set Meeting Agenda

State the Purpose

Present theData

Analyze and

Brainstorm

Record Questions

Prioritize Questions

Set Next Steps for Digging into the Data

What the Data Team Does

• Looks at data to identify critical areas of need at the system level as well as the student level

• Uses data to inform selection of suitable interventions as well as the group(s) that should receive them

• Uses data to determine a baseline measure as well as ongoing, periodic assessments of progress during the intervention

Courtesy of Matthew Klare, Ph.D., NDPC-SD, 209 Martin Street, Clemson, SC 29631, [email protected]

(Kovaleski & Pedersen, 2008)

The Data Team Supports….

• Generation of Strategies• Selection of Strategies• Planning for Implementation• Supporting the Implementation• Identification of Non-responders


6/16/2011

4

What are Important Data ?What are Important Data ?Big 4…• Attendance • Behavior• Academics • Parental Involvement Efforts

Courtesy of Matthew Klare, Ph.D., NDPC-SD, 209 Martin Street, Clemson, SC 29631, [email protected]

Data Activity

• Create a Data Inventory– Consider How this Data is Used?

– Is this Data Important for Improvement?

– Reduce Amount to Relevant Information

Essential To Identify:•Areas to Target

•Methods to Measure Targeted Areas

•Identify Desired Outcomes

•Methods to Measure Change

A Model for Data UseConsist of three phases w/ several steps:

• Phase 1: Preparation– Identify relevant data– Conduct Data Anaylysis

• Phase 2: Inquiry– Test hypothesis

• Phase 3: Action– Plan for improvement– Evaluate progress

Data Analytics

The key to identifying relevant data is to ensure that you clearly

define or select a specific problem or issue.

Problem DescriptionThe described problem should answer:1. What is the problem?

This should explain why the team is needed

2. Who has the problem? This should explain who needs the solution and

who will decide the problem/issue has been resolved

3. Where did the problem occur?4. When did the problem occur?

This should provide the context and timeframe of the problem/issue


6/16/2011

5

Analysis is based upon what the problem is…

The question “WHY” comes into play

Hypothesis Testing

Guiding Questions1. What actions in our practice might have contributed

to these results?

2. Has there been any information that would lead us to reject or fail to reject the stated hypotheses for our data patterns?

3. Given our data picture, are there any other possible explanations from our practice that we might pose?

Set Goals & Evaluate Progress• Establish Short-Term Goals

• Establish Long-Term Goals

• Assess Current Resources

• Strategies & Supports Needed

• How are you Measuring Progress?How Can We Make This Work in

Our School?

Classroom Walk-thrusClassroom Walk-thrus

• Walk-Thrus Provide Great Information: – Effective Instruction– Differentiated Instruction– Classroom Management– Student Engagement

Instructional Planning Forms


6/16/2011

6

Instructional Procedures Materials Arrangement Time Motivational Strategies Focus or Skill Teaching Strategies

Instructional Planning Form

Data and SchedulingData and Scheduling

Scheduling: What’s the Big Deal?Does your schedule allow…..

A core block of reading and math for All Students?

Tier 2 & Tier 3 Interventions?

Opportunities to Support general education teachers with Tier 2 & Tier 3 Intervention and Collaboration?

Flexible Grouping?

Administrator’s RoleDevelop Schedules that allow Sufficient Time for Data AnalysisProvide enough Personnel to deliver Careful Analysis.Identify Appropriate Instructional Programs to Support and Train your staff

Torgesen, Houston, & Kosanovich, 2007

Supportive Scheduling

Step 1Create a scheduling team or committeeEstablish or review your school’s RtI model

Step 2Examine staff capacity and availabilityAnalyze data for incoming and returning students

Supportive Scheduling

Step 3Universal ScreeningDetermine number of students in need of Tier 2 & 3 interventions

Step 4Ask the committee, “Who, What, Where, Delivered By, & When?”Draft Different Schedules to see what Works


6/16/2011

7

Diagnose Your Graph

Design I.Q. ?

Diagnose Your Graph

Design I.Q. ?

Thank You Stephen Fewhttp://www.perceptualedge.com/

Thank You Stephen Fewhttp://www.perceptualedge.com/

Which graph makes it easier to determine whether Mid-Cap U.S. Stock or Small-Cap U.S. Stock has the greater share?

Pie Chart Bar Chart

Which of these Tables is Easier to Read?

Top Table

Bottom Table

Question 4: Which Graph makes it Easier to Focus on the Pattern of Change through Time, instead of the Individual Values.

Bar Graph

Line Graph

Question 5: Only One of these Graphs Accurately Encodes the Values. The Other Skews the Values in a

Misleading Manner. Which Graph presents the Data Accurately?

Graph A Graph B

Question 6: Which map makes it easier to find all of the counties with positive growth

rates?

Map A Map B


6/16/2011

8

Which Graph is Easier to Look at?

Graph A

Graph B

A

B

Question 10: Which Table allows you to See the Areas of Poor Performance more Quickly?

Table A Table B

Simple Rules of Graphing Data1. Select a Chart

Type

2. Add Context

3. Eliminate the nonessential

4. Emphasize the Important

5. Use Color Strategically

6. Ensure Sufficient Contrast

7. Provide interpretation

8. Be Consistent

Data Walls

What’s your Data Wall look like?

Data Based Problem Solving

Thanks to Kristin Johnson

•What patterns exist?

•What hypotheses can you develop?

•What additional information can help?

Referrals by Teacher


6/16/2011

9

Referrals by Location

Implementation Integrity: The Weak Link in Data

Quality

Key Components to Fidelity/Integrity

AccountabilityUnderstandingFeasabilitySystems Support

Chafouleas, et al., 2009

Making the Checklist

What are the Steps?

List Item Per Step

Check Yes or No

What Works to Improve Integrity?• Training, including

Modeling, Coaching, & Feedback

• Routine Integrity Checks with Feedback

• Routine Progress Monitoring with Feedback


6/16/2011

10

Questions?For further information please contact:

[email protected]

Thank You!


la rti conference 6.15.11 elementary handout · • data guru – helps prepare for...

Documents