10+ Ways to Analyze Data

Presenter: Lupe Lloyd

Lupe Lloyd & Associates, Inc.

Accountability Systems

• State Accountability or AEIS• Federal Accountability or AYP• Performance-Based Monitoring Analysis

System or PBMAS• Data Validation (Leaver, Assessment,

Discipline)

Critical Success Factors

Paradigm shift from intuition, tradition, or convenience…

• Scattered staff development / smorgasbord• Budgetary decisions based on prior practice or

priority programs• Staff assignments based on interest and

availability• Reports to the community about school events• Goal setting by administrators or teachers based

on favorite initiatives or fads

…and other school culture cycles

• Staff meetings that focus on operations and dissemination of information

• Parent communications via twice-a-year conferences, open-houses and newsletters

• Grading systems based on each teacher’s criteria of completed work and participation

• Periodic administrator team meetings focused solely on operations

To Data-Driven Decision Making

• Focused staff development that addresses problems/needs identified by data

• Budget allocations to programs based on data-informed needs

• Staff assignments based on skills needed as indicated by the data

• Organized factual reports to the community about the learning progress of students

• Goal–setting based on data about problems and possible explanations

…and more… Data Driven Decision Making

• Staff meetings that focus on strategies and issues raised by the local school’s data

• Regular parent communication regarding the progress of their children with specific data

• Grading systems based on common criteria for student performance that reports progress on the standards as well as work skills

• Administrative team meetings that focus on measured progress toward data-based improvement goals

Top 10 Uses of Data in Schools

1. Data can uncover problems that might otherwise remain invisible

2. Data can convince people of the NEED for CHANGE3. Data can confirm or discredit assumptions about

students and school practices4. Data can get to the root cause of problems, pinpoint

areas where change is most needed, and guide resource allocation

5. Data can help schools evaluate program effectiveness and keep the focus on student learning results

Top 10 Uses of Data in Schools

6. Data can provide the feedback that teachers and administrators need to keep going and stay on course

7. Data can prevent over-reliance on standardized tests

8. Data can prevent one-size-fits-all and quick solutions

9. Data can give schools the ability to respond to accountability questions

10. Data can build a culture of inquiry and continuous improvement (Love, 2000)

Complexity of Student Assessment Data

DAILY• Formative Assessments• Are the teachers asking higher order thinking questions

to assess on-going learning?• Are students learning it?• Is there other evidence of learning taking place?

Complexity of Student Assessment Data

WEEKLY• Classroom Curriculum Tests, Quizzes• Are we testing what was taught?• Did students learn it?• Is there evidence of learning?

Complexity of Student Assessment Data

CURRICULUM UNITS• Performance assessments• Can students apply and generalize what

they have learned?• What evidence of cognitive learning skills

do they have?

Complexity of Student Assessment Data

STUDENT REPORT CARDS• How are students reporting in general?• Do the grading standards truly reflect their

performance?

Complexity of Student Assessment Data

Diagnostic Assessments• What are students’ cognitive strengths and

needs?• How are those needs supported in the

classroom?

Complexity of Student Assessment Data

BENCHMARKING• Are students meeting the state standards?• Are we testing what is taught?• Are we testing with the same rigor?

Complexity of Student Assessment Data

State and National Assessments• Are all students performing optimally?• Are all subgroup populations performing

optimally?

Factors That Affect Student Performance

Individual, educational, and demographic factors

Previouseducationalexperienceand success

Behaviors,attitudes, &aspirations

Current programs,practices,& support

An Integrated Database

INTEGRATEDDATA BASE

DEMOGRAPHICDATA

DATA THAT SUPPORTS EQUITY, ACCOUNTABILITY, AND

IMPROVEMENTS

STUDENT PERFORMANCE

DATA

STUDENTEDUCATION

DATA

Systemic Database System

INTEGRATEDDATA BASE

Student DemographicsGender, ethnicity, disability, economic level,

English proficiency, mobility, & other characteristics

Performance Data• State Assessment Data • Standardized Test Data • Performance Assessments• Diagnostic assessments • Classroom Assessments • Grades • Attendance • Disciple • Dropout rates • Graduation rates

Education Data• Grade level• Feeder School• Prior Education•

Subjects/Courses• Special Ed.• Bilingual Ed.• School-to-career• Title I

Unlimited Disaggregation Across:• Multiple Student Characteristics• Multiple Educational Factors• Multiple Performance Measures

PLC Data Team for Data Driven Dialogue

DATA TEAM• Establishes goals• Defines questions• Collects and organizes

data• Makes meaning of data

or disaggregates• Communicates actions

needed• Evaluates actions

DATA COACH• Member of Data Team• Communicates goals• Provides Data Training• Assists with data

disaggregation• Assists with implementation

of actions• Collects outcomes for

evaluation

CRITICAL QUESTIONS FORDATA COLLECTION

Performance• How are specific groups of students; i.e., All, African

American, Hispanic, White, Economical Disadvantaged performing on state and standardized assessments in all contents?

• How are students, who are enrolled in different learning academies, specific course offerings, and special programs performing?

• What are the proficiency levels of various student groups in content and skill areas?

• How do the grades given to students compare to their scores on state and other standardized measures?

CRITICAL QUESTIONS FORDATA COLLECTION

Feeder System Analysis: • What are the characteristics and literacy

skills of the incoming ninth-grade class?• How has each subgroup performed in the

last three years for state assessments, attendance, and discipline trends?

• What is the failure rate of students by gender and ethnicity in core courses?

CRITICAL QUESTIONS FORDATA COLLECTION

ATTENDANCE• What are the enrollment patterns at different

grade levels?• What are the characteristics of students with

high absence rates?• How does absence affect student performance? • Are students with high attendance rates

achieving success?• What types of students are dropping out?

CRITICAL QUESTIONS FORDATA COLLECTION

CURRICULUM• Is the curriculum vertically and horizontally

aligned to the TEKS.• Is the scope and sequence aligned to the testing

schedule?• Are teachers teaching the TEKS to be assessed

with Student Expectations and rigor?• In the areas of low performance such as reading

and math, what strengths and weaknesses are in the curriculum?

CRITICAL QUESTIONS FORDATA COLLECTION

INSTRUCTIONAL PROGRAM• Do grading patterns suggest inconsistencies in

grading criteria across learning academies, subject areas, or course offerings?

• Are students who are enrolled in specific programs achieving positive results on different measures?

• Are specific groups of students enrolling in specific courses?

• What is the failure rate of students by gender and by ethnicity in core courses?

• How is SES or other interventions showing improvement?

CRITICAL QUESTIONS FORDATA COLLECTION

DROPOUTS• What is impacting the completion,

graduation, and dropout rates?• What are the characteristics of these

students?• By subgroup, what programs have they

participated in that have not resulted in graduation?

• How many overage students are in need of credit recovery?

Data Driven Dialogue

The Inquiry Cycle

Create a Data Room with Data Walls

Contact Information

• LUPE LLOYD• National Educational Consultant• Lupe Lloyd & Associates, Inc.• Data and Instructional Coach• Specialist in Bilingual/ESL support• Professional Service Provider• lupelloydinc@sbcglobal.net• (210) 872-1960