data analysis state accountability. data analysis (what) needs assessment (why ) improvement plan...
TRANSCRIPT
Data Analysis State
Accountability
Data Analysis(What)
Needs Assessment
(Why)
Improvement Plan
(How)
Implement and Monitor
Details
Index Framework Statutory Goal
Improving Student achievement at all levels in the core subjects of the state curriculum
1
Index Framework Statutory Goal
Ensuring the progress of all students toward achieving Advanced Academic Performance
2
Index Framework Statutory Goal
Closing Advanced Academic Performance level gaps among groups
3
Index Framework Statutory Goals
Closing gaps among groups in percentage of students graduating under the recommended high school program and advanced high school program
4
Index 1: Student Achievement
Index 2: Student Progress
Index 3: Closing Performance Gaps
Index 4: Postsecondary Readiness
System Safeguards
Why a Performance Index ?
With a performance Index, the resulting rating reflects overall performance for the campus or district rather than the weakest performance of one student group/subject area.
Multiple indexes can be used in the framework to ensure accountability for every student.
Any number of indicators and student groups can be added to the system without creating additional targets for campuses and districts to meet.
2013
Met Standard
Met Alternative StandardImprovement Required
Index Standards
Index Score
50
AEA-25
5th Percentile
Index Score
55
AEA-30
Index Score
75
AEA-45
Differences
English Language Learners
Student Groups…Economically Disadvantaged
African AmericanAmerican IndianAsianHispanicPacific IslanderWhiteTwo or more races
Special Education
Minimum Group Size
25
Common
Elements
If student was enrolled on the campus/district on this date:
Then these results are included in the campus/district accountability subset
Fall 2011 enrollment snapshot
EOC summer 2012
Fall 2012 enrollment snapshot
EOC Fall 2012
EOC Spring 2013
Grade 3-8 Spring 2013
Different
“Let Go”Keep
Different
“Let Go”Keep
Minimum Group Size 25 30/10/50 or
50/10/200
What does this report tell you about a
campus?
New Reports• Calculation Report-Tables used to
aggregate scores to determine Index Points
• Data Table- Table of disaggregated data used for the Calculation Report. The highlighted cells indicate data used in calculations.
Index 1: Student
Achievement
No Minimum Size3 year average if less than
10 students
Which student groups are calculated in Index 1?
Index 1 :Student Achievement
Subjects: Combined over Reading, Mathematics, Writing, Science, and Social Studies.
Tests: STAAR English, STAAR Spanish, EOC, STAAR and EOC Modified and Alternate, TAKS Grade 11
Performance Standards: Phase-in 1 Level II
(2013)
MSR: None
# Met Phase in Level II for Reading
# Met Phase in Level II for Writing
# Met Phase in Level II for Math
# Met Phase in Level II for Science# Met Phase in Level II for Social Studies
# Tested Reading
# Tested Writing
# Tested Math
# Tested Science
# Tested Social Studies
What does the calculation report indicate about a
campus?What would an Index score
of 45 indicate about the campus?
What are the strengths and weaknesses of the campus based on the calculation report?
What reflective questions would you ask the campus about this data?
What are your unanswered questions about this campus based on the calculation report?
Index 2: Student Progress
We do not know? Scores for :Did not Meet Expectations Met ExpectationsExceeded Expectations
The Index scores that identifies the lowest 5%
What we do know?
Subjects Reading
Math
Writing
Applies to available grades
Student Groups
Two or More Races
Pacific IslanderHispanic
Asian
American Indian
African American
Special Education
ELL
White
All Students
Minimum Size CriteriaAll Students = 10 testsRace/ Ethnicity groups = 25
Methodology
Met- one point for each percent of students at the Met growth expectation levelExceeded- two points for each percent of students at the Exceeded growth expectations level
Set a side for a minute
Methodology
Met- one point for each percent of student at the Met growth expectation levelExceeded- two points for each percent of students at the Exceeded growth expectations level
How is the data in Index 2 different from Index 1?
How does improved performance on Index 2 impact the other
Indexes?
What advice would you give this campus to impact Index 2? (using
the sample reports)
Index 3: Closing
Performance Gaps
What you need to know to calculate Index 3?
Subjects…
• STAAR English 3-8 and STAAR Spanish 3-5 at phase-in Level II
• EOC at phase-in Level II for spring, and the previous fall and summer
• STAAR 3-8 and EOC Modified and Alternative at Level II
• Retest results 5 and 8 from 1st retest• TAKS Grade 11 in 2013
Results include…
2 lowest performing race/ethnicity groups from the previous year
Student Groups…Economically Disadvantaged
African AmericanAmerican IndianAsianHispanicPacific IslanderWhiteTwo or more races
Accountability Subset…
Minimum Group Size… >=25 for Race/Ethnicity groups
Methodology…
Phase-in Level II- 2013 and beyond- one point for each percent of students at the phase-in Level II performance standard and above
Advanced Level III-2014 and beyond- one additional point for each percent of students at the Level III performance standard
Calculations
Number of Tests
Number at Phase in Level II
Number of Tests
Number at Level III
2014
Economically Disadvantaged group always
evaluated
Set a Side
Set a Side
How will each subject tested affect the
overall Index 3 score?
What recommendations would you make to this campus based
on the sample reports?
Index 4: Postsecondary Readiness
Indicators
STAAR Percent Met Final Level II on One or More Tests
Grade 9-12 Graduation Rate
Grade 9-12 Annual Dropout Rate
Recommended/ Distinguished Achievement (Advanced) High School Program (RHSP/DAP)
2013-2014
STAAR Percent Met Final Level II on One or More TestsIncludes Assessment results
for:STAAR English (Grade 3-8 and Spanish (Grade 3-5) at final Level II performance standard for assessments administered in the springEOC at final Level II performance standard for assessments administered in the spring and the previous fall and summerSTAAR Grades 3-8 and EOC Modified and Alternative at final Level II performanceRetest results
2013-2014
Number of Students Met final II Standard on One or More Tests
Number of Students with One or More Tests
2013-2014
Class of
2011 and beyond Student Groups:
All Students ELL-Identified in Grade 9 Special Education 7 Race/ Ethnicity Groups
25
Graduation Rate
Graduates
Graduates + continuers +
GED recipients + dropouts
2013 and beyond
Student Groups: All Students ELL-Identified in during reported year Special Education 7 Race/ Ethnicity Groups
Annual Drop Out Rate
Campuses with Grade 9, 10, 11, & 12
25
Number of students who dropped out during
year
Number of students enrolled during year
Student Groups: All Students 7 Race/ Ethnicity Groups
Recommended/ Distinguished Achievement High School Program
25
Number of prior year graduates with graduation
codes for RHSP or DAP
Number of prior year graduates
Index Standards
Index Score
50
AEA-25
5th Percentile
Index Score
55
AEA-30
Index Score
75
AEA-45
Why is some of the data marked out?
Why is only graduation rate and RHSP/DAP
calculated in the sample report for Index 4 points?
System Safeguards
Purpose• Ensure system disaggregates
performance by student group, performance level, subject area, and grade
• Target for disaggregated results meet and exceed federal requirements– Performance Target– Participation Rate – Graduation rate targets and improvement– Limit on Alternative Assessments
Impact• Results are reported for any cell that
meets minimum size criteria.• Failure to meet the safeguard target
for any reported cell must be addressed
• Performance on the safeguard indicators are incorporated into the Texas Accountability Intervention System (TAIS)
How does the system safeguards ensure high
expectations for all students?
Using these sample reports, how would you advise a
campus that met all Index standards but only 85% of the system safeguards?
Who are our AEA campuses?
Current 10 eligibility Criteria Primarily Grades 6-12
AEA Eligibility
Residential Facilities
No rating for 2013
What’s different for AEA?
GED
What’s different for AEA?
GED 4, 5 and 6 Year Graduation rates
Choose the best
4, 5 and 6 Year Graduation rates
What’s different for AEA?
Dropout Rate
Less then 20%
Bonus points given for Index 4
75 %Graduation
and GED Score
What’s different for AEA?
25 %% met Level II
on one or more tests
Alternate Education Accountability
Index Score
50
AEA-25
5th Percentile
Index Score
55
AEA-30
Index Score
75
AEA-45
AEA
BON
US
POIN
TSRHSD and DAP Plans
Continuing Student who Graduate in 5th or 6th year
Graduating/GED for “statutorily excluded students”
What is the 4 year graduation rate?
What happens if you do not meet graduation for a student group?
What effect does drop out rate have
on index score?
Why will elementary and middle schools not be scored on Index 4 this year?
What information can the AEA Index Scores and the System
Safeguards data tell you about alternative campuses?