2014 Accountability

System

2014Accountability

System

Jana SchreinerSenior Consultant

Accountability State Assessment

972-348-1480Jana.Schreiner@Region10.org

Resources

http://ritter.tea.state.tx.us/perfreport/account/2014/index.html

www.lead4ward.com

www.region10.org/accountability

Reading Percent Meeting Phase In StandardLevel II: Satisfactory

Percent Meeting Recommended Standard

Level II: Satisfactory

Region 2013 Region 2014 Region 2013 Region 2014

Grade 579% 79% NC 44% 46% +2

Grade 886% 85% -1 51% 50% -1

MathPercent Meeting Phase In Standard

Level II: Satisfactory

Percent Meeting Recommended Standard

Level II: Satisfactory

Region 2013 Region 2014 Region 2013 Region 2014

Grade 575% 80% +5 42% 45% +3

Grade 8 77% 80% +3 35% 39% +4

5th Math 5th Reading 8th Math 8th Reading50%

55%

60%

65%

70%

75%

80%

85%

90%

95%

100%

80% 79% 80%

85%

79%76%

79%82%

Region 10Texas

5th and 8th Reading and Math

Agenda

Overview Accountability System Ratings Safeguards Distinctions

2014 Ratings Labels

Rating based on 4 Indexes

Performance Index Framework

Index 1 Index 2 Index 3 Index 4

Student Achievement

Student Progress

Closing Performance

Gaps

Postsecondary Readiness

Rating based on 4 Performance

Indexes

Performance Standards on STAAR

1st Phase-in Level II

2nd Phase-in Level II

Final Level II Performance

Unknown

Dec. 2014Could

Chang

e

2014 Target= 55

Index 1: Student AchievementIndex 1: Student Achievement provides an overview of student performance based on satisfactory student achievement across all subjects for all students.

2013

Combined over All Subjects: Reading, Mathematics, Writing, Science, and Social Studies.

Student Groups: All Students. Performance Standards: Phase-in 1 Level II

(Satisfactory).

STAAR End-of-Course (EOC) Assessments(15 total): Reading I; Reading II; Reading III Writing I; Writing II; Writing III Algebra l; Geometry; Algebra ll Biology; Chemistry; Physics World Geography; World History; US History

English Language Learners (English and Spanish tests): ELLs in US schools Years 1-3 excluded ELLs in US schools Year 4 or more included

2014

Combined over All Subjects: Reading, Mathematics, Writing, Science, and Social Studies.

Student Groups: All Students. Performance Standards: Phase-in 1 Level II

(Satisfactory).

STAAR End-of-Course (EOC) Assessments (5 total): English l; English ll Algebra l Biology US History

English Language Learners (English and Spanish tests): ELLs in US schools Year 1 excluded ELLs in US schools Year 2 and

beyond included

Index 1: Student Achievement English I and II from Spring 2014 + Include Reading I and II from July 2013 and

December 2013 Substitute Assessments EOCs (PSAT, PLAN,

SAT, ACT, AP)

Standard at Meeting Final Level II (CCR Standard)

Counted as PASSER for Index I Counted as Meeting CCR Standard for

Index IV Not used in Index 2 and 3

• Add STAAR M, STAAR ALT, ELL progress measure

Index 2: Student Progress

Progress Measures by Subject Area and School Type

2013

Elem. School Middle School High School

READING

Gr. 4 Reading Gr. 6 Reading English l Reading

Gr. 5 Reading Gr. 7 Reading English ll Reading

_ Gr. 8 Reading _

_ English l Reading

_

MATHEMATICS

Gr. 4 Mathematics

Gr. 6 Mathematics

Algebra l

Gr. 5 Mathematics

Gr. 7 Mathematics

_

_ Gr. 8 Mathematics

_

_ Algebra l _

WRITING

_ _ English ll Writing

Proposed 2014

Elem. School Middle School High School

READING

Gr. 4 Reading Gr. 6 Reading _

Gr. 5 Reading Gr. 7 Reading _

_ Gr. 8 Reading _

_ _ _

MATHEMATICS

Gr. 4 Mathematics

Gr. 6 Mathematics

Algebra l

Gr. 5 Mathematics

Gr. 7 Mathematics

_

_ Gr. 8 Mathematics

_

_ Algebra l _

WRITING

_ _ _

STAAR Weighted Progress Rate

AllStudent

sAfrican Amer.

Amer. Indian Asian Hispani

cPacific Islande

rWhite

Two or MoreRaces

ELL Special Ed.

Total Points

Max.Points

Example Calculation for Reading Progress Number of Tests

100 50 40 30

Performance Results: Met or Exceeded Progress Number Percent

8080%

4080%

40100%

2067%

Exceeded Progress Number Percent

2020%

2040%

3075%

517%

Reading Weighted Progress Rate 100 120 175 84 479 80018

Index 2: Student ProgressIndex 2: 2013 Construction – Table 1

STAAR Weighted Progress Rate

All Students

African

Amer.Amer. Indian Asian Hispani

cPacific Islande

rWhite

Two or More Races

ELL Special Ed.

Total Points

Max.Points

ReadingWeighted Progress 100 120 175 84 479 800

MathematicsWeighted Progress 85 98 150 160 493 800

WritingWeighted Progress 140 170 310 400

Total 1282 2000

Index 2 Score (total points divided by maximum points) 64

Index 2: 2013 Construction – Table 2

Index 2: Student Progress

Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student group, students with disabilities, and English language learners.

By Subject Area: Reading, Mathematics

One point for Met progress levelTwo points for Exceeded progress level

Progress Measures by Subject Area and School Type

New for 2014:No Index 2 for High Schools (9-12 campuses) or AEAInclusion STAAR-Modified, STAAR-AltInclusion of ELL Students

Index 2: Student Progress

Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student group, students with disabilities, and English language learners.

New for 2014: Students who skip grades included

Students who transition from Spanish to English in mathematics included

3rd grade student who receive ELL progress measure will count

ELL Denials: Students whose parent(s) have denied ELL services included Considered as Non-ELL student for Index 2

Index 2: Student Progress

Where can I find info?

Campus rosters Student have either STAAR Progress or

ELL Progress

2013

Points based on STAAR performance:

Phase-in 1 Level II satisfactory performance: One point for each percent of tests MET Phase-in 1 Level II

By Subject Area: Reading, Mathematics, Writing, Science, and Social Studies.

Student Groups: Economically Disadvantaged Lowest Performing Race/Ethnicity from

2012

Index 3: Closing Performance GapsIndex 3: Closing Performance Gaps emphasizes advanced academic achievement of economically disadvantaged students and the two lowest performing race/ethnicity student groups.

2014

Points based on STAAR performance:

Phase-in 1 Level II satisfactory performance: One point for each percent of tests MET Phase-in 1 Level II

Level III advanced performance:Two points for each percent of tests at the Level III advanced performance standard.

By Subject Area: Reading, Mathematics, Writing, Science, and Social Studies.

Student Groups: Economically Disadvantaged Lowest Performing Race/Ethnicity from 2013…

groups must have 25 tests in reading AND math

Inclusion of ELL Students

Index 3: Closing Performance Gaps

Index 3: 2014 Construction – Table 1 (based on 2014 STAAR performance)

STAAR Weighted Performance Rate

Economically Disadvantaged

Lowest Performing Race/Ethnic Group - 1

Lowest Performing Race/Ethnic Group - 2

Total Points

MaximumPoints

Example Calculation for Reading Weighted Performance Number of Tests

80 40 25

Performance Results: Phase-in 1 Level II Satisfactory and above Number Percent

80100%

2050%

25100%

Level III Advanced Number Percent

4050%

00%

25100%

Reading Weighted Performance Rate 150 50 200 400 600

STAAR Weighted Performance Rate

Economically Disadvantaged

Lowest Performing Race/Ethnic Group - 1

Lowest Performing Race/Ethnic Group - 2

Total Points

MaximumPoints

Reading Weighted Performance 150 50 200 400 600

Mathematics Weighted Performance 125 100 90 315 600

Writing Weighted Performance 80 90 125 295 600

Science Weighted Performance 120 40 90 250 600

Social Studies Weighted Performance 50 40 80 170 600

Total 1430 3000

Index 3 Score (total points divided by maximum points) 48

Index 3: 2014 Construction – Table 2 (based on 2014 assessment results by subject area)

Index 3: Closing Performance Gaps

For Discussion……

ELL http://ritter.tea.state.tx.us/perfreport/account/2014/index.html

Index 4: Postsecondary Readiness

2013

Graduation Score: Combined performance across the graduation and dropout rates for:

Grade 9-12 Four-Year Graduation Rate for All Students and all student groups; or

Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index.

RHSP/DAP Graduates: All Students and race/ethnicity student groups.

Index 4: Postsecondary Readiness emphasizes the importance of earning a high school diploma that provides students with the foundation necessary for success in college, the workforce, job training programs, or the military; and the role of elementary and middle schools in preparing students for high school.

2014

Graduation Score: Combined performance across the graduation and dropout rates for:

Grade 9-12 Four-Year Graduation Rate for All Students and all student groups; or

Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index.

RHSP/DAP Graduates: All Students and race/ethnicity student groups.

STAAR Score: STAAR Percent Met Final Level ll for All Students and race/ethnicity student groups.

Additional Indicators Required by House Bill 5 (83rd Texas Legislature, 2013)

College Ready Graduates.

Definition: Page 8, TAPR glossaryRate: Page 7, campus TAPR… “both subjects”

Ind

ex 4

: Posts

econ

dary

Read

iness

IndicatorAll

Students

African

Amer.

Amer. Indian

Asian

Hispanic

Pacific

Islander

White

Two or

MoreRaces

ELLSpecial Ed.

Total Point

s

Max.Poin

ts

STAAR ScoreSTAAR % MetFinal Level ll onTwo or More Tests

29% 16% 40% 23% 38% 36% 182 600

STAAR Score (STAAR total points divided by maximum points) 30

Graduation Score (Gr. 9-12)4-yr. graduation rate

84.3% 78.8% 78.8% 91.6% 86.0% 44.2% 69.8% 533.5 700

5-yr. graduation rate

85.1% 78.8% 80.0% 92.1% 84.0% 48.9% 77.5% 546.4 700

Highest Graduation Total 546.4 700Graduation Score (best of total graduation points divided by maximum points) 78.0

RHSP/DAP Score4-yr. graduationPercent RHSP/DAP

82.7% 76.4% 83.6% 83.0% 325.7 400

RHSP/DAP Score (best of total RHSP/DAP points divided by maximum points) 81.4

Postsecondary/College-Ready Graduates ScoreCollege-Ready Graduates subject (ELA & Math)

82.0% 72.0% 78.0% 89.0% 321.0 400

College-Ready Score (total points divided by maximum points) 80.2

Overall Index ScoreSTAAR Score 30.0

Multiply

byWeight

Graduation Score

78.0

RHSP/DAP Score

81.4

College-Ready Score

80.2

Index Score (sum of weighted index scores)

Index 4: Postsecondary Readiness

STAAR Level II Final Performance Percent Met Final Level II on Two or More Assessments

Weighting of Indicators: ALL FOUR components

Post-Secondary Indicator: Percent Met Criteria on ELA AND MATH

Indicator WeightSTAAR Component 25%Graduation 25%Graduation Plan 25%Post-Secondary Indicators 25%

32

Index 4 Targets

Elementary-12 Middle School-13 High School- 18

21(changed as of April 25th posting)*

District--13

Districts, high schools, and multi-grade campuses-56 57 (changed as of April 25th posting)*

STAAR Component All four components

55%

5th percentile 5th percentile

Rating Labels: AEA

2014 System Standard accountability labels:

Met Alternative StandardImprovement Required

30%5th percentileNA

Distinction Designations2013 Distinction Designation

Campus Top Twenty-Five Percent: Campuses in the top quartile of their campus comparisongroup earn a distinction designation.

Student Progressbased on Index 2

Academic Achievement in: Reading/ELA Mathematics

2014 Distinction Designation

Campus Top Twenty-Five Percent:Campuses in the top quartile of their campus comparison group

Student Progress (based on Index 2) Closing Performance Gaps (based on Index 3)

Academic Achievement in: Reading/English Language Arts Mathematics Science Social Studies

Districts and Campuses Postsecondary Readiness:House Bill 5 (83rd Texas Legislature, 2013) expanded distinctionsfor districts and campuses for attainment of postsecondary readiness

Criteria must include indicators based on percentages of students who: Achieve college-readiness standards on STAAR; Earn nationally/internationally recognized business/industry

certification; Complete a coherent sequence of CTE courses; Complete dual credit or a postsecondary course for local

credit; Achieve college readiness standards on SAT, ACT, PSAT, or

ACT-PLAN; Earn college credit based on AP/IB performance.

Accountability Ratings and Distinction Designations

2013 and 2014 Accountability Rating(Districts and Campuses) 2013 Distinction Designations 2014 Distinction Designations

Met Standard

Campuses Only

Student Progress

Academic Achievement: Reading/ELA Mathematics

Districts and CampusesPostsecondary Readiness

Campuses Only

Student Progress Closing Performance Gaps

Academic Achievement: Reading/ELAMathematics

ScienceSocial Studies

Improvement Required N/A N/A

System SafeguardsSafeguard Measures and Targets:

Reporting system disaggregates performance by student group, performance level, and subject area.

Performance rates are calculated from the assessment results used to calculate Index 1: Student Achievement.

2013 targets for the disaggregated system-safeguard results: STAAR performance target corresponds to Index 1 (50%); STAAR participation target required by federal accountability (95%); Federal graduation rate targets and improvement calculations for 4-year rate (78%) and 5-year rate (83%); and Federal limit on use of alternate assessments (1% and 2%).

40

Indicator Entity All Students

African Amer.

Amer. Indian Asian Hispanic Pacific

Islander White Two or More Races

Eco.Disadv. ELL Special Ed.

Performance Rates*

ReadingState 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55%

Federal 79% 79% n/a n/a 79% n/a 79% n/a 79% 79% 79%

MathematicsState 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55%

Federal 79% 79% n/a n/a 79% n/a 79% n/a 79% 79% 79%

Writing 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55%

Science 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55%

Social Studies 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55%

Participation RatesReading 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95%

Mathematics 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95%

Federal Graduation Rates (including improvement targets)

4-year 80% 80% 80% 80% 80% 80% 80% 80% 80% 80% 80%

5-year 85% 85% 85% 85% 85% 85% 85% 85% 85% 85% 85%

District Limits on Use of Alternative Assessment Results

Reading

Modified 2% Not Applicable

Alternate 1% Not Applicable

Mathematics

Modified 2% Not Applicable

Alternate 1% Not Applicable

Texas Education Agency | Office of Assessment and Accountability | Division of Performance Reporting

20

14 A

ccou

nta

bility

Syste

m S

afe

gu

ard

Measu

res a

nd

Targ

ets

* Targets for 2014 correspond to the performance target for Index 1: Student Achievement.