alternative education accountability (aea) procedures texas association for alternative education...

Alternative Education Accountability (AEA) Procedures

Texas Association for Alternative Education (TAAE) Conference February 8 – 10, 2007

Nancy RinehartTEA, Performance Reporting Division

2

Today’s Discussion will cover…

Accountability Calendars – 2006 and 2007 2006 Alternative Education Accountability (AEA) Ratings

Overview Preview of 2007 AEA Procedures 2007 AEA Indicators Preview of 2008 AEA Procedures Technical Assistance Team (TAT) Campuses TEASE Accountability Accountability Resources

3

Recent Events

August 1 2006 Ratings release on TEA public website

September 2007 AEA campus registration

October 24 Final 2006 Ratings and GPA release on TEASE

October 25 Final 2006 Ratings and GPA release on TEA public website

November 9 2005-06 AEIS release on TEASE

November 16 2005-06 AEIS release on TEA public website

December 7 2005-06 School Report Cards (SRCs) released

December 8 2005-06 Pocket Edition published (web and print)

December 12 2007-08 Public Education Grant (PEG) list released on TEASE

4

2007 Accountability Timeline

January and Development of 2007 Accountability February 2007 System

February 26-27 Educator Focus Group Meeting

March 21 Commissioner’s Accountability Advisory Committee Meeting

Early April Final Decisions Announced by Commissioner

May/June 2007 Accountability Manual posted online

August 1 Release of 2007 Accountability Ratings

September 2008 AEA campus registration

2006 AEARatings Overview

6

2006 AEA Ratings Overview

AEACampus

Type

AEA: AcademicallyAcceptable

AEA: AcademicallyUnacceptable

AEA:Not Rated –

Other Total

AEC Of Choice 321 16 0 337

Residential Facility

75 3 2 80

Total 396 19 2 417

A total of 417 AECs and 84 charter operators were evaluated under AEA procedures in 2006. The AEA ratings distributions follow.

7

2006 AEA Ratings Overview (cont.)

2006 AEA Ratings – Charter Operators Total

AEA: Academically Acceptable 76

AEA: Academically Unacceptable 8

Total 84

Preview of 2007 and BeyondAEA Procedures

9

Principles of AEA Procedures

AEA procedures evaluate the performance of alternative education campuses (AECs) including charters and charter campuses and are based on these principles:

o AEA procedures apply to AECs, not programs.

o AEA procedures apply to AECs and charters that are dedicated to serving students at risk of dropping out.

o AEA procedures apply only to those AECs that qualify and register annually for evaluation under AEA procedures.

o AEA procedures do not apply to DAEPs or JJAEPs.

o AEA procedures do not apply to standard campuses, even if the campus primarily serves at-risk students.

10

The 3 AEA Rating Labels

AEA: Academically Acceptable

AEA: Academically Unacceptable

AEA: Not Rated – Other

11

Required Improvement

An AEA: Academically Acceptable rating may be achieved by meeting the absolute standards for each indicator or by demonstrating Required Improvement.

Required Improvement compares prior year performance to current year performance. In order to qualify for this comparison, the target group (All Students or any student group) must meet a minimum size requirement for the prior year.

12

Charters Evaluated under AEA

Charter ratings are based on aggregate performance of the campuses operated by the charter.

Performance results of all students in the charter are included in the charter’s performance and used in determining the charter’s rating.

Charters rated under AEA procedures are evaluated on the same indicators as registered AECs.

13

Charters Evaluated under AEA (cont.)

Charters that operate only registered AECs are evaluated under AEA procedures.

Charters that operate both standard campuses and registered AECs have the option to be evaluated under AEA procedures if at least 50% of the charter’s students are enrolled at registered AECs. TEA contacts the charter to obtain its preference. If a preference cannot be obtained, then the charter is evaluated under standard accountability procedures. If fewer than 50% of the charter’s students are enrolled at registered AECs, then the charter is evaluated under standard accountability procedures.

14

AEA Campus Types

Two types of campuses have the option to register for evaluation under AEA procedures:

o AECs of Choice – at-risk students enroll at AECs of Choice to expedite progress toward performing at grade level and high school completion.

o Residential Facilities – education services are provided to students in residential programs and facilities operated under contract with the TYC, students in detention centers and correctional facilities registered with the TJPC, and students in private residential treatment centers.

AECs that choose not to register under AEA are evaluated under the standard accountability procedures.

15

AEA Registration Criteria

Ten criteria are required for campuses to be registered for evaluation under AEA procedures.

The requirements in criteria 6-10 may not apply to charter campuses (depending on the terms of the charter) or for community-based dropout recovery campuses established in accordance with TEC §29.081(e).

The requirements in criterion 9 apply to Residential Facilities only if students are placed in the facility by the school district.

16

AEA Registration Criteria (cont.)

1. The AEC must have its own CDC number to which PEIMS data are reported and test answer documents are coded.

2. The AEC must be identified in AskTED as an alternative campus.

3. The AEC must be dedicated to serving students at risk of dropping out of school as defined in TEC §29.081(d).

4. The AEC must operate on its own budget.

17


5. The AEC must offer nontraditional settings and methods of instructional delivery designed to meet the needs of the students served on the AEC.

6. The AEC must have an appropriately certified, full-time administrator whose primary duty is the administration of the AEC.

7. The AEC must have appropriately certified teachers assigned in all areas including special education, bilingual education, and/or ESL to serve students eligible for such services.

18


8. The AEC must provide each student the opportunity to attend a 7-hour school day according to the needs of the student.

9. If the campus serves students with disabilities, the students must be placed at the AEC by their ARD committee.

10. Students with disabilities must receive all services outlined in their IEPs. LEP students must receive all services outlined by their LPAC. Students with disabilities and LEP students must be served by appropriately certified teachers.

19

2007 Registered AECs

A total of 472 AECs are registered for evaluation under 2007 AEA procedures.

A list of these campuses is on the AEA website at http://www.tea.state.tx.us/aea/.

Each registered AEC must meet the 70% at-risk registration criterion in order to receive an AEA rating on August 1, 2007.

20

At-Risk Registration Criterion

An AEA at-risk registration criterion was implemented in 2006. An at-risk registration criterion:

o restricts use of AEA procedures to AECs that are dedicated to serving at-risk students,

o recognizes that by definition students served at Residential Facilities are at-risk of dropping out of school, and

o enhances at-risk data quality.

21

At-Risk Registration Criterion (cont.)

Each registered AEC must have a minimum percentage of at-risk students enrolled on the AEC verified through current year PEIMS fall enrollment data in order to be evaluated under AEA procedures.

The at-risk criterion is 70% in 2007 and 75% in 2008 where it is expected to remain.

22


Two safeguards have been incorporated for those AECs that are below the at-risk requirement.

1. Prior-Year PEIMS At-Risk Data Safeguard: If a registered AEC does not meet the at-risk criterion in the current year, then it remains under AEA if the AEC meets the at-risk criterion in the prior year.

For example, an AEC with an at-risk enrollment below 70% in 2007 and 70% in 2006 remains registered in 2007.

23


2. New Campus Safeguard: If a new campus is registered for evaluation under AEA procedures, then the AEC is not required to meet the at-risk criterion in its first year of operation. This safeguard provides an accommodation for new campuses with no prior-year data.

24


In April 2007, letters will be mailed to the AECs that did not meet the 2007 at-risk registration criterion informing them that the AEC will shift from AEA to standard accountability and that the AEC will be evaluated under 2007 standard accountability procedures.

The Final 2007 Registered AEC list will be posted on the AEA website in May 2007. This list will contain the AECs that will receive a 2007 AEA rating.

A list of the charter operators that will be rated under 2007 AEA procedures will also be posted on the AEA website in May 2007.

25


A State Compensatory Education Questions and Answers (Q and A) document is on the TEA website at:

http://www.tea.state.tx.us/school.finance/audit/sce_presentation.html

This Q and A addresses proper coding of at-risk

students. Also, ESC Compensatory Education contacts can assist with at-risk questions.

26

Attribution of Data to Registered AECs

For 2007 accountability: Campus accountability subset determines attribution of

AEC test data. Only test results for students enrolled on the same campus on the PEIMS enrollment snapshot date (the last Friday in October) and on the testing data are included in the campus performance measure. Accountability subset does not apply to exit-level retests.

2005-06 leaver data are attributed to the last campus of attendance.

The 85-day rule is phased-out completely for accountability in 2007 and beyond.

27

Attribution of Data toDAEP and JJAEP Campuses

Statute and statutory intent prohibit the attribution of performance data to DAEP and JJAEP campuses.

Each district that sends students to DAEP and/or JJAEP campuses is responsible for properly attributing all performance data according to the PEIMS Data Standards and the TAKS testing guidelines.

DAEP and JJAEP campuses are labeled Not Rated: Other. Any accountability data reported erroneously to DAEPs and JJAEPs are subject to further investigation.

2007 AEA Indicators

29

AEA Indicators

The AEA procedures use four base indicators:

performance on the Texas Assessment of Knowledge and Skills (TAKS),

performance on the State-Developed Alternative Assessment II (SDAA II),

Completion Rate II (including GED recipients), and

Annual Dropout Rate for grades 7 through 12.

30

2007 AEA Standards

TAKS Progress indicator increases to 45%.

SDAA II indicator increases to 45%.

Completion Rate II (includes GED recipients) indicator remains 75.0%.

Annual Dropout Rate (Grades 7-12) indicator remains 10.0%.

31

TAKS Progress Indicator

The TAKS Progress indicator sums performance results across grades (3-12) and across subjects to determine ratings under AEA procedures.

This indicator is based on the number of tests taken, not on the number of students tested.

In 2006, 24,728 students enrolled at registered AECs took a total of 59,649 TAKS tests.

32

TAKS Progress Indicator (cont.)

The TAKS Progress numerator is calculated as the number of tests meeting the student passing standard or having a Texas Growth Index (TGI) score that meets the student growth standard of 0 (zero) or higher and TAKS exit-level retests meeting the student passing standard at the February and April administrations or in the previous October or July.

The denominator is the number of TAKS tests taken and the number of TAKS exit-level retests meeting the student passing standard at the February and April administrations or in the previous October or July.

33

TAKS Progress Indicator (cont.)

Student groups evaluated and minimum size requirements:

All Students performance is always evaluated.

Students groups (African American, Hispanic, White, and Economically Disadvantaged) are evaluated if there are:

o 30 – 49 tests for the student group and the student group represents at least 10% of All Students tests; or

o at least 50 tests for the student group even if these tests represent less than 10% of All Students tests (30/10%/50).

34

Use of District At-Risk TAKS Data

Applies to AECs only – performance results of all students in the charter are included in the charter’s performance and used in determining the charter’s rating.

If the AEC does not meet the TAKS Progress standard or demonstrate Required Improvement based on results for fewer than 10 TAKS tests, or if there are no TAKS results for the AEC, then the AEC is evaluated on the district performance of at-risk students.

In 2006, district at-risk TAKS data were used to evaluate 52 AECs.

35

SDAA II Indicator

The SDAAII indicator sums performance results across grades (3-10) and across subjects.

Like the TAKS Progress indicator, the SDAA II indicator is based on the number of tests taken, not on the number of students tested.

In 2006, 2,035 students enrolled at registered AECs took a total of 3,836 SDAA II tests.

36

SDAA II Indicator (cont.)

Student groups evaluated and minimum size requirements:

All Students performance is evaluated when there are 30 or more SDAA II tests.

Students groups (African American, Hispanic, White, and Economically Disadvantaged) are not evaluated.

37

Completion Rate II Indicator

This longitudinal rate shows the percent of students who completed or who are continuing their education four years after first attending grade 9 in Texas.

Completion Rate II counts graduates, continuing students (students who return to school for a fifth year), and GED recipients in the definition of Completion Rate II for AECs of Choice and charters evaluated under AEA procedures.

Residential Facilities are not evaluated on the Completion Rate II indicator.

Charters that operate only Residential Facilities are not evaluated on the Completion Rate II indicator.

38

Completion Rate II Indicator (cont.)

Student groups evaluated and minimum size requirements: All Students are evaluated if there are:

o at least 5 dropouts; ando at least 10 students in the Completion Rate II class.


o at least 5 dropouts in the student group, and;o 30 – 49 students in the student group and they represent at

least 10% of All Students in the class; oro at least 50 students in the student group even if they

represent less than 10% of All Students in the class.

39

Completion Rate II Indicator (cont.)

Required Improvement for the Completion Rate II indicator will not be calculated or applied in 2007. The changes to the dropout definition will prevent comparisons of completion rates used in 2006 and 2007.

40

Use of District At-RiskCompletion Rate II Data

Applies to AECs of Choice only – performance results of all students in the charter are included in the charter’s performance and used in determining the charter’s rating.

If the AEC of Choice does not meet the accountability standard or demonstrate Required Improvement, or if the AEC of Choice has students in any of grades 9–12 but does not have a Completion Rate II, then the AEC of Choice is evaluated on Completion Rate II (including GED recipients) of at-risk students in the district.

In 2006, district at-risk Completion Rate II data were used to evaluate 131 AECs of Choice.

41

Annual Dropout Rate Indicator

The Annual Dropout Rate indicator is grade 7-12 dropouts as a percent of total students enrolled at the registered AEC or charter in grades 7-12 in a single school year.

All Students are evaluated if there are:o at least 5 dropouts; and

o at least 10 students in grades 7-12.

42

Annual Dropout Rate Indicator (cont.)


o at least 5 dropouts in the student group, and

o 30 – 49 students in the student group and they represent at least 10% of All Students in grades 7-12, or

o at least 50 students in the student group even if they represent less than 10% of All Students in grades 7-12.

43


The dropout definition transitions from the state definition to the NCES definition in 2007. Students dropping out of school during the 2005-06 school year are reported in 2006-07 in accordance with the NCES dropout definition.

Required Improvement for the Annual Dropout Rate indicator will not be calculated or applied in 2007. The changes to the dropout definition will prevent comparisons of dropout rates used in 2006 and 2007.

44


Due to the definitional and Required Improvement changes described above, if the Annual Dropout Rate is the only indicator causing a registered AEC or charter to be AEA: Academically Unacceptable, then a ‘hold harmless’ provision will be applied and a rating of AEA: Academically Acceptable will be assigned. This provision will be in place for 2007 only.

Preview of 2008 AEA Procedures

46

2008 AEA Registration

The 2008 AEA campus registration process will be conducted electronically. Details will be included in the 2007 Accountability Manual.

The 2008 AEA campus registration process will occur in September 2007.

47

TAKS-I and Grade 8 Science

TAKS – Inclusive (TAKS-I) and Grade 8 Science TAKS-I results will be used in the state accountability

system for the first time in 2008. This follows the ‘report, report, use’ mechanism for phasing in new assessment results into the accountability system. This phase-in schedule means that only a portion of the TAKS-I results will be used for accountability in 2008. All TAKS-I grades and subjects will be used beginning in 2010.

Grade 8 science results will be used in the state accountability system for the first time in 2008.

Technical Assistance Team (TAT) Campuses

49

Background Info – TAT Campuses

Section 39.1322 of House Bill (HB) 1 requires the commissioner of education to select and assign a technical assistance team (TAT) to campuses rated Academically Acceptable in the state accountability rating system if that campus would be rated Academically Unacceptable using the accountability standards for the subsequent year.

The commissioner has the authority to waive the TAT assignment based on specific improvement criteria.

50

Identification of TAT Campuses

Under 2007 AEA procedures, the AEA: Academically Acceptable standards increase by 5 percentage points to 45% for the TAKS Progress and SDAA II indicators.

Under 2007 standard accountability procedures, the Academically Acceptable standards increase by 5 percentage points for all subjects—to 65% for Reading/ELA, Writing, and Social Studies; to 45% for Mathematics; and to 40% for Science.

51

Identification of TAT Campuses (cont.)

All students and each student group evaluated in the state accountability system that meets minimum size requirements in the current school year must meet the standards established for the subsequent school year.

TATs will be assigned to campuses evaluated under either standard or AEA procedures.

Annually the commissioner will identify campuses assigned TATs following the resolution of appeals related to the state accountability ratings as defined in the Texas Education Code §39.301.

52

Identification of TAT Campuses Demonstrating Improvement

Campuses identified for TATs that do not meet the subsequent year standards but demonstrate improvement over the preceding three years may be eligible to receive a waiver from the commissioner.

o A campus must be evaluated under the same accountability procedures, either standard or AEA, in each of the preceding three years in order to be eligible for the waiver.

53

Identification of TAT Campuses Demonstrating Improvement (cont.)

Campuses meet the TAT required improvement if the sum of actual change averaged across the three prior years is equal to or greater than the improvement needed to achieve each standard established for the subsequent school year. The improvement needed is the difference between the standard established for the subsequent school year and actual performance in the current school year, as shown below.

Required Improvement Actual Change

[(2006 – 2005) + (2005 – 2004) + (2004 – 2003)]

3

≥ [standard for 2007] – [performance in 2006]

54

TAT Results – Standard Acct(based on final 2006 ratings)

Under the standard accountability procedures, approximately 8% of the 3,190 campuses rated Academically Acceptable in 2006 would be rated Academically Unacceptable in 2007 based on their 2006 TAKS performance.

o Of the identified TAT campuses, approximately 17% are eligible for a waiver based on improvement over the preceding three years. The remaining campuses are identified for technical assistance teams.

55

TAT Results – AEA(based on final 2006 ratings)

Under the AEA procedures, approximately 2% of the 396 AEA campuses rated AEA: Academically Acceptable in 2006 would be rated AEA: Academically Unacceptable at the 2007 standard of 45% for the TAKS Progress and SDAA II indicators.

o Improvement over the prior three years cannot be calculated under the AEA procedures since the AEA procedures were first applied in 2005.

56

Status of Adoption of TAT Commissioner’s Rules

The proposed commissioner’s rules for the identification of the TAT campuses were filed with the Texas Register on December 11, 2006 and were published in the Texas Register on December 22, 2006.

The official 30-day public comment period was December 22, 2006 – January 21, 2007. Since no public comments were received, the effective date is scheduled for February 25, 2007.

57

Schedule for TAT District Notification and Public Release

Letters will be mailed no later than Friday, February 16 to districts with one or more TAT campuses. The letter will include the list of TAT campuses in the district and will provide information regarding any required interventions.

The TAT notification letter and statewide list of TAT campuses will be released publicly on February 26, one day after the effective date of February 25.

58

TEASE Accountability

The TEASE Accountability secure website provides school districts with performance-based monitoring analysis system (PBMAS) reports, and confidential unmasked data tables, summary tables, confidential student listings, data files, and other helpful state and federal accountability information.

Each superintendent should apply for access and may designate others in their district (and at the ESC) to also have access.

http://www.tea.state.tx.us/webappaccess/AppsRefSht-TS2.htm

59

Accountability Resources

ESC Accountability Contacts

TEA Division of Performance Reporting(512) [email protected]

AEA website http://www.tea.state.tx.us/aea

Accountability ratings system website http://www.tea.state.tx.us/perfreport/account/

Accountability Resources website http://www.tea.state.tx.us/perfreport/resources/index.html

AYP website http://www.tea.state.tx.us/ayp

alternative education accountability (aea) procedures texas association for alternative education...

Documents

aea procedures slide

o aea procedures

aea campus type aea

unacceptable aea

aea indicators

aea rating labels aea

acceptable76 aea

aea charter ratings