draft 2015 pbmas - region 4 education service center · math and science. add pl assignment for...

4/23/2015

1

DRAFT 2015 PBMASTHESE ARE NOT SET IN STONE AND MAY CHANGE

2015 PBM Calendar (blue = current projection)

PBM Product When are data submitted by LEAs?

When are data available for internal

TEA use?

Date of 2014 release Projected date of 2015 release

PBMAS(Unmasked reports)

Throughout the year, depending on the indicator

Data for all indicators available by July

LEA reports posted on TEASE ACCT 08/13/14


PBMAS(Masked reports)

LEA reports posted on TEA web site 09/17/14

LEA reports posted on TEA web site 09/18/15

PBMAS State and Region Reports

State and region reports posted on TEA web site 10/17/14

State and region reports posted on TEA web site 10/16/15

Leaver Data Validation Indicators

PEIMS Data Fall/Submission 1

March (but cannot be officially released until August)



Discipline Data Validation Indicators

PEIMS DataSummer/Submission 3

October/November LEA reports posted on TEASE ACCT 11/21/14


Student Assessment Data Validation Indicators

Spring Student Assessment Data

June LEA reports posted on TEASE ACCT 12/19/14


2

Note: PBM products always use the most current data available.

4/23/2015

2

2015 PBMAS

The development of the 2015 PBMAS is currently underway.

There are important changes for this year. We will cover those in detail this afternoon.

2015 preview information is provided to give ESC PBM contacts a general sense of what the 2015 PBMAS will look like in order to facilitate ESC planning or training that may be appropriate in the upcoming months.

3

2015 PBMAS (continued)

At this time, we cannot guarantee the preview information is final. There could be factors that may necessitate a change to what is being shared this early in the process.

As we’ve done in the past, we will always provide an update to any preview information that undergoes a change.

4

4/23/2015

3

2015 PBMAS Indicator Preview

Reminder on Acronyms PL Performance Level RI Required Improvement SA Special Analysis PJSA Professional Judgment Special Analysis* YAE Year-After-Exit MSR Minimum Size Requirements

*Note: PJSA will no longer be available beginning with the 2015 PBMAS.

5

2015 PBMAS Indicator Preview: SPED

Program Area and Indicator Number

Indicator Name 2014 PBMAS 2015 PBMAS

SPED #1(i-v)

Additional provisions pertaining to this indicator will be covered in the 2015 PBMAS Other System Components preview.

SPED STAAR 3-8 Passing Rate(M, R, S, SS, W)

PLs were assigned based on Phase-In 1 Level II performance.Added RI.No SA or PJSA.Two years of data available for analysis (except social studies).Social studies PL assignment was reinstated.

Add STAAR A and STAAR Alternate 2 results.Assign math PL based on the performance standards from the previous STAAR math assessments.One year of data.No RI or SA.

6

4/23/2015

4

2015 PBMAS Indicator Preview: SPED(continued)



SPED #2(i-v)


SPED YAE STAAR 3-8 Passing Rate(M, R, S, SS, W)

PLs were assigned based on Phase-In 1 Level II performance.No RI, SA, or PJSA.Two years of data available for analysis (except social studies).Social studies PL assignment was reinstated.

Two years of data available for social studies; three years of data available for reading, science, and writing; and one year of data available for math.Assign math PL based on the performance standards from the previous STAAR math assessments.No RI or SA.

7




SPED #3(i-iv)


SPED STAAR EOC Passing Rate(M, S, SS, ELA)

PLs were assigned based on Phase-In 1 Level II performance for math (A1) and science (BI).A new combined reading/writing indicator (E1 and E2) and a new social studies indicator (US) were added as RO.One year of data.No RI, SA, or PJSA.

Add STAAR A and STAAR Alternate 2 results.Change PL cut-point ranges for math and science.Add PL assignment for U.S. History and align PL cut-point ranges with math and science.Continue ELA indicator as RO.One year of data.No RI or SA.

8

4/23/2015

5




SPED #4 SPED STAAR Participation Rate

PLs were assigned based on two years of data.Added RI.No SA or PJSA.Methodology revisions were incorporated to reflect the changes HB 5 made to the EOC assessments.

Discontinue this indicator.

9




SPED #5 SPED STAAR Modified Participation Rate

PLs were assigned based on two years of data.Added RI.No SA or PJSA.Methodology revisions were incorporated to reflect the changes HB 5 made to the EOC assessments.


10

4/23/2015

6




SPED #6 SPED STAAR Alternate Participation Rate

PLs were assigned based on two years of data.Added RI.No SA or PJSA.AR (Agency Review) PL assignment was replaced with new PL 1 – PL 3 cut points.

Rename the indicator STAAR Alternate 2 Participation Rate.Three years of data available for analysis.Students qualifying for a Medical Exception or a No Authentic Academic Response designation are not included in the calculation.No SA or PJSA.

11




SPED #7 SPED Regular Early Childhood Program Rate (Ages 3-5)

Implemented as a new Report Only indicator.

Assign performance levels:PL 0 = 30.0% to 100%PL 1 = 20.0% to 29.9%PL 2 = 10.1% to 19.9%PL 3 = 0% to 10.0%(2014 State Rate = 25.4%)

No RI or SA.One year of data.

12

4/23/2015

7




SPED #8 SPED Placements in Instructional Settings 40/41 Rate (Ages 3-5)

PLs were assigned with RI and SA.


13




SPED #9 SPED Regular Class ≥80% Rate (Ages 6-11)

PLs were assigned.No RI, SA, or PJSA.One year of data.

Two years of data available for analysis.Add RI.No SA.

14

4/23/2015

8




SPED #10 SPED Regular Class <40% Rate (Ages 6-11)



15




SPED #11 SPED Regular Class ≥80% Rate (Ages 12-21)



16

4/23/2015

9




SPED #12 SPED Regular Class <40% Rate (Ages 12-21)

PLs were assigned.No RI, SA, or PJSA.One year of data


17




SPED #13 SPED Annual Dropout Rate (Grades 7-12)

PLs were assigned with RI and SA.New PL 0 – PL 3 cut points were implemented.

No changes.

18

4/23/2015

10




SPED #14 SPED RHSP/DAP Diploma Rate


Add new RHSP/DAP Grad Types (31 and 32) to numerator.

SPED #15 SPED Graduation Rate

PLs were assigned with RI but no SA or PJSA.

Implement new PL 1 – PL 3 cut points:PL 0 = 75.0% to 100%PL 1 = 70.0% to 74.9%PL 2 = 50.0% to 69.9%PL 3 = 0% to 49.9% (2014 State Rate = 77.8%)

19




SPED #16 SPED Representation

PLs were assigned with RI but no SA or PJSA.

No changes.

SPED #17 SPED African American (Not Hispanic/Latino) Representation


No changes.

20

4/23/2015

11




SPED #18 SPED Hispanic Representation


No changes.

SPED #19 SPED LEP Representation


No changes.

21




SPED #20 SPED Discretionary DAEP Placements

PLs were assigned with RI, SA, and PJSA.Reason Codes 22, 51, and 52 were deleted.Reason Code 02, if reported with Behavior Location Code 04 or 05, was added.

Begin transition to a new PL structure by reporting disproportionality rates (as Report Only) in addition to percentage point differences.

22

4/23/2015

12




SPED #21 SPED Discretionary ISS Placements

PLs were assigned with RI, SA, and PJSA.


SPED #22 SPED Discretionary OSS Placements

PLs were assigned with RI, SA, and PJSA.


23

2015 PBMAS Indicator Preview: SPED (continued)

Why are we transitioning to a new PL structure for the discipline indicators? The original expectation was that focusing on percentage point

differences (DIFF) would encourage districts, regardless of PL assignment, to address issues of disproportionality, but this has not typically been the case.

Focusing on percentage point differences may have given some districts the impression they do not have disproportionate discipline placements, when they actually do.

24

4/23/2015

13


Unlike other PBMAS indicators, the rate of progress for the three discipline indicators has been slower than expected considering the indicators have been in place for more than a decade.

Percentage point differences can mask very high rates of disproportionality.

Focusing on districts’ rate of disproportionality is a more meaningful and reliable way to evaluate disproportionality.

Unlike percentage point differences, disproportionality rates will enable us to implement more consistent PL cut points across all three discipline indicators.

25


Disproportionality rates are much easier to understand and will provide more transparent information.

Disproportionality rates are not a significantly different methodology from what’s currently used; they basically take the current calculations one step further and tell us how much higher the special education rate is compared to the all students rate, e.g., 50% higher, 10% higher, 200% higher.

26

4/23/2015

14


This will, however, be a significant change for some districts who may not have undertaken a detailed enough data analysis to understand what their percentage point differences were actually telling them about the extent of disproportionality in their discipline placements.

It is extremely important that ESCs begin to work with their districts now to help them understand what disproportionality means and how they can use their 2015 PBMAS reports and the Report Only information for those indicators to plan for improvements before the new PL structure is implemented.

The new PL structure is scheduled to be implemented with the 2017 PBMAS.

27


SPED Discretionary OSS Placements(DIFF) 6.2 SPED OSS SPED Students

SPED OSSPlacements

12.2 170 1,388

OSS All StudentsAll OSS Placements

6.0 672 11,224

28

How to Calculate the Disproportionality Rate:

percentage point difference(6.2)all students OSS placements rate (6.0)

= 103%

4/23/2015

15


SPED Discretionary OSS Placements(DIFF) 8.0 SPED OSS SPED Students

SPED OSSPlacements

20.8 735 3,531

OSS All StudentsAll OSS Placements

12.8 5,129 40,165

29

How to Calculate the Disproportionality Rate:

percentage point difference(8.0)all students OSS placements rate (12.8)

= 63%

2015 PBMAS Preview: Other System Components

Program Area Description 2014 PBMAS 2015 PBMAS

Other System Components

Minimum size requirements (MSR)

No changes. No changes.


Special analysis No changes were implemented.

PJSA will no longer be available.

30

4/23/2015

16

2015 PBMAS Preview:Other System Components (continued)



PL 0 cut points for STAAR 3-8 Performance Indicators

PL 0 cut points were changed for social studies: PL 0 = 65%-100%.

No changes.

31

STAAR 3-8 Subject-Area PL 0 Cut PointsSTAAR 3-8 Passing Rate Indicators (BE/ESL, NCLB, and SPED)

Mathematics 2014 = 70%-100%2015 = 70%-100%

Reading 2014 = 70%-100%2015 = 70%-100%

Science 2014 = 65%-100%2015 = 65%-100%

Social Studies 2014 = 65%-100%2015 = 65%-100%

Writing 2014 = 70%-100%2015 = 70%-100%

32

4/23/2015

17




PL 1, PL 2, and PL 3 cut points for STAAR 3-8 Performance Indicators

No changes. For SPED Indicator #1(i-v): Lower the PL 1,

PL 2, and PL 3 cut point ranges for all subject areas.

Add a PL 4. Implement a

targeted hold harmless provision.

See next slide for details.

33


BE/ESL, NCLB, and SPED YAE Indicators

PL 0 PL 1 PL 2 PL 3

Mathematics 70.0% - 100% 60.0% - 69.9% 50.0% - 59.9% 0% - 49.9%Reading 70.0% - 100% 60.0% - 69.9% 50.0% - 59.9% 0% - 49.9%Science 65.0% - 100% 55.0% - 64.9% 45.0% - 54.9% 0% - 44.9%Social Studies 65.0% - 100% 55.0% - 64.9% 45.0% - 54.9% 0% - 44.9%Writing 70.0% - 100% 60.0% - 69.9% 50.0% - 59.9% 0% - 49.9%

34

SPED IndicatorPL 0 PL 1 PL 2 PL 3 PL 4

1(i): Mathematics 70.0% - 100% 55.0% - 69.9% 40.0% - 54.9% 25.0% - 39.9% 0% - 24.9%1(ii):Reading 70.0% - 100% 55.0% - 69.9% 40.0% - 54.9% 25.0% - 39.9% 0% - 24.9%1(iii):Science 65.0% - 100% 50.0% - 64.9% 40.0% - 49.9% 25.0% - 39.9% 0% - 24.9%1(iv):Social Studies 65.0% - 100% 50.0% - 64.9% 40.0% - 49.9% 25.0% - 39.9% 0% - 24.9%1(v): Writing 70.0% - 100% 55.0% - 69.9% 40.0% - 54.9% 25.0% - 39.9% 0% - 24.9%

4/23/2015

18

2015 PBMAS Indicator Preview: Other System Components (continued)

What is the targeted hold harmless provision for SPED Indicator #1(i-v)? It stipulates that any district that received a PL 0 or 0 RI on the SPED

STAAR Modified Participation Rate indicator in the 2014 PBMAS that would otherwise receive a PL 3 or PL 4 on SPED Indicator #1(i-v) in the 2015 PBMAS will receive a PL 3 HH or PL 4 HH, as applicable for that subject area(s).

For 2015 PBMAS interventions purposes, the count of PL 3 HH or PL 4 HH under SPED Indicator #1(i-v) will not be considered in a district’s total PL 3 or PL 4 count in the special education program area.

35




PL 0 cut points for STAAR EOC Performance Indicators

No changes were made to mathematics and science. However, social studies and ELA were assigned a PL of Report Only.

See next slide for changes.

36

4/23/2015

19

STAAR EOC Subject-Area PL 0 Cut PointsSTAAR EOC Passing Rate Indicators (BE/ESL, CTE, NCLB, and SPED)

Mathematics 2014 = 50%-100%2015 = 60%-100%

Science 2014 = 50%-100%2015 = 60%-100%

Social Studies 2014 = Report Only2015 = 60%-100%

English Language Arts 2014 = Report Only2015 = Report Only

37




PL 1, PL 2, and PL 3 cut points for STAAR EOC Performance Indicators

PL 4 was discontinued.

For SPED Indicator #3(i-iv) and CTE Indicator #4(i-iv): Implement PL 1

and PL 2 cut points that are aligned with other EOC indicators.

Add a PL 4. Implement a

targeted hold harmless provision.

For all other EOC indicators, implement PL cut points as shown on next slide.

38

4/23/2015

20


All EOC Indicators, Except SPED #3 and CTE #4

PL 0 PL 1 PL 2 PL 3

Mathematics 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 0% - 39.9%Science 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 0% - 39.9%Social Studies 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 0% - 39.9%ELA Report Only Report Only Report Only Report Only

39

SPED #3 & CTE #4PL 0 PL 1 PL 2 PL 3 PL 4

Mathematics 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 30.0% - 39.9% 0% - 29.9%Science 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 30.0% - 39.9% 0% - 29.9%Social Studies 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 30.0% - 39.9% 0% - 29.9%ELA Report Only Report Only Report Only Report Only Report Only

2015 PBMAS Indicator Preview: Other System Components (continued)

What is the targeted hold harmless provision for SPED Indicator #3(i-iv) and CTE Indicator #4(i-iv)? It stipulates that any district that received a PL 0 or 0 RI on the SPED

STAAR Modified Participation Rate indicator in the 2014 PBMAS that would otherwise receive a PL 3 or PL 4 on SPED Indicator #3(i-iv) or CTE Indicator #4(i-iv) in the 2015 PBMAS will receive a PL 3 HH or PL 4 HH, as applicable for that subject area(s).

For 2015 PBMAS interventions purposes, the count of PL 3 HH or PL 4 HH under SPED Indicator #3(i-iv) or CTE Indicator #4(i-iv) will not be considered in a district’s total PL 3 or PL 4 count in the special education or career and technical education program area.

40

4/23/2015

21

2015 PBMAS Preview: Other System Components (continued)



EOC Test Administrations

Results from the summer 2013, fall 2013, and spring 2014 administrations were included, except the new ELA indicator only included results from the spring 2014 administration.

Results from the summer 2014, fall 2014, and spring 2015 administrations will be included, including for the ELA indicator.

41




Format of Performance Levels

Agency Review (AR) was replaced with PL 1 – PL 3 cut points.The PL 4 was discontinued.

Reinstate PL 4 for certain indicators.Reinstate PL 3 HH and add PL 4 HH.Discontinue all PJSA PLs.


Required Improvement calculation

No changes were implemented.

No changes.

42

4/23/2015

22

2015 PBMAS Manual

2015 PBMAS Manual rule adoption is underway. We are in the process of preparing the rule packet for adoption. Proposed Amendment to 19 TAC Chapter 97,

Planning and Accountability, Subchapter AA,Accountability and Performance Monitoring, §97.1005, Performance-Based Monitoring Analysis System

Summary: The proposed amendment would adopt the Performance-Based Monitoring Analysis System 2015 Manual.

43

2015 PBMAS Manual (continued)

30-Day Public Comment Period: Anticipate May 8, 2015 – June 8, 2015.

The rule will likely be effective in mid July. For current information on the rule adoption

process: Visit

http://tea.texas.gov/About_TEA/Laws_and_Rules/Commissioner_Rules_(TAC)/Commissioner_of_Education_Rules_-_Texas_Administrative_Code/ and/or

Subscribe to the Rules Listserv at https://public.govdelivery.com/accounts/TXTEA/subscriber/new

44

4/23/2015

23

2015 PBMAS Manual (continued)

Once the rule becomes effective, the Manual will be posted on our web site, followed by a listserv notification of the posting.

At that time, hard-copy versions will also be available from TEA’s Publications Office (see order form at the back of the posted Manual).

45

draft 2015 pbmas - region 4 education service center · math and science. add pl assignment for...

Documents