20102010--11 School and11 School and20102010 11 School and 11 School and District Report CardDistrict Report Cardpp

ValidationValidationSeptember 20, 2011September 20, 2011

Jon WiensJon WiensOffice of AssessmentOffice of Assessment

Oregon Department of EducationOregon Department of EducationE il j i @ t tE il j i @ t tEmail: jon.wiens@state.or.usEmail: jon.wiens@state.or.us

Changes to the Report CardChanges to the Report CardChanges to the Report CardChanges to the Report Card

FourFour year and fiveyear and five year cohort year cohort FourFour--year and fiveyear and five--year cohort year cohort graduation rates are now both on the graduation rates are now both on the school report cards school report cards school report cards. school report cards.

Disaggregated graduation rates are Disaggregated graduation rates are 2 2on page 2.on page 2.

Changes to the Rating SystemChanges to the Rating SystemChanges to the Rating SystemChanges to the Rating System

High school Achievement index High school Achievement index High school Achievement index High school Achievement index cutoffs raised by 5 points.cutoffs raised by 5 points.Hi h h l i t t ff Hi h h l i t t ff High school improvement cutoff High school improvement cutoff raised by 2 points.raised by 2 points.

Graduation rating now used only the Graduation rating now used only the cohort graduation rates.cohort graduation rates.

R t C d Ti liR t C d Ti liReport Card TimelineReport Card TimelineSept 15Sept 15 11stst Preview of Summary sheets Preview of Summary sheets Sept 15Sept 15 11stst Preview of Summary sheets Preview of Summary sheets

and unsuppressed detailsand unsuppressed detailsSAT validation opens. SAT validation opens. SAT validation opens. SAT validation opens.

Sept 22 Sept 22 22ndnd PreviewPreviewSAT validation closesSAT validation closesSAT validation closes.SAT validation closes.

Sept 29Sept 29 33rdrd Preview. All appeals due.Preview. All appeals due.Oct 4Oct 4 Final district previewFinal district previewOct 4Oct 4 Final district previewFinal district previewOct 5Oct 5 District and media webinarsDistrict and media webinarsO t 6O t 6 P bli R lP bli R lOct 6Oct 6 Public ReleasePublic Release

Report Card OverviewReport Card OverviewReport Card OverviewReport Card Overview

The report cards include a lot of The report cards include a lot of The report cards include a lot of The report cards include a lot of data. data.

Much of this was validated prior to Much of this was validated prior to Much of this was validated prior to Much of this was validated prior to September 15.September 15.W ti i f tti W ti i f tti We are correcting minor formatting We are correcting minor formatting errors and reposting on Sept 22errors and reposting on Sept 22ndnd..

Sept 22Sept 22thth repost will include state repost will include state and national SAT test counts.and national SAT test counts.

RC ValidationsRC ValidationsRC ValidationsRC Validations

Here is partial list of RC Validations:Here is partial list of RC Validations:Here is partial list of RC Validations:Here is partial list of RC Validations:Validation Opened Closed

Cohort Graduation Feb 24 Mar 25Dropout Rate (Early Leavers) Feb 24 Mar 25General Fund Apr 28 May 27ESD Support Apr 28 May 27ESD Support Apr 28 May 27Bond Level Apr 28 May 27Videoconferencing Facilities Apr 28 May 27Classes taught by Highly Qualified Teachers Aug 11 Sep 2Emergency Certification Aug 11 Sep 2Spring Membership Jun 6 Jul 22p g pAttendance Jun 7 Jul 22

RC Validations (cont’d)RC Validations (cont’d)RC Validations (cont d)RC Validations (cont d)

V lid ti O d Cl dValidation Opened Closed

School Size Jun 7 Jul 22

Students attending from/in another district Jun 7 Jul 22Students attending from/in another district Jun 7 Jul 22

English Language Learners Jun 7 Jul 22

Expulsions due to Weapons Jul 7 Jul 14

School Personnel Jul 7 Aug 12

Class Size (elementary) Jul 7 Aug 12

SAT Scores Sep 15 Sep 22

Report Card detail and summary sheets Sep 15 Sep 29

How to ValidateHow to ValidateHow to ValidateHow to Validate Log into the secure ode district site.Log into the secure ode district site. Choose ApplicationsChoose Applications Select Report Card/AYPSelect Report Card/AYP Select one of:Select one of:

–– School and District Report Card PDFSchool and District Report Card PDF–– School Report Card Detail PDFSchool Report Card Detail PDF–– SAT Scores: note that the SAT data we SAT Scores: note that the SAT data we

receive from the college board is the latest receive from the college board is the latest receive from the college board is the latest receive from the college board is the latest test for the student, not the highest test. It test for the student, not the highest test. It includes tests through June 2011.includes tests through June 2011.

S h l R t C dS h l R t C dSchool Report Card School Report Card SSSummary Summary

Data ElementsData ElementsData ElementsData Elements

School at a GlanceSchool at a Glance ---- HSHSSchool at a Glance School at a Glance HSHS

School at a GlanceSchool at a Glance ---- ElemElemSchool at a Glance School at a Glance ElemElem

School at a GlanceSchool at a Glance –– data detailsdata detailsSchool at a Glance School at a Glance data detailsdata details

Number of Students Number of Students –– based on average daily based on average daily g yg ymembership from 3membership from 3rdrd period cumulative ADM. period cumulative ADM. Excludes program type ’02’ and ’03’Excludes program type ’02’ and ’03’SAT SAT ll t d di tl f th ll ll t d di tl f th ll SAT scores SAT scores –– collected directly from the college collected directly from the college board board

Attendance Attendance –– 20102010--11 is from 311 is from 3rdrd period period Attendance Attendance 20102010 11 is from 311 is from 3 period period cumulative ADM. Uses only program type ‘01’cumulative ADM. Uses only program type ‘01’

Participation Participation –– based on reading, math, writing based on reading, math, writing AND i t ll t t d dAND i t ll t t d dAND science at all tested grades.AND science at all tested grades.

Graduation Rate Graduation Rate –– fourfour--year and fiveyear and five--year cohort year cohort rate are shown.rate are shown.rate are shown.rate are shown.

Achievement DataAchievement DataAchievement DataAchievement Data

Achievement DataAchievement DataAchievement DataAchievement DataThe “Academic Achievement” charts use AYP reporting rules:The “Academic Achievement” charts use AYP reporting rules:

St d t id t t th h l M 2St d t id t t th h l M 2–– Students resident at the school on May 2Students resident at the school on May 2–– Full Academic YearFull Academic Year–– 1% flags for extended assessments1% flags for extended assessments

The “Improvement” chart uses:The “Improvement” chart uses:–– Percent meeting or meeting growth targetsPercent meeting or meeting growth targets–– High schools show cohort graduation rates. Note the High schools show cohort graduation rates. Note the High schools show cohort graduation rates. Note the High schools show cohort graduation rates. Note the

labels are based on high school entry year.labels are based on high school entry year.Data is suppressed if Data is suppressed if

–– Fewer than 6 studentsFewer than 6 students–– Fewer than 6 studentsFewer than 6 students–– Greater than 95% metGreater than 95% met–– Less than 5% metLess than 5% met–– Graduation data is not suppressedGraduation data is not suppressed

Writing at Grades 4 and 7 is not displayed.Writing at Grades 4 and 7 is not displayed.

StatewideStatewideStatewide Statewide Assessment Assessment

ResultsResults

Statewide Assessment ResultsStatewide Assessment ResultsStatewide Assessment ResultsStatewide Assessment ResultsThe “Student Achievement” chart uses PAGR reporting rules:The “Student Achievement” chart uses PAGR reporting rules:–– All students resident at the school on May 2 no full academic All students resident at the school on May 2 no full academic –– All students resident at the school on May 2, no full academic All students resident at the school on May 2, no full academic

year requiredyear required–– All extended assessments are not metAll extended assessments are not met

Transitioning LEP students are not included in LEP subgroupTransitioning LEP students are not included in LEP subgroup–– Transitioning LEP students are not included in LEP subgroupTransitioning LEP students are not included in LEP subgroupData is suppressed if Data is suppressed if

–– Fewer than 6 studentsFewer than 6 students–– Greater than 95% met, in which case both the meets and Greater than 95% met, in which case both the meets and

exceeds columns show “>95.0”exceeds columns show “>95.0”–– Less than 5% met, in which case both the meets and Less than 5% met, in which case both the meets and

exceeds columns show “< 5.0”exceeds columns show “< 5.0”The “Student Participation” table has:The “Student Participation” table has:

–– PAGR participation ratesPAGR participation ratesPAGR participation ratesPAGR participation ratesScience staging is open, so results may differ slightly from PAGR.Science staging is open, so results may differ slightly from PAGR.

AccountAccount--ability ability

InformationInformationInformationInformation

Accountability InformationAccountability InformationAccountability InformationAccountability Information

Shows the AYP met/not met status Shows the AYP met/not met status Shows the AYP met/not met status Shows the AYP met/not met status at your school.at your school.

The order of subgroups differs from The order of subgroups differs from The order of subgroups differs from The order of subgroups differs from the AYP report, but is consistent with the AYP report, but is consistent with earlier pages of the RCearlier pages of the RCearlier pages of the RC.earlier pages of the RC.

This page also contains the local This page also contains the local i f ti li f ti linformation panel.information panel.

Di t i t R t C dDi t i t R t C dDistrict Report Card District Report Card SSSummary Summary

Data ElementsData ElementsData ElementsData Elements

Front PageFront PageFront PageFront Page

The first page of the district report The first page of the district report The first page of the district report The first page of the district report card shows:card shows:

District AYP statusDistrict AYP statusDistrict AYP statusDistrict AYP statusReport Card rating for each school in Report Card rating for each school in

th di t i t d th AYP h l th di t i t d th AYP h l the district, and the AYP school the district, and the AYP school improvement status for each school.improvement status for each school.

District District InformationInformationInformationInformation

District InformationDistrict InformationDistrict InformationDistrict InformationBar charts show grade by grade percent met Bar charts show grade by grade percent met

di t AYP ldi t AYP laccording to AYP rules:according to AYP rules:––Students resident in the district on May 2Students resident in the district on May 2––Full Academic year within the districtFull Academic year within the district––1 percent cap1 percent cap

Data is suppressed if Data is suppressed if ––Fewer than 6 studentsFewer than 6 students––Greater than 95% metGreater than 95% met––Less than 5% metLess than 5% met

Writing at Grade 4 and 7 is not displayedWriting at Grade 4 and 7 is not displayed

District InformationDistrict InformationDistrict InformationDistrict Information

Participation includes reading math Participation includes reading math Participation includes reading, math, Participation includes reading, math, science and writingscience and writing

Attendance is from 3Attendance is from 3rdrd period ADMperiod ADM Attendance is from 3Attendance is from 3 period ADMperiod ADM HQT “High Poverty” and “Low Poverty” HQT “High Poverty” and “Low Poverty”

schools are in the highest and lowest schools are in the highest and lowest schools are in the highest and lowest schools are in the highest and lowest quartiles for FRL percent in the state.quartiles for FRL percent in the state.

HQT and Emergency Cert Data utilizes HQT and Emergency Cert Data utilizes Q a d g y C a a u sQ a d g y C a a u sdata from the TSPCdata from the TSPC

Statewide Statewide AssessAssess--

mentmentmentmentResultsResults

Statewide Assessment ResultsStatewide Assessment ResultsStatewide Assessment ResultsStatewide Assessment ResultsThe “Student Achievement” chart uses PAGR reporting rules:The “Student Achievement” chart uses PAGR reporting rules:–– All students resident in the district on May 2 no full academic All students resident in the district on May 2 no full academic –– All students resident in the district on May 2, no full academic All students resident in the district on May 2, no full academic

year requiredyear required–– All extended assessments are not metAll extended assessments are not met

Transitioning LEP students are not included in LEP subgroupTransitioning LEP students are not included in LEP subgroup–– Transitioning LEP students are not included in LEP subgroupTransitioning LEP students are not included in LEP subgroupData is suppressed if Data is suppressed if

–– Fewer than 6 studentsFewer than 6 students–– Greater than 95% met, in which case both the meets and Greater than 95% met, in which case both the meets and

exceeds columns show “>95.0”exceeds columns show “>95.0”–– Less than 5% met, in which case both the meets and Less than 5% met, in which case both the meets and

exceeds columns show “< 5.0”exceeds columns show “< 5.0”The “Student Participation” table has:The “Student Participation” table has:

–– PAGR participation ratesPAGR participation ratesPAGR participation ratesPAGR participation ratesScience staging is open, so results may differ slightly from PAGR.Science staging is open, so results may differ slightly from PAGR.

A tA tAccountAccount--abilityabilityability ability

InformationInformation

Accountability InformationAccountability InformationAccountability InformationAccountability Information

District AYP status Note that all District AYP status Note that all District AYP status. Note that all District AYP status. Note that all grade bands have been combined.grade bands have been combined.

NAEP Results NAEP does not NAEP Results NAEP does not NAEP Results. NAEP does not NAEP Results. NAEP does not provide scores for districts or provide scores for districts or schoolsschoolsschools.schools.

Financial Data. Note that this is for Financial Data. Note that this is for 20092009 2010201020092009--2010.2010.

Report CardReport CardReport Card Report Card Detail Sheets andDetail Sheets andDetail Sheets and Detail Sheets and

School RatingSchool RatingSchool Rating School Rating FormulaFormula

Rating ComponentsRating ComponentsRating ComponentsRating Components AchievementAchievement

–– An index that utilizes growth and weights An index that utilizes growth and weights students in underperforming subgroupsstudents in underperforming subgroups

I t (hi h h l l )I t (hi h h l l ) Improvement (high schools only)Improvement (high schools only)–– The twoThe two--year improvement in the year improvement in the

performance indexperformance indexperformance indexperformance index Attendance or GraduationAttendance or Graduation ParticipationParticipation ParticipationParticipation

–– Includes reading, math, writing, AND scienceIncludes reading, math, writing, AND science AYP StatusAYP Status AYP StatusAYP Status

Detail Detail Sh tSh tSheet Sheet CoverCoverCover Cover PagePage

The Achievement IndexThe Achievement IndexThe Achievement IndexThe Achievement Index Utilizes the Growth modelUtilizes the Growth model

–– Students not meeting in the prior year are given a Students not meeting in the prior year are given a “growth target” for the current year. Those students “growth target” for the current year. Those students whose score is at or above their growth target will have whose score is at or above their growth target will have “Met Growth”“Met Growth”

Points awarded according to:Points awarded according to:–– 133 points for Exceeds133 points for Exceeds133 points for Exceeds133 points for Exceeds–– 100 points for Meets100 points for Meets–– 100 points for Did Not Meet, but Met Growth100 points for Did Not Meet, but Met Growth

0 points for Did Not Meet and did not meet growth 0 points for Did Not Meet and did not meet growth –– 0 points for Did Not Meet and did not meet growth 0 points for Did Not Meet and did not meet growth Use the same students as are used for AYP Use the same students as are used for AYP

–– includes extended assessmentsincludes extended assessmentsl d h f d dl d h f d d–– includes the 1% cap for extended assessmentsincludes the 1% cap for extended assessments

Weighting of SubgroupsWeighting of SubgroupsWeighting of SubgroupsWeighting of Subgroups To address the Achievement Gap, a school’s To address the Achievement Gap, a school’s

Achievement Index is a weighted average of the Achievement Index is a weighted average of the Achievement Index is a weighted average of the Achievement Index is a weighted average of the achievement those in subgroups with an historic achievement those in subgroups with an historic statewide achievement gap. statewide achievement gap.

The weighting of subgroups does not provide The weighting of subgroups does not provide “extra credit” to schools with students in the “extra credit” to schools with students in the subgroupssubgroupssubgroups.subgroups.

Schools with significant achievement gaps will Schools with significant achievement gaps will see a negative impact on their achievement see a negative impact on their achievement see a negative impact on their achievement see a negative impact on their achievement index.index.

Schools in which subgroups are outperforming Schools in which subgroups are outperforming g p p gg p p gthe all students subgroup will see a positive the all students subgroup will see a positive impact on their index.impact on their index.

The Achievement IndexThe Achievement IndexThe Achievement IndexThe Achievement Index Subgroups included in the weighted index:Subgroups included in the weighted index:

–– All StudentsAll StudentsAll StudentsAll Students–– Students with disabilitiesStudents with disabilities–– Limited English proficientLimited English proficient

Economically DisadvantagedEconomically Disadvantaged–– Economically DisadvantagedEconomically Disadvantaged–– American Indian/Alaskan NativeAmerican Indian/Alaskan Native–– Black (not of Hispanic origin)Black (not of Hispanic origin)

HispanicHispanic–– HispanicHispanic

Achievement Index CutAchievement Index Cut--scoresscores

I N d f I N d f OutstandingOutstanding SatisfactorySatisfactory In Need of In Need of ImprovementImprovement

Elementary/Elementary/90 0 or Higher90 0 or Higher 60 0 to 89 960 0 to 89 9 Less than 60 0Less than 60 0

MiddleMiddle90.0 or Higher90.0 or Higher 60.0 to 89.960.0 to 89.9 Less than 60.0Less than 60.0

High SchoolsHigh Schools 85.0 or Higher85.0 or Higher 55.0 to 84.955.0 to 84.9 Less than 55.0Less than 55.0

Detail Sheet Detail Sheet -- AchievementAchievement

Improvement (High Schools)Improvement (High Schools)Improvement (High Schools)Improvement (High Schools)

Since high school students do not have Since high school students do not have Since high school students do not have Since high school students do not have growth targets, we measure improvement growth targets, we measure improvement in high schools as the year to year in high schools as the year to year improvement in student performance.improvement in student performance.

Schools with an “Improved” rating will Schools with an “Improved” rating will have their achievement rating raised by have their achievement rating raised by one category.one category.

Detail Sheets:Detail Sheets:Improvement Improvement Index for High Index for High

SchoolsSchools

Other IndicatorsOther IndicatorsOther IndicatorsOther Indicators Graduation: High Schools rated on Graduation: High Schools rated on

graduation on AYPgraduation on AYP Cohort rates are used in the rating, NCES Cohort rates are used in the rating, NCES

rates are no longer used.rates are no longer used. Attendance: Elementary/Middle schools Attendance: Elementary/Middle schools

d ll hi h h ld ll hi h h land small high schools.and small high schools. All schools are rated on participation in All schools are rated on participation in

reading math writing AND sciencereading math writing AND sciencereading, math, writing AND science.reading, math, writing AND science.

Other IndicatorsOther IndicatorsOther IndicatorsOther Indicators

The ratings for these other indicators can The ratings for these other indicators can The ratings for these other indicators can The ratings for these other indicators can limit a school’s overall rating, as shown limit a school’s overall rating, as shown below.below.

Limit for Overall RatingLimit for Overall Rating

IndicatorIndicator In Need of In Need of ImprovementImprovement SatisfactorySatisfactory OutstandingOutstanding

dd “Not Met” on “Not Met” on “ ”“ ”44--year rate of 69.0year rate of 69.0

GraduationGraduation Not Met on Not Met on AYPAYP “Met” on AYP“Met” on AYP oror

55--Year Rate of 74.0Year Rate of 74.0

AttendanceAttendance Less than 89.0Less than 89.0 89.0 to 91.989.0 to 91.9 92.0 or Higher92.0 or Higher

ParticipationParticipation Less than 94.5Less than 94.5 94.5 or Higher94.5 or Higher

Detail Detail Sheets:Sheets:Sheets:Sheets:

Additional Additional I di tI di tIndicatorsIndicators

Calculating the Overall RatingCalculating the Overall RatingCalculating the Overall RatingCalculating the Overall Rating1. The preliminary school rating is the 1. The preliminary school rating is the

Achievement RatingAchievement RatingAchievement RatingAchievement Rating2. If the Attendance/Graduation or 2. If the Attendance/Graduation or

Participation ratings are lower than the Participation ratings are lower than the Participation ratings are lower than the Participation ratings are lower than the Achievement Rating, reduce the overall Achievement Rating, reduce the overall rating to the lowest of these two ratingsrating to the lowest of these two ratings

3. If the school received a “Met” on AYP, the 3. If the school received a “Met” on AYP, the school can be rated no lower than school can be rated no lower than S ti f t Thi t id S ti f t Thi t id Satisfactory. This step overrides any Satisfactory. This step overrides any prior designation of “In Need of prior designation of “In Need of Improvement”Improvement”ImprovementImprovement

Overall Rating Overall Rating -- ExampleExamplegg pp

Overall Rating Overall Rating -- ExampleExamplegg pp

Overall Rating Overall Rating -- ExampleExamplegg pp

ResourcesResourcesResourcesResources

Main Report Card Page Main Report Card Page Main Report Card Page Main Report Card Page http://www.ode.state.or.us/go/reportcardhttp://www.ode.state.or.us/go/reportcard

Report Card Manuals Report Card Manuals Report Card Manuals Report Card Manuals http://www.ode.state.or.us/search/page/?id=24http://www.ode.state.or.us/search/page/?id=24

Report Card Calculators and How to Report Card Calculators and How to Reads Reads http://www.ode.state.or.us/search/page/?id=661http://www.ode.state.or.us/search/page/?id=661

Longitudinal Student Growth Model: Longitudinal Student Growth Model: http://www.ode.state.or.us/search/page/?id=2495http://www.ode.state.or.us/search/page/?id=2495