september 2009demographic data corrections1 2009 star demographic data corrections webcast september...

September 2009 Demographic Data Corrections 1

2009 STAR2009 STARDemographic Data Demographic Data

CorrectionsCorrections

Webcast

September 30, 2009

Start time 9:00 a.m.


ObjectivesObjectives

District STAR coordinators will understand:• Why data should be corrected• What data can be corrected• What the cost is for correcting data• When data can be corrected• How to make data corrections• Data corrections vs. handscoring end-of-

course mathematics and science tests


What’s New?What’s New?• New fields

– Testing start date – Special conditions X (student refused

accommodation/modification)– Accommodation/modification G (braille)– Testing irregularities (not assigned)

• Deleted fields– Accommodation/modification I (applicable to

CAT/6 Survey only)– Accommodation/modification N (dictionary);

for CMA only– Receiving Title I Services

• New fields– CMA-writing specific

• Updated fields and sections• Revised update rules and acceptable

values


What’s New? (cont.)What’s New? (cont.)


Why Correct Data?Why Correct Data?

• Correct API and AYP calculations– Corrected data is sent to the CDE’s

Academic Accountability Unit for recalculation

• Score uncoded and rescore miscoded end-of-course mathematics or science tests– Other option is to hand score

• Obtain corrected data CD


• SSID• CAPA Level• County/District code for student’s residence

if residence is other than where student attends school/receives services

• Special Testing Conditions (except for certain fields)

• Modifications Used• Adult Testing Irregularities• Inappropriate Test Preparation

Fields used for API and/or AYP Fields used for API and/or AYP calculations that may be corrected calculations that may be corrected



• Student’s English Proficiency

• English Learner Date First Enrolled in U.S. School

• R-FEP students in grades 5–11 scored PRO or ADV 3 years on ELA CST

• National School Lunch Program (NSLP)

• Primary Disability

• Special Education Exit Date


•Primary Ethnicity

•Parent Education Level

•CBEDS Enrollment—District

•CBEDS Enrollment—School

•CST for Mathematics Test Taken

•CST for Science Test Taken

•Attends Nonpublic, Nonsectarian School



Demographic fields that may Demographic fields that may NOTNOT be be corrected corrected

•District Name

•County District School Code

•School Name

•School Code

•Grade Level of Test Taken (enrollment grade may be changed, however)


How much does it cost?How much does it cost?

• One set up fee of $630– Regardless of number of administrations

changed• 16 cents per record

– ALL students tested on the administration• Additional cost for replacement reports and CD


ExampleExample

• Two administrations– 1,000 students tested on admin. 1– 5,000 students tested on admin. 2

• Correct 900 students on admin. 1– Cost = $630 + (0.16 x 1000) = $790

• Correct 3,000 students on admin. 2– Cost = $630 + (0.16 x 5000) = $1,430

• Correct 900 students on admin. 1 plusCorrect 3,000 students on admin. 2– Cost = $630 +(0.16 x 6000) = $1,590


Cost of Cost of Replacement ReportsReplacement Reports

Report Cost per student tested in the admin.

Student Report PaperStudent Report PDF on DVD-ROM Student Record Label

$1.50$0.25$0.80

Student Master List $0.60

Student Master List Summary CST, District level $0.60

Student Master List Summary CST, School level $0.60

Subgroup Summaries $0.85

Master List Summary: CST End-of-course results(mathematics and science)

$0.60

Student Data File on CD-ROM $0.32


TimelineTimeline

• Submit Form– Form available on www.startest.org – Last day for submissions is October 16

• System OPEN for corrections on September 28• System CLOSED for corrections on November 6

– Last day to request file download is November 5; corrected file then must be uploaded by November 6

• Corrected STAR Internet reports to be posted in December– Not the same as accountability reports


The ProcessThe Process

• Complete and submit form• Obtain new password• Access “STAR 2009 Administration” • Data corrections

– Online– Offline

• Match unmatched records (optional)– Online only

• “Approve – District Complete”– If this step is NOT completed, NO data changes

will be sent to CDE– Must be completed by 6:00 p.m. (PST) November 6


Online & Offline UpdatesOnline & Offline Updates

Scenario One Scenario Two

1. Request and download file.

2. Edit data in file.3. Upload corrected file.

1. Edit data online.2. Submit online corrections.

Scenario Three Scenario Four

1. Edit data online.2. Submit online corrections.3. Request and download

file.4. Edit data in file.5. Upload corrected file.

1. Request and download file 1.2. Edit data online.3. Submit online corrections.4. Request and download file 25. Edit data in file 2.6. Upload file 2.


Download & Upload Download & Upload FormatFormat

• Based on STAR Student Data Layout – Includes ALL data in one file– Includes additional control data fields

• Includes records for ALL administrations

• File includes CST, CMA, and CAPA records– STS records not included


Format of Data FileFormat of Data File• Appendix C of Demographic Data Corrections Manual


Sample Data FileSample Data File

Header Record – Do NOT remove or alter

Trailer Record – Do NOT remove or alter


After DownloadAfter Download

• Save a COPY of download file to desktop.• Do NOT make online data changes in

between downloading and uploading• Use text editor to make data changes

• Do not use Excel

• Keep data in same columns and sequence• Do NOT remove records• Do NOT change fields UIN (3–22) and

Checksum (856–887)• Do NOT adjust header or trailer records


Upload File Upload File Phase 1, File CheckPhase 1, File Check

• Unsuccessful– All records rejected– Possible errors

• Header record error• Trailer record error• Records deleted or added• Latest download file not used for upload• File format


Upload File Upload File Phase 1, File CheckPhase 1, File Check

• Successful– Proceed to Phase 2

• Record check–Only modified records will be checked


Upload File Upload File Phase 2, Record CheckPhase 2, Record Check

• Data for entire record has to be valid

• Updates record if all data valid

• Rejects record if ANY data on the record is invalid

• E-mail sent to inform that Phase 2 has been completed


E-mailE-mail

From: [email protected] Subject: Student Demographic Edit File Status Notification

Below is the file processing status for: STAR Student Demographic Edit Upload File

Filename: PN543.1txt.txt

Date Submitted: Thu Sep 28 11:18:36 EDT 2009

Submitter: Mark Hansen

Status: Error

Total Number of Records: 51

Total Number of Accepted Records: 50

Total Number of Rejected Records: 1

Please return to [URL] to download the detailed error report for this file.

Contact customer service at (800) 955-2954 if you need further assistance.


ResubmitResubmit

• Download data

• Locate records in error

• Correct errors

• Upload ENTIRE file– Not just the corrected error records


SoftwareSoftwareDemonstrationDemonstration

Online Updates

Matching Records

Download & Upload Files


Login to 2009 DatabaseLogin to 2009 Database


Welcome ScreenWelcome Screen


Online CorrectionsOnline CorrectionsSearch for StudentSearch for Student


Online CorrectionsOnline CorrectionsSearch for Student ResultsSearch for Student Results


Online CorrectionsOnline CorrectionsUpdate Student DataUpdate Student Data

• Cannot update online

– Special test conditions

– Modifications and accommodations

– Must make these corrections offline


Online CorrectionsOnline CorrectionsMatching RecordsMatching Records

• Matching only available online

• Grades 4 and 7 multiple choice/ writing


Online CorrectionsOnline CorrectionsMatching RecordsMatching Records


Offline CorrectionsOffline CorrectionsRequest FileRequest File


Offline CorrectionsOffline CorrectionsDownload FileDownload File

• Available the next day for download


Offline CorrectionsOffline CorrectionsEdit FileEdit File

• Text editor


Offline CorrectionsOffline CorrectionsUpload FileUpload File


Upload MessagesUpload MessagesSuccess

Failure


Offline CorrectionsOffline CorrectionsCheck File StatusCheck File Status


ApproveApprove


Final StepFinal Step

• Approve – District Complete– Sends data for inclusion in January

Internet posting– Sends invoice from ETS


Score uncoded and rescore Score uncoded and rescore miscoded miscoded

end-of-course mathematics or end-of-course mathematics or science testsscience tests

• Two options– Demographic data corrections– Handscore


Data Corrections Hand Scoring

Question: Cost to district for scoring individual students?

Zero additional cost ……if district is already performing demographic

data corrections to correct other data.

$52 per student

Question: Will updated data be sent to CDE for inclusion in Internet data posting and API/AYP calculations?

YES NO

Question: Will updated Summary reports, data CD, etc., be available?

YES NO

Question: Will there be notification of new score(s) (Student Master List, Student Record Label, data CD, etc.)?

YESThe updated Student Master List, Student

Record Label, and the student data file CD will be available for an additional charge

YESLetter will be sent to the district STAR coordinator

containing the new/revised scores.

Question: Will updated STAR Student Reports be available?

YESPaper and PDF available

NO

Data Corrections vs. Handscoring FAQs Data Corrections vs. Handscoring FAQs for EOC Mathematics or Sciencefor EOC Mathematics or Science


Questions?Questions?


Next WebcastNext Webcast2010 STAR Order Management 2010 STAR Order Management

SystemSystem

October 28, 2009

Webcast starts at 9:00 a.m.

september 2009demographic data corrections1 2009 star demographic data corrections webcast september...

Documents

correct data

correctedwhat data

ayp calculationscorrected

correcting datawhen

demographic fields

students residence

recordall students

correct api