State Assessment Accommodations:

Verification and Monitoring

Melissa Gholson Office of Assessment and Accountability

2013-2014Participation Guidelines

• The document includes references to current state policies and procedures.

• The document was revised in December

• Updated to reflect the changes for online assessment.

https://sites.google.com/a/wvde.k12.wv.us/oaar-file-cabinet/accommodations

Code SummaryExhibit 2. Acceptable Options and Accommodations for Students With Disabilities by WV-MAP Assessment

Options and Accommodations Key:A Accommodation allowed

WVEIS CodeO Option to standard

conditions allowed to all students N Not allowed

WESTEST 2RLA Multiple Choice

WESTEST 2RLA Online Writing

MathematicsWESTEST 2

WESTEST 2Science

WESTEST 2Social Studies

ACT EXPLORE

ACT PLAN

ACT COMPASS

ACT COMPASS

APTA Smarter Balanced

Presentation

P01 Use text to speech, excluding ELA reading passages (Smarter Balanced, WESTEST 2 & NAEP)

A A A A A N N N M N A

P02 Have test read aloud verbatim N N A A A A A A A O A

P03 Use braille or other tactile form of print A A A A A A A N N A A

P06 Have test presented through sign language N A A A A A A A A O A

P13 Use text to speech, including ELA reading passages (Smarter Balanced–for documented need, grades 6-11)

N N N N N N N N N N A

P14 Have test read aloud, including passages (Smarter Balanced –for documented need for grades 6-11; students who are blind/low vision grades 3-11 who do not yet have adequate braille skills)

N N N N N N N N N N A

ONLINE WRITING

General Reminders

P26 Have directions, passage and prompt read aloud (Allowed for WESTEST 2 Online Writing

and NAEP Writing) This is the only read aloud option for this test. P02 is not a universal read aloud code for Online Writing.

R04 Indicate responses to a scribe, all elements to be scored

(Smarter Balanced, WESTEST 2 and Online Writing) http://wvde.state.wv.us/oaa/westest_training_writing_scribe.html

Screen Readers

P21 Use screen-reading software to access computerAllowed for: WESTEST 2 Online Writing, ACT COMPASS Mathematics and other computer-based assessments excluding WESTEST 2 and Compass Writing Skills.Description: Screen-reading software provides text-to-speech translation.When to select: For students who are vision impaired, and for whom the use of screen-reading software is the typical mode of accessing written material.Notes for implementation: Screen readers are allowed only when it is typical access. Only JAWS 11 and 12 work as well as Systems Mobile Access (see Appendix L on page 89 for more directions). On NAEP the text-to-speech function is a built-in universal design element.

High Contrast

P28 Use high contrast for online assessmentsAllowed for: Smarter Balanced, WESTEST 2 and Online Writing, ACT COMPASS, NAEP, and other computer based assessments. Description: Enable students to adjust screen background or font color, based on student needs or preferences. This may include reversing the colors for the entire interface or choosing the color of font and background. Reverse contrast turns the screen from white to black and creates text in white.When to select: For students who have vision or perception difficulties and use this accommodation instructionally. Students with attention difficulties may need this support for viewing test content. It also may be needed by some students with visual impairments or other print disabilities (including learning disabilities). Choice of colors should be informed by evidence that color selections meet the student’s needs.

WESTEST 2 ACCOMMODATIONSPreparing for Spring 2014

WESTEST 2 Accommodations

P01 Use text to speech, excluding reading passages – Text is read aloud to the student via technology (Embedded

into the platform). The students are able to control the speed as well as raise and lower the volume via a voice control.

– This support may be needed by students with reading-related disabilities or by students who are blind and do not have adequate braille skills.

– For WESTEST 2 this accommodation will be provided via recordings. The student will need headphones.

– Emphasizes student independence.

P01 Use text to speech, excluding ELA reading

P02 Have test read aloud.(There are no books with online testing. Teacher will read directly from students screen).

NEW

Human reader

Listen to recorded voice through headset

Understanding the difference between P01 and P02 for the WESTEST2

Enlarge Text• P22 Enlarge text on a screenDescription: Screen-enlarging software may involve the use of enlarged computer monitors or computers with screen-enlargement programs. Some students use closed-circuit television to enlarge print and display printed material with various image enhancements on a screen.When to select: For students who are visually impaired, and for whom computer screen adjustment is the typical mode of accessing onscreen written material.

High Contrast

P28 Use high contrast for online assessmentsAllowed for: Smarter Balanced, WESTEST 2 and Online Writing, ACT COMPASS, NAEP, and other computer based assessments.Description: Enable students to adjust screen background or font color, based on student needs or preferences. This may include reversing the colors for the entire interface or choosing the color of font and background. Reverse contrast turns the screen from white to black and creates text in white.When to select: For students who have vision or perception difficulties and use this accommodation instructionally. Students with attention difficulties may need this support for viewing test content. It also may be needed by some students with visual impairments or other print disabilities (including learning disabilities). Choice of colors should be informed by evidence that color selections meet the student’s needs.

All available WESTEST 2Accommodation Codes

• P01 Use text to speech, excluding ELA reading passages –embedded (provided online) WESTEST 2 a recorded voice

the student will need headphones• P02 Have test read aloud -WESTEST 2 may be administered individually by a

trained examiner.• P03 Use contracted braille or tactile graphics • P06 Have test presented through sign language • P15 Have directions only read aloud –Provided by a human only unless P01 • P16 Have directions presented through sign language • P17 Use secure electronic braille note taker• P18 Have directions rephrased by trained examiner• P19 Use large print edition• P21 Use screen reading software (Will not be compatible-NA)• P22 Enlarge text on screen (Large Font Size)

WESTEST 2 Codes (continued)

• P23 Use a magnifying device to enlarge assessment material• P24 Use electronic translator or sign-dictionary to present test• P25 Use electronic translator or sign dictionary to present directions

only• P26 Have directions, passage and prompt read aloud• P27 Use approved bilingual word to word dictionary • P28 Use high contrast on screen (For WESTEST 2 Online the student

will be able to receive color font and background options) • P29 Use sign-dictionary to present test, including directions• R02 Indicate responses to a scribe (multiple-choice) • R03 Use braille or tactile graphics• R04 Indicate responses to a scribe (constructed, extended and

gridded response)• R05 Use an abacus

WESTEST 2 Codes (Continued)

• R11 Use computer or other assistive technology device to respond

• R13 Provide physical support • R15 Use a bilingual word to word dictionary • R16 Mark responses in large-print test book• R17 Use an electronic translator to respond• T03 Take more breaks (no studying) • T04 Use extra time for any timed test (extended time)

(NAEP, ACT Explore and Plan are timed) • T07 Flexible scheduling, same day

SMARTER BALANCED FIELD TEST ACCOMMODATIONS

Smarter BalancedSmarter Balanced website has more specific guidelines on • General Accessibility

Guidelines• ELA Audio Guidelines• Mathematics Audio Guidelines • ELL Guidelines • Signing Guidelines • Tactile Guidelines • Bias and Sensitivity Guidelines • Style Guide

Smarter BalancedSmarter Balanced

Universal ToolsAvailable to all

Designated SupportsAvailable for Students with LEP, IEP and 504 Plans

AccommodationsAvailable for Students with IEP and 504 plans.

Embedded BreaksCalculatorDigital NotepadEnglish DictionaryEnglish GlossaryExpandable PassagesGlobal NotesHighlighterKeyboard NavigationMark for ReviewMath ToolsSpell CheckStrikethroughWriting ToolsZoom

Color Contrast/P28Masking /P37Text-to-Speech /P01Translated Test Directions/P30Translations(Glossary)/P31Translations (Stacked)/P32Turn off Any Universal Tools/P33

American Sign Language/P34Braille/P03 or P35Closed Captioning/P36Text-to-Speech/P13

Non-Embedded

BreaksEnglish DictionaryScratch PaperThesaurus

Bilingual Dictionary /R15Color Contrast/P38Color Overlay/P39Magnification/P23Read Aloud/P02Scribe/R04Separate Setting/T09Translations(Glossary)/P41

Abacus/R05Alternate Response Options/R11Calculator/R19Multiplication Table/R20Print on Demand/P40Read Aloud/P14Scribe/R04Speech-to-Text/R21

What about the other codes?• Smarter Balanced does not provide/allow for

P06, P15, P16,P17, P18, P19, P24,P25, P26,P27,P29, R02, R13, R16, R17, R18, T03,T04, T07

• P21-screen reading software-Smarter is compatible with JAWS and Window Eyes

• P22-universal zoom is provided to all

Smarter BalancedReading Supports

• P01 Use text to speech, excluding ELA reading passages (Smarter Balanced & NAEP)

• P02 Have test read aloud (All WV-MAP tests excluding Smarter Balanced ELA reading passages, WESTEST 2 RLA/Online Writing, ACT COMPASS Writing Skills and NAEP Reading)

• P13 Use text to speech, including ELA reading passages (Smarter Balanced –for documented need, grades 6-11) Form required

• P14 Have test read aloud, including passages (Smarter Balanced –for documented need for grades 6-11; students who are blind/low vision grades 3-11 who do not yet have adequate braille skills)

Documented Need:P13

Smarter Balanced

• P03 Use contracted braille or tactile graphics (All WV-MAP tests excluding NAEP computer-based)

• P23 Use a magnifying device to enlarge assessment material• P28 Use high contrast on screen (Smarter Balanced, WESTEST 2 and

Online Writing, ACT COMPASS,NAEP, and other computer based assessments)

• P33 Turn off any universal tools (Smarter Balanced)• P34 Use embedded American Sign Language (Smarter

Balanced – for ELA listening and math items only ) • P35 Use non-contracted braille and tactile graphics (Smarter Balanced) • P36 Use closed captioning (Smarter Balanced – for ELA

listening and NAEP) • P37 Use masking (Smarter Balanced)

Smarter Balanced

• P38 Use color contrast (Smarter Balanced – in conjunction with print on demand)

• P 39 Use color overlays (Smarter Balanced – in conjunction with print on demand)

• P40 Use print on demand (Smarter Balanced)• P41 Provide translations glossary (Smarter Balanced

ELL only for paper pencil version)• R04 Indicate responses to a scribe• R05 Use an abacus (Smarter Balanced, WESTEST 2

Mathematics and Science, APTA, ACT COMPASS Mathematics, ACT EXPLORE and PLAN)

Smarter Accommodations

• R11 Use computer or other assistive technology device to respond (Alternate response options)(All WV-MAP tests)

• R19 Use calculator (Smarter Balanced –for students needing a special calculator, e.g. braille or talking)

• R20 Use multiplication table (Smarter Balanced)• R21 Use Speech to Text (Smarter Balanced)• T09 Provide separate setting (Smarter Balanced)

Smarter Balanced ELL Only• P30 Provide translated test directions (ELL Smarter

Balanced – for math items only)• P31 Provide translations glossary (ELL Smarter

Balanced – for math items only) • P32 Provide translations stacked (ELL Smarter

Balanced – for math items only)• R15 Use a bilingual word-to-word dictionary

(All WV-MAP and Smarter Balanced ELA-performance task full writes excluding WESTEST 2 RLA and Online Writing, ACT COMPASS Writing Skills and NAEP Reading and Writing)

ACCOMMODATIONS MONITORING

State Accommodations Monitoring Policies

• West Virginia Policies: 2340, 2419, 2417 provide guidance for accommodations for students with IEP, 504 and LEP plans.

• All required district and state assessments must provide accommodations monitoring using the WVS.326 Process.

• Students should always receive the accommodations identified in their plans for other assessments.

• Individual accommodations data is archived in the West Virginia Education Information System (WVEIS).

28

Selection of accommodations are documented in the

IEP,504 or LEPDistrict

Accommodations data is entered into

WVEIS system: Online IEP, LEP and

504 plansDistrict

Accommodations data must be verified prior to assessment:

WVEIS WOW TabDistrict

Accommodations data is pulled to

identify the appropriate

accommodations for WVS 326 forms:

WVDE

Accommodations provision data is

collected, analyzed and reports created

and shared: WVS 326 Process

District/WVDE The Accommodations

Process

ACCOMMODATIONS VERIFICATIONWVEIS WOW

Prior to Testing: Verification

Follow the steps outlines in the Participation Guidelines.• Accommodations are verified:

(WVEIS WOW is compared to current IEP,LEP and 504 plan)

• Assessment decisions are made prior to testing.

• The only way to change an accommodation(s) is by holding an appropriate IEP meeting/addendum.

• Finalizing it in the Online IEP.

Your County

THE WVS 326 FORM & MONITORING

The 326 Process• The WVS.326 form will be provided for all

WV-MAP assessments.• One form will be provided for each student

who should receive accommodations.• WVS. 326 video http://

wvde.state.wv.us/oaa/videos/WV_326/Documentation%20Procedures.zip

WVS.326

• New WVS.326 form includes all the accommodations changes

• All pre-slugging and data entry one side(no flipping back and forth)

• Directions on the back side• Data entry is the same• Complete information on

accommodations and the WVS. 326 process is included in the Participation Guidelines.

During the Assessment• Data is marked for each accommodation that a student should

be receive according to their current plan.• If you provide an accommodation not identified on the form, you

have over-accommodated a student. • You may add an accommodation to a pre-slugged form; if you

need to delete an accommodation, a new form must be filled out.

• Teachers/BLC review forms daily at the site to assure they are documenting the form correctly.

• Report all errors to Principal/BLC.

Let’s Talk About CodesIf you mark Provided “Yes”- this means the student was given the identified accommodation.If you mark “No”- this means the student was not provided the identified accommodation. This is an accommodations breach UNLESS it is a:• Code 1-the student refused; or• Code 2-the accommodation is not allowed/applicable for

this testIf “no” is not marked with a code 1 or 2, then it constitutes an accommodations error that requires documentation.

Common Errors in Filling Out the WVS.326 Form

Over-accommodating• Selecting “Yes” when

accommodation is not pre-slugged

• Selecting “Yes” when an accommodation was not allowed/not applicable

Under-accommodating• Failing to provide a

currently identified accommodation

• Selecting “No” and failing to identify a code 1 (refused) or code 2 (not allowed/not applicable)

Training IssuesReasons for errors

• Not understanding when specific accommodations are allowed for a test

• Inappropriate use of the not applicable/not allowable reason code

• Accommodations not verified/finalized or entered by the pre-slug

• Failure to sign or date the form

How to Fix• Retrain on accommodations

Use the quick guide in Participation Guidelines

• Clarify how to use NA reason code

• Emphasize how to add an accommodation

• Remind examiners to review sheets before submitting

What to do about students who do not receive accommodations?

All incidents for failing to provide an accommodation requires written documentation.

• The CTC will review all accommodation breaches with principals/building level coordinators and report any findings to the Special Education, Title III and/or 504 director(s) and to the Office of Assessment and Accountability.

• If a student has been denied accommodations listed within the IEP, 504 or LEP plan, there has been a breach in the integrity/accuracy of test results. Therefore, the CTC or county special education director should contact the principal who must inform the parent/guardian of the testing administration breach and provide the following options: – Test is invalidated and the student is retested using a breach form (if the testing window is still open). – Test is scored. – Test is invalidated and student receives a score of ―0.

If the second or third option is selected—there must be a signed written agreement between the parent/guardian and principal/building level coordinator. Copies of the agreement must be kept on file with the CTC/county special education director, Section 504 director, or Title III director.

WVS.326 REPORTS

WVS 326 State and District Accommodations Report

• Provision of accommodations data by content area• 7 reports were generated for each content area to

summarize (1) provision rate, (2) refusal rate, (3) not allowable rate, and (3) number of students over-accommodated– State, district, school-level reports – Intended uses of these data– Set specific targets for provision rates– Identify common errors to inform your training– Eliminate under- and over-accommodation

WVS. 326Accommodations Reporting

1. Count of Students with Accommodation

This report provides the total number of students with the accommodation listed on the front of the 326 form (this number serves as the denominator for all rate calculations in reports 2 – 6).

2. Provision Rate

This report provides the percentage of students with the accommodation for whom the accommodation was marked “provided.”

3. Not Allowed Rate

This report provides the percentage of students with the accommodation for whom the accommodation was marked “not provided” and the “not allowed” code was provided in the reason field.

4. Refusal Rate

This report provides the percentage of students with the accommodation for whom the accommodation was marked “not provided” and the “refused” code was provided in the reason field.

5. Not Provided (no reason indicated)

This report provides the percentage of students with the accommodation for whom the accommodation was marked “not provided” but no reason code was provided.

6. Not Provided (blank)

This report provides the percentage of students for whom no information was provided on whether or not the accommodation was provided.

7. Count of Students Over-accommodated

This report provides the number of students who do not have the accommodation listed in the pre-slug file, but for whom the accommodation was marked “provided.”

State Reports

District Reports

FINAL REMINDERS

Accommodations Data

• Be sure the current and appropriate accommodations are reflected in the WOW Accommodations App.

How is the data entered into the system:• Accommodations for students with disabilities will be entered by

finalizing the data in the Online IEP. • With the exception that students with a 504 plan will be entered into

green screen.• Accommodations for students who are LEP will be entered by the LEP

Plan.How is the system data reviewed and verified:All accommodations are verified by the WVEIS WOW Accommodations APP which supports the WVS 326 monitoring of accommodations.

Accommodations Checklist Identify accommodations changes for each assessment

(WESTEST 2 including Online Writing and Smarter Balanced Field Test).

Emphasize the collection dates. Review IEP’s, 504’s and LEP’s for any changes necessary

regarding changes for accommodations. Conduct any addendums or meetings for students to be

eligible to receive the appropriate accommodation prior to collection dates.

Districts must verify and record each student who receives accommodations. This means the Online IEP must be “finalized”.

Reminders• Review the changes to accommodations and

their codes prior to each assessment.• Review the WESTEST 2 accommodations

changes for the transition online. • Review and consider Smarter Balanced field

test accommodations, if the student is taking the field test this spring.

• Select Smarter Balanced accommodations for all IEP’s written after April 1.

Data Collections for Accommodations SY 2013-2014

• Writing Assessment: Certification due date Jan. 15

• WESTEST 2 & SBAC Field Test: – Feb 7-14 - Certification Window– Feb 14* by 11:59 PM - Certification Due Date

• APTA: March 15

Resources

• Make good decisions about who should be receive accommodations Participation Guidelines

• OAA File Cabinet-Accommodations folder• Accommodations checklists• Smarter Balanced Accommodations Guidelines• Smarter Balanced Practice Tests

Updating WVEIS Accommodations Codes

• A Quick sheet containing all accommodations codes

• Bold codes are embedded• New codes or updated

definitions are highlighted• Will be included in the

updated PG, WVEIS…

Why do we have to improve?“It is not enough to have a list of available accommodations. Rather, accommodations must be used for instruction and assessment, they must be monitored, and they must be used appropriately so that scores are valid and provide information about a student’s knowledge and skills”.(NCEO, 2012)

Questions?

Melissa Gholsonmgholson@access.k12.wv.us