jami-jon m. pearson, ph.d. research & assessment coordinator canyons school district

+Direct Writing Assessment (DWA) Proctor’s Training:

Measurement Inc. Secure Training (MIST)

1/20/2010 and 1/25/2010

Direct Writing Assessment (DWA) Proctor’s Training:

Measurement Inc. Secure Training (MIST)

1/20/2010 and 1/25/2010

Jami-Jon M. Pearson, Ph.D.Research & Assessment

CoordinatorCanyons School District

Jami-Jon M. Pearson, Ph.D.Research & Assessment

CoordinatorCanyons School District

+DWA OverviewDWA Overview

DWA is designed to measure student’s mastery DWA is designed to measure student’s mastery of the of the writing standards writing standards of the Utah Core of the Utah Core Curriculum in Language ArtsCurriculum in Language Arts

Grade 5 & 8Grade 5 & 8

End of traditional elementary & mid junior highEnd of traditional elementary & mid junior high

All student testing can be over a few daysAll student testing can be over a few days

Individual student must finish test in one dayIndividual student must finish test in one day

DWA is designed to measure student’s mastery DWA is designed to measure student’s mastery of the of the writing standards writing standards of the Utah Core of the Utah Core Curriculum in Language ArtsCurriculum in Language Arts

Grade 5 & 8Grade 5 & 8

End of traditional elementary & mid junior highEnd of traditional elementary & mid junior high

All student testing can be over a few daysAll student testing can be over a few days

Individual student must finish test in one dayIndividual student must finish test in one day

2

+Ethics (Pg. 4)Ethics (Pg. 4)

DWA is highly secure materialDWA is highly secure material

Only authorized personnel Only authorized personnel

Staff & students ALWAYS FOLLOW Staff & students ALWAYS FOLLOW DIRECTIONS EXPLICITLYDIRECTIONS EXPLICITLY

Never TEACH the actual promptNever TEACH the actual prompt

DWA is highly secure materialDWA is highly secure material

Only authorized personnel Only authorized personnel

Staff & students ALWAYS FOLLOW Staff & students ALWAYS FOLLOW DIRECTIONS EXPLICITLYDIRECTIONS EXPLICITLY

Never TEACH the actual promptNever TEACH the actual prompt

3

+Ethics (Pg. 4)Ethics (Pg. 4)

No hard copies of prompt or student No hard copies of prompt or student responsesresponses

R277-473 TESTING PROCEDURES R277-473 TESTING PROCEDURES http://www.rules.utah.gov/publicat/code/r277/r277-473.htm

Standard Test Administration and Standard Test Administration and Testing Ethics Policy for Utah Testing Ethics Policy for Utah educators educators http://www.schools.utah.gov/assessment/documents/AAEthicsPolicy.pdf

No hard copies of prompt or student No hard copies of prompt or student responsesresponses

R277-473 TESTING PROCEDURES R277-473 TESTING PROCEDURES http://www.rules.utah.gov/publicat/code/r277/r277-473.htm

Standard Test Administration and Standard Test Administration and Testing Ethics Policy for Utah Testing Ethics Policy for Utah educators educators http://www.schools.utah.gov/assessment/documents/AAEthicsPolicy.pdf

4

+CHECKLIST for Administration:Before testing (Pg. 7)

X

X

X

5

+CHECKLIST for Administration:During testing (Pg. 7)

6

+CHECKLIST for Administration: After testing (Pg. 8)

7

+(DWA) MIST:

2 Main Screen Interfaces(DWA) MIST:

2 Main Screen Interfaces

Tester Station (Student Screen) Tester Station (Student Screen) – – student uses to access teststudent uses to access test

Proctor Station (Proctor Screen)Proctor Station (Proctor Screen) – – proctor uses to access, start, and monitor a proctor uses to access, start, and monitor a test administration. test administration.

Tester Station (Student Screen) Tester Station (Student Screen) – – student uses to access teststudent uses to access test

Proctor Station (Proctor Screen)Proctor Station (Proctor Screen) – – proctor uses to access, start, and monitor a proctor uses to access, start, and monitor a test administration. test administration.

8

+Overview

STEP I Select a test and assign a student to each

computer.

STEP II Select a test from the Proctor Station and

start the testing session.

STEP I Select a test and assign a student to each

computer.

STEP II Select a test from the Proctor Station and

start the testing session.

9

+

HOW DO YOU SETUP EACH STUDENT TO TAKE THE DWA?

On the day of DWA testing

10

+PART 1. Administering the Test - Tester Station (Student screen) DISTRICT TECH should have uploaded MIST

on each computer (Proctor & student screens). Do you know your DISTRICT TECH?

11

+Login screen Tester Station (Student computer): use MIST User ID & Password (handout). Hit enter (Pg. 10)

USER ID

PASSWORDLOGIN

CLOSE (will completely exit program)

12

+Click appropriate test from list & click Tester Station.

2010 Utah DWA Grade 5 (Practice)

Tester Station

Date & Time

13

2010 Utah DWA Grade 8 (Practice)

Refresh

Log Off

+Select a pre-loaded student’s name from the Droplist. Select Test Form (Pg. 10).

Droplist (last, first name)

Test Form (eg. Standard, large print)

*Do not use New Student

Submit

No Seat Name required.

14

+Special Codes (Pg. 5)

15

+ 16

Special Codes (Pg. 5)

+Tester Station Welcome Screen: do this for each student’s computer (Pg12)

Start Test

17

+Repeat Login to All WorkstationsDO LAST 3 SLIDES ON EACH COMPUTER FOR EACH STUDENT (estimated 25 computers, 3 minute-per-computer).

THIS IS THE LABOR INTENSIVE PART!

WILL NOT BE REPEATED NEXT YEAR!

DO LAST 3 SLIDES ON EACH COMPUTER FOR EACH STUDENT (estimated 25 computers, 3 minute-per-computer).

THIS IS THE LABOR INTENSIVE PART!

WILL NOT BE REPEATED NEXT YEAR!

18

+Adding New students (pg. 10)

19

+NEW STUDENT SCREEN

FIRST NAME

MIDDLE

LAST

DOB

GENDER

ETHNICITY

EMAIL

STUDENT LEA ID

9+2

Non-Participation (unless student has code)

Non-Standard Participation (unless student has code)

20

*IF NEXT DOESN’T WORK:

scroll down page

+New Students (Pg.11)

21

*DO NOT USE NEW

STUDENTSUBMIT

CLOSE (will completely exit program)

+Special Codes (Pg. 5)

22

+ 23

Special Codes (Pg. 5)

+Tester Station Welcome Screen: do this for each student’s computer (Pg12)

Start Test

24

+Functional/Non functional Computer Keys during testing (Pg 16)

When in test mode, some keys do NOT have same function TAB will NOT work for paragraph indention RIGHT CLICK & SHORTCUT keys disabled

Keys that DO have same functionality: Backspace, Enter, Shift, End, Home Caps Lock

STUDENTS ARE ENCOURAGED TO USE Toolbar options: Cut, copy, paste, undo, redo, increase/decrease text size Students see description when scrolled over

When in test mode, some keys do NOT have same function TAB will NOT work for paragraph indention RIGHT CLICK & SHORTCUT keys disabled

Keys that DO have same functionality: Backspace, Enter, Shift, End, Home Caps Lock

STUDENTS ARE ENCOURAGED TO USE Toolbar options: Cut, copy, paste, undo, redo, increase/decrease text size Students see description when scrolled over

25

+STEP II: FROM PROCTOR STATION – Start Testing Session

26

+STEP II:Login screen at Proctor station: use MIST User ID & Password in handout. Hit enter (Pg. 13) 1.

2. USER ID

PASSWORD

LOGIN

CLOSE

27

+Click appropriate test from list & click Tester Station.

Proctor Station

28

2010 Utah DWA Grade 5 (Practice)

2010 Utah DWA Grade 8 (Practice)

+Proctor screen: all computer assigned students listed under Tester Name & Status = Ready

TESTER NAME STATUS:

READY

START TEST

29

*Roster report will NOT work for DWA live test.

Roster report

+ Proctor Testing Protocol(all students sitting at computers ready

to go)Proctor hit “START TEST” on Proctor computer

Tell students to click “START TEST”Have teacher read through directionsHAVE STUDENTS SCROLL OVER Toolbar

options Cut, copy, paste, undo, redo,

increase/decrease text sizeTell students to NOT click CLOSE until

Proctor tells them at end of test

Proctor hit “START TEST” on Proctor computer

Tell students to click “START TEST”Have teacher read through directionsHAVE STUDENTS SCROLL OVER Toolbar

options Cut, copy, paste, undo, redo,

increase/decrease text sizeTell students to NOT click CLOSE until

Proctor tells them at end of test

30

+

TEACHERS ADMINISTER the PROMPT

31

+TEACHERS: All “SAY” directions must be READ ALOUD (Pg. 15)

32

+TEACHERS (con’t) Pg. 16 33

+TEACHERS (con’t) Pg. 16

34

+FINISH TESTING

35

+Finishing Test (Pg. 18 & 20)

If student clicks Finish “without written response”, a warning box appears asking if

Ready to submit (YES/NO)

If NO – returns to test

If YES – submitted

If submitted incomplete test, change Status from “Finished” to “Paused” (1 hr only) Pg. 20

If student clicks Finish “without written response”, a warning box appears asking if

Ready to submit (YES/NO)

If NO – returns to test

If YES – submitted

If submitted incomplete test, change Status from “Finished” to “Paused” (1 hr only) Pg. 20

36

+

When students finished Click Finish & then Exit Tester Station (student’s screen) reads,

“your test has been submitted” Student reads book, etc. DO NOT HIT CLOSE

When Close is clicked, application ends & computer is unlocked.

When students finished Click Finish & then Exit Tester Station (student’s screen) reads,

“your test has been submitted” Student reads book, etc. DO NOT HIT CLOSE

When Close is clicked, application ends & computer is unlocked.

How to Complete DWA Test (Pg. 18 & 20)

37

+TROUBLESHOOTING

38

+Troubleshooting (Pg. 19-22)

39

+ Troubleshooting

Specific: Restarting Finished Test (submits incomplete test) Pg.

19 Pause a test for student absent Pg. 20 Resume a test for student(s) Pg. 20 Pause & resume a test (fire drill) Pg. 21 Pause & resume a test (bathroom) Pg. 21 Resume a student who’s disconnected from system Pg.

22 Move a student to different computer Pg 22

TO CLOSE out TESTER STATION (B4,F4 , G11) PC: hit CONTROL/ALT/SHIFT P MAC: hit ESC/ALT/COMMAND

Specific: Restarting Finished Test (submits incomplete test) Pg.

19 Pause a test for student absent Pg. 20 Resume a test for student(s) Pg. 20 Pause & resume a test (fire drill) Pg. 21 Pause & resume a test (bathroom) Pg. 21 Resume a student who’s disconnected from system Pg.

22 Move a student to different computer Pg 22

TO CLOSE out TESTER STATION (B4,F4 , G11) PC: hit CONTROL/ALT/SHIFT P MAC: hit ESC/ALT/COMMAND

40

+Absent Students (Pg.20)

IGNORE 5. DO NOT CLOSE the Proctor Station

Go through “PAUSE” process (next slides)

IGNORE 5. DO NOT CLOSE the Proctor Station

Go through “PAUSE” process (next slides)

41

+Pausing Test (PG 19-22)

1. LOGIN to Proctor Station

2. Click on TEST and then PROCTOR STATION

3. Click STUDENT name in drop down menu.

4. Click on the FINISHED button and click YES to “RESTART”

5. the student’s STATUS will change to “PAUSED”

6. TELL STUDENT TO HIT “FINISH” to activate PAUSE

1. LOGIN to Proctor Station

2. Click on TEST and then PROCTOR STATION

3. Click STUDENT name in drop down menu.

4. Click on the FINISHED button and click YES to “RESTART”

5. the student’s STATUS will change to “PAUSED”

6. TELL STUDENT TO HIT “FINISH” to activate PAUSE

42

+Resuming Test (Pg. 19-22)

1. LOGIN to Tester Station (Student’s computer)

2. Click on TEST and then TESTER STATION

3. Click on REASSIGN EXISTING TESTER Tab & students name

4. Type in a Reason & Click SUBMIT

5. Tester Station will read, “The test has been paused. Click Continue once the Proctor has resumed test.”

1. LOGIN to Tester Station (Student’s computer)

2. Click on TEST and then TESTER STATION

3. Click on REASSIGN EXISTING TESTER Tab & students name

4. Type in a Reason & Click SUBMIT

5. Tester Station will read, “The test has been paused. Click Continue once the Proctor has resumed test.”

43

+Resuming Test (Pg. 19-22)

1. Go to Proctor Station

2. Click on student’s name

3. Click on the STATUS icon & change PAUSE to READY.

1. Go to Proctor Station

2. Click on student’s name

3. Click on the STATUS icon & change PAUSE to READY.

44

+Moving Students (Pg. 22)

Same as “Paused”

TESTER STATION

“Reassign Existing Tester” tab

then “Assign new seat”

Add reason

Submit

TESTER STATION

Hit “Continue”

Same as “Paused”

TESTER STATION

“Reassign Existing Tester” tab

then “Assign new seat”

Add reason

Submit

TESTER STATION

Hit “Continue”

45

+ 46

All student testing can be over a All student testing can be over a few daysfew days

Individual student must finish test Individual student must finish test in one dayin one day

All student testing can be over a All student testing can be over a few daysfew days

Individual student must finish test Individual student must finish test in one dayin one day

+Contacts

DWA Technical Support (866) 691-1231 support@utahwrite.com

Jami-Jon Pearson (801) 501-1388 jami-jon.pearson@canyonsdistrict.org

PJ Giles (801) 501-1040 pj.giles@canyonsdistrict.org

ComputerBasedTesting.wikispaces.com

DWA Technical Support (866) 691-1231 support@utahwrite.com

Jami-Jon Pearson (801) 501-1388 jami-jon.pearson@canyonsdistrict.org

PJ Giles (801) 501-1040 pj.giles@canyonsdistrict.org

ComputerBasedTesting.wikispaces.com

47