test administration training cannot combine scores from workkeys 1.0 with workkeys 2.0 assessments...
TRANSCRIPT
1
Test Administration Training
Paper Testing
2017-18
Michigan Department of Education
2
1. Overview of ACT WorkKeys
2. What’s New
3. Testing Facilities
4. Testing Staff Requirements
5. Planning for Test Administration
6. Test Day Activities
7. Post-Test Activities
8. Success for You and Your Students
9. Resources
Topics
3
Chapter 1
Overview of ACT
WorkKeys
2
4
Assessments
WorkKeys 1.0 Titles WorkKeys 2.0 Titles
Reading for Information Workplace Documents
Applied Mathematics Applied Math
Locating Information Graphic Literacy
Students will have 55 minutes to complete each
assessment
5
Assessments
Level Scores for Foundational Skills Assessments
Workplace Documents <3 3 4 5 6 7
Applied Math <3 3 4 5 6 7
Graphic Literacy <3 3 4 5 6 7
6
➢Research based
➢ Industry
recognized
➢Portable
➢Measures and
certifies essential
work skills
Certification
Examinees cannot combine scores from WorkKeys 1.0 with WorkKeys 2.0 assessments to earn the new certificate.
3
7
Certification
Minimum Score of 6 on each of three tests
Minimum Score of 5 on each of three tests
Minimum Score of 4 on each of three tests
Minimum Score of 3 on each of three tests
8
➢ #1 priority
➢ACT WorkKeys tests are high stakes
➢Tests can be used to get a job, keep a job, or
earn a promotion
➢ Integrity of the system is critical
➢Read and understand the ACT WorkKeys
Administration Manual for State Paper Testing
Test Security
9
➢Constant monitoring is required
➢Discussion of test items is not allowed
➢Consequences of poor test security are high
• Fairness
• Expense
Test Security
4
10
➢ Manage Participation: November 6 – December 1, 2017
➢ Order test materials and submit pre-id student data: January 8 – February 13, 2018
➢ Question & Answer Webinars: February 6 and March 20,
2018
➢ Initial Test Day: Wednesday, April 11, 2018
➢ Makeup Test Day: Wednesday, April 25, 2018
➢ Accommodations Test Window: April 11 – 24, 2018
➢ Accommodations Make up Window: April 25 – May 1,
2018
➢ Answer Document Receipt Date: May 4, 2018
➢ Tested Roster: May 22 – 31, 2018
➢ Score Reporting: August 2018
Schedule of Events
11
Chapter 2
What’s new?
12
What’s New for 2017-18
WorkKeys 1.0 Titles WorkKeys 2.0 Titles
Reading for Information Workplace Documents
Applied Mathematics Applied Math
Locating Information Graphic Literacy
Students will have 55 minutes to complete
each assessment
5
13
What’s New for 2017-18
➢ ACT WorkKeys state testing website at
http://www.act.org/stateanddistrict/Michigan has a new look!
14
➢New Answer Document
• Disregard Block 18 – Reporting High School Code
➢Spanish version of ACT WorkKeys
• Standard time, extended time, large type, Braille,
Reader Script, and Audio DVD
What’s New for 2017-18
15
➢ Accommodations Materials
• Replaced Video DVDs with Audio DVDs
• Braille available in UEB format only
• Translated Test Directions
What’s New for 2017-18
6
16
What’s New for 2017-18
➢ Simplified returning test materials• Eliminated polymailers
o Answer documents will be placed in colored
envelopes and returned in the same boxes
with all other test materials• Return materials (Test Administration Forms, return
labels, etc.) are color-coded by administration type:
17
What’s New for 2017-18
➢ Reporting
• New Report Titles
• ACT WorkKeys NCRC en español
• Students will print their own ACT WorkKeys NCRC from myworkkeys.com
WorkKeys 1.0 Titles WorkKeys 2.0 TitlesSummary Report for Examinee Summary Score Report
Memo to Examinee Individual Summary Score Report
Examinee Roster Report Roster Score Report
18
Chapter 3
Testing Facility
Requirements
7
19
Type and Size of Rooms
Recommended = 15–30 students per room
Maximum Capacity = 100
20
Type and Size of Rooms
X
21
Room Setup and Seating Arrangements
8
22
Room Setup and Seating Arrangements
3 ft.
3 ft.
23
Distractions
Quiet,
Please!
Testing in
Progress!
24
Writing Surfaces
Test Booklet
Answers
9
25
Bulletin Boards
26
Timepieces
9:009:00
27
Room Conditions
10
28
Administration Manuals
29
Chapter 4
Testing Staff
Requirements
30
➢Test Coordinator
• Responsible for all assessment activities
• Maintains continuity and administrative uniformity
➢Substitute Test Coordinator
• Assists test coordinator with all assessment
activities
• Serves as test coordinator on test day if the test
coordinator is unable to serve
Testing Staff Requirements
11
31
➢Test Coordinator• Each individual’s name must be on file with ACT
• Responsible for selecting and training staff to assist
during testing (e.g., room supervisors and proctors)
Testing Staff Requirements
32
➢Room Supervisor• One room supervisor must be present in each room
• Responsible for the following:
o Testing conditions
o Admission and seating of students
o Monitoring students
o Completing required documentation
Testing Staff Requirements
33
➢Proctor
• Assist room supervisor
• Responsible for:
oAdmission and seating of students
oMonitoring students
oReporting irregularities
oAccompanying students to the restroom
Testing Staff Requirements
12
34
Testing Staff Requirements
Students Staff
1-25 Room Supervisor
26-50
Room Supervisor
+
1 Proctor
51-100
Room Supervisor
+
2 Proctors
35
➢Current or retired faculty members
➢School employees
➢Substitute teachers
➢Student teachers
➢Teachers’ aides
Who May Act as Staff?
36
➢High school students
➢Volunteers
➢Lower-division undergraduates
➢Relatives or wards
➢Anyone who will take ACT WorkKeys
within next 12 months
➢Individuals involved in ACT WorkKeys test
preparation for commercial gain
Who May Not Act as Staff?
13
37
Avoiding Conflicts of Interest
38
Following Standardized Procedures
39
➢Discuss before test day• Policies and requirements
• Security of test materials
• Preparation
• Test administration activities
• Attentiveness during testing
➢Review forms and required documentation
➢Resources• ACT WorkKeys Administration Manual
➢Test administration training
• www.act.org/stateanddistrict/michigan
Local Training
14
40
Chapter 5
Planning for
Test
Administration
41
➢Complete Manage Participation process
➢Order test materials
• Ordering window for initial standard time and
accommodations testing:
January 8 – February 13, 2018
• Ordering window for makeup testing:
April 11 – 12, 2018
• You will use the OEAA Secure Site to order all test
materials: www.michigan.gov/oeaa-secure
• Order the number of test booklets, answer
documents, and manuals needed
Pre-planning
42
➢Train and assign testing staff
• Follow required staffing ratios
• Direct staff to ACT WorkKeys Test Administration
Manual posted on the ACT Workkeys state testing
website
Pre-planning
15
43
➢Select and prepare rooms
• Students testing with standard time
• Students testing with accommodations
o Students using alternate testing modes must test
separately
• Follow requirements under “Testing Facility
Requirements” section
Pre-planning
44
Pre-planning
45
➢Provide information to students
• Bring #2 pencils
• Bring permitted calculator
• Bring required ID
• Don’t bring a cell phone
• When and where to report
Pre-planning
16
46
Pre-planning
47
Permitted Calculators
➢ Policy ensures fairness for all examinees, avoids disturbances during
testing, and protects the security of the test materials.
➢ Calculators may only be used on the Applied Math test.
➢ Examinees may use any 4-function, scientific, or graphing calculator
not on the prohibited list.
• Examinees are responsible for knowing if their calculator is
permitted.
➢ Calculators cannot be shared during the test.
➢ Entire calculator policy is posted on the ACT hosted Michigan
WorkKeys website in the Administration tray.
48
➢Reader / Audio DVD
➢Large-print testing materials
➢Sign Language Interpreter
➢Braille (UEB only)
➢Extended time
➢Word-to-word foreign
language glossary
➢Translated Test Directions
Testing Accommodations
17
49
Ineligible Accommodations
50
➢Local Arrangements
• Standard time limits with normal breaks
oRegular type
oNo special test format
• Examples:
oWheelchair access
oFront of room
oSeparate room
Testing Arrangements
51
➢Must be written by the diagnosing professional
➢Must meet the following guidelines:• States the specific disability
• Is current (no older than 3 years)
• Describes the present problem(s) and developmental history
• Describes the comprehensive assessments
• Describes the functional limitations or impairment
• Describes specific recommended accommodations
• Establishes the professional credentials of the evaluator
➢Collect, review, and keep on file for 1 year
Documentation Needed
18
52
Administration Codes
53
➢Shipped to Test Coordinator
• Test booklets
• Answer documents
• ACT WorkKeys Administration
Manual
• Administration Supplement
• Test Administration Forms Folder
• Return envelopes
Receipt and Check-in of Materials
54
➢Check contents within 24
hours
• Check against packing list
• Count test booklets individually
• Follow instructions in the
Administration Manual
➢Lock up cartons in a secure
place
Receipt and Check-in of Materials
24 hours
19
55
➢IMMEDIATELY report shortages or
evidence of tampering
➢Contact ACT
• Phone: 800.553.6244 ext. 2800
Missing Materials
56
Security of Materials
57
Security of Materials
20
58
NEVER leave test booklets unattended
when out of secure storage
Security of Materials
59
Chapter 6
Test Day
Activities
60
ACT Test Security Principles
21
61
➢Arrival of proctors
• At least 30 minutes
prior to check-in
➢Review
procedures
• Test security
• Checking in
students
➢Make last-minute
adjustments
Briefing Session
62
➢Authorized
observers
• ACT ID
• State DOE or District
official ID
➢Unauthorized
observers
• Media
• Test prep companies
• Parents
• Employers
Observers
63
➢Personal recognition
by staff
➢Current official photo
ID
Identifying Students
22
64
➢Check students
in at the door
➢Mark students’
names on
roster
➢Direct students
to seats
Admitting Students
65
➢No late
admittance
➢No cell phones
Admitting Students
66
➢The ACT WorkKeys testing must only occur on
the designated test days
➢Testing to begin no later than 9:00 a.m.
➢Must allow full time for testing
• Workplace Documents 55 minutes
• Applied Math 55 minutes
• Graphic Literacy 55 minutes
Test Day Schedule
23
67
Test Day Schedule
15 minute
break
Workplace
DocumentsApplied
Math
Graphic
Literacy
Tests must be administered in order
68
Start
absent
350222
350223
350226
350225
350224
absent
350228
End
350227
➢ After students are seated
➢ Only when prompted in
verbal instructions
➢ Individually, one to each
student
➢ Unbroken, sequential order
Distributing Test Booklets
69
➢Use more than one timepiece• Do NOT use a cell phone
• An accurate wall clock is allowed
➢Time each room separately
➢Record times on the Test Administration
Form
➢Remember to give 5-minute warning
Exact Timing of Tests
24
70
Staff Attentiveness
71
Staff Attentiveness
72
➢Document and call ACT if:
• Missing test materials
• Mistiming
• Inclement weather
• Emergency evacuations
• Power failure
• Disturbances/distractions
➢Phone: 800.553.6244 ext. 2800
➢File an Irregularity Report
Group Irregularities
25
73
➢ Include, but are not limited to:• Defective test materials
• Duplicating test materials
• Student illness
• Irrational or prohibited behavior
➢Document everything
Individual Irregularities
74
➢Prohibited behaviors include:• Creating a disturbance
• Giving/receiving help
• Possessing a cell phone
• Violating calculator rules
➢File an Irregularity Report
➢ If there’s been a security breach, call ACT at
800.553.6244 ext 2800
➢Document everything
Prohibited Behavior
75
Anonymous Security Hotline
877.777.7296
26
76
Chapter 7
Post-Test
Activities
77
➢Account for all test booklets and answer
documents
• Documented on Test Booklet Count Form
• All signatures present
➢Verify rosters are marked
• No blanks – mark if absent
• “R” with staff initials
• Notarized Letter collected for every “L”
➢Review Irregularity Reports
• Attach voided answer documents
Before Dismissing Staff
78
➢Retain documentation for 1 year
• Rosters: Include students absent from testing
• Record of students dismissed for prohibited
behavior
• Irregularity Reports
• ACT WorkKeys Report of Accommodated Tests
Documentation
27
79
Return to ACT Scoring Services
Packing the Processing Envelope
➢ Required Items:
• Testing Staff List
• Test Administration Forms
• Site Header
• Answer documents to be scored
➢ If Applicable, also include:• Student Identification Forms
• Large Type Worksheets
• Reader, Interpreter, and Transcriber
Agreements
• Irregularity Report
• Voided or Replaced Answer Documents
80
Return to ACT Distribution Center
➢ Packing the carton
• Processing Envelope(s)
• Used and Unused Test
Booklets
• All Alternate Test Forms
o Braille, DVDs, etc.
• Translated Test Directions
➢Mark the cartons 1 of x, 2 of
x, etc.
➢ Detailed instructions are in the
Administration Manual
81
➢Standard ACT WorkKeys Reports
• All reports are sent to testing sites in August
• Summary Score Report
• Individual Summary Score Report
• Roster Score Report
➢Students will print their own NCRC from
myworkkeys.com
Score Reports
28
82
Chapter 8
Success for You
and Your
Students
83
➢Avoiding the Pitfalls
• No cell phones or other electronic devices
• Administer tests in proper sequence
• No extra breaks or extended breaks
• Do NOT throw away shipping cartons; use these
to return test materials
• Use the preprinted site header
• Be ready for pickup of testing materials
• Answer documents will not be scored:
o Late return
• Improper return packaging – no guarantee of
scoring
Success for You and Your Students
84
Task Date
Submit pre-id student data, order standard time and accommodations test materials
Jan 8 – Feb 13, 2018
Q&A Session #1 Feb 6, 2018 10:00 am ET
Receipt of Test Materials* Mar 19 - 23, 2018
Q&A Session #2 Mar 20, 2018 3:30 pm ET
Additional Materials Ordering Window Mar 21 – 28, 2018
Initial Test Date April 11, 2018
Makeup materials Ordering Window April 11 -12, 2018
Accommodations Test window April 11 – 24, 2018
Makeup Test Date April 25, 2018
Accommodations Make up Window April 25 – May 1 2018
Deadline for ACT to receive answer documents May 4, 2018
Upcoming Key Milestone Dates
*Schools were able to indicate the alternative arrival of Mar 12-16, 2018 during the Manage
Participation process
29
85
Chapter 9
Resources
86
➢ACT WorkKeys State Testing Website:
www.act.org/stateanddistrict/michigan
➢ACT WorkKeys Website:
www.act.org/workkeys/
For Information…
87
➢ACT Customer Service:
• Standard time:
o 800.553.6244 ext. 2800
• Accommodations:
o 800.553.6244 ext. 1788
• Contact Form:
o www.act.org/stateanddistrict/contactus
For Help…