meap coordinator briefing bureau of assessment and accountability fall 2012
TRANSCRIPT
MEAP Coordinator Briefing
Bureau of Assessment and Accountability
Fall 2012
04/10/232
Welcome
James A. Griffiths, Manager Assessment Administration and Reporting
Gayle de Jong, MEAP Program Manager
Agenda
• What’s New
• Critical Reminders
• Accommodations
• BAA Secure Site
• Receiving and Returning Materials
• On-line Social Studies04/10/23
3
04/10/234
What’s New • Test Administration Manuals (TAMs) have been
revised to make them more user friendly. Important Dates, The MEAP Assessment Schedule and Calendar, and The Table of Estimated Test Lengths are now in the first 3 pages of the TAMs.
• Based on IEPs, Students may take one subject test with MEAP and another with MEAP-Access.
• There will be an On-line Social Studies Pilot for grades 6 and 9 for selected schools.
What’s New
Test
Administration
Manual
04/10/235
04/10/236
What’s New
IMPORTANT MEAP DATES FOR FALL 2012
What’s New
04/10/237
04/10/238
MEAP Feedback:We are interested in feedback about student and test administrator experiences with the 2012 MEAP. After testing has been completed we would appreciate your responses to a survey found at:
https://baameap.wufoo.com/forms/2012-meap-feedback-survey/
This link may be found on the MEAP website (Test Administration Manuals) at: www.michigan.gov/meap.
What’s New
What’s New
Test Manual
•The first section of the TAM focuses on information for coordinators and school/district administrators
04/10/239
What’s New
Test Manual
•The second section focuses on information for test administrators and accommodation providers
04/10/2310
What’s New
Test Manual
•The third section contains the actual grade and subject specific directions for test administration.
04/10/2311
What’s New
Test Manual, The Appendix:
•DVD Information
•Diagram for Packing Scorable Materials
•Sample Group/Grade Header Sheets
•OSA Security Compliance
•Return Verification Form
•Answer Document Return Checklist
04/10/2312
What’s New
Administration Order of Test Parts
•Test parts for reading, writing, science and social studies must be administered in the specified order unless written permission for change from BAA is provided.
04/10/2313
Emergency Tests (Form 99)
•Emergency tests now include Reader Scripts for Math, Science and Social Studies
•Incidence reports can be found at the bottom of the BAA Secure Site announcements page
04/10/2314
What’s New
Critical Reminders
Highlighters•References to highlighters in the test directions have been removed due to problems with use on answer documents (still a universal accommodation)
04/10/2315
Critical Reminders
Requests for Off-Site Test Administration:•Michigan has established policy that all students are tested at the school where they receive instruction. Occasionally, exceptions must be made to this policy, however the security guidance outlined in the Assessment Integrity Guide must be followed: (http://www.michigan.gov/documents/mde/Assessment_Integrity_Guide_291950_7.pdf )
•Typical requests for off-site testing are due to seat time waiver programs, homebound students, and suspended or expelled students.
04/10/2316
Critical Reminders
04/10/2317
FORM NUMBERS
•Schools are assigned form numbers (1-5)
•Students must take all tests with the same form
•Form 1 is also used for the Accommodated Test
Critical Reminders
Reader Scripts, CDs, DVDs and Enlarged Print are based on Form 1
•Make sure to use a Form 1 test booklet
04/10/2318
Critical Reminders
•All test materials must be kept in one secure location within the school
•Test materials must be returned to this location daily
04/10/2319
Critical Reminders
• Make sure students complete the information at the top of the answer document
• Make sure every answer document has a bar code label that matches the student information at the top
04/10/2320
Critical Reminders
• Double check to be sure special education students take the correct tests and use the correct accommodations based on their IEPs
04/10/2321
Critical Reminders
•BAA recommends a full day of school on each initial testing day
• Schools must have written permission from BAA to alter the initial testing day schedule
04/10/2322
Critical Reminders
•Provide professional development for staff members
04/10/2323
This is your staff jumping for joy!
Critical Reminders
• The Appendix of the Test Administrator Manual provides a table to help schools organize and pack answer documents.
04/10/2324
Critical Reminders
• The Appendix also has a document return Checklist that can be used to provide a record of the Answer Documents Returned.
04/10/2325
Critical Reminders
•Note for Shared Time Students: The Public School must ensure correct Residency codes are entered for home schooled and non-public students.
04/10/2326
Critical Reminders
04/10/2327
The BEST PRACTICES Guide will be updated soon and provides a valuable reference about Reporting for Trouble-free Accountability Data
See: www.michigan.gov/meap
Critical Reminders
•Attention to test security benefits everyone.
•Observations are done for security and test administration.
04/10/2328
04/10/2330
Assessment Accommodations
• Most students with disabilities will be able to participate in the MEAP when provided with standard, appropriate accommodations.
04/10/2331
Assessment Accommodations
Assessment Accommodation Summary Table •The Assessment Accommodation Summary Table displays accommodations for MEAP, MEAP-Access, MI-Access, ELPA, and NAEP
The Accommodation Table is located atwww.michigan.gov\meap
04/10/2332
Assessment Accommodations
• Accommodation Types
–Standard (S)
•Universal
–Any student can utilize, regardless of eligibility, without changing what is being measured by the assessment
04/10/2333
Assessment Accommodations • Accommodation Types
– Non-standard (NS) •Changes construct of test•Consequences must be communicated to parents
•Does not count toward–Valid assessment scores–School accountability
04/10/2334
Assessment Accommodations Summary Table
04/10/2335
Assessment Accommodations
• The IEP Team has two responsibilities by law:
–Choose which state assessment
–Choose accommodations (if any)
04/10/2336
Assessment Accommodations
AssessmentAssessment Type of Type of AssessmentAssessment Based OnBased On
MEAPMEAP GeneralGeneral GLCEsGLCEs
MEAP with MEAP with AccommodationsAccommodations
GeneralGeneral GLCEsGLCEs
MEAP-AccessMEAP-Access AA-MASAA-MAS GLCEsGLCEs
Functional IndependenceFunctional Independence AA-AASAA-AAS Extended GLCEsExtended GLCEs
Supported IndependenceSupported Independence AA-AASAA-AAS Extended GLCEsExtended GLCEs
ParticipationParticipation AA-AASAA-AAS Extended GLCEsExtended GLCEs
Assessment ContinuumAssessment Continuum
04/10/2337
Assessment Accommodations
Content Content AreaArea 33 44 55 66 77 88 99
ReadingReading XX XX XX XX XX XXWritingWriting XX XXMathMath XX XX XX XX XX XX
ScienceScience XX XXSocial Social
StudiesStudies XX XX
04/10/2338
Assessment Accommodations
• When determining the appropriate state assessment
– Never choose based on disability category alone
– Never choose based on one piece of data
– Consider curriculum and instruction
04/10/2339
Assessment Accommodations
• Kits, other than Braille, were developed from the Form 1 test booklet
• Answer documents not included in kits. Use regular answer document with correct barcode
04/10/2340
Assessment Accommodations
• Braille Kit includes:
– Braille Form 88 test booklet
– If Grade 3, unique Braille answer document
– Assessment Administration Booklet for Braille (AABB)
04/10/2341
Assessment Accommodations
•Braille (Form 88)–Student answers must be transferred into scannable answer document with completed student information and barcode label
04/10/2342
Assessment Accommodations
• Braille Version (Form 88)–Braille materials can only be ordered by telephone at 877-560-8378, option 22
04/10/2343
Assessment Accommodations
• Enlarged Print Kit includes
–Enlarged print Form 1 test booklet
–Regular print Form 1 test booklet
•Grade 3 - combined test booklet/answer document
04/10/2344
Assessment Accommodations
•Enlarged Print Version–Student answers must be transferred into scannable answer document with completed student information and barcode label
04/10/2345
Assessment Accommodations
•Audio (CD) kit includes–CD version of Form 1
–Form 1 test booklet
•Grade 3 - combined test booklet/answer document
Assessment Accommodations
• Audio (CD) version– Can be administered in small
groups as practiced in the classroom if each student has own headset •Otherwise, administered individually
– Not available for reading or writing tests
04/10/2346
04/10/2347
Assessment Accommodations
• English, Arabic, or Spanish Video (DVD) kit includes
–DVD version of Form 1
–Form 1 test booklet•Grade 3 - combined test booklet/answer document
04/10/2348
Assessment Accommodations
• Video (DVD) version may be administered in small groups as practiced in the classroom– Additional Form 1 test booklets
may need to be ordered• Not available for reading or
writing tests
04/10/2349
Assessment Accommodations
•Purpose of the video accommodation is to help students find and keep their place in the test booklet – not read the assessment from the screen
04/10/2350
Assessment Accommodations
•Reader Script kit includes–Reader Script (scripted version of test)
–Form 1 test booklet
•Grade 3 - combined test booklet/answer document
04/10/2351
Assessment Accommodations
• Reader Script version may be administered in small groups of up to 5 students–Additional Form 1 test booklets may need to be ordered
• Not available for reading or writing tests
04/10/2352
Assessment Accommodations
• Standard accommodation for students who require extended time and who take the test over multiple days – IEP or
–Section 504 Plan or
–ELL Plan
04/10/2353
Assessment Accommodations
• Form 1 not required
– Use test form assigned to school
• Fill in Multiple Day Testing circle under Standard Accommodations on answer document
54
Tina Foote
BAA Secure Site Analyst
www.Michigan.gov/BAA-Secure
BAA Secure Site
04/10/23
55
Announcement page
• Contains important messages in relation to the BAA Secure Site
• Contains important deadlines and dates in relation to tasks on the BAA Secure Site
• Contains information for all assessments
04/10/23
56
Additional Material Orders
• Additional material orders open September 25 – October 23
– Don’t wait until the last minute to ensure you have all materials needed to return the test on time
• District coordinator will be sent overage materials
• Only district level users can place an order• Click on Add’l Material Orders from the left
04/10/23
Additional Material Orders
• Select shipping destination– You can select school or
district for each individual order
• Braille orders, call 877-560-8378 and press option 2 for MEAP.
• Using Day 1 field for math, science, and social studies
04/10/2357
58
Additional Material Orders
04/10/23
59
Order Summary/Tracking
• Click on “Order Summary/Tracking” from the left
• List Initial Material and Add’l Material Orders
• Report button creates a printable report of all orders displayed
• You can view the Initial Material Order report and it will include overages and ancillary materials included in the order
04/10/23
60
Order Summary/Tracking
• Available to track your order/shipment:– Order Detail for each order
•Separate order for answer documents from Initial Order
– Current status of orders– Date shipped (when shipped)– Shipment Detail – packing list– Tracking number with link to track
the package(s) through the shipper, i.e. FedEx or UPS once shipped
04/10/23
Order Summary/Tracking
04/10/2361
62
Barcode Labels
• All answer documents must have a barcode label– Must be the correct student – Must be the correct test cycle– Home school students must have a
barcode label• Students must be identified for testing first
– Instructions to pre-ID are available in BAA Secure Site User Manual.
• Click on Barcode Label from the menu at the left
04/10/23
63
Barcode Labels
What is the “After Date” field?
04/10/23
64
Barcode Labels
04/10/23
65
Barcode Labels
• Print with a laser printer, not inkjet• Specific to student, school and test
cycle• Cannot use previous years• Cannot use from other test cycles,
i.e. MI-Access, MEAP-Access• Reprint damaged labels• Ensure barcode label matches
student’s name at top
04/10/23
66
Barcode Labels
All answer documents must have a barcode
label!
04/10/23
Student Demographics
• Demographics such as ethnicity, special education, economically disadvantaged, etc. will be loaded from MSDS by BAA
– Full list of demographics to be pulled is in the Student Demographic Updates section of the BAA Secure Site User Manual
• Demographics will come from the fall general MSDS collection and Student Record Maintenance (SRM) files that follow
04/10/2367
Student Demographics
• BAA will use demographics with an “as of date” on or before October 26
• Changes or corrections must be in MSDS by December 4
• Important to work with the district MSDS person to ensure demographics are accurate by deadlines
04/10/2368
Student Demographics
• If fall general MSDS collection is accurate, only student information from October 3 – October 26 will need to be updated in MSDS for assessment purposes
• Demographics cannot be updated or changed on the BAA Secure Site
• UIC’s must be resolved
04/10/2369
Expected to Test
• Enrollment list from MSDS provided on BAA Secure Site
• List students enrolled and not exited in MSDS
• List students tested, even if not enrolled in MSDS
• Student demographics from MSDS
• All data pulled with an “as of date” on or before October 26
04/10/2370
Expected to Test
• Available November 28 along with Tested Roster
• Includes all students, not just students taking the MEAP
• Verify enrollment, students that need to be exited, students that need to be enrolled, and student demographics
04/10/2371
Expected to Test
• Use the filters!
– SE Discrepancy
– Enrolled Discrepancy
• The report can only be updated through MSDS using a student record maintenance file (SRM)
– Expected to Test will be updated hourly with new data
• Data used for Accountability calculations and assessment reporting
04/10/2372
Expected to Test
04/10/2373
74
Tested Roster
• Very important!!• Last chance to identify errors and
report them• Identify & fix out-of-level issues
– If tested in the wrong grade level or used the wrong grade level answer document, it cannot be corrected
– If grade is in incorrect in MSDS, it can be corrected in MSDS
04/10/23
75
Tested Roster
• Look for missing answer documents – If tested in MEAP, report any missing
• Look for duplicate records– If duplicate students listed, submit
combine• Verify students are listed in building
where they tested– Students that did not test at the
building, submit a move
04/10/23
Tested Roster
• Look for students incorrectly marked PB or NS
– If it is an error, submit an appeal
– Required to submit a reason why the student’s answer document was marked PB or NS and why it is incorrect now
• Student demographics pulled from MSDS and are same as on the Expected to Test screen
• Use the filters!
04/10/2376
77
Tested Roster
04/10/23
78
Not Tested
• Start getting prepared now
• BAA will identify students that did not take any one of the three fall assessments, MEAP, MEAP-Access, MI-Access
• Schools will be required to select a reason a student did not test
04/10/23
Not Tested
• Avoid most common mistakes now Administrative Errors
– Students not exited in MSDS
– Students not identified correctly as home school or nonpublic school students if receiving services
– Multiple or incorrect UIC number
• Needed for federal reporting and accountability calculations
04/10/2379
Not Tested
04/10/2380
81
Report Printing Options
• Selected at a district level• Two options:
–All reports–Green – individual student report, student record labels and parent reports
• Defaults to Green option
04/10/23
82
Report Printing Options
04/10/23
83
BAA Secure Site
• Email [email protected]• Call 877-560-8378, press option 2• BAA Secure Site User Manual
–Located on log in page before logging in
–Located at bottom of Announcement page after logging in
04/10/23
84
Receipt and Return of Receipt and Return of Assessment Materials Assessment Materials
Chris McCownChris McCown
Project ManagerProject Manager
Measurement IncorporatedMeasurement Incorporated
85
Measurement IncorporatedMeasurement Incorporated
•Printing, distribution, Printing, distribution, scoring, and reporting scoring, and reporting contractor for MEAPcontractor for MEAP
•aka “MEAP Scoring aka “MEAP Scoring Services”Services”
•55thth year of the contract year of the contract
86
OverviewOverview
•When and how you’ll When and how you’ll receive your materialsreceive your materials
•How to return your How to return your materials after testingmaterials after testing
87
Delivery DatesDelivery Dates
•Materials delivered via Materials delivered via FedEx Ground beginning FedEx Ground beginning Sept. 19Sept. 19thth
•All materials delivered by All materials delivered by Sept. 24Sept. 24thth
88
Shipped Separately!Shipped Separately!
•From Measurement From Measurement IncorporatedIncorporated– Test bookletsTest booklets
– Accommodated materialsAccommodated materials
– Ancillary materialsAncillary materials
– Printed Pre-ID labelsPrinted Pre-ID labels
89
Shipped Separately!Shipped Separately!
•From Data Recognition From Data Recognition Corp.Corp.– Answer documents Answer documents
– Grade 3 test booklets Grade 3 test booklets
90
Receipt of MaterialsReceipt of Materials
• Orders are packed by schoolOrders are packed by school
• Boxes containing packing lists Boxes containing packing lists will be marked with a stickerwill be marked with a sticker
• Inventory your shipments Inventory your shipments immediately after receiving immediately after receiving them!them!
91
Receipt of MaterialsReceipt of Materials
•FedEx shipping labels will FedEx shipping labels will include:include:– School nameSchool name
– Box number, e.g. 1 of x, 2 of Box number, e.g. 1 of x, 2 of x, etc.x, etc.
92
Receipt of Materials
• MEAP-Access boxes will be identified with a green box label
93
94
Shrink-wrappingShrink-wrapping
•Test booklets and answer Test booklets and answer documents will be shrink-documents will be shrink-wrappedwrapped
•Cover sheets show secure Cover sheets show secure material info for items material info for items w/in the shrink packw/in the shrink pack
95
•Packing List in Box 1 Packing List in Box 1
•Security List in Box 1Security List in Box 1
•Box List in each boxBox List in each box
Shipments from MeasurementShipments from Measurement Incorporated Incorporated
96
Shipments from Measurement Shipments from Measurement Incorporated Incorporated
•Printed Pre-ID labels Printed Pre-ID labels will be in order by will be in order by – GradeGrade
– Subject Subject
– Class/Group Class/Group
– Last nameLast name
97
MEAP Fact:MEAP Fact:
• It takes 4 weeks to pack It takes 4 weeks to pack the initial orders for the initial orders for MEAPMEAP
98
Shipments from Data Shipments from Data Recognition Corporation Recognition Corporation
•White boxesWhite boxes
•Packing/Security Lists in last Packing/Security Lists in last boxbox
•Answer docs w/Pre-ID Answer docs w/Pre-ID information will be in order by information will be in order by grade, subject, class/group, grade, subject, class/group, last namelast name
99
Shipments from Data Shipments from Data Recognition Corporation Recognition Corporation
•Problems with answer doc Problems with answer doc shipment? shipment? – Call Measurement Call Measurement
Incorporated Call Center at Incorporated Call Center at 877-560-8378877-560-8378 and select and select option option 22
100
MEAP Facts:MEAP Facts:
•116 million pages of test 116 million pages of test booklets printed!booklets printed!
•Print vendor uses paper Print vendor uses paper from tree farmsfrom tree farms
•We recycleWe recycle
101
Need more?Need more?
•Districts receive an overage Districts receive an overage of most materialsof most materials
•Exhaust district overage Exhaust district overage firstfirst
•Place additional orders via Place additional orders via BAA Secure SiteBAA Secure Site
102
Where’s my order?Where’s my order?
•Order history and Order history and shipments may be shipments may be tracked via BAA Secure tracked via BAA Secure SiteSite
103
Before TestingBefore Testing
•Review manualsReview manuals
•Stress SECURITYStress SECURITY
•Know school and district Know school and district codescodes
104
During TestingDuring Testing
•No. 2 pencilNo. 2 pencil
•Demographics page is Demographics page is completed correctlycompleted correctly
•Form number is recorded Form number is recorded correctlycorrectly
105
During TestingDuring Testing
•All answer docs have All answer docs have correct Pre-ID correct Pre-ID informationinformation
•Handle with care!Handle with care!
106
107
Return of MaterialsReturn of Materials
•Follow instructions in Follow instructions in manualsmanuals
•Return materials as soon Return materials as soon as possible after testingas possible after testing
•Two returns?Two returns?
108
What do I return?What do I return?
•ScorableScorable::
– Used answer docsUsed answer docs
– Used Grade 3 answer Used Grade 3 answer docsdocs
109
What do I return?What do I return?
•Non-scorable:Non-scorable:– Used and unused test Used and unused test
booklets booklets – Used and unused Used and unused
accommodated mediaaccommodated media– Unused Grade 3 answer Unused Grade 3 answer
documentsdocuments
110
111
Returning Scorable MaterialsReturning Scorable Materials
•Sort answer docs into Sort answer docs into stacks by subject, grade, stacks by subject, grade, and formand form
•No sticky notes!No sticky notes!
•No paper clips!No paper clips!Really, Really
Important!
112
School/Grade HeaderSchool/Grade Header
•Place a completed Place a completed School/Grade Header School/Grade Header Sheet on top of each Sheet on top of each stack of answer docsstack of answer docs
113
114
115
MEAP Fact:MEAP Fact:
• 26 million pages 26 million pages of answer documents of answer documents printed!printed!
116
Returning Scorable MaterialsReturning Scorable Materials
•No sticky notes! Really.No sticky notes! Really.•No white out No white out transcribe transcribe
onto new answer onto new answer documentdocument
•Poor erasures Poor erasures transcribe transcribe onto new answer onto new answer documentdocument
117
Returning Scorable MaterialsReturning Scorable Materials
•Don’t store a used answer Don’t store a used answer doc inside a test booklet!doc inside a test booklet!
•Scorable materials returned Scorable materials returned in a non-scorable box?in a non-scorable box?
118
Class/Group ID SheetClass/Group ID Sheet
•Links a teacher name in a Links a teacher name in a school to up to SIX four-digit school to up to SIX four-digit numbers. numbers.
•Numbers must be unique to Numbers must be unique to schoolschool..
•Four-digit numbers can be Four-digit numbers can be applied to any answer doc.applied to any answer doc.
119
120
Special HandlingSpecial Handling
• Word-processed pages and Word-processed pages and additional paperadditional paper
– ID info on all additional pagesID info on all additional pages
– Place within student’s answer docPlace within student’s answer doc
– Place in the orange Special Place in the orange Special Handling EnvelopeHandling Envelope
121
MEAP Facts:MEAP Facts:
• It takes 3 weeks to pack It takes 3 weeks to pack all the accommodated all the accommodated materials into kitsmaterials into kits
•128,000 plastic bags128,000 plastic bags
122
Special HandlingSpecial Handling
• Write “Do Not Score” on the Write “Do Not Score” on the first page on any answer doc first page on any answer doc that should not be scoredthat should not be scored
• Do not return biohazardous Do not return biohazardous materials! Transcribe onto materials! Transcribe onto new answer doc.new answer doc.
123
Return KitsReturn Kits
•Return instructionsReturn instructions•FedEx AirbillsFedEx Airbills•Blue scorable and green Blue scorable and green
non-scorable adhesive non-scorable adhesive labels for boxeslabels for boxes
124
Fed Ex AirbillFed Ex Airbill
•One Airbill per shipment!One Airbill per shipment!
•Airbill goes with Box 1Airbill goes with Box 1
•Don’t tamper with pre-Don’t tamper with pre-printed info on Airbill - printed info on Airbill - including class of service!including class of service!
125
126
FedEx Multiple-Piece Shipment FedEx Multiple-Piece Shipment LabelLabelss
•FedEx will apply Multiple-FedEx will apply Multiple-Piece Shipment labels to Piece Shipment labels to the remaining boxesthe remaining boxes
•Stickers with tracking Stickers with tracking numbers!numbers!
127
FedEx Multiple-Piece Shipment FedEx Multiple-Piece Shipment LabelsLabels
128
FedExFedEx
• Call Call 1-800-GoFedEx1-800-GoFedEx to schedule a to schedule a pickuppickup
• You can press 9 or say, “Premier You can press 9 or say, “Premier Customer Service Program,” at the Customer Service Program,” at the voice promptvoice prompt
• Provide acc’t # 999 999 933 to be Provide acc’t # 999 999 933 to be transferred to a Premier Cust. Service transferred to a Premier Cust. Service Rep. familiar with MEAPRep. familiar with MEAP
• Call by 2:30 pm for same-day pickupCall by 2:30 pm for same-day pickup
129
Call Center Contact InfoCall Center Contact Info
•Phone: Phone: 877-560-8378877-560-8378and select option and select option 22
•Email: Email: [email protected]
130
Call Center Contact InfoCall Center Contact Info
In Oct. 2011, over 3,000 In Oct. 2011, over 3,000 calls were fielded by the calls were fielded by the
call center.call center.
Fall 2012 MEAP Online Social Studies
Pilot
MIST Overview
Key Pilot Dates/Timeline
• Download and install MIST – 8/20
• Student Practice Site opens – 9/4
• Rosters available for viewing – 10/3
• Test window opens – 10/17 at 7 a.m.
• Online Pre-ID closes – 10/26
• Test window closes – 11/7 at 5 p.m.
• Scores available – same as paper tests
Prepare for Success -Three phases of MIST
1. Installation
2. Training and Preparation
3. Test Administration
Prepare for Success
Careful adherence to installation guidelines, along with preparation of computers, staff, and students, will make using the MIST administration go smoothly.
Most of the difficulties MIST users may experience are due to incomplete installation or not having enough bandwidth.
Familiarity with the Test Administrator Website and the MIST Tester Station makes testing go more smoothly.
Installation: MIST Technical Guide Installation Checklist
Your technical support staff will need to perform the installation and configuration of your computers and network.
A detailed checklist of steps is found in the Technical Guide to MIST.
Training and Preparation:Test Administration Preparation Checklist 8 things you need to do before the first day of testing
• This checklist is found in the Quick Start Guide to MIST and is called Checklist in Advance of Testing
Test Administration Preparation Checklist
1. Verify that the network administrator completes the preparation tasks in the MIST Technical Guide Checklist.
2. Train on MIST by completing the steps in the MIST Self-training plan.
3. Develop test security protocol, schedules, and emergency procedures with the building MEAP testing coordinator and the school principal.
Preparation Checklist continued
4. Choose your method of assigning tester stations.
Student Test Ticket Setup Test Administrator Login Setup
Pro Con Pro Con
Decreases possibility of setting
up stations for late or absent
students.
Increases preparation time
needed. The school must
download and distribute tester
passwords for each test.
Simplifies preparation for the
test. No need to print and cut
apart student Tester Tickets
(student passwords).
Increases possibility of setting
up stations for late or absent
students.
Reduces overall time for test
administration because multiple
testers can log themselves in
simultaneously.
Students may still require
assistance with the sign-in
process.
Reduces student involvement
in the setup process.
Increases pretest preparation
time for staff because staff set
up one tester station at a time.
Decreases possibility of
choosing the wrong test part
for a student.
Tester Tickets (student
passwords) must be retrieved
from students after setup and
destroyed in a secure manner
after testing.
No tickets to retrieve from
students after setup and
destroy in a secure manner
after testing.
Increases possibility of
choosing the wrong test part
for a student.
Can control seating by handing
out tickets only after students
are seated at the correct
computer.
Can control seating by
assigning desired computer to
that student.
Preparation Checklist continued
5. If using the student test tickets method, print Student Test Tickets and store in a secure location until test administration. (Remember to treat Student Test Tickets as secure material.)
6. Read all MEAP Online Pilot documentation, which can be found at www.michigan.gov/meap.
Preparation Checklist continued
7. Plan the schedule for your student practice sessions and MIST test administrations.
– Use the BAA schedule template.
8. Conduct your student practice sessions.
– Students may use the practice website as many times as you choose.
Test Administration:Live Test Administration Checklist
1. Make sure preparation checklist is complete
2. Set up testing room
3. Set up Test Administrator Website workstation
4. Set up Tester Stations
This checklist is also found in the Quick Start Guide to MIST and is called Checklist on Day of Testing.
Live Test Administration Checklist continued
5. Administer the test
6. Monitor closure of Tester Stations
7. Shut down testing room
8. Collect and Return Student Test Tickets (if used) to building MEAP coordinator for secure destruction
9. Make note of any needed follow-up
Tips for Success at Each Phase
• Installation
– Equipment meets specifications
– Configure network and verify computer configuration
• Verifying is really easy – can be done by any staff member
– Maximize the benefit of your available bandwidth
• Preparation
– Discuss testing procedures
– Use the Student Practice Site
– Make a testing schedule (use BAA template)
– Read the Quick Start Guide to MIST
• Test Administration
– Prepare room as for a paper test
– Treat Student Test tickets like a booklet
– Treat Tester Stations like a booklet
Verifying Computer Configuration
1. Log into the operating system as a student-level user
2. Verify that you can see the MIST.exe icon on the desktop
3. Double-click the icon4. Verify that the login screen loads5. Start Internet Explorer (not another browser)6. Go to https://mi.mistttest.com/practice/ and
verify that you can click on the practice test link and the test opens up for you.
Computers that do not pass all of these tests can be referred back to your network administrator to have incomplete configuration issues addressed.
Maximize Benefit of Bandwidth
• MIST uses an active internet connection to deliver test content.• Competing traffic on your internet connection can slow MIST down.
– Some examples are streaming video, downloading files, playing online games
– You can request that your staff plan to minimize these activities during testing
• Minimizing competing traffic will make MIST faster.• Wireless networks are less stable than wired networks so wired
computers are preferable.– Wireless networks send and receive data similar to the way your
radio receives a signal, so the signal can be blocked by walls or people
– Wireless routers can receive multiple signals to the same port at the same time, causing one or more of those to be “dropped”.
Follow-up to testing
• Conduct any needed make-up tests• Add Research Codes, Accommodations or
Report Codes as needed– Accommodations can only be added via MIST
so make this a priority.• Mark any needed tests as Do Not Score• Fill out any needed incident reports• Class/Group codes may only be updated at the
BAA secure site.• The Test Administrator Website will remain open
for at least two days after 11/7 for you to add information such as Do Not Score or Accommodations to student records.
Test Security
MIST-Specific
MIST Test Security
• Test Administrator username/password
• Student Test Tickets or student username/password
• Extended test sessions
• Treat the Tester Station like a test booklet
– Do not look at student test screens
– Do not take pictures of student test screens.
– Do not reproduce test material in any fashion
Test Administrator username/password
• One per school
• Accesses a lot (all student information, all student usernames/passwords)
• Like the key to the room where all the test booklets are kept
• Active during the entire test window
Student Test Ticket (or student username/password)
• One per test or test part (i.e. two per student for this Pilot)
• Accesses only the test material in that test part
• Only valid until the test or test part is submitted• Not started tickets/passwords are more
dangerous than started tests. – If a ticket or tickets get lost or are stolen, simply
pause the associated tests and they will be locked.
Managing Your Secure Material
You may wish to:• Keep a list of who in each building has the
Test Administrator username/password• Issue the Test Administrator
username/password only on the first day it is needed rather than earlier
• Keep a list of absent students and make sure their tests are not started
• Make sure that the correct student gets the correct test station or Student Test Ticket, as if the Tester Station were an Answer Document
Getting ready be a MIST Test
Administrator
The Training part of Preparation and Training
MIST Self-Training Checklist (This checklist is also in the Quick Start Guide. )
1. Review and understand the Quick Start Guide (QSG) thoroughly
2. Make sure you understand how to do each of the MIST test administrator tasks listed in the QSG
3. Watch the MIST training videos (on the Test Administrator Website – requires QuickTime)
MIST Self-Training Checklist continued
4. Develop a plan for addressing the situations listed in “Trouble-shooting Problems” section of the QSG
5. Read the MIST Frequently Asked Questions (FAQ)
6. Take the student practice test yourself before administering it to students
7. Consult your district MEAP coordinator and building MEAP coordinator for answers to any unresolved questions
Test Administrator Website
• Log in with the School-Specific MIST username and password district MEAP coordinators will receive via FedEx by 9/26
• Manage tests and perform administrative tasks
Test Administrator Website
Tour of Test Administrator Website
•Routine tasks
•Special tasks
•Troubleshooting and handling problems
Print Student Test Tickets
They list:
• the student’s name and date of birth
• Name of test (or test part)
• Student username and password
Student Test tickets look like this:
You only need to print them if you are using the Student Test Ticket method for your Tester Station Set-up
Check Your Roster• When the roster is first posted on October 3rd
• 24-48 hours after making significant updates to your pre-ID information via the BAA Secure Site
• Immediately before testing begins• To monitor the Not Started status of absent students’
tests• When planning or scheduling makeup test sessions• As the test window draws to a close to verify that
makeup sessions have taken place• To verify that all post-test documentation and follow-
up has taken place– Do Not Score (DNS) Tests– Accommodated testing
Check Your Roster continued
Click on the name of the test for which you want to check the roster. The students with their statuses are
listed.
Pause and Resume TestsTwo ways to do this, depending on the
circumstances
1) Continuous session on the same computer
2) Interrupted session on the same computer or an interrupted session on two computers
Pause and Resume Method 1• For use when a student needs to go to the restroom or take an approved supervised break per their IEP, and returns to the same
computer
• Can only be used when connectivity to the MIST server is not lost
Steps are:1. On Test Administrator Website
workstation, click on the correct test name
2. Click on the student’s check box in the roster
3. Click Pause on the Test page toolbar4. Have student click PREVIOUS button on
their Tester Station to bring up the PAUSED screen (It reads, “The test has been paused.”)
5. When student returns, Click on student’s checkbox
6. Click Resume on the Test page toolbar
7. Instruct the student to click CONTINUE on their PAUSED screen to return to the most recent test
Pause and Resume Method 2 continued
• For times when a student loses their connection to the MIST website or needs to move to another computer
1. Pause the student’s test– Identical to steps 1-3 of Method 1
2. Close the Tester Station– If the station is still connected, have the student click
PREVIOUS on the Tester Station and then click EXIT TEST
– If the station is open but not connected ( ) then reboot the computer to close the Tester Station
3. Re-establish the Tester Station– Either at the same computer or at a new computer,
login again using the same username and password as the first time.
Pause and Resume Method 2 continued
2. Re-establish their Tester Station continued
– After clicking CONFIRM, you will see a screen that says “Your test has been paused. Please contact your proctor or administrator.”
3. Resume the student’s test– Go to the Test Administrator Website workstation– Check the box next to their name– Click Resume
4. Instruct them to resume testing– Tell them to click on the CONTINUE button in the
lower right to return to their test on their most recent screen.
Special Tasks
•Mark tests Do Not Score
•Add student demographic information
•Manage longer tests
Mark Tests Do Not Score
Reasons to mark a test Do Not Score (DNS)
• DNS-Partial Test, Completed Emergency Form
• DNS-Partial Test, Exited Student
• DNS-Misadministration (excludes Nonstandard Accommodations)
• DNS-Emergency Evacuation (requires Emergency Test)
• DNS-Other
How to Mark Tests Do Not Score
For this Pilot you should mark both parts of a test Do Not Score, because the two parts make up one test booklet. 1. Click on the name of the student whose
tests you need to mark, either on the test roster or on the student roster
You can see that the student’s name looks a little different in each place, but clicking on either one will take you to the student’s information page.
How to Mark Tests Do Not Score
2. On that student’s information page, click the check box next to both tests.
3. Click on the Advanced tab
(denoted by a small wrench) on the right of the student information page toolbar to display the Advanced drop-down menu.
How to Mark Tests Do Not Score
4. Select Non-Participant from the drop-down.
This will cause the Non-Participation Details box to be displayed.
How to Mark Tests Do Not Score
5. Select the correct reason from the drop-down menu.
The selected reason will then appear in the Make a selection window.
How to Mark Tests Do Not Score6. Click OK to save your changes.
7. You can add a comment in the comment box if you like, but please remember that any comment entered here does not take the place of an incident report.
8. To exit without saving your changes, click X in the upper right corner of the Non-Participation Details box.
How to Mark Tests Do Not Score
9. Now the tests’ Status icons will be on all screens, indicating Non-Participant, and the reason you selected will be reported as if you had sent a test booklet in marked Special Handling.
Add Student Demographic Info
To mark these bubbles in MIST, 1.Click on the student’s name,
either in the test roster or the student roster.
Now you are on the Student Information page.
Add Student Demographic Info
2. Click on Edit Details.
Add Student Demographic Info
3. Mark desired data.4. Click Save.5. To exit without saving your changes, click on the
X in the upper right corner of the Edit Student Information window..
Class/Group
For the Pilot, Class/Group is being collected via the student test. After students click CONFIRM on Part 1, but before they begin the test, they will see this screen:
If you are not using Class/Group, they will click to leave this screen without typing anything.
You will only be able to edit their entries via Tested Roster, not via the Test Administrator Website.
Manage Students Who Require Additional Time
• All MEAP tests, including the Online Social Studies Pilot tests, are UNTIMED tests.
• Students must be given as much time as needed to complete the test.
• If you move them to another computer, follow the steps for pausing and resuming a student’s test using Method 2.
Troubleshooting and Handling Problems
•Lost internet connectivity
•Computer malfunction
•Emergency evacuation
•Latency (slow loading or screen transitions)
Troubleshooting and Handling Problems
•Lost internet connectivity
•Computer malfunction
•Emergency evacuation
•Latency (slow loading or screen transitions)
Troubleshooting and Handling Problems
•Lost internet connectivity
•Computer malfunction
•Emergency evacuation
•Latency (slow loading or screen transitions)
Troubleshooting and Handling Problems
•Lost internet connectivity
•Computer malfunction
•Emergency evacuation
•Latency (slow loading or screen transitions)
Tester InterfaceNAVIGATION: Students move through the test screens by using the
buttons at the lower edge of their tester station. These buttons are:
Tester Interface
•You can see and use the Tester Station by taking the student practice test.
•There are more screen shots and information about the Tester Station in the Quick Start Guide.
MEAP Online Documentation
i. The Fall 2012 MEAP Online Social Studies Pilot Test Administration Manual contains detailed instructions specific to the administration of the online MEAP Social Studies test for both 6th and 9th grade students.
ii. The online Directions for Administration are being published separately this year.
iii. Additional information that applies to both the online and paper-and-pencil test modes can be found in the grade-appropriate MEAP Test Administration Manual Fall 2012
iv. Security protocols and other crucial information is found in the BAA Assessment Integrity Guide.
The four documents mentioned below should be studied and consulted with regard to testing protocol:
Coming Soon!
•On-Line Training Webinar
•Tentative plans for last week of September or first week of October
04/10/23185