end-of-course assessment test coordinators manual training phase i and phase ii 2009/2010 1
TRANSCRIPT
End-of-Course Assessment
Test Coordinator’s
Manual Training
Phase I and Phase II
2009/20101
AgendaEOC General Information and Changes
Testing Windows & Test Formats
Online Test Examiner’s Manual
Questions
2
End-of-Course AssessmentsRequired Tests
English IIAlgebra IBiologyGovernment
3
End-of-Course AssessmentsPhase I Assessments
Include: English II, Algebra I, and Biology
Were the first group of EOC tests created
Became operational in Spring 2009
Required for AYP, APR and/or NCLB
4
End-of-Course AssessmentsPhase I Assessments ~ Session II
Points are not the same for each content area
‣ English II writing prompt is worth 4 points
‣ Algebra I PE is worth 4 points
‣ Biology PE is worth 20 points 5
End-of-Course AssessmentsPhase II Assessments
Include: English I, Algebra II, Geometry, American History, and
Government
Were the second group of EOC tests created
Become operational October 13, 2009
6
End-of-Course AssessmentsPhase II Assessments
Government is the only required Phase II Assessment
Government is required for APR
7
End-of-Course AssessmentsPhase II Assessments
• Have selected response (SR) items only
• English I has 52 items – 7 passages with 6 or 8 items each
• All other Phase II Assessments have 50 items each.
• All are worth 40 points
8
End-of-Course AssessmentsScoring EOC
SR Items for both Phase I and Phase II Assessments are officially scored by Riverside Publishing immediately after testing
Official SR scores are returned to the district within 5 business days from receipt of tests
9
End-of-Course AssessmentsScoring EOC
WPs and PEs are officially scored by the Assessment Resource Center (ARC) at a later time
Unscored WP and PE items are scanned and electronic copies are returned to the district for local scoring 5 business days from receipt of tests
10
End-of-Course AssessmentsScoring EOC
Session I official scores and locally scored Session II results can be included in a student’s final grade
DESE highly recommends that EOC Assessments be used as 10-25% of the students’ final grades
The percentage is a district-level decision
11
End-of-Course AssessmentsScoring EOC
Riverside Publishing sends two e-mails with attachments to the DTC – one for training and one for scoring
Task Scoring Workshop and Teacher Interface have URLs, user names, and passwords
12
End-of-Course AssessmentsScoring EOC
User names and passwords for Task Scoring Workshop and Teacher Interface allow teachers access to secure materials
For security reasons, the passwords are not forwarded to the STC or teachers until district testing is complete
13
End-of-Course AssessmentsEOC score results
Official scores for PEs and WPs arrive in the district in August
Both Session I & II are combined into a Scale Score for Student Reports
Official state scores will be used for AYP and APRCrystal Reports have breakdown of Session I and
Session II scoresTeachers will be able to compare their scored Session
II assessments to the official state-scored Session II
14
End-of-Course AssessmentsEOC score results
Advanced Proficient Basic Below Basic
SubjectRaw
ScoreCut
ScoreRaw
ScoreCut
ScoreRaw
ScoreCut
ScoreRaw
ScoreCut
Score
Algebra I 31-39 225-250 22-30 200-224 13-21 177-199 0-12 100-176
Biology 45-55 225-250 32-44 200-224 18-31 177-199 0-17 100-176
English II 33-39 225-250 24-32 200-224 15-23 180-199 0-14 100-179
15
End-of-Course AssessmentsLevel Not Determined (LND)
• For EOC Assessments, a district will receive a Level Not Determined (LND) for a student if that student NEVER participates in a required EOC Assessment (English II, Algebra I, Biology, Government) before they graduate • beginning with the graduating class of 2011
• EOC Assessments are not a graduation requirement
16
End-of-Course AssessmentsLowest Obtainable Scale Score (LOSS)
Students who participate in an EOC Assessment receive scores
A student receives the Lowest Obtainable Scale Score (LOSS) if a student’s test is invalidated for cheating or paraphrasing in any content area because they have participated in the test
17
End-of-Course AssessmentsIndividualized Education Program (IEP)
Students who have an IEP with accommodations can be accommodated during testing
18
End-of-Course AssessmentsChanges and Updates
The “Not Enrolled” bubble is used for a student who begins any session of an EOC Assessment and moves either out of the district or from building to building within a district before finishing the entire assessment
The sending school should keep documentation on file about the student’s move
In the manuals EOC Assessments will be categorized as Phase I and Phase II
19
End-of-Course AssessmentsChanges and Updates
Dictionaries, thesauruses, and grammar handbooks can be used with the writing prompt for English II, Session II
When students are taking the online version of the test, do not mark a student as absent until the END of the district’s testing window
English II will not have a stand alone field test this year - however, the Phase II GIS has a bubble for an English II field test so please disregard
20
AgendaEOC General Information and Changes
Testing Windows & Test Formats
Online Test Examiner’s Manual
Questions
21
EOC TESTING WINDOWS for SJSD
• Fall/Winter• 11/30 – 12/4 Biology and English II• 12/7 – 12/11 Algebra I and Government
• Spring• 4/19 – 4/23 Biology and English II• 4/26 – 4/30 Algebra I and Government
• Summer
22
EOC in Two Versions
Paper/Pencil version
Online version
23
End-of-Course AssessmentsAll Phase I Assessments
Two sessions:
• Session I - Selected Response Items
• Session II - Performance Events (PE) or Writing Prompts (WP)
24
End-of-Course AssessmentsPhase I, Session I Assessments
Have 47 selected response (multiple choice) items
Present students with a question followed by four response options
Are worth 35 points total
25
End-of-Course AssessmentsPhase I, Session II Assessments
• Require students to work through more complicated items
• Make allowances for more than one approach to a correct answer
• Allow insight into a student’s ability to apply knowledge and understanding to real-life situations
26
Session II Performance Events for Algebra I and Biology
Assesses student’s applied knowledgeAlgebra I PE assesses CLEs with a Level 3
DOK from the Algebraic Relationships strand
Biology PE assesses the Inquiry strand
27
Session II Writing Prompt for English IIOn-demand writing proficiency
Scored holistically, using a four-point scoring guide
The prompt may be persuasive, descriptive, expository, or narrative
28
Phase I Fall/Winter Spring 2010 Summer 2010Algebra ISession I
35 operational + 12 EFT
35 operational + 12 EFT,
35 operational + 12 EFT,
Algebra I Session II 2 PE, taking about 30 minutes each
2 PE, taking about 30 minutes each
2 PE, taking about 30 minutes each
BiologySession I
35 operational + 12 EFT
35 operational + 12 EFT
35 operational + 12 EFT
BiologySession II
2 PE scenarios with approximately 6 – 12 separate items per scenario, taking about 30 minutes for each scenario
2 PE scenarios with approximately 6 – 12 separate items per scenario, taking about 30 minutes for each scenario
2 PE scenarios with approximately 6 – 12 separate items per scenario, taking about 30 minutes for each scenario
English II Session I 35 operational + 12 EFT
35 operational + 12 EFT
35 operational + 12 EFT
English II Session II 1 Writing Task 1 Writing Task 1 Writing Task
Snapshot of Phase I
29
Snapshot of Phase IIPhase II Fall/Winter Spring 2010 Summer 2010
American Government
40 operational + 10 EFT
40 operational + 10 EFT
40 operational + 10 EFT
American History 40 operational + 10 EFT
40 operational + 10 EFT
40 operational + 10 EFT
English I 40 operational + 10 EFT
40 operational + 10 EFT
40 operational + 10 EFT
Integrated Math 2 40 operational + 10 EFT
40 operational + 10 EFT
40 operational + 10 EFT
Integrated Math 3 40 operational + 10 EFT
40 operational + 10 EFT
40 operational + 10 EFT
Geometry 40 operational + 10 EFT
40 operational + 10 EFT
40 operational + 10 EFT
Algebra 2 40 operational + 10 EFT
40 operational + 10 EFT
40 operational + 10 EFT
30
Agenda
EOC General Information and Changes
Testing Windows & Test Formats
Online Test Examiner’s Manual
Questions
31
Purpose of Test Coordinators Manual
Detailed instructions for:Preparing for online testingDelivering of online testsAdministering of online tests
32
Test CoordinatorsDistrict Test Coordinator (DTC) – the point
person for testing in a school district
School Test Coordinator (STC) – the point person for testing in a particular building
These are sometimes the same person and/or they may have interchangeable roles
33
Breakdown of EOC Assessments
Guidelines for Testing: PrepareNotify parents in advance so that students will be
well-restedPre-read the manualInclusions of Special PopulationsMake-up SessionsUse of TranslatorsInvalidation ProceduresAccommodations and Status Codes
34
Special PopulationsIEP students must take all EOC Assessments
administered by the district or portions of each content-area assessment as determined by the IEP team
IAP/504 Students
35
Students Not Tested• MAP-Alternate (MAP-A)• ELL students who have been in the US for 12
months or fewer (cumulative time) may be exempt from the English II assessment
Students who move before or during testing (p. 5)If a student was enrolled to take an EOC
Assessment but moved prior to test administration, the sending school should keep documentation on file about the student’s move
The receiving district tests the student in any applicable EOC Assessment
The “Not Enrolled” bubble is used for a student who begins any session of an EOC Assessment and moves before finishing the entire assessment, either out of the district or from building to building within a district. The sending school should keep documentation on file about the student’s move.
36
Students Who Are Absent During TestingDistricts should make every attempt to have all
students take the entire test. If a student is absent and unable to take the test during the testing window, the school should keep documentation on file about the student’s absence and use the following procedures :1. If a student is absent and unable to take the test at a
later test window, fill in the “Absent” bubble
2. If a student is absent and the district will assess the student during the next testing window, fill in the “District Team Decision – Delayed” bubble
3. The districts may re-enroll the student in the next semester’s testing window.
37
Use of TranslatorsTranslators must be trained in test
administration
No for English I and English II assessments
Yes for all other Phase I and Phase II tests
Native language responses are acceptable from ELL students – transcribe appropriately
38
Invalidation ProceduresCheck the chart (Page 7)
Mark appropriately
39
Test Invalidation Reasons
40Neither student behavior nor the judgment of student effort can invalidate test.
What Districts Must Do When Invalidating A TestAgreement on Invalidation (between STC and
Examiner)
Information STC must provide to DTC
The Letter to DESE from the Superintendent
A Copy of the letter for the District
41
Accommodations and Status Codes (Pages 22 - 23)
Student accommodations are recorded for the entire assessment
Accommodation Code definitions can be found in the EOC manual and on the DESE website. Check the appropriate box for the corresponding test.
Status code definitions can be found in the Test Examiner’s Manuals.
42
Electronic DevicesYes to Calculators – at minimum, students
can use, a four-function calculator for Algebra I – both sessions (nothing with Internet access of a Qwerty keypad)
No to cell/mobile phones, electronic music players, digital cameras, handheld scanners, gaming devices, any portable device that can be connected to the internet, etc.
43
Testing Periods – Phase I Suggested Times Algebra I
Session I = 90 – 100 minutesSession II = 60 – 70 minutes
BiologySession I = 55 – 60 minutesSession II = 65 – 70 minutes
English II Session I = 90 – 110 minutesSession I = 90 - 100 minutes
Testing Periods – Phase II Suggested Times
Government – 60 - 80 minutesAmerican History – 60 - 80 minutesEnglish I - 90 - 110 minutesAlgebra II – 90 - 100 minutesGeometry – 90 - 100 minutes
DTC ResponsibilitiesThe District Test Coordinator (DTC) is
responsible for training ALL School Test Coordinators (STCs) on EOC Assessment processes.
Communicating with RPC (Riverside Publishing Company) – one point of contact for the district
Responsible for test securityOrdering additional materials if/when needed
46
STC ResponsibilitiesEnsure EOC Browser is on each workstation for
test deliveryInput students who were not included in the
MOSIS precode file to the online testing systemVerify/edit student demographic information for
pre-imported studentsContact District Assessment Office if any
students need to be transferredView/set student classes, testing statuses, and
accommodations
47
District Team Decision – Delayed
This is a bubble designed for students who are not yet ready to take the EOC assessment for which they were enrolled.
PRIOR to the testing window(s), the district should have their “delay” procedure clearly in place
The procedure should:include decision parameters include who is on the team to make the decisionbe in writing
48
Bubble and DocumentIf the district believes a particular student is not
ready to take the EOC assessment for which he/she was enrolled, the district team makes the decision based upon the qualifications in the procedure.
The STC bubbles in the “District Team Decision – Delayed”
The district keeps documentation about the decision to delay testing.
49
Post Test Administration Task Scoring WorkshopThe Task Scoring Workshop is an Internet-based tool that
provides training on how to score the Session II portion of the Phase I Missouri End-of-Course assessments. Through this system, teachers have access to scoring rubrics, anchor papers, annotations and practice papers that allow them to practice the scoring process independently.
Once Riverside has received a district’s testing materials, an e-mail will be sent to the DTC with the Task Scoring Workshop URL, user IDs, and passwords. The e-mail will be sent from [email protected] with the subject line of “MO EOC: Task Scoring Workshop.” The DTC is responsible for distributing the information to their teachers. Please note that this information should not be distributed until all testing has been completed for a subject area.
50
Post Test Administration Teacher InterfaceThe Teacher Interface is the system through which teachers are
able to view students’ selected response raw scores and view, print, and locally score the unscored, scanned copies of their students’ performance events. Teachers are able to include these scores in the students’ final grades. However, the official state scoring of the Session II items will not occur until a later time. Teacher Interface does not provide export files of raw scores, nor does it allow for batch printing of the performance events/writing prompts.
Within 5 business days of Riverside receiving a district’s testing materials, an e-mail will be sent to the DTC with the Teacher Interface URL, user IDs, and passwords. The e-mail will be sent from [email protected] with the subject line of the DTC’s name followed by “MO EOC Teacher Interface.” DTCs and STCs will have access to a performance event summary report for their buildings. Teachers will have access to their class roster page with the selected response raw scores and performance event images. 51
Accommodation Codes List for English Language Learners (ELL)
The following slide are the only accommodations allowed for ELL students.
Oral reading, oral reading in native language, or the use of a bilingual dictionary during the English II assessment will result in the LOSS (Lowest Obtainable Scale Score).
52
53
Accommodations List for Students with Disabilities
Has changed since last year!
54
Note 1 for Students with DisabilitiesNOTE 1: Oral reading, oral reading in native language or signing any English assessment will result in the LOSS (Lowest Obtainable Scale Score). The use of a bilingual dictionary during the English I or English II, Session I assessment will result in the LOSS. Students identified as blind/visually impaired (who do not read Braille) may use the oral reading accommodation if it is their primary instructional method.
55
Note 2 for Students with Disabilities Paraphrasing test questions invalidates all EOC
Assessment student scores for accountability purposes.
56
Note 3 for Students with DisabilitiesUse of magnifying equipment, amplification equipment, graph paper and testing with the teacher facing the student are not listed as accommodations because these are not required to be reported as accommodations for the EOC Assessments.
Examiner’s Manual Phase I & II
Directions for Administering Online Assessments
English II (Pages 34-37) Biology (Pages 38-41) Algebra I (Pages 42-47)Government (Pages 54-55)
57
Test MaterialsStudent Materials
Computer workstation with EOC Browser
Scratch, graph or draft paper (not provided)
At minimum four-function calculators for Algebra I (not provided and not required)
Algebra I reference sheet (for Algebra I Sessions I and II)
Dictionary, thesaurus, grammar handbook (for English II Session II only – not provided)
58
Prepare for Test AdministrationOrganize the classroom
Plan seating arrangements/computer usageEliminate distractions under your controlUse a Do Not Disturb sign (not provided) on your
doorRemove or cover any maps, charts, or other
materials that relate to the content and processes of the test.
Make testing arrangements for students who do not finish testing in the allotted time frame.
59
Electronic Devices At minimum, students may use a four-function
calculator during the Algebra I (Session I and Session II) Assessment. Other electronic devices must not be accessible during the testing session. Such items include, but are not limited to: cellular/mobile phoneselectronic music playersdigital camerashandheld scannersportable gaming devicesany portable device that can connect to the
Internet60
Administer the TestsSpecific directions for each content area are
in the Examiner’s manual.
The following symbol is used throughout the specific directions:
61
Agenda
EOC General Information and Changes
Testing Windows & Test Formats
Online Test Examiner’s Manual
Questions
62
•Re-Read the Manuals
63
•Who Calls Riverside?The district should have one point of contact – the DTC!
What If We Still Have Questions After Today?