welcome! new system test coordinators’ mid-year “touchpoint” webinar thursday, january 8, 2015...
TRANSCRIPT
Welcome!
New System Test Coordinators’ Mid-Year “Touchpoint” Webinar
Thursday, January 8, 201510:00 AM – 12:00 PM
1
Purpose
• To “check-in” with you at the mid-year point;
• provide information and reminders for the upcoming months;
• and answer questions.
2
Assessment & AccountabilityContact Information
Melissa Fincher, Ph.D.Deputy Superintendent, Assessment and Accountability
(404) 651-9405; [email protected]
Melodee Davis, Ph.D.Director, Assessment Research and Development
(404) 657-0312; [email protected]
Anthony (Tony) EitelDirector, Assessment Administration
(404) 656-0478; [email protected]
Cowen HarterDirector, Accountability
(404) 463-1168; [email protected]
3
Assessment & Accountability TeamDeputy Superintendent Support Staff
¤ Melissa Fincher ¤ Connie Caldwell ¤ Joni Briscoe
Assessment Administration – Anthony (Tony) Eitel∞ Bobbie Bable ∞ Deborah Houston ∞ Mary Nesbit-McBride∞ Michael Huneke ∞ Robert McLeod
Assessment Research & Development – Melodee (Dee) Davis∞ Jan Reyes ∞ Kelli Harris-Wright ∞ Niveen Vosler ∞ Sheril Smith
Accountability – Cowen Harter∞ Michelle Christensen ∞ Nancy Haight ∞ Paula Swartzberg∞ August Ogletree
Growth Model∞ Allison Timberlake ∞ Qi Qin
4
Assessment Administration Contact InformationGeorgia Milestones
Lead Contact for End of Grade (EOG)Support Contact for EOG & EOC Technology
Robert McLeod, Ed.D.404.656.2589;
Lead Contact for End of Course (EOC)Lead Contact for EOG & EOC Accommodations
Mary Nesbit-McBride, Ph.D.404.232.1207;
Lead Contact for EOG & EOC Technology:
Michael Huneke404.232.1208;[email protected]
ACCESS for ELLsGeorgia Alternate Assessment (GAA)
Deborah Houston
404.657.0251;[email protected]
Georgia Graduation Assessments (GHSGT & GHSWT)Georgia Online Formative Assessment Resource (GOFAR) & Online Assessment System (OAS)
Michael Huneke404.232.1208;[email protected]
National Assessment of Educational Progress (NAEP)Georgia Kindergarten Inventory of Developing Skills (GKIDS)
Bobbie Bable404.657.6168;[email protected]
5
Assessment Research & DevelopmentContact Information
Assessment Specialists,Research and Development
Sheril Smith, Ph.D.Assessment Research Specialist404.463.0164;[email protected]
Niveen VoslerAssessment Research Specialist404.463.0166;[email protected]
6
Kindergarten Entry Profile Project
Jan Reyes, Ph.D.Assessment Specialist404.463.6665;[email protected]
Formative Instructional Practices (FIP)
Kelli Harris-WrightAssessment Specialist404.463-5047;[email protected]
Accountability & Growth ModelContact Information
7
Accountability
Michelle ChristensenAccountability Specialist404-463-1175;[email protected]
Nancy HaightAccountability Specialist404-463-1166;[email protected]
Paula SwartzbergAccountability Specialist404-463-1539;[email protected]
August OgletreeAccountability Research [email protected]
Growth Model
Allison Timberlake, Ph.D.Program Manager404.463.6666;[email protected] Qi QinAssessment Specialist404.657.0311;[email protected]
Things you need to know…• Never hesitate to call or email• Testing is all about logistics, careful planning, and clear
communication• Superintendent Certification Form is due twice a year:
January 31 (for July – December) and July 31 (for January – June)– Submit via the MyGaDOE portal
• Principal Certification Form is now due after each administration http://archives.gadoe.org/DMGetDocument.aspx/Principals%20Certification%20Form.pdf?p=6CC6799F8C1371F6C3DC31F0F32C6BF289E49092B5868EA4D75D9E9EE197E244&Type=D
– Retain at the system level for 5 years
8
State Board RulesThe most current rules below can be found on the GaDOE web site at the following link: http://www.gadoe.org/External-Affairs-and-Policy/State-Board-of-Education/Pages/PEABoardRules.aspx
State Board Rules relating to assessment include: • 160-3-1-.07 Testing Programs – Student Assessment (Amended August 2014)• 160-4-2-.11 Promotion, Placement, and Retention • 160-4-2-.13 Statewide Passing Score• 160-4-2-.20 List of State-Funded K-8 Subjects and 9-12 Courses • 160-5-1-.15 Awarding of Units of Credit and Acceptance of Transfer Credit and/or Grades• 160-4-2-.06 through 160-4-2-.48 (IHF) High School Graduation Requirements• 160-1-3-.09 Waivers and Variances of High School Graduation Assessments• 160-4-5-.02 Language Assistance: Program for English Learners• 160-4-2-.31 Hospital/Homebound (HHB) Services• 160-4-2-.34 Dual Enrollment• 160-4-8-.12 Alternative/Non-Traditional Education Programs• 160-5-1-.07 Student Data Collection• 160-5-1-.14 Transfer of Student Records• 160 7 1 .01 Single Statewide Accountability System‐ ‐ ‐
9
•Superintendent’s Certification Form (Online in the MyGaDOE Portal)January – June: Submit no later than July 31July – December: Submit no later than January 31
•Principal’s Certification Form (Paper Form) – required after each administration. http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Information-For-Educators.aspx
Must be kept on file by System Test Coordinator for 5years.– Form is posted within the ‘For Educators’ link on the GaDOE site
•Webinar schedule: http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Memoranda--Announcements.aspx •GaDOE Published Resources: Please remind staff in your local systems that GaDOE publications/resources such as Study Guides, Test Content Descriptions, released test items, and test items from the OAS/GOFAR may not be “repackaged”, cut/pasted, etc. and presented as either a unique creation or as a GaDOE approved resource.
10
General Announcements: Managerial Topics
General Announcements: Managerial TopicsTransmission of Secure Information
• Do not include GTID or FTE #’s numbers in emails. • In addition, please do not email other secure information
such as confidential personnel information, secure test content, confidential student documents, etc.
• If secure information such as this needs to be shared via email, you may do so via the MyGaDOE Portal.
11
General Announcements: Accurate Reporting• Reasons for non-participation must be provided during the Accountability Non-
Participation Collection. This application may be accessed via the MyGaDOE Portal. Those marked (*) are applicable only for EOC non-participation. - Illness - Medical Emergency- Other - Unknown* EOC Course Not Completed
* EOC Course Not Taken for Core Credit/EOC Administered Previously• Be reminded that assessment data must report to the “FTE-reporting” location
(the school that reports the student for FTE purposes) and that students must be assessed per their FTE-reported grade level.
• Program Codes (such as the four-digit 6000 series) may not be used as the four-digit state school number. Please note that doing so will result in reporting errors for your students and may also create inaccuracies in your Accountability reporting.
12
CONTRACTOR URLS, ACCOUNTS, AND PASSWORDS
13
Assessment Testing Contractor/WebsiteWhen do you need or
receive this information?
Who should you communicate with to have your name added/account created?
MyGaDOE Portal Georgia Department of Educationhttps://portal.doe.k12.ga.us/login.aspx
Need to obtain ASAP Local System Technology Director
ACCESS for ELLs World Class Instructional Design and Assessment (WIDA)http://wida.us/contactus.aspx
Sent in October from WIDA
WIDA Help Desk ([email protected]) or Deborah Houston [email protected], 404-657-0251
GAA Questar Sent in October from Questar
Deborah [email protected]
GHSGT and GHSWT Georgia Center for Assessment (GCA)https://gcap.tsars.uga.edu/materials/
Need to obtain ASAP GCA: 888-392-8977
GKIDS Georgia Center for Assessment (GCA)https://gkids.tsars.uga.edu/start
Need to obtain ASAP Contact GCA to update STC designation888-392-8977
Georgia Milestones Test Administration System and other functions
CTB/McGraw-Hill•CTB.com•Test Administration System
Need to obtain ASAP [email protected]
OAS Riversidehttps://www.georgiaoas.org/
Sent in Mid-August from Riverside
Michael [email protected] or Riverside 866-215-6881
14
04/18/23 15
Webinar Dates for January – June 2015Memo found at:
http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Information-For-Educators.aspx
http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Memoranda--Announcements.aspx
Student Assessment Handbook2014- 2015
17
http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Information-For-Educators.aspx
Overview webinar from September 2014 Recording Link:http://video.doe.k12.ga.us/assess/assess10
Handbook posted at:
High Level Overview of 2014-2015
18
2014 - 2015 Assessments• Active Programs
– ACCESS for ELLs (K-12) and Alternate ACCESS for ELLs (1-12)– Georgia Alternate Assessment (GAA) (Gr. 3-8 and HS)– Georgia High School Writing Test (GHSWT) – Remains a requirement in 2014-2015– Georgia Kindergarten Inventory of Developing Skills (GKIDS)– Georgia Milestones Assessment System (Georgia Milestones) (Gr. 3-8 and HS)– National Assessment of Educational Progress (NAEP) (Gr. 4, 8, and 12)
• Legacy Programs – Still available, but only for a specific set of students– Basic Skills Test (BST)– Georgia High School Graduation Tests (GHSGT)
• Former Programs – Discontinued and no longer available– CRCT and CRCT-M– End of Course Tests (EOCT) – after November 2014 Mid-Month/Retest– Grades 3, 5, and 8 Writing Assessments
19
2014 - 2015 Assessments• ACCESS for ELLs (K-12) and Alternate ACCESS for ELLs (1-12)• Georgia Alternate Assessment (GAA) (K, 3-8, 11)
– Important change to content standards in high school mathematics in 2014-2015 (Coordinate Algebra & Analytic Geometry) . . . Revised Blueprint for high school mathematics for 2014-2015
• Georgia High School Writing Test (GHSWT)– Unchanged in 2014-2015; REMAINS a diploma requirement in 2014-2015– A rule change was approved in August 2014 that would no longer require the GHSWT for students
who enrolled in grade nine on/after July 1, 2013 (this year’s 9th & 10th graders)– Summer retest administration moves to June (June 17, 2015) . . . No more July graduation
assessment windows . . . It is important that your system publicizes this fact early, and often.
• Georgia High School Graduation Tests (GHSGT)– Available for students who remain subject to this requirement (Reference: Secondary Assessment
Transition Plan); BST remains available as well for students in that cohort– No summer retest window any longer (Last GHSGT summer administration, July 2014) . . . It is
important that your system publicizes this fact early, and often.– All administrations (with maybe a few rare, student-by-student exceptions) are now “retests” . . .
The Fall, Winter, and Spring windows will be available during 2014-2015– Pre-registration is required per State Board Rule; Confirm identity of all test-takers
20
2014 - 2015 Assessments• Georgia Kindergarten Inventory of Developing Skills (GKIDS) (K)
– No changes
• Georgia Milestones Assessment System (Georgia Milestones)– Grades 3 – 8 (End of Grade measures, “EOG”)– High School (and middle school where applicable) (End of Course measures, “EOC”)
• National Assessment of Educational Progress (NAEP) (4, 8, 12)– 400+ schools sampled statewide in 2015– 2015 is a “state year” for which state-level data will be reported
21
Roles and Responsibilities• The successful implementation of the statewide student
assessment program requires a concerted effort by many individuals at the local level.
• The failure of any personnel to assume the responsibilities described in the Student Assessment Handbook (SAH) may result in testing irregularities and/or invalidation of scores.
• Failure to assume responsibilities can have many far-reaching implications and may effect professional certification status.
22
Roles and ResponsibilitiesDetailed descriptions of roles and responsibilities are provided inthe SAH, 2014-2015:• Superintendent• System Test Coordinator (STC)• System Special Education Coordinator• System Title III Coordinator• Principal• School Test Coordinator• Examiner• Proctor
23
Roles and Responsibilities• System Test Coordinator
– Liaison between system and GaDOE– Conduct local system trainings of School
Coordinators– Coordinate ALL administration activity– Know and enforce responsibilities of all other roles– Adhere to planned schedule– Implement approved security plan– Detailed list of responsibilities in SAH
24
Roles and Responsibilities
• School Test Coordinator– Count and secure all test materials– Material distribution/return– Attend and redeliver training – Sign out materials– Monitor test administration environment– Receive/verify test materials after testing each
day– Detailed list of responsibilities in SAH
25
CONDUCTING SECURE & SUCCESSFUL TEST ADMINISTRATIONS
26
The state assessment program provides critical information to:
¤ Students ¤ Parents¤ Teachers ¤ Schools & Systems¤ Community Members ¤ Administrators¤ Policymakers¤ Various accountability measures
The integrity of the assessment process is critical to all we do as educators . . . And the public’s faith and trust in
what we do!
27
Roles and Responsibilities• The successful implementation of the statewide student assessment program
requires a concerted effort by many individuals at the local level. • The failure of personnel to assume the responsibilities described in the Student
Assessment Handbook (SAH) may result in testing irregularities and/or invalidation of scores.
• Failure to assume responsibilities can have many far-reaching implications and may affect professional certification status.
• Most importantly, a failure to fulfill one’s responsibilities can also have a detrimental impact upon students.
• Detailed descriptions of roles and responsibilities are provided in the SAH:Superintendent System Test Coordinator (STC)System Special Educ. Coordinator System Title III CoordinatorPrincipal School Test CoordinatorExaminer Proctor
28
Scheduling Considerations• Mandated tests must be scheduled in accordance with published GaDOE testing dates. This is a
provision that Superintendents document via the Supt’s. Certification Form. – The Statewide Assessment Calendar can be found on the GaDOE Testing web page in the
‘For Educators’ link. • http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Information-For-
Educators.aspx
– In scheduling each assessment, schools must adhere to the testing times prescribed in the Examiner’s Manuals. Allowing too much or too little time may result in an invalidation.
– Given the implementation of Georgia Milestones in this first year, we will be working more closely with systems than ever before regarding the details of scheduling.
• When scheduling tests, consider the optimum time to administer the tests. – Consider logistics, including time and staff availability. – The advent of online testing, on a larger scale than ever before, requires different
thinking relative to logistics.• Technology requirements, support needs, and capacity• More than one session per day (AM and PM, AM, Mid-Day, PM, etc.) and testing on Mondays and Fridays
(which are days many systems have tried to avoid in the past)• “Cycling” students through test settings where technology is housed• Seating/space considerations• Contingency planning for unexpected events such as power outages (incl. weather related), Internet
service interruptions, etc.
29
Scheduling ConsiderationsWhile “traditional” scheduling considerations will continue to apply to multiple testing programs, online testing considerations would apply here as well in terms of physical setting, space, etc.•Each system/school has the option of deciding whether students will be tested in their classrooms or in a large-group setting. It is strongly recommended that students are tested in a classroom setting (or computer lab), especially for elementary school students.•Mandated tests must be scheduled in accordance with published GaDOE testing dates . . . And where applicable, the prescribed order of content areas, etc.•If breaks are allowed, they should be scheduled so that an unhurried pace is maintained. The monitoring of students during an allowed/scheduled break is required. While breaks are intended to allow students to “pause” so to speak, they cannot be viewed as a time where disruptive or loud behaviors are allowed or create a scenario where test security could be compromised.•If the large-group testing option is selected, all students must be able to hear the test instructions and have sufficient workspace for writing or marking answer documents. Instructions should be delivered by the students’ examiner who is present with them in the test setting.•A sufficient number of proctors must be available to assist with test administration and monitor test security. A proctor is required when 30 or more30 or more students students are in a test setting. For every additional 30 students, another proctor is required.•Plans for the effective, documented, and secure distribution and collection of test materials (test booklets, answer sheets, online authorization log-ins/passcodes, etc.) must be in place regardless of the type of setting used. •Plans must be in place for students who become ill or have an urgent personal need (restroom).
30
Materials Management & Security• Make certain that Pre-ID label files and/or student data submissions for online testing
are created accurately and uploaded in a timely manner.• Correction of school/system level errors that result in reporting errors may result in
fees (potentially substantial dollar amounts) to the local system. More importantly, they may also negatively impact students.
• All testing materials must be stored – under lock and key and with strict “key control” – in a secure central location. Each STC must implement an accounting system for the materials that are required for each test administration. This applies at both the system and school levels.
• The STC should plan for the distribution of test booklets, answer documents, online log-in/password, etc., Examiner’s Manuals and Test Coordinator’s Manuals in a timely manner.
• Secure materials should be distributed to schools as close to the beginning of the testing window as possible.
• Each of the above bullets applies to online testing log-ins, etc. as well.• Once an answer document has a student pre-id label on it, student information
bubbled on it, and/or student responses on it . . . It is considered secure.
31
Materials Management & Security• Upon receipt, STC should:
– Inventory all materials to ensure sufficient quantities of materials have been provided for each school.
– Locate pickup/return instructions/memo, return labels, and airbills/bills of lading.
– If there are any errors in shipping materials, contact the vendor and/or Assessment Specialist associated with the testing program immediately.
32
Materials Management & Security• Staff members who are not involved in testing should also be aware of the
school’s responsibility for test security. • Paraprofessionals, custodial staff, and others in the school who may be in
classes during testing or may be near the area where tests are stored (even though they do not have direct access to tests) should be aware of security rules.
• All personnel involved in the administration must be trained in a manner appropriate to their role; this includes all staff who are involved in the handling of secure test materials (receipt, distribution, pre/post administration activities, return shipment, computer hardware management, etc.).
• Volunteers who assist in the school (non-employees) should not manage test materials or manage testing logistics but may assist in the administration in other ways (front office support, hall monitors, etc.). If needed, volunteers may serve as proctors – but MUST be fully trained. See SAH for details.
33
Materials Management & Security• Distribute materials to schools in a timely manner. However,
materials should not be in schools for lengthy periods of time either prior to or after the assessment window.
• Use appropriate “security checklists” to assign booklets to schools.
• School Test Coordinator should count and sign for all paper materials and online “tickets” received.
• Materials should be in a locked, secure location both at the system and school levels. – Restricted access must be confirmed.– A “rule of thumb” . . . If one would not store a large sum of money in the
chosen location, then it is probably not a wise choice for secure test materials either.
34
Materials Management & Security• The School Test Coordinator must count before disseminating to
examiners. • Examiners must verify count upon receipt. • Materials that are specific to a student (answer documents,
booklets, online test tickets, etc.) MUST be given to the correct student. This is a staff error that we see much too frequently – watch this carefully. Mistakes on this task can result in reporting errors that may be irreparable . . . With potentially negative impacts upon students . . . And potentially with financial costs to a district.
• At the end of testing each day, the examiner must account for all materials before dismissing students.
• The School Test Coordinator must count and secure all materials as examiners check in the materials at the end of testing each day.
35
Materials Management & Security
• Each school should have a process that outlines how, when, where tests are to be distributed and collected each testing day.– Schools should distribute materials to examiners immediately before testing.– Schools should collect materials immediately at the conclusion of testing each
day (or after each testing “period” or “session” if applicable).
• A local school’s process must ensure that staff is in possession of test materials for only the amount time that is necessary to ensure a secure and successful test administration. Secure materials may not be in the possession of staff (outside the designated secure location) for an entire day.– For instance, if multiple sessions are conducted during the day, the morning
session materials must be turned in immediately after the morning session concludes. They cannot remain outside of the school’s secure storage until the end of afternoon testing.
36
Materials Management & Security• All personnel are prohibited from reviewing contents of test
booklets.*• Do not copy any secure test materials.• The use, or intended use, of an electronic device to
photograph, post, retain, or share information/images from any portion of a secure test booklet and/or answer document will result in invalidation.
• Monitor students.*Interpreters for the hearing impaired may review in advance,
with supervision, to plan for administration.
37
Materials: Pre-ID Labels• Pre-ID labels (where provided) must be used to
provide accurate student information for state tests. – Refer to the Test Coordinator’s and Examiner’s
manuals for current information on use of labels specific to each test.
– Labels with incorrect information should not be used (and should be securely destroyed).
– Labels should be applied to answer documents prior to administration. Once applied, the answer document is considered secure.
38
Training Plan• The STC must develop and implement a district plan for training for
each specific assessment program. • Remember, online test administration necessitates the inclusion of
very detailed information that in many aspects differs from the training that most are familiar with for paper/pencil testing. Additionally, it may require the inclusion of staff members who were not included in trainings before – such as technology specialists, etc.
• Maintain detailed attendance records with the name of each participant, responsibility, date of training, and name of assessment.
• Develop a specific plan for implementing accommodations including:– ensuring students receive the right accommodations– ensuring the examiner administers the accommodation
appropriately – ensuring that any necessary logistics, materials, peripherals are
considered
39
Importance of Training MaterialsPrior to and during test administrations, please refer to the following resources:
– Student Assessment Handbook– Examiner’s Manuals (paper/pencil & online)– Test Coordinator’s Manuals (paper/pencil &
online)– Accommodations Manual
Even for those Georgia programs that are not experiencing changes this year, read manuals again even though you may have read them before.
40
Planning for a Conducive Environment
• Ensure that seating spaces and writing surfaces are large enough.
• Seating arranged to prevent cheating. • No cell phones or other electronic devices in the test setting. • No. 2 Pencils - Each student should have two No. 2 pencils with
erasers on test days. However, there should be a supply of extra pencils and erasers available.
• Keep a timing device visible - you should have a clock or watch to keep track of time during test administration.
• Prior to testing, make a plan for students who finish early, arrive late, appear to be (or become) ill, etc.
41
Online Testing ImplicationsOnline testing requires different thinking relative to logistics . . .
• For many systems (if not all), many lessons have been learned over time through use of the EOCT online in Main, Mid-Month, and Retest administrations and through the CRCT Retest online.
• Technology hardware, requirements, support needs, and capacity• More than one session per day (AM and PM, AM, Mid-Day, PM, etc.) and testing on Mondays
and Fridays (which are days of the week many systems have tried to avoid in the past)• “Cycling” students through test settings where technology is housed• The number of students a school can test online given the bullets noted above• Seating/space considerations• Securing log-ins, passwords, etc.• Proficiency of staff and students with technology• Contingency planning for both expected and unexpected events such as power outages (incl.
weather related), Internet service interruptions, construction in or near a school, etc.Remember, the state’s (minimum) goal is 30% in this first year of Georgia Milestones . . . 80% by Year 3 . . . 100% by Year 5. All schools will be expected to conduct some testing online.
42
Materials: ResourcesRESOURCES AND AIDS• NO dictionaries(*), textbooks, or other aids and/or resources
that would provide assistance. (*EL Word to Word Dictionaries would be an exception to this if prescribed in an EL-TPC plan)
• Any instructional materials that are displayed in the room, such as posters, must be covered or removed during testing.
• Review the calculator policies for each program as they differ.• The Georgia Milestones Calculator Policy can be found at:
http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Georgia-Milestones-Assessment-System.aspx
43
Roles and Responsibilities– Refer to Student Assessment Handbook for detailed
information.– Superintendent has ultimate responsibility for all
testing activities within the local school system. The System Test Coordinator shares this responsibility as the Superintendent’s designee.
– Principal has ultimate responsibility for all testing activities within the school.• Emphasis: The Principal must complete the
Principal’s Certification Form after each administration.
44
Roles and ResponsibilitiesSystem Test Coordinator
– Liaison between system and GaDOE– Conduct local system trainings of School Coordinators– Coordinate ALL administration activity– Know and enforce responsibilities of all other roles– Adhere to the state testing calendar and local
calendars/schedules– Implement plans for ordering and receipt of materials,
distribution, test security, administration, collection and return shipments, receipt and dissemination of reports and data
– Detailed list of responsibilities in SAH
45
Roles and ResponsibilitiesSchool Test Coordinator
– Must hold a PSC-issued certificate (per Student Assessment Handbook)
– Count and secure all test materials– Materials distribution/return, signing out and signing in materials– Attend and then redeliver training – Plan for all aspects of the school’s test administration, monitor
test administration environment– Receive/verify test material counts after testing each day– Collaborate effectively with local system colleagues who have a
role in the success of your system’s testing program.– Detailed list of responsibilities in SAH
46
Roles and ResponsibilitiesExaminer
– Must hold a Georgia PSC-issued certificate (teachers, counselors, administrators, paraprofessionals) . . . This is required per SBOE Rule 160-3-1-.07. GaDOE is compelled to invalidate when this does not occur (!).
– Security/verification of test materials– Control of testing environment and active monitoring– Accuracy of demographic/student information on answer documents– Correct delivery of assigned accommodations– Follows procedures for testing as given in Examiner’s Manuals, including
reading all directions/script to students– Test materials are not to be used for any purpose other than test
administration– Detailed list of responsibilities in SAH
47
Roles and Responsibilities
Proctor– Must be trained– With examiner supervision, ensures that students
are managing test materials appropriately– Active monitoring– Detailed list of responsibilities in SAH
48
Irregularities• All personnel in the local system must follow protocol as they become aware
of testing irregularities• Signs of any testing irregularity must be dealt with immediately
– Test Examiner > School Test Coordinator > System Test Coordinator > GaDOE
• All irregularities must be coded, documentation completed and submitted to the GaDOE Assessment Administration Division
• Only the GaDOE may invalidate assessments• The Assessment Administration Division will review all reports of
irregularities– Issue irregularity/invalidation codes– If appropriate, advise the local system as to whether a report of possible
unethical conduct should be made to the Professional Standards Commission (PSC)
49
Examples of Irregularities in Security Procedures: – Examinee was given access to test questions or prompts
prior to testing– Test Examiner or other personnel copied or reproduced and
distributed secure test materials– Examinee’s test booklet, online testing “ticket”, answer
sheets, or portfolio entries (GAA) are lost– Test Examiner or other personnel provided answers to the
examinee, or altered/interfered with student responses– For more examples, please refer to the SAH
50
Examples of Irregularities during Testing Administration:
– Test Examiner or other personnel failed to follow administration directions for the test
– Examinee’s test booklet, online testing “ticket”, answer sheets, or portfolio entries (GAA) are lost
– Test Examiner fails to provide an examinee with a documented accommodation or provides examinee with an accommodation that is not documented . . . Including a failure to transfer student responses to an answer document (such as with a Braille student)
– For more examples, please refer to the SAH
51
Steps for Reporting an IrregularitySchool Test Coordinator:
– Communicate with the Principal and System Test Coordinator about a possible testing irregularity
– System Test Coordinator will provide guidance regarding investigation if necessary
– Statements should be provided by all parties involved in the irregularity . . . Details, Details, Details . . .
– Return all documentation to the System Test Coordinator in the manner and at the time prescribed
52
Steps for Reporting an IrregularitySystem Test Coordinator:
– Collect Testing Irregularity Forms and documentation, if needed, from School Test Coordinators
– Documentation may include statements from parties with knowledge of event, list of students involved, copies of training logs, etc.
– Compile documentation and submit Portal entry for each incident– Notify the Assessment Specialist in the Assessment Administration
Division to determine appropriate coding for student answer documents
– Know your system’s protocol for cases that may constitute a breach of the Code of Ethics . . . Systems typically have defined investigation protocols for such instances. This may even require support from your system’s Human Resources Division and/or Board Attorney.
53
Characteristics of a Quality Investigation
• Examiner must notify Principal and School Test Coordinator of incident
• School Test Coordinator must notify System Test Coordinator
• Request detailed written statements from all parties involved if necessary– Follow up on details, probe all angles, etc.
• Follow district procedures regarding alleged employee misconduct
54
Characteristics of a Quality Investigation
• Provide a written summary of incident and investigation findings– Consult with GaDOE as needed.
• System Test Coordinator is responsible for reporting to GaDOE
• Note:– Report to GaDOE immediately, before investigation– Final documentation should be entered into Portal– The Portal is your system’s, and GaDOE’s, official record of
the event and its disposition
55
Irregularities – Post Testing• Make certain that all irregularities and invalidations
are documented correctly before sending scorable documents
• Make certain that online test irregularity forms have been finalized
• Communicate to school personnel the GaDOE responses to irregularity forms and consequences of irregularities, invalidations, and participation invalidations
• If appropriate, refer to PSC for investigation
56
Cell Phones and Electronic Devices• Students are not permitted to use, or bring into the testing environment, any electronic
device that could allow them to access, retain, or transmit information (e.g., cell phone, smartphone, PDA, electronic recording, camera, or playback device, etc.). Announcements must be made prior to testing that such devices are not allowed in the testing environment and that possession or improper use of such devices during testing may result in disciplinary action in accordance with the system's student code of conduct and/or test invalidation.
• In the event students attempt to enter the testing environment with such a device, districts and schools must have a plan to collect and secure such devices so that they are not accessible during testing.
• Script appears in the appropriate Examiner’s Manuals regarding this topic. This script, as with all script, MUST be read to students.
• If necessary, remind students that this expectation for Georgia’s state assessments is no different than most (if not all) other test settings that they will experience . . . Georgia Driver’s License Knowledge Exam, the ACT, the SAT, etc.
• Many systems have local policies regarding cell phone access and/or use during the instructional day. The district should continue to apply and enforce their local discipline or other policies regarding the use of electronic devices.
• The GaDOE will determine if the assessment should be invalidated.
Cell Phones and Electronic DevicesShould a case occur where a student does not conform to the directions given by school staff and a device is located in the test setting . . .•In the event an examiner confirms during testing that a student is using a device to access, retain, or share information, the examiner must with minimal disruption:
– collect the device, – stop testing that student, – remove the student from the testing session, and – notify the School Test Coordinator immediately.
•In the event such actions are suspected, but not yet confirmed, the examiner must with minimal disruption:
– collect the device, – allow the student to complete testing, – notify the School Test Coordinator immediately, and – as soon as it is appropriate attempt to confirm whether or not the device has been used in
violation of the guidelines above•Simple possession of a device (including the ringing of a phone during test administration) may be addressed in keeping with the system’s code of conduct and does not require an irregularity report to the GaDOE.
Accommodations Considerations and Current Updates for 2014 - 2015
• For many Georgia assessment programs, there are no changes to allowable accommodations in 2014-2015 . . . ACCESS for ELLs, GHSGT, GHSWT, GKIDS, NAEP.
– Allowable accommodations for these programs appear in the Student Assessment Handbook (SAH) and in the Accommodations Manual
• Revisions to the long-standing chart of allowable accommodations were made given the advent of Georgia Milestones.
• In the past, now, and in the future, accommodations not specified as allowable must be pre-approved or their unauthorized use may result in an invalidation. Requests must be received 6 weeks in advance of the state testing window for the applicable assessment. This is true for all programs . . . Including Georgia Milestones.
59
Requests for Accommodations Not on State-Approved ListIn rare instances, the GaDOE will consider a request for use of an accommodation that is not included in the Student Assessment Handbook, on a student by student basis. In order to consider the request, the Assessment Division will need detailed information for the/each student. See the Student Assessment Handbook for the required information that must be submitted.
The Assessment Division will review this information with staff from the Division of Special Education Services and determine if the request can be granted. To grant the request, there must be a clear relationship between the student’s disability and the need for the accommodation to access the test. Accommodations that serve to grant the student a differential boost in correct answers cannot be approved if that is the sole reason for the request. Given that accommodations are to be prescribed based upon the needs of individual students, requests that are identical for multiple students are not appropriate and will not be reviewed.•The System Test Coordinator must review all requests submitted by their local schools PRIOR to submission to GaDOE and indicate their approval of the school’s request. Requests must be reviewed with consideration given to the purpose of the assessment and the constructs measured. Requests must not be forwarded to GaDOE if they are not appropriate and/or are incomplete.•Requests must be submitted by systems in a “batched” fashion so that all being submitted for each state assessment are provided to GaDOE at one time (e. g.: all Georgia Milestones EOG requests submitted in one batch).•This will likely require local systems to establish internal timelines for such requests to be tendered to the System Test Coordinator.•This information should be submitted to the Assessment Division by submitting the form by fax at (404) 656-5976, or preferably by emailing the information to Melissa Fincher, Deputy Superintendent, at [email protected]. Requests MUST be received six weeks prior to the opening of each applicable state testing window for consideration.
60
Irregularities and Investigations
61
Irregularities
• All personnel in the local system must follow protocol as they become aware of testing irregularities.
• Signs of any testing irregularity must be dealt with immediately. – Test Examiner > School Test Coordinator > System
Test Coordinator > GaDOE
62
Irregularities• All irregularities must be coded, documentation
completed and submitted to the GaDOE Assessment Administration Division.
• Once the irregularity code is received, it may be used on future common place irregularities without calling the GaDOE but all irregularities must be reported.
• Only the GaDOE may invalidate assessments.
63
Steps for Reporting an Irregularity• System Test Coordinator:
– Collect Testing Irregularity Forms and documentation, if needed, from School Test Coordinators.
– Documentation may include statements from parties with knowledge of event, list of students involved, copies of training logs, etc.
– Compile documentation and submit portal entry for each incident.– Notify the Assessment Specialist in the Assessment Administration
Division to determine appropriate coding for student answer documents.
– Know your system’s protocol for cases that may constitute a breach of the Code of Ethics . . . Some systems have defined investigation protocols for such instances.
64
Characteristics of a Quality Investigation
• Examiner should notify Principal and School Test Coordinator of incident.
• School Test Coordinator should notify System Test Coordinator.
• Request detailed written statements from all parties involved if necessary.– Follow up on details (“connect the dots”)
• Follow district procedures regarding misconduct.
65
Characteristics of a Quality Investigation
• Provide a written summary of incident and investigation findings.– Consult with GaDOE as needed.
• System Test Coordinator is responsible for reporting to GaDOE.
• Note:– Report to GaDOE immediately, before investigation.– Final documentation should be entered into portal.
66
CODE OF ETHICS FOR GEORGIA EDUCATORS
The Professional Standards Commission’s (PSC) Code of Ethics for
Georgia Educators contains a standard specific to testing.PSC Ethics Division: http://www.gapsc.com/Ethics/Home.aspx
Standard 11: Testing - An educator shall administer state-mandated assessments fairly and ethically.
Unethical conduct includes but is not limited to: 1. committing any act that breaches Test Security; and 2. compromising the integrity of the assessment.
67
Code of Ethics Guidelines for Student Assessment
Georgia Professional Standards Commission website: www.gapsc.com
68
Test Security Reminders• Be thoroughly familiar with the Student Assessment
Handbook and test administration manuals• Thoroughly train everyone involved in testing• Carefully consider who has access to secure materials . . . And
that includes who has access to online testing platforms and what “role” they have in the online system
• Make everyone in the school/system aware of the importance of test security and the consequences of violating test security
• Report problems in a timely manner• Principal’s Certification Form is required after each
administration and must be maintained by the System Test Coordinator for 5 years
69
Test Security Reminders• Advanced planning is necessary• Solid logistical procedures must be in place• Secure storage before, during, and after must be present• Clear and concise communication about roles and responsibilities• Leave no doubt about what’s expected and required by both GaDOE and your
local system . . . And what’s unacceptable and unethical• Remind staff that security breaches can be either “acts of commission”
(“doing something wrong”) or “acts of omission” (“not fulfilling one’s role or responsibilities”)
• Document training carefully, including participants • Loss of test booklets, answer documents, and/or any other secure materials
constitute a breach of test security that can result in a referral to PSC
70
ONLINE FORMS IN THE MyGaDOE PORTAL
71
Assessment Online Formshttps://portal.doe.k12.ga.us/login.aspx
• Superintendent’s Certification Form January – June: Submit no later than July 31July – December: Submit no later than January 31
• Testing Irregularity Form• Rescore Request Form (Please email/call appropriate Assessment Specialist
as well)
• Graduation Assessment Special Administration Request Form – In addition, these requests require a letter from the System Superintendent outlining
rationale for the request.– Remember that special administration requests for the GHSGT and GHSWT should be rare
and only requested for extraordinary circumstances as defined in the Student Assessment Handbook.
– Given where we are in the Secondary Assessment Transition Plan, these should be exceedingly rare in the GHSGT program.
72
Assessment Online Forms https://portal.doe.k12.ga.us/login.aspx
• Special Administration Request– STC > Superintendent > GaDOE
• Assessment Rescore Request– STC > GaDOE
• Testing Irregularity– STC > GaDOE
• Superintendent’s Test Certification– STC > Superintendent > GaDOE
73
Dr. John D. Barge, State School Superintendent“Making Education Work for All Georgians”www.gadoe.org
Entering IRs into the MyGaDOE PortalIn the MyGaDOE Portal, find the “Surveys” section and click on “More”
https://portal.doe.k12.ga.us/login.aspx
Click on “View Summary” next to Testing Irregularity Form
Click on “Add New Record”
Click on “Start”
Entering IRs into the MyGaDOE Portal https://portal.doe.k12.ga.us/login.aspx
See the Online Forms QuickStart Guide at http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Information-For-Educators.aspx
75
When entering irregularities into the MyGaDOE Portal . . .
• Provide comments in the “Comment” section to help elaborate on the irregularity (or in the “Reason for Invalidation” section if applicable).
• Please include in the comments the Form # in question (if applicable).• If it has been determined that the irregularity will result in invalidation
– make sure to indicate “Yes” in that drop-down box.• Names of students and their GTIDs must be provided.• Upload statements and other documents that provide necessary
details on the event.• Make sure you indicate the correct “Assessment Cycle” (Date) in that
field.• In an event that involves multiple students – some of whom may be IR
and some who may be IV, please enter them as two separate records.
76
Post Administration Info/Reminders
77
Collecting Materials• In a supervised setting, at the conclusion of testing:
– The School Test Coordinator . . . Conducts, coordinates, and supervises inspection of all completed answer documents for the following purposes only . . .
• to ensure that student demographic and identification information is accurate• that necessary coding/labeling is complete• that documents are in good condition for scanning/scoring. (If there is concern about some
form of damage, stain, tear, etc., please contact GaDOE Assessment to discuss.)
• Count the answer documents and test booklets to account for the appropriate number
• Check to make certain there are no answer documents left in the test booklets
• Unnecessary handling of answer documents must be avoided• The timely return of answer documents ensures a timely return of scores
– for your systems and, to some degree, others
78
Returning Scorables and Nonscorable Materials
• Arrange for pickup of test materials. Refer to Test Coordinator Manual regarding pickup protocols
• Prior to shipping, make certain that there are no documents left in the schools or district offices and that an accounting of all documents is completed
• All materials should be in the proper order as explained in the Test Coordinator Manuals
79
Test Administration & Errors in ReportingPlease note that mistakes in test administration that occur in a school or system may result in the local school system being invoiced for the costs incurred to correct any resulting errors in test data/reports.
Such errors that may result in costs being borne by the local school system include, but are not limited to:•late return of scorable materials•failure to report irregularities in a timely manner•use of old/incorrect answer documents•not correctly coding student information or incorrectly using one student's label for another student (this would include providing incorrect online testing authorization tickets to the wrong student)•incorrect coding of header sheets, incorrect use of school names, inaccurate grouping of answer documents•failure to transpose student responses (i.e., for Braille students or other accommodated students) from the test booklet to an answer document•leaving scorable answer documents in test booklets or shipping scorables with non-scorables•administering the wrong test(s) to the wrong student(s)•return shipments sent to the wrong location/wrong contractor
These errors may necessitate custom and/or hand scoring, creation of new student, school, system, or state reports and/or data files and some may be irreparable. It is important to be aware that costs for such
instances could be quite substantial.
80
Transferring Student Test Scores• It is the responsibility of local school systems to
ensure that test scores become a part of students' records as soon as possible after testing, and that such records follow students to their new schools
• This responsibility to provide scores to students/parents continues even after a student withdraws/exits school. GaDOE does not issue individual student scores to students, parents, or receiving schools.
81
Dissemination of Test Scores• Data files, and for some programs PDFs of reports, are released on the
department’s secure portal, MyGaDOE, and/or (for some programs) via a contractor’s delivery system– To have access to these downloadable roster reports and data files, it is
imperative that System Test Coordinators acquire a login and password for both the MyGaDOE Portal and any necessary contractor sites
• Requests for data from other personnel in the system (e.g. principals, teachers, parents, etc.) will be directed to the System Test Coordinator
• Individual student reports, rosters, school level summary reports, and system level reports are made available to districts via printed copy
• Most importantly, parents must receive their student’s report(s) on a timely basis – this includes both test scores and growth scores (SGPs)
82
Note that reports from the initial administrations (2014-2015) of Georgia Milestones will be delayed until after the close of the 2014-2015 school year. Specific timelines will be provided in our future/ongoing updates relative to Georgia Milestones.
Final Thoughts: Proactive planning is key to your assessment program’s success
• The Student Assessment Handbook is a critical resource and reference.• Stakeholders will want their test results immediately upon receipt – so plan ahead for communication and
distribution. Timelines – especially in the spring – tend to be tight.• Schedule your local trainings in advance . . . Check your local calendar for possible conflicts and schedule
locations in advance.• You will find yourself working closely with all divisions of your school system . . . Special Education, Title
III/ELL, Technology, Student Information Systems, Building/Grounds/Maintenance, etc.• Know (or have access to information about) your Students with Disabilities . . . Particularly those who are
visually impaired and/or who require Assistive Technology for testing.• There will be a high level of public and media interest (and scrutiny) of your assessment program,
procedures, and results. Your local Board will have a high level of interest as well.• Logistics are key! Having procedures for the receipt, distribution, and return shipment of secure materials
is critical. Deadlines are frequent . . . and critical to meet.• The ordering of materials occurs far in advance of each testing window – having data (such as enrollment
numbers) on hand is critical.• Planning for a test begins up to 3 months prior (ordering materials) to 2 months past (distributing and
interpreting results throughout your system).• Create procedures to receive and investigate irregularity reports in your system.• As much as possible . . . plan for the unexpected (bad weather, staff absences, fire alarms that go off, etc.).
83
Assessment Administration Contact InformationGeorgia Milestones
Lead Contact for End of Grade (EOG)Support Contact for EOG & EOC Technology
Robert McLeod, Ed.D.404.656.2589;
Lead Contact for End of Course (EOC)Lead Contact for EOG & EOC Accommodations
Mary Nesbit-McBride, Ph.D.404.232.1207;
Lead Contact for EOG & EOC Technology:
Michael Huneke404.232.1208;[email protected]
ACCESS for ELLsGeorgia Alternate Assessment (GAA)
Deborah Houston
404.657.0251;[email protected]
Georgia Graduation Assessments (GHSGT & GHSWT)Georgia Online Formative Assessment Resource (GOFAR) & Online Assessment System (OAS)
Michael Huneke404.232.1208;[email protected]
National Assessment of Educational Progress (NAEP)Georgia Kindergarten Inventory of Developing Skills (GKIDS)
Bobbie Bable404.657.6168;[email protected]
84
Thank you for your efforts!
85