brevard spring 2011 computer-based testing fcat/eoc training presentation

83
BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

Upload: jabir

Post on 25-Jan-2016

31 views

Category:

Documents


0 download

DESCRIPTION

BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation. Two versions of this presentation are available online at the Accountability, Testing and Evaluation Website Version 1: Abbreviated for CBT Team Training Version 2: Complete with steps for using PearsonAccess. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

BREVARDSpring 2011

Computer-Based TestingFCAT/EOC

TRAINING Presentation

Page 2: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

2

Two versions of this presentation areavailable online at the

Accountability, Testing and Evaluation Website

Version 1: Abbreviated for CBT Team TrainingVersion 2: Complete with steps for using PearsonAccess

Page 3: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

Agenda

• Overview Housekeeping Reminders New

• The Big Picture: 5 Parts of administering CBT Planning Translate Planning into Scheduling in PearsonAccess Preparing for testing

General prep Training/ Test Administrator Responsibilities

During Testing After Testing

• Appendix A: Training Test Administrators• Appendix B: Technology Coordinator

3

Page 4: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

4

Spring 2011 Computer-BasedTest Administration Schedule

Test Testing Window Duration

Mathematics Retake*April 6 – April 13, 2011

Untimed

Grade 10 MathematicsApril 13 – April 25, 2011

160 minutes

Geometry EOC Field Test

Biology EOC Field TestMay 2-6

90 minutes 75 minutes

Algebra 1 EOC May 9-13160 minutes + (Untimed1)

*Reading Retake and Gr. 10 Reading are NOT computer-based tests in Brevard.

*All RETAKE paper-based materials will be picked up on Thursday, April 14, 2011.

1 160 min. w/ 10 min. break after 80 min. No dismissals during first 80 min. After 10 min. break, students may be dismissed as they complete the test. Must

complete test in 1 day.

Page 5: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

5

HOUSEKEEPING

• There are two separate correction sheets (page 27 and page 40) for the FCAT Spring 2011 Computer-Based Test Administration Manuals . (These sheets are included in the manual shipment.)

Distribute one corrected page 27 and one corrected

page 40 with each Spring 2011 Computer-Based Test Administration Manual.

FDOE recommends stapling or taping the replacement sheets over the current sheets. (The current pages should not be completely removed from the manuals because the replacements are not double-sided.)

Replace Pages in FCAT CBT Manual

Page 6: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

6

Pearson Support and PearsonAccess• Contact Pearson Support

Phone Number: 1-877-847-3043

• Appendix C in the manual provides the following information: PearsonAccess

User Accounts– Everyone should have an account specific to their function.– Contact Midge Rondello if you need help.

Browser requirements Logging in for the first time Resetting passwords

Training Center Test Setup Exercise

Note: PearsonAccess will timeout after 14 minutes of inactivity.

HOUSEKEEPING

Page 7: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

7

• PearsonAccess – www.pearsonaccess.com/fl • Brown Site: Training Center for Infrastructure Trial

and practice• Blue Site: Operational center for actual test preparation

(e.g., PreID, setup, administration, and reporting tasks) Correct test administration must be selected each

timeyou log in.

Requires a username and password.

Reminders for Spring 2011Computer-Based Testing

Page 8: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

8

Practice Tests• Students are required to participate in a practice test at the

school using the script provided in the CBT test administration manual. Practice test is delivered using an ePAT (electronic practice assessment

test). ePAT is available for student to practice on their own. The ePAT practice tests, test scripts, and answers for FCAT

Math, Algebra 1, Biology 1, and Geometry are posted to www.FLAssessments.com/ePAT under the Practice Assessment Tools and the Resources tabs.

• Practice tests (ePATs) can be used at any time at home; schools must stop one week before the test.

• After participating in a practice test, students can request an FCAT hand-held calculator or a hard-copy of the reference sheet on the day of testing.

Reminders for Spring 2011Computer-Based Testing

Page 9: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

9

Reminders for Spring 2011Computer-Based Testing

• Reference sheets are provided in the CBT platform as on online tool. Schools may provide hardcopy reference sheets to students. Hardcopy reference sheets must be single-page, double-sided

photocopies of the reference sheet that is in the Appendix of the CBT manual.

• Ratio of proctors to students required for computer-based testing is one proctor for every 25 students.

• Mathematics Work Folder is now called Florida Computer-Based Testing Work Folder.• WORK FOLDER = SCRAP PAPER

Page 10: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

10

Reminders for Spring 2011Computer-Based Testing

>Call TA office

Page 11: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

1111

Something New• A new user role, CBT Test Administrator, has been created in

PearsonAccess. School Assessment Coordinators may create accounts for test

administrators at each school testing site (computer lab, etc.) for the purpose of resuming computer-based tests during the testing window. Log in on the Blue Site Select a CBT test administration (it doesn’t matter which

one) Click on Administrative Management >View User

Accounts>New User Fill in the required demographic information, entering test

windows for start and end dates Click on CBT Test Administrator Click on your school and

NOTE: you will not be able to edit this info in PearsonAccess once it is entered. If you need to make any changes, contact Midge Rondello

www.pearsonaccess.com/fl >Administrative Management>View user accounts>new user

Page 12: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

CBT Team

Responsibilities

The Big Picture

School Assessment Coordinator

Responsibilities

The Big Picture

Page 13: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

1313

School CBT Team Responsibilities

1.Planning2.Translate planning into

scheduling in PearsonAccess

3.Prepare for Testing4.During Testing5.After Testing

Page 14: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

1414

School CBT Team Responsibilities

1. Planning• WHO TESTS? Identify which students are

required to take which tests• WHAT TEST? Computer based test or a P/P

test?• WHERE to TEST? Identify your CBT and your

P/P test sites• WHEN to Test? Schedule days and times for

CBT and P/P• WHO ASSISTS? Identify staff as test

administrators/ proctors• HOW will students/test administrators know

where to go and when?

Page 15: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

151515

School CBT Team Responsibilities

2. Translate Planning into Scheduling in Pearson• Manage student information in Pearson• Create test sessions• View and verify student data• Add and delete students• Manage Tests• Manage Test Sessions• Print authorization tickets

Pearson Scheduling

FCAT Open Feb. 21EOC opens April 9

Page 16: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

16161616

School CBT Team Responsibilities

3. Prepare for Testing• Make sure all students have done ePAT• Assign test group codes to each session• Plan for distribution and collection of P/P tests• Plan for distribution and collection of auth.

tickets• Plan for distribution and collection of calculators

and reference sheets (go in DC box)• Train test/site administrators, proctors, back-ups• Get everyone involved to sign security

agreements• Set up Pearson usernames for test

administrators so they can resume testing when necessary

• Set up workstations, download, install, launch, etc.

Page 17: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

1717171717

School CBT Team Responsibilities

4. During Testing• Distribute and collect materials for P/P

testing• Distribute and collect session rosters &

authorization tickets to/from test administrators

• Ensure each site has calculators & reference sheets

• Start and stop test sessions• Monitor session status and student progress• Supervise test administration and maintain

security• Manage make-up sessions and move

students• Start proctor caching software daily, assist

with technical issues

Page 18: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

1818181818

School CBT Team Responsibilities

5. After Testing

• Prep P/P materials for return• In PearsonAccess

• Update student information• Mark student tests as “complete”• Stop test sessions• Invalidate tests• Record accommodations• Purge test content• Complete comment form

Page 19: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

School CBT Team Responsibilities

1- PLANNING

Page 20: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

2020

• FCAT Gr. 10 Math and Reading• First-time gr. 10 students who entered gr. 9 in Fall 2009

• FCAT Reading and Math Retakes• Retained gr. 10 students and all gr. 11-AD students

• Alg 1 EOC• All students enrolled in Alg 1 or equivalent course in 2010-

11 (or any part of an eligible course)• ??? PLAN for all students currently in gr. 7, 8, 9 who

previously took Alg. 1 and pray we don’t have to test them• Geom/Biol EOC field tests (no students who need P/P tests)

• All students currently enrolled in Geom or equiv. course • All students currently enrolled in Biol/Int 3 or equiv. course• NOT students who completed courses at the end of 1st

semester

Planning: Who Tests?

Page 21: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

212121

• FCAT CBT Math Retakes: April 6-13• FCAT P/P Reading Retakes: April 11-13

• Pick up all P/P Retake materials 4/14/11

• FCAT Gr. 10 Reading: • Group testing for all 4/11/11• Small groups and make-ups 4/12-4/25

• FCAT Gr. 10 CBT: May begin 4/13/11 and test thru 4/25/11

• Geom/Biol EOC field tests: May 2-6

• Alg 1 EOC: May 9-13 (160 min. w/ 10 min. break after 80 min. No dismissals during first 80 min. After 10 min. break, students may be dismissed as they complete the test. Must complete test in 1 day)

??? Idea to test small group on day one as OTJ training

Planning: When Do we Test?

Page 22: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

School CBT Team Responsibilities

2 - SCHEDULING

Page 23: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

2323

• Scheduling in Pearson dependent on download of PreID files into PearsonAccess

• Scheduling for FCAT (Retakes and Gr. 10) open as of Feb. 21

• Scheduling for EOCs will open April 9

Scheduling in Pearson

Page 24: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

24

School CBT Team PearsonAccess – Before Testing

Pearson Access instructional slides included in full version

ALSO

Please see Steve and Melinda’s screen shot handout

Page 25: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

School CBT Team Responsibilities

3 - Preparing for Testing General Preparation

Training Test Administrators Tech Coordinator Role

Page 26: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

26

School CBT Team Checklist – Before Testing

Read the test administration manual. Read the Test Administration Policies and Procedures and

sign the FCAT CBT Administration and Security Agreement. Train Test Administrators and Proctors and ensure that

they, as well as all school administrators, sign the FCAT CBT Administration and Security Agreement.

Receive test materials from district assessment coordinator; inventory materials within 24 hours of receipt, and report missing materials or request additional materials.

If your school will provide paper reference sheets (Mathematics tests only), ensure an adequate supply is available for all students.

Communicate the process for collecting required administration information to test administrators.

Distribute test group codes to test administrators.

Page 27: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

27

School CBT Team Checklist – Before Testing Make arrangements to test any special program students

(district virtual instruction programs, Home Education Program, etc.) who may be testing at your school.

Assign proctors, as needed. Ensure that appropriate test settings are available for all

test sessions. For students who require special accommodations at your

school, discuss with test administrators how accommodations will be provided.

Verify student information and create test sessions in PearsonAccess.

Distribute Session Rosters and Student Authorization Tickets on the day of testing.

Complete any Computer-Based Assessments Certification district readiness activities as directed by FDOE.

Page 28: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

28

Test Group Code Test CodeA unique four-digit number used to identify groups of students tested together which is created by district assessment coordinators or by school assessment coordinators. This is entered after the Welcome screen in TestNav (or TestHear) and before students see the first question.

A six-digit code created by PearsonAccess and printed on Student Authorization Tickets and Session Rosters. The Login ID and the test code are required to log in to TestNav (or TestHear).

Test Code & Test Group Code

Page 29: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

29

Practice Test (ePAT)

• All students MUST participate in a practice test (approximately 45 minutes) prior to taking any computer-based test. Recommend completing at least three weeks prior to

administration. Provide students with URL so they can practice on their own

www.FLAssessments.com/ePAT.

• About the ePAT Familiarizes students with

Mathematics Reference Sheets Online tools Process of responding to items on the computer

Practice test items are not intended to replicate the difficulty of the items on the test.

Work Folders and Reading Passage Booklets will not be provided for practice tests. Instruct students to bring their own scratch paper and

pencils/pens.

Page 30: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

30

Conduct Practice Test (ePAT)

• ALL students MUST complete a practice test to learn how to use the computer-based system. Even students who participated in a Spring 2010

computer-based test MUST complete a practice test prior to the Spring 2011 administration.

• Ensure that the following items have been downloaded to each computer that will be used for the practice test ePAT Launcher FCAT Reading and Mathematics Retake Practice Test

Each appropriate EOC Practice Test

• Scripts provided in manual and in Pearson>ePAT>Resources .

Page 31: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

31

School CBT Team Training – Before Testing

Train Test Administrators and Proctors• Monitoring test sessions and resuming students in

PearsonAccess School coordinators have the ability to resume students and may

require test administrators to contact them during testing to request this authorization.

Test administrators may resume students if PearsonAccess accounts have been created by the district.

• Securing a student’s computer if a student leaves the room and will resume testingRecommended Long breaks: student must exit the TestNav system by clicking the

X or the red circle in the top corner and then clicking Yes, exit the test Student will not be able to continue testing until he/she is authorized to

resume testing in PearsonAccess. Short breaks: visual block (e.g., a file folder) must be applied to

obscure the computer screen or turn off the monitor

Page 32: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

32

School CBT Team Training – Before Testing

• Test administrators must contact the school assessment coordinator if the following occurs: A student exits the test to finish later and logs out

of the test session. A student has trouble logging in the first time. A student has not participated in a practice test. A test administrator does not have a Student

Authorization Ticket. A student’s name is not correct (e.g., misspelled)

on the Student Authorization Ticket. A test administrator is concerned that a student is

unable (e.g., too ill) to finish the test.

Page 33: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

33

• Required Administration Information for each Test Administrator’s room: Students assigned to each test site

Student Name and Student ID Number Attendance Information

P=Present, A=Absent, W=Withdrawn, P/I=Present but Invalidated Accommodations provided

Codes are in the Spring 2011 Computer-Based Test Accommodations Guide for Grade 10 Mathematics and Reading & Mathematics Retakes

Test Group Code (to identify groups of students tested together) Grade Level Signatures of test administrator and school assessment

coordinator and dates for when secure materials (e.g., Work Folders, Student Authorization Tickets, Session Rosters, Reading Passage Booklets, Mathematics Reference Sheets) are received and returned

Materials Needed for Testing

Page 34: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

34

Materials Needed for Testing

• Test Group Codes Unique four-digit number Identifies a group of students tested together

• Florida Computer-Based Testing Work Folders (if needed) A blank piece of yellow 11x17 paper folded in half

that students use to work Mathematics problems

• Reading Passage Booklets (Accommodation) Students are eligible if their IEPs or Section 504

plans include this accommodation Booklets contain Reading passages but do not

contain test items Students will respond to test items on the computer

Page 35: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

35

Materials Needed for Testing

• Calculators Computer-based FCAT Math tests have a

built-in, 4-function calculator (TI-108). Students may request a hand-held FCAT

calculator instead of the online TI-108 after participating in a CBT practice test.

Geom EOC includes online scientific calculator.

• Reference Sheets/Periodic Table Computer-based tests have a pop-up

window that includes the Math Reference Sheet s and a Biology periodic table.

Schools may provide paper copies of reference sheets to students; however, schools must make their own copies.

Page 36: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

36

Materials Needed for Testing

• Student Authorization Tickets (secure materials) Session/Test/Location Student Name Date of Birth Student ID Student Signature Line URL Login ID Test Code (password)

• Students need a Login ID and Test Code (password) for each test session.

• Students need a pencil or pen to sign their tickets.

Page 37: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

37

Samples (3 types) Of Printed Student Authorization Tickets

Detail View/Single TicketDetail View/Single Ticket

List View/3 TicketsList View/3 Tickets

Grid View/6 TicketsGrid View/6 Tickets

Page 38: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

38

School CBT Team Training – Before Testing

Train Test Administrators and Proctors

• For Test Administrator training slides, see

Appendix ATest Administrator

Training and Responsibilities

Page 39: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

3939

School CBT TeamPreparing for Testing

• For Technology Coordinator Role, see

Appendix BTechnology Coordinator

Before, During, and After Testing

Page 40: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

School School Assessment Coordinator/CBT Team

Responsibilities

4 - During Testing

Page 41: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

41

School Assessment CoordinatorChecklist – During Testing

Ensure that test sessions have been started in PearsonAccess.

Provide test administrators with additional materials, as necessary.

MonitorMonitor each testing room to ensure that test administration and test security policies and procedures are followed.

Security Logs are being properly completed and required administration information is being collected.

Be available during testing to answer questions from test administrators.

In PearsonAccess, monitor session status and resume students’ tests, if necessary.

Arrange for and supervise make-up administrations.

Page 42: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

42

School Assessment CoordinatorDuring Testing

• Maintain/ensure test security• Supervise test administration• Gather info needed for make-up testing

• In Pearson- Start test sessions Monitor session details Resume students’ tests Monitor student progress

Page 43: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

43

Security Log

• Schools are required to maintain an accurate Security Log for each testing room.

• Anyone who enters a room for the purpose of monitoring a test MUST sign the log for that testing room, regardless of how much time he/she spends monitoring a testing room.

• A perforated Security Log can be found in Appendix D of the manual.

• Blank Security Log can also be found at www.FLAssessments.com/SpringRMS.

Page 44: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

44

Sample of Security Log

Page 45: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

45

School Assessment CoordinatorDuring Testing

Supervise Test Administration/Maintain Test Security• School Assessment Coordinator and Technology Coordinator must be

available to answer questions and assist with computer problems/error messages.• How will you communicate?

• Provide test administrators with additional Work Folders, reference sheets, and calculators, if necessary.

• Ensure that Security Logs and required administration information are being maintained.

Page 46: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

46

School Assessment CoordinatorDuring Testing

Supervise Test Administration• If the Internet connection is interrupted during testing:

Student will still be able to complete the test. Student responses are automatically saved and, once

Internet connection has been restored, will be sent to Pearson.

IF the Internet connection is not restored by the time the student has finished the test, the test administrator should contact the school assessment coordinator or technology coordinator for assistance.

If there are issues on a specific computer Shut down the first computer and move student to another

computer that has been properly set up for testing. Student should be able to resume testing where he/she

left off if the responses were saved to the network. If a student cannot continue testing, document the

issue and determine whether invalidation is appropriate.

Page 47: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

47

School Assessment CoordinatorPearsonAccess – During Testing

Test Session Management Tasks During Testing

TASK DESCRIPTION

FCAT/ EOC

MANUAL

PAGE(S)

Start test sessionsA session must be started in PearsonAccess before students can begin the test.

63-64/ 89-90

Monitor session details

Keep track of each student’s testing status in PearsonAccess.

64/90

Resume students’ tests

If a student exits the test (intentionally or unintentionally) before completing a test and will resume the same test.

64-65/90-92

Page 48: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

48

School Assessment CoordinatorPearsonAccess – During Testing

Test Session Management Tasks During Testing

Pearson Access instructional slides included in full version

ALSO

Please see Steve and Melinda’s screen shot handout

Page 49: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

School Assessment Coordinator/CBT Team

Responsibilities

5 - After Testing

Page 50: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

50

School Assessment CoordinatorChecklist – After Testing

Verify that all distributed secure materials have been returned. Report any missing materials to your district assessment coordinator and conduct the necessary investigation.

Make copies of all collected required administration information and Security Logs and file the copies.

In PearsonAccess, stop test sessions and invalidate student tests, if necessary.

In PearsonAccess, record accommodations actually used by students.

Organize materials and return them to your district assessment coordinator.

Complete the CBT School Assessment Coordinator Comment Form.

Page 51: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

51

School Assessment CoordinatorChecklist – After Testing

• Report to district assessment coordinator

• missing materials (particularly secure documents such as student authorization tickets),

• test irregularities,

• security breaches

• In Pearson

• Update/edit student information

• Mark students’ tests complete

• Stop test sessions

• Invalidate tests and cite reason for invalidation

• Record accommodations

• Transcribe each P/P Alg 1 EOC test into a CBT test

• Complete Comment Form

Page 52: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

52

Missing Materials and Test Irregularities/Security Breaches

Test administrators should report any test irregularities (e.g., power outage, fire alarm) and possible security breaches to the school assessment coordinator immediately.

• If a secure document, such as a Student Authorization Ticket, a used Work Folder, a Session Roster, or a Reading Passage Booklet, is lost or a test irregularity or security breach is identified, the school assessment coordinator must contact the district assessment coordinator.

• Missing Materials form and Test Irregularities/Security Breaches form will be sent from the District Testing Office.

Page 53: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

53

Test Invalidation Policies and Procedures

• Purpose of test invalidation is to identify when the validity of test results has been compromised.

• Test administrators should discuss situations involving possible invalidation with the school assessment coordinator and the situation should be investigated immediately.

• A test MUST be invalidated if any of the following circumstances occur: A student has an electronic device during testing. A student is cheating during testing. A student is disruptive during testing.

Situations involving possession of electronic devices, possible cheating, or disruptive behavior should be investigated and discussed with the school assessment coordinator and site administrator before a final invalidation decision is made.

Page 54: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

54

Test Invalidation Policies and Procedures

A test MAY be invalidated if any of the following circumstances occur:

1. A student becomes ill and is unable to finish, OR a student is not allowed the correct amount of time.

2. A student was given an accommodation not allowed on the FCAT.

3. A student was given an accommodation not on the student’s IEP, Section 504 plan, or ELL plan.

4. A student was not provided an allowable accommodation listed on the student’s IEP, Section 504 plan, or ELL plan.

5. An error occurs in test administration or procedures that could compromise the validity of the test results (e.g., students had access to an unauthorized visual aid that gave an unfair advantage).

Page 55: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

55

School Assessment CoordinatorPearsonAccess – After Testing

Test Session Management Tasks After Testing

TASK DESCRIPTION

FCAT/ EOC

MANUAL

PAGE(S)

Mark a student’s test complete

Mark a student’s test complete if a student exits the test and will not resume the same test.

70-71/ 96-97

Stop test sessionsA test session cannot be stopped until all students are in “Completed” or “Marked Complete” status.

71/97

Invalidate testsAny tests that should not be scored must be invalidated.

71/ 97-98

Record accommodations

All accommodations used by students must be recorded in PearsonAccess.

71/98

Page 56: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

56

School Assessment CoordinatorPearsonAccess – After Testing

Test Session Management Tasks After Testing

Pearson Access instructional slides included in full version

ALSO

Please see Steve and Melinda’s screen shot handout

Page 57: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

57

School Assessment CoordinatorPearsonAccess – After Testing

Complete Comment Form

• Please provide feedback that will be meaningful to the FDOE and the test contractor.

Go to www.FLAssessments.com/SpringRMS or to the appropriate EOC Comment form under Pearson>Support>Resources.

Click the CBT School Assessment Coordinator Comment Form and complete the form.

THAT WASTHAT WASTHAT WASTHAT WAS

Page 58: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

APPENDIX A

Test Administrator

Training andResponsibilities Before, During,

and AfterTesting

Page 59: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

59

Test AdministratorChecklist – Before Testing Read the test administration manual. Read the Test Administration Policies and Procedures and sign the

FCAT CBT Administration and Security Agreement. Establish appropriate setting and remove or cover any unauthorized

visual aids. Prepare necessary forms to collect required administration

information. Prepare Security Log(s) to be used in testing room(s). Make copies of the Do Not Disturb sign and Electronic Devices sign

to post prior to testing. Receive your test group codes from school assessment coordinator. Assemble all materials. Ensure that students understand the electronic devices policy. Become familiar with accommodations specified on students’ IEPs or

Section 504 plans. Ensure that you are familiar with how to open TestNav to the login

screen for each student computer prior to testing.

Page 60: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

60

Test AdministratorPrepare Testing Room

• Ensure that all software applications, including Internet browsers, are closed on all student workstations.

• Start TestNav and open each student workstation to the student login screen.

• Ensure that you have a way to contact the technology coordinator or school coordinator during testing without leaving the room unattended.

• Test Sessions have a unique six-digit test code (password) that will be printed on the Student Authorization Tickets and Session Roster. Test Code (password) is used to access the test. Test Group Code (4-digits) is used to identify groups of

students tested together.

Page 61: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

61

• Students may not have any electronic or recording devices at their desks, in their pockets, or anywhere they can reach them during testing, even if the devices are turned off or the students do not use them. If a student is found to be in possession of ANY electronic

device(s) during testing, his or her test must be invalidated in order to successfully enforce this policy.

• Inappropriate actions by school or district personnel before, during, or after test administration may result in consequences such as test invalidations and/or loss of teaching certification. Carefully read the Test Security Policies and Procedures to

ensure that you are following the correct procedures. District assessment coordinators must require school

administrators, school assessment coordinators, test administrators, and proctors to sign an FCAT CBT Administration and Security Agreement.

Security of all test materials, including Student Authorization Tickets, must be maintained before, during, and after test administration.

Schools are required to maintain an accurate Security Log for each testing room.

Reminders for Spring 2011Computer-Based Testing

Page 62: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

62

Test AdministratorChecklist – During Testing

Maintain your record of required administration information.

Ensure that proctors and anyone who enters a testing room for the purpose of monitoring the test sign the Security Log.

Administer the test according to the directions in the appropriate administration script and read the SAY boxes verbatim to students.

Page 63: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

63

Test AdministratorSupervise Test Administration

• During testing, ensure that students: Clear the area around their workstations of all materials except for the

following: Student Authorization Tickets Pencils or pens Work Folders, if applicable Calculators, if applicable Reference Sheets, if applicable Reading Passage Booklets, if applicable

Do not have books, notes, extra scratch paper, or electronic devices of any kind (except for FCAT calculators) during testing, even if they do not use them

Do not talk or make any disturbance Work independently

• Test administrators MAY NOT: Talk with students about test items Help students with their answers Have any desktop-viewing programs or similar software that would

enable a test administrator to view test items and student responses Provide students with any information that would allow them to infer the

correct answer Discuss test items or answers with students even after testing has been

completed

Page 64: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

64

Test AdministratorSupervise Test Administration

• If a computer is disconnected from the test: Contact the technology coordinator to help

diagnose any technical issues Contact the school assessment coordinator to

resume student’s test in PearsonAccess

If you have a Test Administrator account in PearsonAccess, you will be able to resume the student’s test and assist the student with logging in again.

Page 65: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

65

• If the Internet connection is interrupted during testing: Student will still be able to complete the test. Student responses are automatically saved and, once

Internet connection has been restored, will be sent to Pearson.

IF the Internet connection is not restored by the time the student has finished the test, the test administrator should contact the school assessment coordinator or technology coordinator for assistance.

If there are issues on a specific computer Shut down the first computer and move student to another

computer that has been properly set up for testing. Student should be able to resume testing where he/she

left off if the responses were saved to the network. If a student cannot continue testing, document the

issue and determine whether invalidation is appropriate.

Test AdministratorSupervise Test Administration

Page 66: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

66

Test Administrator PearsonAccess – During Testing

Resume Students’ Tests• Student exits TestNav (either unintentionally or intentionally) before

completing a test.• School Coordinator or Test Administrator must resume the test

before student can continue.1. On Session Details screen, click the check box next to the name of the

student. Student cannot be resumed if he/she has a Ready, Submitted, or Marked

Complete status.2. Click Resume Test (resumes the student’s test from the point at which

the test was interrupted). System will upload any test responses that the student entered and that were

saved. Once the connection to the testing server is reestablished and the student is

in Resumed-Upload status, the saved responses are transmitted to the testing server and added to the responses already stored there.

Page 67: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

67

Test AdministratorChecklist – After Testing

Verify that you have collected all required administration information, including accommodations actually used by each student.

Report any missing materials to your school assessment coordinator.

Verify that Security Logs were completed correctly.

Organize materials and return to your school assessment coordinator.

Complete the CBT Test Administrator Comment Form at www.FLAssessments.com/SpringRMS or to the appropriate EOC Comment form under Pearson>Support>Resources.

Page 68: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

68

Test AdministratorSteps for Returning Test Materials to School Assessment Coordinator

1. Notify school assessment coordinator immediately if any of the following are missing: Student Authorization Tickets Session Rosters Work Folders Reading Passage Booklets Reference Sheets

2. Verify that you have collected all required administration information. Ensure that all accommodations used by each student

are included.3. Verify that your Security Log has been completed

correctly.4. Return all materials to school assessment coordinator.5. Complete a CBT Test Administrator Comment Form.

Page 69: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

69

Test AdministratorComment Form

Complete Comment Form

• Please provide feedback that will be meaningful to the FDOE and the test contractor.

Go to www.FLAssessments.com/SpringRMS or to the appropriate EOC Comment form under Pearson>Support>Resources. .

Click the CBT Test Administrator Comment Form and complete the form.

THAT WASTHAT WASTHAT WASTHAT WAS

Page 70: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

APPENDIX B

Technology Coordinator

Before, During, and AfterTesting

Page 71: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

71

Technology CoordinatorChecklist – Before Testing

Read the test administration manual. Read the Test Administration Policies and Procedures and

sign the FCAT CBT Administration and Security Agreement.

Ensure all workstations meet the minimum requirements, including screen resolutions set to 1024 x 768.

Confirm TestNav 6.9 software has been installed (file share or local install) on all computers to be used for testing.

Ensure all student workstations have successfully loaded the Infrastructure Trial.

Meet with the school assessment coordinator to discuss the administration of the computer-based test and to walk through the test administration.

Page 72: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

72

Technology CoordinatorChecklist – Before Testing

Discuss and implement plans for handling possible technical interruptions during testing.

Run the TestNav System Check to determine the amount of bandwidth needed for testing.

Evaluate the testing locations in the school to ensure availability of sufficient electrical outlets and network jacks.

For wireless testing, ensure appropriate security protocols are used. The three most common protocols: Wired Equivalent Privacy (WEP) Wireless Access Protocol (WAP) Wireless Access Protocol Version 2 (WAP2) – RECOMMENDED

– highest level of security Verify that specified applications have been disabled prior

to computer-based testing. screen savers, automated virus scan software, remote access

applications, and the Macintosh control strip

Page 73: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

73

Technology CoordinatorChecklist – Before Testing

Computers used for test administration activities (i.e., PearsonAccess) have the appropriate required version of a standard Internet browser based on the operating system in use on the computer and the browser’s pop-up blocker is disabled.

School has a high-speed connection to the Internet AND the connection is not over-allocated.

If a firewall is used, appropriate destination/port/protocol combinations are allowed through the firewall.

Any proxy servers have been checked to ensure that the appropriate URLs are not blocked.

Internet content filters are configured to allow the specific IP addresses required for administering computer-based testing.

Proctor Caching computers have been set up properly.

Page 74: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

74

Technology CoordinatorChecklist – Before Testing

A printer (color is not required) is available for printing the Student Authorization Tickets and Session Rosters.

School technology coordinator has analyzed the network to determine whether network bottlenecks exist.

Confirm that student computers and the Proctor Caching computer have not been updated with any additional software and will not be updated before testing begins.

Confirm that test content has been cached for all scheduled test sessions. Test content is available one week prior to the test administration window.

Verify that the performance of your Internet connection is consistent with expected levels of performance for computer-based testing.

Alert your Internet Service Provider to your computer-based testing window, and also confirm that no scheduled maintenance or outages are planned during that entire window.

Page 75: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

75

Technology CoordinatorChecklist – Before Testing

If utilizing wireless network connections for computer-based testing, ensure that all computers can effectively communicate with their access point from the testing location.

If utilizing wireless network connections for computer-based testing. Ensure that all security measures have been properly enabled. Ensure that laptops are connected to AC power. If batteries

must be used, ensure that they are fully charged and have the capacity to last for the entire test session.

Ensure that each computer station is equipped with a keyboard and mouse (or other pointing device).

Disable instant messaging and email notification. Disable screen savers, power savers, and remote desktop.

Page 76: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

76

Technology CoordinatorChecklist – Before Testing Disable or delay anti-virus, auto-scan and/or auto-update, system

restore utilities, Windows Security Firewall, web content filtering, or other software that may impact CPU speed or scan/block information transferred between the workstation and the servers.

Alert your school to the dates and times for computer-based testing and require students and teachers not testing to refrain from using any streaming media or other high-bandwidth applications while students are testing.

Ensure student workstations and the user profiles and logins being used for testing allow full permissions (read-/write-/modify-) to the TestNav/Temp and TestNav/Logs directories.

Ensure that the primary and secondary save locations are set for student response files and that students have read-/write-access to these locations.

Ensure that test administrators are familiar with how to access TestNav software from student workstations and how to access the student comment forms (if shortcuts are provided).

On each day of testing, the Proctor Caching computer and Proctor Caching software will be turned on and remain running.

Page 77: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

77

Technology CoordinatorChecklist – During Testing

Ensure Proctor Caching software is running on all Proctor Caching computers.• Turn on Proctor Caching software

Windows: go to Start>All Programs>Proctor Caching>Proctor_Caching

Mac: once Proctor Caching is initiated it will not have to be restarted unless it has been manually stopped.

Monitor each testing room to ensure that there are no technical issues.

Be available during testing to answer questions from test administrators.

Page 78: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

78

Technology CoordinatorTasks – After Testing

Purge Test Content from the Proctor Caching Computer It is strongly recommended that test content be

purged from the Proctor Caching computer after each test administration window.

Windows Platforms1. Go to Start>Programs>Proctor Caching>Purge Cache.2. Click Delete to confirm that you would like to purge the cache.

If the Proctor Caching computer is not currently running, the cached items will not be removed until the next time it is started.

Mac Platforms1. Proctor Caching software includes functionality to purge all

content from the cache.2. To purge the cache, use the same script that was used to install

Proctor Caching.

Page 79: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

79

Glossary of Terms• Proctor Caching is a process of loading or “caching” test content

locally on a computer at the school level. Does not require a separate caching server and can run on any

workstation on the network that meets minimum requirements. Proctor Caching software is provided by Pearson. Reduces test delays due to network congestion. Provides students with a more seamless testing experience. Required for all FCAT/EOC computer-based testing in Florida.

• Proctor Caching Network Diagram

Page 80: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

80

Glossary of Terms

• TestNav 6.9 (TestNav) Platform that Florida will use for high-stakes computer-

based statewide assessments. Software application installed either on a file server or

on each computer that will be used for testing.

Page 81: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

81

Technology Coordinator PearsonAccess – After Testing

Pearson Access instructional slides included in full version

Page 82: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

82

Technology CoordinatorComment Form

Complete Comment Form

• Please provide feedback that will be meaningful to the FDOE and the test contractor.

Go to www.FLAssessments.com/SpringRMS or to the appropriate EOC Comment form under Pearson>Support>Resources.

Click the CBT Technology Coordinator Comment Form and complete the form.

THAT WASTHAT WASTHAT WASTHAT WAS

Page 83: BREVARD Spring 2011 Computer-Based Testing FCAT/EOC TRAINING Presentation

83

2010-11 7 8 9 10 11 12

2009-10 6 7 8 9 10 11

2008-09 6 7 8 9 10

2007-08 6 7 8 9

ALG 1 EOC: WHO TESTST?

IF we have to test students who took Alg 1 or an equivalent course prior to 2010-11, WHO DO WE INCLUDE???

1. First, any student who completed Alg 1 or an equivalent course this school year must participate in the assessment , no matter what grade they are in.

2. IF the Florida statue is not changed to waive PREVIOUS Alg 1 students: You will test students who earned high school credit in Algebra 1 while in grades 6 through 9 during the 2007–2008 through 2009–2010 school years and who have not taken Grade 10 FCAT Mathematics must take the Algebra 1 End-of Course Assessment during the 2010–2011 school year.