spring 2012 training materials

1

Spring 2012Training Materials

Writing

2

Overview

These training materials are designed to highlight important information regarding test administration policies and procedures. Not all information from the test administration manual is included in this presentation, so it is imperative that district and school staff read and familiarize themselves with all information in the manual in addition to using these training materials.

3

Overview

• These training materials are based on the 2011-12 Writing Test Administration Manual.

• There are separate training materials for FCAT/FCAT 2.0 RMS and Spring 2012 Computer-based Tests.

• Training materials are available in PearsonAccess under the Support tab.

4

Daily Administration Schedule

Day 1 – Tuesday, February 28

Grades 4, 8, 10 Writing Test45 minutes

Day 2 – Wednesday, February 29

Grades 4, 8, 10 Writing Make-Up Test45 minutes

Day 3 – Thursday, March 1

Grades 4, 8, 10 Writing Make-Up Test45 minutes

Any deviation from this schedule requires written approval from the FDOE prior to implementation.

5

What’s New

STUDENT PLEDGE • Prior to testing, students are required to read and sign a

student pledge.

• If a student refuses to sign, this must be noted in the record of required administration information, but the student should be allowed to test. (This has been updated since the manual was finalized in Fall 2011)

• The Student Pledge is located on the back page of the student planning sheet.

6

What’s New

SEATING CHARTS• Test administrators are required to maintain an accurate

seating chart for each group of students in their rooms during testing.

• All seating charts must indicate the front and back of the room, as well as the direction the students are facing.

• If students are moved to a different location during testing, a new seating chart must be created and maintained for this location.

7

What’s New

TEST ADMINISTRATORS• ALL test administrators must be certified educators.

• Test administrators are required to sign a Test Administrator Prohibited Activities Agreement in addition to a Security Agreement. Certification numbers must be recorded on this document.

• The FCAT Administration and Security Agreement has been revised to emphasize the importance of proper training and the possible consequences of test administration irregularities.

8

What’s New

• Districts must make arrangements to test Florida Virtual School (FLVS) Full-Time public school students, as well as other virtual program students, per Section 1002.45(6)b, Florida Statutes (F.S.).

• Materials for K–8 Virtual Continuity (Florida Virtual Academy) Program students will no longer be returned in separate envelopes.

9

What’s New

Test Group Codes• Writing folders do not contain a field for a test

group code; however, test group codes must still be used to identify groups of students tested together.

• Test group codes must be recorded with required administration information on Administration Record/Security Checklists as well as on seating charts.

10

What’s New

Writing Folders• The writing prompt is included in the Writing folders, as it had been

in years prior to the Spring 2011 FCAT Writing administration.

• Writing folders include security numbers to assist in the tracking of these secure documents.

• School assessment coordinators and test administrators must maintain records of required administration information that include the security numbers of Writing folders assigned to them.

• A security number consists of a nine-digit number followed by a check digit (located in upper right corner of Writing folders).

11

Reminders

• Inappropriate actions by school or district personnel before, during, or after test administration may result in consequences such as test invalidations and/or loss of teaching certification.

• District assessment coordinators must ensure that all school administrators, school assessment coordinators, test administrators, and proctors receive adequate training prior to test administration.

• All personnel involved in test administration must read and sign an FCAT Administration and Security Agreement, provided in Appendix C, and test administrators must sign a Test Administrator Prohibited Activities Agreement, also provided in Appendix C.

12

Reminders

• Students may not have any electronic or recording devices including, but not limited to, cell phones and smart phones, at their desks, in their pockets, or anywhere they can reach them during testing, even if the devices are turned off or the students do not use them.

• If a student is found to be in possession of ANY electronic device(s) during testing, his or her test must be invalidated in order to successfully enforce this policy. Students and parents must be made aware of this policy prior to testing.

13

Reminders

• If a student begins a session and leaves campus without finishing (due to an appointment, illness, etc.), he or she will NOT be allowed to complete that session.

• No exceptions will be made once the student leaves the school’s campus, so parents and students must be made aware of this policy.

• If you have concerns about a student, you should not allow the student to begin. Instead, arrange to administer the test to that student on a make-up day.

14

Reminders

• Test administrators are required to use ALL of the allotted time for the Writing tests and should not end a test early or collect test materials prior to the end of the allotted time.

• Test administrators must NOT administer the FCAT to their family members. Students related to their assigned test administrator should be reassigned to an alternate test administrator.

• Administration manuals must be provided to itinerant teachers in time for them to prepare adequately for the test. These teachers must also be included in test administrator training.

15

Students to be Tested

• In general, all Florida public school students enrolled in the tested grade levels (Grades 4, 8, and 10) participate in FCAT Writing, per s. 1008.22(3)(c)8, F.S. Students must take the appropriate test for the grade level in which they are enrolled.

• All Grades 4, 8, and 10 students, including retained students, are required to participate in FCAT Writing. Special documents (large print and braille) are available for the Spring FCAT Writing Test, and administration accommodations may be provided to eligible students with IEPs, Section 504 plans, or ELL plans.

16


Special Program Students• Make arrangements to test special program

students (Home Education, Virtual School, McKay Scholarship, FTC Scholarship).

• Ensure that grid sheets and Document Count Forms for these students are completed properly, according to the chart on page 6 of the manual.

17


English Language Learners (ELLs)• Per the Department’s Office of Student Achievement through Language

Acquisition, all ELLs are expected to participate in FCAT Writing.

Students With Disabilities• All students with disabilities participate in the statewide assessment

program by taking one of the following: – FCAT without accommodations,– FCAT with accommodations, or– Florida Alternate Assessment.

• All determinations regarding participation in the statewide assessment program must be documented in the student’s IEP or Section 504 plan. See Appendix A of the manual for information regarding accommodations.

18

Test Materials

• Writing Folders– Grade 4– Grade 8– Grade 10

• Planning Sheets

19

PreID Labels

• School personnel must adhere to the following policies as they prepare student materials:

– Only the school assessment coordinator and school personnel designated by the building/site administrator may open the shrink-wrapped packages and affix labels.

– Do not use student labels from previous administrations.

– Students are not permitted to assist in preparing secure materials before testing or in organizing and returning materials after testing.

– All secure materials must be returned to locked storage and remain there until testing.

20

PreID Labels

• PreID labels and rosters arrive separately from test materials.

• The PreID roster should be verified against the school’s student information database.

• Verify that the student is still enrolled and will be tested.

• FIVE elements MUST be correct on a student PreID label:– Student name– Student ID number– District number– School number– Grade Level

Destroy labels in a secure manner if ANY of this information is incorrect.

• If any other preidentified information (e.g., date of birth) is incorrect, use the label.

21

PreID Labels

• Affix the label in the box in the lower left corner of the student grid sheet.

• Do not remove labels once they have been affixed.

• Do not place a label over another label.

22

PreID Labels

• If the student name, student ID number, district number, school number, or grade level is INCORRECT on a USED Writing folder, the student must, under the supervision of the test administrator, transfer his or her exact response into a replacement answer document.

• The student grid sheet of the replacement folder MUST be gridded.

• Grid the DNS bubble on the folder with the incorrect label affixed and set it aside to be returned to the school assessment coordinator with all other NOT TO BE SCORED materials.

23

Security Numbers

• As directed by the school coordinator, test administrators may use the pre-populated administration record/security checklist, a blank copy of the checklist, or may make his/her own comprehensive record of security numbers.

• Security number(s) of the document(s) assigned to and returned by each student should be recorded and verified at the completion of each day of testing.

• Security numbers of secure materials not already listed on the checklist (e.g., materials distributed from district overage) MUST be added to the record with the names of the students to whom the test materials are assigned.

24

Pre-populated Security Checklist

In Pearson Access: • Test Setup > Order Additional Materials and Tracking > Reports• Select “Security Checklist Detail” from the drop-down list

25

Test Invalidation

• A test MUST be invalidated if either of the following circumstances occurs:– A student has an electronic device during testing.– A student is cheating during testing.

• A test MAY be invalidated if one of the following circumstances occurs:– A student becomes ill and is unable to finish.– A student is not allowed the correct amount of time.– A error occurs in the administration of an accommodation.– An error occurs in test administration or procedures.– A student is disruptive during testing.

26

Test Invalidation

• District assessment coordinators should advise schools of the appropriate course of action if invalidation is being considered. Remember that the purpose of invalidation is to identify when the validity of test results has been compromised.

• When a student’s test is invalidated for any reason, return the invalidated test with the DNS bubble gridded with all other TO BE SCORED materials.

• More information about test invalidation and instructions for defective materials may be found on pages 16-17 of the manual.

27

Testing Location

• The test should be administered in a room that has comfortable seating, good lighting, and sufficient workspace.

• There must be at least three feet between students.

• Make sure that students are not facing each other when seated at tables and are not in seating (stadium or staggered) that allows them to easily view other students’ answers.

• Students may not have access to any unauthorized aids.

28

Required Administration Information

• Test Administrators must record and maintain the following Required Administration Information:– Students assigned to the room– Attendance information– Test group code– Unique security number of secure documents assigned

to each student– Grade level– Signatures of test administrator and school assessment

coordinator– Dates for when documents are received and returned

29

Seating Charts

• An accurate seating chart must be maintained for each testing room for each test session. Seating charts must capture the following information:– the room name/number– student names and their location in the room during testing– date– starting time– test administrator name– names of proctors (if applicable)– test group code

• All seating charts must indicate the front and back of the room, as well as the direction the students are facing.

• If students move around or change seating during a test session, a new seating chart must be created.

30

Security Log

• A Security Log must be maintained for each testing room.

• Anyone who enters a room for the purpose of monitoring a test MUST sign the log for that testing room.

31

Test Administrator before testing

• Assemble Materials– Test Administration Manual is needed on the day of

testing to read scripts to students, to ensure accurate timing for test sessions, and as a reference to avoid testing irregularities.

– Test Group Codes will be provided by your School Assessment Coordinator; a unique code must be recorded on your required administration information and seating chart.

– Test Administrator Checklist (located in Appendix C)

32


• Assemble Materials (cont’d)– Signs (located in Appendix C)

• Do Not Disturb (posted on entrances to the testing room)• Electronic Devices (displayed for students)

– Security Log (located in Appendix C)– Seating Chart – Record of Required Administration Information – Pencils for students, if needed– Watch or Clock to keep accurate time during testing

33


• Sign and return an FCAT Security Agreement, which indicates that the test administrator:– Has received training– Understands and agrees to adhere to all test security

and administration policies and procedures

• Sign and return a Test Administrator Prohibited Activities Form (certification numbers must be recorded on this form)

34

Test Administratorbefore testing

Special Documents • Ensure that the correct procedures are followed for administering tests

to students using special documents.

• Student responses must be recorded properly in all special documents before they are submitted for scoring.

• Refer to the Special Document sections of the manual to ensure the correct treatment of these materials.

35

Test Administratorbefore testing

Special Documents • Test Administrators must familiarize themselves

with the information in the Special Documents section, including:– Test configurations and materials needed for testing– Special Scripts/Instructions for students who test using

Special Documents– Student Responses– Providing Accommodations– Preparing Special Documents for return

36


• Communicate Testing Policies to Parents and Students– Electronic Devices Policy—If students are found with ANY electronic

devices during testing, their tests will be invalidated. The best practice would be for students to leave devices at home or in their lockers on the day of testing.

– Leaving Campus—If students leave campus before completing the test (for lunch, an appointment, or illness, etc.), they WILL NOT be allowed to complete the test.

– Student Pledge—Students will be asked to sign a pledge prior to testing indicating that they will not give or receive unauthorized help during the test. If students are caught cheating, their tests will be invalidated.

37

Test Administrator during testing

• Ensure that you have a Security Log, a seating chart, and a form to collect required administration information for your room. Maintain these documents during testing.

• Read the appropriate administration script VERBATIM to students. Please read the important information and adhere to the instructions between the SAY boxes.

• FCAT Writing is administered in one 45-minute session – incorrect timing of a session may result in classroom invalidations. Keep accurate time and display times for students.

38


• Supervise test administration and ensure the following:– Students are using only No. 2 pencils – Students do not have books, notes, scratch paper, or

electronic devices of any kind during testing, even if they do not use them

– Students have signed the student pledge– Students do not talk or make any disturbance– Students are working independently– Students are recording their responses in the

appropriate area

39


• It is not appropriate to use cell or classroom phones, grade papers, or work on the computer during testing.

• While you may encourage students to continue working, you may not talk with them about the prompt or help them with their responses.

• If students finish the test before the allotted time for the session has elapsed, you may encourage them to go back and check their work. You may not collect test materials prior to the end of the 45-minute session.

40

Test Administrator after testing

• Make sure that each student returns his or her Writing Folder and Planning Sheet, and indicate on your record of required administration information that each folder is returned.

• Report any missing test materials and/or test security irregularities to your school assessment coordinator immediately.

• Ensure that the box in the top left corner of the student grid sheet has been completed by each student and that the gridded or preidentified information is accurate and complete.

• Return all materials to your school assessment coordinator, as described on pages 41-42 of the manual.

41

School Coordinatorbefore testing

• Receive Materials/Maintain Security– Box contents are listed on pages 43-44 of the manual.– Keep materials secure at all times.– No more than three individuals may have access to the

locked storage area.– Do not open shrink-wrapped materials or begin

preparing (applying student labels) more than one week prior to testing.

– Save the original boxes for returning special document materials.

– If you need additional materials or if you have questions, contact your district assessment coordinator.

42


• Train Test Administrators and Proctors– You are responsible for training all test administrators

and proctors, including non-school-based instructors (e.g., itinerant teachers). You must train several employees to act as possible alternates.

– Test Administrators must be certified educators.

– Test administrators who will be administering the test to students using large print or braille materials must be trained in the use of those test materials.

– For students with accommodations, make sure that test administrators are aware of and have made provisions for the exact accommodations needed for individual students.

43


• Train Test Administrators and Proctors– Distribute Test Administration Manuals and instruct

administrators to read all appropriate sections. Make sure they have manuals on each day of testing.

– Ensure all test administrators maintain the following according to the requirements in the manual:

• Records of Required Administration Information• Seating Charts• Security Logs

– Review test security policy and procedures and collect the following:

• Signed Security Agreements• Signed Test Administrator Prohibited Activities

Agreement

44


• Prepare for Testing– Distribute Test Group Codes to Test

Administrators– Assign Proctors to test sessions

• Proctors are required for rooms where 30 or more students are tested

• It is strongly encouraged to assign proctors to rooms where fewer than 30 students are tested

– Provide appropriate test settings• Ensure visual aids are covered or removed• There must be at least 3 feet between students• Test in classrooms whenever possible

– Make arrangements to test special program students not enrolled in your school, if any

45


Special Documents • Ensure that test administrators follow the correct procedures for

administering tests to students using special documents.

• Student responses must be recorded properly in all special documents before they are submitted for scoring.

• Refer to the Special Document sections of the manual to ensure the correct treatment of these materials.

46

School Coordinatorduring testing

• Supervise Test Administration– Provide test administrators with additional

materials during testing, as necessary.– Monitor each testing room to ensure that test

administration and test security policies and procedures are followed.

– Be available during testing to answer questions from test administrators.

– Make sure that Security Logs, seating charts, and records of required administration information are being maintained in each testing room.

47

School Coordinatorduring testing

• Maintain Security– After ANY administration, initial OR make-up,

materials must be returned to you immediately. – Materials must be placed in locked storage until they

are packaged for return.– Secure materials should never remain in classrooms

or be taken from the school’s campus overnight.– Report any testing irregularities or security breaches

to your District Assessment Coordinator immediately.

48

School Coordinatorafter testing

• Verify that all distributed secure materials have been returned. Notify your District Assessment Coordinator immediately if any secure materials are missing.

• Check for and remove any stray planning sheets from the Writing Folders.

• Make copies of the records of required administration information collected by test administrators and file the copies.

• Make copies of all Security Logs and seating charts and file the copies.

• Ensure that the DNS bubble has been gridded on invalidated tests and place the tests with TO BE SCORED materials.

49


Document Count Forms• Do not copy blank count forms; however, once the

count forms are completed, you may copy them for your records. If you need additional count forms, contact your district assessment coordinator.

• Place each completed form on top of the first stack of corresponding TO BE SCORED answer documents.

• Separate Document Count Forms must be completed for any special program student documents (Home Ed, Virtual School, etc.).

50

Ensure that the correct district and school numbers are gridded.

Grid the correct document type,number of documents under theform, and special documenttype, if applicable.

51


Paper Bands• Documents for each grade level must be banded

separately. You may use more than one paper band per grade level, if necessary.

• Follow these steps for each paper band you use:– In the space labeled District/School Number, write your district

number and your school number OR the special program school number.

– Count the number of TO BE SCORED answer documents that will be banded in each paper band. Write that number under Number of TO BE SCORED Documents Contained in This Paper Band.

52


Paper Bands• Under Number of Banded Stacks per Document Count

Form, number the paper bands 1 of n, 2 of n, etc., where n is the total number of banded stacks per Document Count Form.

• Place a paper band around each stack of TO BE SCORED answer documents. The Document Count Form must be under the paper band on top of the stack labeled 1 of n.

• Seal the paper band and be sure that it securely holds the documents. Do not use staples, paper clips, or tape.

53


• Use this chart on page 6 of the manual when completing Document Count Forms and Paper Bands.

54


• Prepare the following types of boxes for return to your district assessment coordinator:– All TO BE SCORED Writing folders—Red-labeled boxes– All NOT TO BE SCORED materials—Yellow-labeled boxes– All large print and braille materials, if applicable—White-labeled boxes – District Assessment Coordinator ONLY box

• It is your responsibility to package all materials correctly. Mispackaged materials will delay reporting of student results.

• See pages 83–84 of the manual for instructions on the packaging and return of large print and braille materials.

55


• Package Materials for Return– Place your school’s TO BE SCORED Writing Folders in the

boxes according to the diagram on page 57 of the manual.

– You may place materials for more than one grade level in a box.

– Place the appropriate colored label in the square on the top of each box that reads “Apply return shipping label here.”

– Labels may be placed over any existing shipping labels (e.g., vendor or carrier labels). Do not copy labels.

– If you need additional return labels, contact your district assessment coordinator.

56


District Assessment Coordinator ONLY Box• Place the following materials in the District Assessment

Coordinator ONLY box:– Test administration manuals (after Spring FCAT Writing test

administration) and unused non-secure materials (e.g., paper bands, count forms, labels)

– Unused planning sheets– Used planning sheets (with signed student pledge)– Original records of required administration information– Original Security Logs– Original seating charts

• Seal the box.• Write District Assessment Coordinator ONLY on the

side of the box.

57

Special Documents

• Pages 69-84 of the manual contain specific information and instructions regarding Special Documents (large print and braille). Each document type has its own section and set of instructions.

• Appropriate personnel must familiarize themselves with the information in this section, including:– Test configurations and materials needed for testing– Special Scripts/Instructions for students who test using Special

Documents– Student Responses– Providing Accommodations– Preparing Special Documents for return

58

Appendix A

• Appendix A of the manual contains detailed information regarding administration accommodations for students with disabilities and English language learners.

• All personnel involved in administering tests to students with allowable accommodations must familiarize themselves with the information in Appendix A.

59

Test Security Statuteand Rule

• Appendix B of the manual contains the following:– Florida Test Security Statute (1008.24)– Florida State Board of Education Test Security Rule

(6A-10.042)

• All personnel involved in testing activities, including handling and maintenance of test materials, must read and understand the information in Appendix B prior to signing a Security Agreement.

60

Ancillary Materials

• Appendix C contains the following documents to be copied and used prior to, during, or after testing:– FCAT Administration and Security Agreement– Test Administrator Prohibited Activities Agreement– FCAT Security Log– Administration Record/Security Checklist (blank)– Checklists

• Test Administrator• School Assessment Coordinator• District Assessment Coordinator

– Signs• Electronic Devices• Do Not Disturb

– Cover Sheets

61

PearsonAccessResources

• The following materials may be found on the PearsonAccess website under the Support tab:– Test administration manuals– Forms to report missing materials and test

irregularities/security breaches– Training materials– Comment forms– Blank Administration Record/Security Checklist– Security Log– Materials Return Lists– Braille Scripts

62

Comment Forms

• After testing, test administrators, school coordinators, and district coordinators are encouraged to complete a Writing comment form located at www.PearsonAccess.com/fl under the Support tab.

• Thank you for your valuable feedback!