test chairpersons training march 26, 28, and 29

Florida Department of Education

John L. Winn, Commissioner

Test Chairpersons TrainingMarch 26, 28, and 29

Spring 2007 Comprehensive English Language Learning

Assessment (CELLA)



Dare I Discuss Florida CELLA?



TRAINING OBJECTIVES

• Learn general information about the design and administration of CELLA and its uses

• Learn how to train test administrators to administer the CELLA group sessions



WHY ADMINISTER CELLA?

• CELLA measures the growth of students classified as English Language Learners (ELLs) in mastering the skills in English they will need to succeed in school

• CELLA provides evidence of program accountability in accordance with Title I and Title III of NCLB



Monitoring student progress over time Placement into, or exit from, English

for Speakers of Other Languages (ESOL) programs

Identifying students’ strengths and weaknesses in English

Results will NOT be used for Grade level placement Promotion or Retention decisions

HOW WILL THE RESULTS FROM CELLA BE USED?



WHAT’S NEW FOR 2007?

• 2007 Test Administration Manual (TAM) Revised to eliminate duplication of information.

• 2007 Directions for Administration (DFA) and Scoring Guides.

All levels (A-D) are included in one secure DFA.

• Answer sheet improved.• Supplemental order form revised.• Level A2 Reading/Writing cover

redesigned to avoid errors in administration.



CELLA SCHEDULE OF ACTIVITIES

January 12 Student identification information for ESOL students is submitted.

March 26, 28 and 29 CELLA training sessions for Test Chairpersons.

April 9-13 CELLA testing materials are delivered to schools via Comet Delivery Services.

April 16 – May 25 CELLA testing window.



CELLA SCHEDULE OF ACTIVITIES CONTINUED

April 16 - 20 Recommended window for CELLA group administered sessions in all senior high schools.

April 23 - 27 Recommended window for CELLA group administered sessions in all elementary, middle and K-8 centers.

April 30 – May 4 CELLA group-administered make-up sessions.

May 14 – May 25 OPEN window for return of CELLA testing materials to TDC.

May 29 and 30 Final return of CELLA testing materials to TDC.

August CELLA score reports provided to schools.



STUDENTS TO BE TESTED

• All students classified as ESOL at the time of CELLA testing are to be tested.

• All new students who respond affirmatively to the Home Language Survey must be assessed for English language proficiency using the OLPS within 20 days of entry to the district.

• (New) Any ESOL students who were exited from the ESOL program as of August 18, 2006 (classified as former Limited English Proficient (LEP)), must be included in the spring 2007 administration.



ESOL STUDENTS EXEMPTED FROM TESTING

• Students entering the school district on or after March 12, 2007 with affirmative responses to the Home Language survey would not be included in the Spring 2007 administration, even though the OLPS and placement may be completed prior to the end of the testing window.

• The 20-day requirement for assessment English language proficiency is waived for the period between March 12, 2007 and May 25.



OVERVIEW OF CELLA

Test Levels:Level A (Grades K-2)Level B (Grades 3-5)Level C (Grades 6-8)Level D (Grades 9-12)

Test Sections and Formats:Listening: Multiple Choice (MC)Speaking: Constructed Response (CR)Reading: MCWriting: MC and CR



TEST DOCUMENT CONFIGURATIONON GRADE LEVEL – ALL SECTIONS

Grade Level Test Materials

Kindergarten and Grades 1 & 2 • Level A Student Test Book

Grades 3, 4, and 5 • Level B Listening & Speaking Test Book• Level B Reading & Writing Test Book• Level B, C & D Answer Sheet

Grades 6, 7, and 8 • Level C Listening & Speaking Test Book• Level C Reading & Writing Test Book• Level B, C & D Answer Sheet

Grades 9, 10, 11 and 12 • Level D Listening & Speaking Test Book• Level D Reading & Writing Test Book• Level B, C & D Answer Sheet



TEST BOOKLET CONFIGURATIONON GRADE LEVEL – ALL SECTIONS

Level A: Grade K - 2

Level B: Grades 3 - 5

Level C: Grades 6 - 8

Level D: Grades 9 - 12



CELLA TEST SECURITY

• All CELLA testing materials are to be secured.

• Test administrators must account for ALL test materials assigned to them.

• Test administrators must sign the Florida CELLA Administration and Security Agreement



DETERMINING TEST LEVELS TO BE USED

Listening and Speaking: ESOL Levels 1-4 MUST be administered on grade level to ALL ESOL students in grades K-12

Reading and Writing: ESOL Levels 3-4On grade level for ALL ESOL

students in grades K-12Exception: a small number Special

Education (SPED) students Reading and Writing: ESOL Levels 1-2

Grades 3-12, test at 1 lower level.



DETERMINING LEVELS TO BE USEDCONTINED

• Example: An ESOL Level 1 student in grade 5 will take Level B, Listening and Speaking and record all answers in the Level B, C, and D Answer Sheet. The student must take the Level A Reading and Writing test, recording all responses in the Level A Reading and Writing

test book.

andand



CELLA TEST LEVELSFUNCTIONAL LEVEL TESTING

Grade Level ESOL Level Reading/Writing Level

Speaking/Listening Level

K-2 ALL A A

3-51-2 A

B3-4 B

6-81-2 B

C3-4 C

9-121-2 C

D3-4 D



LOCATOR TEST

• Will ONLY be used for some SPED students in ESOL Levels 3 and 4

• Testing the Reading & Writing sections at the student’s functional level

• Allows ESOL Level 3 and 4 SPED students in grades 3-12 to take a lower level if their literacy skills are at a more basic level

• The Locator Test can be used to determine which level is appropriate



LOCATOR TESTCONTINUED

Only for some SPED students in ESOL Levels 3 and 4

Directions for Administration

Locator Test Booklet



CONTACT INFORMATION

• For specific questions concerning the locator test and your SPED students ESOL Levels 3 or 4, please contact the Division of Special Education, at 305 274-8889.



CELLA ITEM TYPES LISTENING AND SPEAKING

Listening:• Listen & Match• Picture Description• Short Talks• Extended Listening

Speaking:• Oral Vocabulary• Speech Functions• Personal Opinion• Story Retelling• Graph Interpretation



CELLA ITEM TYPES READING

Vocabulary:• Synonym• Antonym• Idiom• Root & Affix

Comprehension:• Main Idea• Detail• Inference/Prediction• Reference• Rhetorical Elements• Vocabulary in Context



Multiple Choice:• Grammar, structure

& written expression

• Paragraph choices• Recognizing errors

CELLA ITEM TYPESWRITING

Constructed Response:• Writing sentences• Writing paragraphs



CELLA LEVEL A

GRADES K-2



LEVEL A MATERIALS• Two Test Book Forms:

Level A Student Test Book, including the Core and the Extension (orange in color): Grades K-2 students

Level A Reading/Writing Book (green in color):Grades 3-5 ESOL levels 1-2 for functional level testing only

• Level A Listening and Speaking CD

• Directions for Administration and Scoring Guide Book

Level A section begins on page 5



ADMINISTERING LEVEL A

• All sessions should be individually administered to students in kindergarten.

• One-on-One (Speaking) is administered individually at all grade levels

• Grades 1 and 2 may take Listening, Reading and Writing in small groups.

• Grade 2 will take the “Extension Section” which includes additional items in Reading and Writing.



CELLA Sessions Level A Grades K-2

Grade

Listening Reading WritingOne-on-

One (Speakin

g)

K

15 Questions(approx. 15

minutes)Individually

Administered

CD required

15 Questions(approx. 15 minutes)

IndividuallyAdministered

7 Questions(approx.15 minutes)




1st

15 questions(approx. 5 minutes)

Administered in small groups

CD required



7 questions(approx. 15

minutes)



minutes)

Individually administered

2nd


minutes)


CD required




minutes)



minutes)




LEVEL A LISTENING

• The Listening section is divided into three parts and is paced by a script that can be delivered in 2 ways:

Recorded Delivery: playing the CD

Administrator Delivery: reading the

script aloud

Approximate testing time is 15 minutes.



Level A Reading

Core Level A items (1 – 15) are delivered by script and read aloud by the test administrator.

Approximate testing time is 15 minutes.

Extension Level A items (16 – 5)administered in Grade 2 only contain reading comprehension passages that are completed by the student independently.

Approximate testing time for both the Core and Extension is 30 minutes.



Level A Writing

Core Level A items (1-7) will take approximately 15 minutes to complete.

Extension Level A items (8-16) administered in Grade 2 only contains editing tasks and prompts to write sentences and paragraphs. Approximate testing time for both the Core and the Extension is 30 minutes.



When to use Level A Reading/Writing Test Booklet

• ESOL level students 1 and 2 in grades 3-5 will a need a Level A Reading and Writing Test Book

• These students will also need a Level B Listening and Speaking Test Book and a Level B-D Answer Sheet



Level B-D for Grades 3-12

Individually Administered:Speaking

Group Administered:ListeningReadingWriting



MATERIALS: LEVEL B-D

• B-D Answer Sheet

• Directions for Administration and

Scoring Guide Book

• Listening/Speaking Test Booklets for B,

C, and D

• Reading/Writing Test booklets for B, C,

and D

• Listening CDs for B, C, and D



CELLA SESSIONS LEVELS B-D GRADES 3-12

Levels Listening Reading* Writing*

One-on-One (Speaking)

BGrades

3-5


minutes)

CD required

26 Questions(approx. 45 minutes)

Administered in groups


minutes)




CGrades

6-8


minutes)


CD required




minutes)



minutes)


DGrades

9-12


minutes)


CD required




minutes)



minutes)


* DROP DOWN ONE LEVEL FOR ESOL LEVELS 1-2



ADMINISTERING LISTENING AT LEVELS B-D

Grade Levels: 3-5 (B)6-8 (C)9-12 (D)

• Test design is identical across levels for Listening

• Listening is all multiple-choice



LEVEL B-D LISTENING

• Divided into four parts• Script contains all of the test items

to which students must respond.• Script can be delivered in two ways:

Recorded Delivery: playing the CDAdministrator Delivery: reading the

script aloud

• Approximate testing time is 25 minutes.



LEVEL B-D READING

• Divided into two parts:Part one: Students answer

discrete vocabulary questions.Part two: Students read

passages and answer questions about each passage.

• Approximate testing time for the Reading section is 45 minutes.



LEVEL B-D WRITING

• Divided into four partsPart one and Part two contain

multiple-choice questionsParts three and four require

students to write sentences and paragraphs, respectively

• Approximate testing time for the Writing sections is 70 minutes



IMPORTANT REMINDER

• Students in grades 3-5 who are ESOL 1 and 2 use two answer documents:

• Level B Listening/Speaking answers will be recorded on the level B, C, and D Answer Sheet.

• BOX #22 of the answer sheet must be bubbled YES.

• Level A Reading/Writing answers will be recorded directly in the test book.

• Labels ‘link’ the two answer documents



IMPORTANT TEST ADMINISTRATION DETAILS

• Do not allow the students to use any extra paper or scratch paper.

• Only answers written in the spaces provided will be scored.

• All responses must be recorded with a No.2 pencil.

• If a student makes an error, ensure that they have erased it completely (do not use correction fluid).

• Thesauruses, dictionaries, or similar tools are not permitted.



Student DemographicInformation



Sample of a Pre-ID Label



Student Pre-ID Labels• Students entering after January 12,

2007, will not have pre-id labels. • Each student will have 3 pre-id labels

– Used to ‘link’ multiple answer documents if necessary

• The following information must be correct for a label to be used:

• Name, (First and Last)• Date of Birth• Grade• School• District



Incorrect or No Pre-ID Labels

If a student does not have a label, OR

If any of the printed information is incorrect, so that the label cannot be used,

THENAll demographic information must be bubbled in on the answer document.

Page 20-22 of the Test Administration Manual provides information on bubbling in the demographics information. All fields must be filled out.



LINKING LABELS

Required for: • ESOL level 1 and 2 students in grades 3-5; • Taking the Level A Reading and Writing; and

Level B Speaking and listening, and • Did not receive a Pre-ID label.

• Linking labels ensure the accurate match of the student’s two answer documents

• If such a student DOES have Pre-Id labels, use those instead.



SPECIAL ADMINISTRATIONS

The Division of Special Education, 305 274-8889, will provide assistance with questions concerning:

– Special accommodations and test administrations issues regarding

(Braille, large-print, deaf, and hard-of-hearing)

Reminder: No Braille version of Level A Test Books. CELLA will not be

administered to these students



DAMAGED OR SOILED ANSWER DOCUMENTS

School Coordinator transcribes the information from the damaged answer document onto a new document.

Mark the damaged documents with a large ’X’. Return damaged answer documents with the brown “Not To Be Scored” boxes.

Bundle the new transcribed answer document with the other “To Be Scored” materials for that grade.



Soiled Answer Documents

For soiled materials, call Student Assessment and Educational Testing at 305 995-7520. Provide the serial number, then destroy the soiled document.



Test Administration Irregularities

• Examples which may require invalidation upon completion of a full investigation:– Student(s) caught cheating– Student(s) very disruptive– Fire alarm or similar event occurs during the testing

session– Student becomes ill and is unable to finish– Student is removed by a parent prior to the end of the

allotted time for testing– Administration time limited (No CELLA sessions have

time limits)

• Each circumstance should be treated individually. – Call Student Assessment and Educational Testing,

(SAET) and report any such irregularities– If the incident involves a test security violation, a

written memorandum to SAET will also be required.



2007 Florida CELLA Test Irregularities Report Form

•Appendix A

This form should be used to report any security violations, misconduct, or other incidents.

Place all completed original forms inside on top of the first white box.

•



SCHOOL COORDINATOR ROLESMANAGE MATERIALS

Receipt of Materials Keep all boxes in which materials arrived. Request additional materials from TDC as soon as possible. Remove the shipping notice from Box 1. Verify the quantity of each item received.

Track Materials Ensure an internal tracking system is used to track all test

materials Directions for Administration and Scoring Guide Secure Test booklets and answer sheets CDs

Count and verify materials distributed to and received from test administrators Always store all testing materials in a secure locked

location.



SCHOOL COORDINATOR ROLESPREPARE FOR ADMINISTRATION

Train Test Administrators for Group Administration– Ensure the appropriate number of test

administrators and proctors are available

– Ensure that test administrators understand their roles and are prepared prior to testing

Coordinate individual administration with contracted employees



SCHOOL COORDINATOR ROLESDURING TESTING

Testing Environment– Rooms used for testing should provide the following:

• Good lighting

• Comfortable temperature

• Proper ventilation

• Freedom from noise and interruption

• “Do Not Disturb --- Testing in Progress” sign on the door

Supervision of Test Administration and Test Security– Monitor group and individual administration



Test Administrator Roles & Responsibilities

• Prior to testing• Must appropriately account for and protect

the security of the test materials. Test administrators can use the CELLA security log or a school developed security log.

• Need to become familiar with the Directions for Administration and Scoring Guide.

• Must maintain a record of exemptions, absences and invalidations.



Test Administrator Roles & Responsibilities

Continued

• During the Test Administration

• Post “Do Not Disturb --- Testing in Progress” sign on the door.

• Must make sure students are on task.

• After Testing• Be sure to report any problems to

the school’s test chairperson and complete a Florida CELLA Irregularity Report if necessary.



RETURN OF CELLA MATERIALS

Please refer to the return instructions provided in the training packet ONLY.

To Be Scored • Bundle answer documents by grade level.• Bundle documents by type (test books separate from

answer sheets within grade) in grades 3-5 if applicable.• Place a Grade Header on the top of each grade.• Secure bundles with paper bands.• Place a School Header at the top of all grades in Box #1.• Place originals of all forms on top of the School Headers.



NEW RETURN NEW RETURN PROCEDURESPROCEDURES

• CELLA materials will be picked up at the school sites.

• Fill out the 2007 Florida CELLA School Coordinator Materials Return Form

• Fax copies to ETS at 1-866-387-2598and Student Assessment and Educational Testing at 305 995-7522

• Call Eagle Logistics at 1-800-888-4949 for pick-up



NEW RETURN NEW RETURN PROCEDURESPROCEDURES

• Package materials according to the instructions in your packet.

• However . . .

• Do not return materials to TDC as instructed in your packet.

• Disregard return instructions in the CELLA manual.



RETURN OF CELLA MATERIALSCONTINUED

Not To Be Scored• Organize materials in the following order:

– All Florida CELLA School Coordinator’s or Test Administrator’s Suggestion Forms,

– All CDs,– Test Administration Manuals,– Directions for Administration and Scoring Guide,– Unused Level A answer books,– Test Booklets (Levels B, C, and D),– Unused answer sheets,– Unused linking labels or pre-id labels,– Damaged materials (answer sheets or test booklets),– Invalidations (answer sheets or test booklets), and– Absences (answer sheets or test booklets).



RETURN OF CELLA MATERIALSCONTINUED

• Wrap like materials with paper bands.

Return all To Be Scored and Not ToBe Scored materials to TDC

Open Window: May 14 – 25Final Return: May 29 - 30



District Level Training Contact Information

CELLA Program Dr. Joanne Urrutia, Administrative Director, Division of Bilingual Education and World Languages, 305 995-1945

Individual administrations of One – on – One or Speaking Sessions

Ms. Beatriz Pereira, Executive Director, Division of Bilingual Education and World Languages, 305 995-7430

Group Administered Sessions

Ms. Mayda Cabeza, Director I,Student Assessment and Educational Testing, 305 995-7520 [email protected]

Test Materials Ms. Magaly Hernandez, Supervisor I, Test Distribution Center, 305 995-374313135 SW 26 Street, Miami Fl. 33175Hours of Operation: 7:30a.m. – 3:30p.m.

Special Accommodations for SPED students

Ms. Rosalia Gallo, Instructional Supervisor, Division of Special Education, 305 274-8889 or [email protected]

test chairpersons training march 26, 28, and 29

Documents

administration of cella

florida cella

cella testing window

new students

cella testing materials

time of cella testing

level d grades

level c grades