National Assessment of Educational Progress

Felicia Mallory, Executive DirectorDenetra Collins, Staff Specialist

Overview of NAEP

• NAEP is mandated and funded by Congress and administered by the National Center for Education Statistics (NCES) in the U.S. Department of Education.

• Policy oversight is provided by the National Assessment Governing Board (NAGB). NAGB establishes the frameworks on which NAEP is based.

• Results of the assessments allow for comparisons between states and to the nation

• Results of NAEP are not connected to the No Child Left Behind measurement of adequate yearly progress (AYP). However, use of a common scale of achievement allows for the comparison of states’ assessment systems.

Florida State Statute 1008.22 (2)

“The Commissioner of Education shall direct Florida school districts to participate in the administration of NAEP . . . both for the national sample and for any state-by-state comparison programs.”

NAEP in Florida

Purpose of NAEP• A common nationwide measure of student

performance

• Reports changes over time.

• Provides results for the nation, states, and some urban districts.

• Secondary indicator for state progress and allows national comparisons between states and large urban districts

• Used by the President, Congress, and state leaders to set education policy

Features of NAEP•Broad subject-area assessments based on NAEP frameworks

•Limited number of schools and students within schools

•Item sampling –students take only a subset of test items

•Administered across the country by contracted administrators – minimal burden to schools

•Contains multiple-choice and constructed response questions

Sampling

•Every school and student has a chance of being selected for the sample.

•The sample is designed to be representative of the entire student population.

•Lists of schools are obtained by Westat from the National Center for Education Statistics Common Core of Data (CCD).

Reporting of NAEP Results

NAEP results are reported by:

• Scale scores – 0-300 or 0-500 depending on the subject

•Achievement levels – Basic, Proficient, Advanced

•Data is disaggregated by subgroups

Features of TUDA

• Provides district-level data to participating urban districts

•Provide a common yardstick to measure student achievement in comparison to

Other urban districts States Large Central Cities National Public Schools Census Regions

NAEP 2009 Assessed Components

OperationalComponents Grades

Reading 4, 8, 12

Mathematics 4, 8, 12

Science 4, 8, 12

Pilots and Special Studies Grades

Reading 4, 8

Mathematics 4, 8

U.S. History, Civics, Geography 4, 8, 12

Science Interactive Computer Tasks (ICT) and Science Hands-on Tasks (HOTs)

4, 8, 12

High School Transcript Study 12

National Indian Education Study (NIES)

4, 8

Improving NAEP SES Indicator Study

4, 8, 12

NAEP Instrument Design• Long Test, Short

Booklet– Each student gets a

small part of the test

– No individual student scores

• Test Questions– Multiple-choice– Open-ended

• Background Items– Student, teacher,

administrator questionnaires

R M R M R M

M R M R M R

R M R M R M

Mp Rp M R M R

Rp Mp R M R M

Science Interactive Assessments

•Science Interactive Computer Tasks (ICT) ( One 40-minute extended task and two 20-minute short tasks)

• Science Hands-on Tasks (HOTs) (Two 20 –minute short tasks and one 40- minute extended tasks)

Pre Assessment Visits (PAV)

• Meet with Westat Assessment Coordinator

•Scheduled between January 6 through January 24, 2009

•Allow about 2 hours

•Confirm participating students

Pre- Assessment Visit (PAV) Packet Contents

•Student Information Report—List of students selected for NAEP as well as their demographic information based on October FTE data

•NAEP SD and ELL Questionnaires (www.naepq.com)

•Roster of Questionnaires

•If Grade 12, School Questionnaire

•U.S. Department of Agriculture Letter

•NAEP Logistics Questionnaire

•NAEP Red Storage Envelope

•Parent/Guardian Notification Letter

Preparing for the Pre-Assessment Visit (PAV)

Obtain current list of students from the Office of Student Assessment and Educational Testing.

Distribute SD and ELL questionnaires to teachers, who are directly involved with the SD and ELL students selected for the assessment.

Collect completed questionnaires prior to PAV

Complete the 2009 Logistics Questionnaire.

Prepare the parent/guardian notification letter.

Request testing locations.

Parent/Guardian Notification Letter

•By law, NAEP requires that parents/guardians of all selected students be notified in writing about the assessment.

•Notification must be signed by a school representative and dated on school letterhead stationary.

•A copy of the letter should be faxed to The Office Student Assessment and Educational Testing and be given to the NAEP Westat Assessment Coordinator during the PAV.

•Templates of this letter in English, Spanish, and Haitian-Creole will be provided to the schools in hard copy and posted on-line at http://www.fldoe.org/asp/naep/naep2009.asp

During the PAVThe school NAEP coordinator will• Provide work space or area to review materials with NAEP field staff• Provide NAEP field staff with a current student

enrollment list provided to you by SAET• Verify student demographic information.• Confirm withdrawn and newly enrolled students.• Corrected NAEP Student Information Report• Provide SD and ELL questionnaires• Discuss and arrange accommodation sessions.• Receive NAEP Teacher Questionnaires.• Provide a copy of dated parent/guardian notification

letter.• Finalize assessment logistics with NAEP field staff after

they have completed their paperwork.

After the PAV The school NAEP coordinator will• Distribute the NAEP school and teacher

questionnaires (the questionnaires can be completed online).

• Send parent/guardian notification letters to all students selected for the assessment.

• Notify the students of the assessment.• Notify the teachers of the assessment.• Place the NAEP Storage Envelope in a safe

place.

Assessment Day Activities

•Have the NAEP Storage Envelope available for the NAEP field staff when they arrive at the school.

•Give completed NAEP teacher and school questionnaires to the NAEP field staff.

•Make sure all sampled students arrive promptly.

•Investigate reasons for student absences (e.g., suspensions, attending classes off campus, absences, etc.).

NAEP Inclusions and Accommodations

•Schools may exclude students according to carefully designated criteria.

•NAEP’s most frequent accommodations include:•Extra testing time•Individual or small group administrations•Large-print booklets

•NAEP accommodations do not include reading passages or questions aloud on the NAEP reading assessment.

After the NAEP Assessment• Participate in a short debriefing interview with the NAEP field staff.

• Schedule a make-up session, if necessary.

• Complete a short quality-control call with a Westat staff member. Only 25 percent of schools assessed will be called.

• Retain the NAEP Storage Envelope and destroy the contents on the last day of the academic year.

• Mail the provided postcard to Westat confirming that the materials have been destroyed.

Important Dates for NAEP 2009Tasks Date

•MySchool Registration and School Data Collection Form

October 1, 2008

•Assessment Coordinator will contact schools to schedule an assessment visit

December 2008

•Pre-Assessment packet arrives in selected schools

By January 5, 2009

•Pre-Assessment visits will be scheduled after registration

January 6 – January 24, 2009

•NAEP Testing Administration Window January 26 – March 4, 2009

Information for Parents•If parents have questions or concerns about the NAEP assessment, please share the Sample Questions Booklet with them.

•The booklets are available on the MySchool Web site at www.MyNAEP.com and will be distributed to the schools during the PAV.

Information for Teachers and Students

Videos available at the National Center for Education Statistics NCES: •Introducing NAEP to Teachers •Introducing NAEP to Students

http://www.nces.ed.gov/nationsreportcard/about/schools.asp

Best Practices for Improving Twelfth-Grade NAEP Participation

Includes: Strategies effective in engaging Grade 12 students in NAEP

Talking points that principals can use with teachers and parents

Resources for NAEPNCES NAEP Websitehttp://nces.ed.gov/nationsreportcard/

The Nation’s Report Cardhttp://nces.ed.gov/nationsreportcard/

Florida’s NAEP Website (Parent and Student Letter Templates)www.fldoe.org/asp/naep

Sample questions, initial release websitehttp://www.nationsreportcard.gov

Examples of background questionshttp://nces.ed.gov/nationsreportcard/bgquest.asp

NAEP School Coordinator Packethttp://oada.dadeschools.net/TestChairInfo/96NAEPSchoolCoordinatorPacket.pdf

NAEP SD and ELL Questionnaireswww.naepq.com

Information for Parentshttp://nces.ed.gov/nationsreportcard/parents

NAEP Data Explorerhttp://nces.ed.gov/nationsreportcard/naepdata/

NAEP Questions Toolhttp://nces.ed.gov/nationsreportcard/itmrls/