field tests … tests of the test questions

Field Tests …Tests of the test questions

Jeff Nellhaus, PARCC, Inc.Louisiana Common Core Implementation Conference

February 19, 2014

1

• Provide information about the …– PARCC consortium – Design of the PARCC assessment system– Spring 2014 Field tests

• Hear your comments and suggestions• Answer questions

Purpose of the session

2

• PPT Presentation• Understanding the PARCC Field Test (2-pager)• List of Field Test Training Modules• Checklist for Getting Read

Handouts

3

The PARCC Consortium

• 17 states and the District of Columbia

• Led by Chief State School Officers of governing states

• 11 million students in tested grades

2

• Measure– Student performance on the full range of the Common Core Standards– All students with precision, including high- to low-performing students,

students with disabilities and English learners• Report

– Whether students are ready for college & careers or on track– Comparable data across schools, districts & states

• Provide– Actionable information & tools to support instruction – Reliable data for accountability uses

• Innovate– By using technology to engage students & create efficiencies in all phases of

the assessment process from test development to reporting

PARCC’s Priorities

3

Develop and Implement a High Quality Assessment System

The PARCC Assessment Systemmore than just a test

Beginning of School Year End of School Year

DiagnosticAssessment

Mid-Year Assessment

Performance-Based

Assessment

End-of-Year Assessment

Speaking and Listening

AssessmentFormativeoptional

Summativerequired

Flexible scheduling

4

Legend

ELA/LiteracyWriting essays drawing evidence from sources, including multi-media

MathSolving multi-step problems that address reasoning and real world situations

Focus of Summative Assessment Components

ELA/LiteracyDemonstrating comprehension (including vocabulary) of literary and informational texts

MathDemonstrating conceptual understanding, fluency, and short applications

Performance-Based Component End-of-Year Component

PBA and EOY Combined = Total Score5

• Grades 2-8• Reading, Writing,

Mathematics• Computer-based, adaptive• Designed to pinpoint

strengths and weaknesses

Focus of Formative Components

Diagnostic Assessments Mid-Year Assessments• Grades 3-11• ELA/Literacy and Math• Computer-and paper-based

modules comprised of released PARCC items

• Designed to serve a variety of purposes: – interim assessments– classroom assignments– practice with new item types

and computer-based interactions

6

• They will also provide an opportunity for a number of important research studies

• But are not designed to yield individual student, school, or district results

Purpose of Field Tests

The field tests are designed to generate data to evaluate the quality of the test questions

9

Schools in 14 States & DC are Participating in the Field Tests

10

• Over 1 million students will participate

• Nearly 16,000 schools• In most cases , 1-3

grades per school, 2 classrooms per grade

• Most student take one component in one content area

• Students become familiar with new item types and the test delivery platform

• Teachers provide feedback on the administration • Technology Coordinators evaluate their schools’

technology systems• Parents learn more about PARCC• Administrators evaluate overall staff, student and

community readiness

Field Tests Benefits

11

• Field Tests– Most students will use PARCC’s computer-based

platform– Paper-and-pencil versions of the field tests will

also be administered

• Tests in 2014–2015 and onward– Paper versions will be available for schools still in

the process of gearing up– Goal is for all students to take PARCC assessments

on computer within a few years

PARCC is Developing Both Computer- and Paper-Based Tests

12

Timeline 2014

13

January Feb March April May June July August Sept

Support for School Staff • Regional workshops• On-Site Visits• Manuals & Training

modules• Call Center • Tools to check

computer systems & conduct “dress rehearsals”

Practice Tests

EOY Field Test

May 6–June 6

Research Findings

PBA Field TestMarch 24–

April 11

• Sample items available now!– For students and educators– www.parcconline.org/computer-based-samples

• Practice tests coming soon!– For the general public– Available this spring

• Both sample items and practice tests are designed to help students familiarize students with the item types and with the technology platform before taking a full test in spring 2015

Sample Items and Practice Tests

14

A tutorial for using TestNav8 is available now for students and educatorswww.parcconline.org/computer-based-samples

Tutorial for how to use TestNav8

15

What’s Next for PARCC

2014 2015 2016

Spring Summer/Fall Winter/Spring Summer Fall Fall

Students take field tests

PARCC releases practice tests

PARCC begins building tests

Findings from research reported

Mid-year assessments available Students take operational tests

Performance level cut scores set

Results of first operational assessments released

Diagnosticassessments available

Colleges & universities use scores to place student into credit- bearing courses

16

Transparency and CapacityResources and On-the-Ground Supports • Model Content Frameworks

– www.parcconline.org/parcc-model-content-frameworks• Test Specifications and Blueprints

– http://www.parcconline.org/assessment-blueprints-test-specs• Sample items and tutorials for every tested subject and grade

– http://practice.parcc.testnav.com/#• Educator Leaders Cadres

– Public ELC portal for educator resources!– http://parcc.nms.org/

• Test Administration Training Modules– PowerPoint and voice recorded guidance to guide test administration– Register here: parcc.pearson.com/tms

• Practice Test– Spring 2014: PARCConline.org

14

• PARCC aims to develop tests worth taking, made up of texts worth reading and problems worth solving

• Full of the kinds of questions that great teachers routinely ask students

• Your involvement in implementing the new system is critical and greatly appreciated!!

In conclusion …

18

More InformationFor further details, please visit PARCC online at:

www.parcconline.org/field-test

19