Post-Test Data Analysis Workshop

Agenda

I. Analyze 2014 TerraNova ResultsII. Comparative Data Analysis: TerraNova &

Explore Test ResultsIII. Using CTB Online ReportingIV. Generate & Analyze SubgroupsV. Deep Dive: Measurable Learning

Objectives

Data Rich…….Information PoorMany schools invest a great of time in creating elaborate analyses of the end-of-year assessment. Such reports are often exhaustively detailed, breaking down student results by every conceivable demographic or academic attribute. Yet despite the huge amount of data it generates, analysis of these test is of little use to the students who took them. Indeed, it may show what went wrong, but it comes too late to make a difference. Rather than pouring time into figuring out what students failed to learn at year’s end, it is much more effective to focus on interim assessments and avoid failures altogether.- Paul Bambrick-Santoyo, Driven by data (2010)

I. Analyze 2014 TerraNova Results

TerraNova Template

Data Points: NP of the Mean NCE vs Mean NCE National Percentile

(NP) Normal Curve

Equivalent (Mean NCE)

Mean Anticipated NCE Quartiles

Analyze 2014 TerraNova Results Which areas are above the expected levels of

performance? Which areas are below the expected levels of performance? What is the achievement gap between student

performance in reading and mathematics, and the mean NCE of 76 (90th percentile)?

Is the percent of students above the national mean greater than or equal to 66%?

What is the percent of students that are in Quartile 1? Which of the above reported findings are consistent with

findings from previous TerraNova results?

II. Comparative Analysis: TerraNova & Explore

Results

Understand Explore Results

Use the Profile Summary Report

Explore Test Frequencies & National Averages

Table 1a Columns:

- Explore score range- Freq- CP*- Local & Nat’l

Explore Test Quartiles & Score Ranges

Score Ranges vary by test

Q1 = 1-24% Q2 = 25-49% Q3= 50-74% Q4= 75-

100%

Three Analysis Types1. Status Analysis: percent

performing at or above grade-level

2. Impact Analysis: impact teacher has on different groups of students

3. Growth Analysis: academic growth with cohort of students

Status Analysis1. Use the 2012, 2013, and 2014 TerraNova results2. What is the percent performing at or above

grade-level for the last three years?3. Is the level of performance on the TerraNova

consistent?4. Use the 2012, 2013, and 2014 Explore results5. What is the percent performing at or above

grade-level for the last three years?6. Is the level of performance on the Explore

consistent?

Impact AnalysisUse the 2012, 2013, and 2014 TerraNova resultsReading: Is the Mean NCE within ±7 points for all

years tested?Reading: Are the Quartile distributions

consistent for all years tested?

Math: Is the Mean NCE within ±7 points for all years tested?

Math: Are the Quartile distributions consistent for all years tested?

Which subject areas indicate the overall highest performance?

Which subject areas indicate the overall lowest performance?

Impact Analysis

Growth Analysis Use the 2012, 2013, and 2014 TerraNova results Compare Mean NCE scores for a cohort of students.

For example, grade 3 students in 2012 are in grade 4 in 2013, and in grade 5 in 2014

Analyze reading: Is there significant growth (+7 Mean NCE), significant regression (-7 Mean NCE), or even performance (±6 Mean NCE)?

Analyze math: Is there significant growth (+7 Mean NCE), significant regression (-7 Mean NCE), or even performance (±6 Mean NCE)?

Analyze the other subject tests

Growth Analysis Describe the areas that show a positive trend in

performance. Describe the areas that show a negative trend in

performance. Which areas indicate the overall highest performance? Which areas indicate the overall lowest performance?

Growth Analysis: Student Performance on Different Psychometric Summative Assessments

Cohort Quartile performance on TerraNova to quartile performance on Explore

Diagnostic Questions:1. Top performing subject test: What is the top

performing subject test and what is the quartile distribution on the TerraNova in grade 7? Is student performance consistent on the Explore test? Is there a growth? Is there regression?

Student Performance on Different Psychometric Summative Assessments Cohort Quartile performance on TerraNova to quartile

performance on ExploreDiagnostic Questions:2. Least performing subject test: What is the least

performing subject test and what is the quartile distribution on the TerraNova in grade 7? Is student performance consistent on the Explore test? Is there a growth? Is there regression?

III. CTB Online Reporting

Log into CTB Online Reporting

Guide to CTB Online Reporting- Spring 20141.Summary Report: Combination2.Summary Report: Objectives3.Roster Report4.Item Summary5.Cohort Comparison Report

IV. Generate & Analyze Subgroups

Are there Achievement Gaps in Sub-Groups?

School’s demographics shape the subgroups

Types of sub-groups: ethnicity, gender, Title 1, English Language Learners, transfer-in, other

Identify at least one sub-group but no more than three

V. Deep Dive: Measurable Learning

Objectives

Deep Dive: Measurable Learning ObjectivesCTB Online Reporting1.Summary Report:

Objectives2.Item SummaryObjectives and Subskills

(OCS Resource Portal- Academic Excellence- Assessment)

Your Questions

“I Choose C”

https://www.youtube.com/watch?v=dY2mRM4i6tY

I Appreciate Our Time Together!