create actionable data for schools july 16-26 2012 dr. yuwadee wongbundhit and mr. nelson suarez...
TRANSCRIPT
Create Actionable Data for Schools
July 16-26 2012Dr. Yuwadee Wongbundhit and Mr. Nelson Suarez
Curriculum and Instruction
Day 1 Topics
FCAT 2.0/EOC Data Elements
School Level Data: Year-at-a Glance Reports, Reports from DOE and OADA Web
2012 School Grade Reports
Student Performance Indicators and 2012 Student Report from Pearson
Use of Excel Pivot Table and Excel Filter for Data Analysis
Day 2 Topics
Data Elements from Accountability Report
Data Elements from File Download Manager
Use of Excel Vlookup
Use of Excel Pivot Table for Data Analysis
Assumptions:You...
are familiar with the School Grade System and FCAT 2.0/EOC
have some experience in data analysis
are comfortable using Excel 2010
love, love, love data!!!
4
NORMS
5
Norms
Listen to others
Engage with the
ideas presented
Ask questions
Reflect on relevance
to you
Next, set your
learning into action
Http://osi.dadeschools.net/actiondata
Designed by
Nelson Suarez
Update on Assessments
Math at a Glance
2012 Math District and State Results% Scoring Achievement Level 3 and Above
Gr3 Gr4 Gr5 Gr6 Gr7 Gr80
50
100
58 60 57 53 56 5760 62 5850 52 56
State District
% o
f S
tud
ents
+2+2 +2+2 +1+1 -3-3 -4-4 -1-1
2011 to 2012 Math Results% Scoring Achievement Level 3 and Above
Gr3 Gr4 Gr5 Gr6 Gr7 Gr80
50
100
56 58 56 53 56 5658 60 57 53 56 57
State
20112012
% o
f S
tud
ents
Gr3 Gr4 Gr5 Gr6 Gr7 Gr80
50
100
58 61 54 47 51 5460 62 58 50 52 56
District
20112012
% o
f S
tud
en
ts
+2+2 +2+2 +1+1 00 00 +1+1
+2+2 +4+4 +3+3+1+1 +1+1 +2+2
Understanding FCAT 2.0/EOC Reports?
Understanding FCAT 2.0 and EOC Reports, Spring 201212
FCAT 1999
FCAT 2001FCAT
2002FCAT 2010
Base scale of FCAT
1996 SSS
Base scale of FCAT 2.0
2007 NGSSS
2011FCAT 2.0
Equivalent Scores
FCAT 2.0 Scores Reading/Math
13
FCAT 2.0 2014
FCAT 2.0 2013
FCAT 2.0 2012
FCAT 2.0 2011 2010-11 Baseline Year (Retrofitted Scores)
FCAT 2.0 Scores, Reading/math
14
RawScore
C2
C3
C4
C1
Content Area Scores
FCAT 2.0 Reading-Math Scores Raw Score
Developmental Scale Score (DSS)(140 to 302 R: G3-10)
(140 to 298 M: G3-8)
Achievement Level
(1 to 5)
Sample Math Report, Grade 3-4
16
31
32
Developmental Scale Score (Math)
G6
G8
140 298Developmental Scale Scores
Min Max
G3
Raw Score
Grade 3 Grade 10
Grade Level 1 Level 2 Level 3 Level 4 Level 5
3 140-182 183-197 198-213 214-228 229-260
4 155-196 197-209 210-223 224-239 240-271
5 163-204 205-219 220-233 234-246 247-279
6 170-212 213-226 227-239 240-252 253-284
7 179-219 220-233 234-247 248-260 261-292
8 187-228 229-240 241-255 256-267 268-298
3 4 5 6 7 8180
220
260
204
217215
223
220
226224
234
234
243
De
vel
op
me
nta
l Sc
ale
Sc
ore
s
Grades
G3-4 G4-5 G5-6 G6-7 G7-8
State: Gain Scores 13 9 6 9 7
District: Gain Scores 13 8 5 10 9
% of Students Matched to 2011 92 93 92 92 93
2012 FCAT 2.0 Mathematics - District Mean Developmental Scale Score (Matched Students)
2012 FCAT 2.0 Mathematics - District Mean Developmental Scale Score (DSS)
Gr3 Gr4 Gr5 Gr6 Gr7 Gr8180
220
260
202
216
223 225
233
242
Dev
elo
pm
enta
l S
cale
Sco
re
2012 FCAT 2.0 Possible Points, Grades 3-5 Mathematics Reporting Category
Content G3 G4* G5Number: Operations, Problems, and Statistics
21
Number: Fractions 10
Geometry and Measurement 13 12 14
Number: Operations and Problems 18Number: Base Ten and Fractions
10 22
Expressions, Equations, and Statistics 10
Total 44 40 46
2012 FCAT 2.0 Possible Points, Grades 6-8 Mathematics Reporting CategoryContent G6 G7 G8
Fractions, Ratios, Proportional Relationships, and Statistics 18Expressions and Equations 17Geometry and Measurement 9 13 17Number: Base Ten 11Ratios/Proportional Relationships 12Statistics and Probability 8Number: Operations, Problems, and Statistics 12Expressions, Equations, and Functions 19
Total 44 44 48
22
23
RawScore
C1
C2C3
Algebra Content Scores
Algebra 1 EOC ScoresRaw Score
EOC Scale Score(325 - 475)
Achievement Level(1 to 5)
Source: FL DOE/Office of Assessment
Level 1 Level 2 Level 3 Level 4 Level 5
325-374(49)
375-398(23)
399-424(25)
425-436(11)
437-475(38)
Sample Algebra 1 Report
25
15
15
Raw Score
T-Score Scale(20 to 80)
Statewide Comparison by
Thirds
RawScore
C1
C2C3
Content Scores
Geometry EOC Scores
Statewide by Thirds
T-Score Scale Range
1 20-45
2 46-54
3 55-80
2012 Geometry EOC Scale Distribution - Statewide
27
20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78 800
1000
2000
3000
4000
5000
6000
7000
8000
9000
2012 Geometry EOC Distribution
EOC Scale Scores
Num
ber o
f Stu
dent
s 35% of Students at the bottom third (MDCPS: 44%)
34% of Students at the top third(MDCPS: 27%)
Statewide by Thirds T-Score Scale Range1 20-452 46-543 55-80
28
Test
For
m
Scal
e Sc
ore Statewide
Comparison
Points Earned by Content
Area
1 2 3
Student Name and ID
End-of-CourseReporting Category %
2012items
Alg 1
Functions, Linear Equations, and Inequalities
55% 31
Polynomials 20% 10Rationals, Radicals, Quadratics, and Discrete Mathematics
25% 13
Total 100% 54
Geo. Two-Dimensional Geometry 65% 35
Three-Dimensional Geometry 20% 11
Trigonometry & Discrete Math 15% 8
Total 100% 54
30
FCAT 2.0/EOC Achievement Level Policy Definitions
5. Demonstrate mastery of the most challenging content of the NGSSS.
4. Demonstrate an above satisfactory level of success with the challenging
content of the NGSSS.
3. Demonstrate a satisfactory level of success with the challenging content of the
NGSSS.
2. Demonstrate a below satisfactory level of success with the challenging content of
the NGSSS.
1. Demonstrate an inadequate level of success with the challenging content of the
NGSSS.
FCAT 2.0/EOC Achievement Level Policy Definitions
Level 1
Student has little success with the challenging content of the SSS.
Level 2
Student has limited success with the challenging content of the SSS.
Level 3
Student has partial success with the challenging content of the SSS, but performance is inconsistent.
Level 4
Student has success with the challenging content of the SSS.
Level 5
Student has success with the most challenging content of the SSS. A student scoring in Level 5 answers most of the test questions correctly, including the most challenging questions.
Demonstrate an inadequate level of success with the challenging content of the NGSSS.
Demonstrate a below satisfactory level of success with the challenging content of the NGSSS.
Demonstrate a satisfactory level of success with the challenging content of the NGSSS.
Demonstrate an above satisfactory level of success with the challenging content of the NGSSS.
Demonstrate mastery of the most challenging content of the NGSSS.
FCAT FCAT 2.0 and EOC
Worksheet 1: Calculate the % correct for each content area.Total Points Points Earned By Content Area % Correct By Content Area
Number of Points Possible 7 21 11 100% 100% 100%
SchoolRaw Score % Corr. Content
1Content
2Content
3% Content
1% Content
2% Content
339 100%
1 6 17 82 5 17 93 4 12 74 4 13 65 5 17 96 6 18 97 4 13 78 4 21 79 4 10 5
10 5 14 711 4 9 412 3 10 513 4 8 714 6 10 715 4 11 616 5 14 717 4 19 718 3 9 619 4 12 620 4 15 621 5 13 722 5 19 323 3 17 924 4 5 725 5 13 5 34
Worksheet 1: Calculate the % correct for each content area.Total Points Points Earned By Content Area % Correct By Content Area
Number of Points Possible 7 21 11 100% 100% 100%
SchoolRaw Score % Corr. Content
1Content
2Content
3% Content
1% Content
2% Content
339 100%
1 31 79 6 17 8 86% 81% 73%2 31 79 5 17 9 71% 81% 82%3 23 59 4 12 7 57% 57% 64%4 23 59 4 13 6 57% 62% 55%5 31 79 5 17 9 71% 81% 82%6 33 85 6 18 9 86% 86% 82%7 24 62 4 13 7 57% 62% 64%8 32 82 4 21 7 57% 100% 64%9 19 49 4 10 5 57% 48% 45%
10 26 67 5 14 7 71% 67% 64%11 17 44 4 9 4 57% 43% 36%12 18 46 3 10 5 43% 48% 45%13 19 49 4 8 7 57% 38% 64%14 23 59 6 10 7 86% 48% 64%15 21 54 4 11 6 57% 52% 55%16 26 67 5 14 7 71% 67% 64%17 30 77 4 19 7 57% 90% 64%18 18 46 3 9 6 43% 43% 55%19 22 56 4 12 6 57% 57% 55%20 25 64 4 15 6 57% 71% 55%21 25 64 5 13 7 71% 62% 64%22 27 69 5 19 3 71% 90% 27%23 29 74 3 17 9 43% 81% 82%24 16 41 4 5 7 57% 24% 64%25 23 59 5 13 5 71% 62% 45%
Use Excel for Data Analysis1. At the FLDOE website (Select one grade), download School Scores for All
Curriculum Groups2. Save the file on the desktop and open the file3. Apply Filter to column header4. Filter out District number 135. Delete all rows below the state row6. Clear filter from “District Number”7. Apply Freeze panes to appropriate cell8. Copy reporting categories name to new empty cell 9. Apply filter to column header including the new ones10. Calculate Average % Correct for each reporting category11. Sample formula: =N11/N$10*10012. Apply formula to all cells
36
Data Analysis Worksheet 2
37
1. In each reporting category, name three schools with the lowest average % Correct.
RC 1:____________________ RC 2:____________________ RC 3:____________________ RC 4:____________________
2. In each reporting category, name three schools with the highest average % Correct.
3. Which schools have %Level 1 >= 50? 4. Which schools have % level 5 > 20%
5. How many schools have % Levels 3-5 >=70?____________
7. Name 6 schools that have increased their %L3-5 the most from last year in your assigned school region?
6. How many schools have the %L3-5 > the State? _________
Grade ______ Assessment:___________
Update on School Grades
Florida School Accountability
• Performance Status• Annual Learning
Gains
School Grade
• Performance Status• Performance by subgroupsAYP
Adequate Yearly Progress (AYP) Benchmark
Year%Proficiency Targets
Reading Math
2009-10 65 68
2009-10 72 74
2010-11 79 80
2011-12 86 86
2012-13 93 93
2013-14 100 10040
AYP 39 Components Criteria (NA, No, Yes)
41
Group
Participation Met(Tested 95%) Proficiency Met
Reading Math Reading Math
TOTAL 1 1 1 1
WHITE 2 2 2 2
BLACK 3 3 3 3
HISP. 4 4 4 4
ASIAN 5 5 5 5
Am. Ind. 6 6 6 6
ED 7 7 7 7
ELL 8 8 8 8
SWD 9 9 9 9
School Grade
Total Group
GraduationTotal Group
WritingTotal Group
Other AYP Criteria
Annual Measurable Objectives
AYP is gone.AMO is here.Annual Measurable Objectives
ESEA Flexibility Waivershttp://www.fldoe.org/esea/
Ambitious & Achievable Goal
42
Transition from AYP to AMOAMO-1
• School Performance Grade Target
AMO-2
• Reading and Math Performance Targets
AMO-3
• Target for Annual Learning of Students in the Lowest-Performing 25% in Reading and Math
AMO-4
• Benchmark Florida’s Students Performance to the Highest-Performing States and nations. This is a statewide target.
AMO vs. Differentiated Accountability• The AMOs are not linked to
Differentiated Accountability categories.
Not Linked to DA
44
School Grade ESEA Category DA CategoryA Reward
Schools that increase their grade
Reward
BC Prevent PreventD Focus CorrectF Priority Intervene
Target Performance for AMO-2
45
• Increase % of students scoring at Levels 3-5 and reduce % of students scoring at levels 1 and 2 by 50% over six years (using 2010-11 as the baseline year).
Annual Measurable Objective 2
(AMO 2) sets targets
for each school and subgroup
to:
AMO Performance Targets: 2010-11 to 2016-17
2016-17AMO Target
Proficient
30+35=65%
Non-proficient
70-35=35%
2010-11PerformanceBaseline Year
Proficient (%L3-5)
30%
Non-proficient(%L1-2)
50% of 70 = 35
70%
46
The goal of AMO-2 is to reduce the % of
non-proficient by 50% over six years
(2010-11 to 2016-17).
2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17Increase %pt. 5.8 11.7 17.5 23.3 29.2 35.0
30 36 42 48 53 59 65
35÷6 = 5.83
AMO Performance Targets: 2010-11 to 2016-17
2016-17AMO Target
Proficient
60+20=80%
Non-proficient
40-20=20%
2010-11PerformanceBaseline Year
Proficient (%L3-5)
60%
Non-proficient(%L1-2)
50% of 40 = 20
40%
47
The goal of AMO-2 is to reduce the % of
non-proficient by 50% over six years
(2010-11 to 2016-17).
2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17Increase %pt. 3.3 6.7 10 13.3 16.6 20
60 63 67 70 73 77 80
20÷6 = 3.33
Worksheet 3: AMO-2 TargetSchool
Baseline Year
2010-11% L3-5
Baseline Year2010-11% L1-2
Baseline Year2010-11
50% of L1-2 Annual
Increment
% AMO-2 Target at
Year 62016-17
% AMO-2 Target for
Year 22012-13
1 70%2 40%3 58%4 45%5 38%6 73%7 50%8 63%9 35%
10 20%
Worksheet 3: AMO-2 TargetSchool
Baseline Year
2010-11% L3-5
Baseline Year2010-11% L1-2
Baseline Year2010-11
50% of L1-2 Annual
Increment
% AMO-2 Target at
Year 62016-17
% AMO-2 Target for
Year 22012-13
1 70% 30 15.0 2.5 85 752 40% 60 30.0 5.0 70 503 58% 42 21.0 3.5 79 654 45% 55 27.5 4.6 73 545 38% 62 31.0 5.2 69 486 73% 27 13.5 2.3 87 787 50% 50 25.0 4.2 75 588 63% 37 18.5 3.1 82 699 35% 65 32.5 5.4 68 46
10 20% 80 40.0 6.7 60 33
OSI Website -- Http://osi.dadeschools.net
50
Direction: Go tohttp://osi.dadeschools.net/actiondata
Click on “2012-2013 School Improvement Tools”
Locate “SIP Current and Expected Results”, click on
AMO-2 SIP Targets
Annual Measurable Objective (AMO)
51
Are there consequences for not making annual progress to wards an AMO-2 target?
AMO-2 Reports• AMO-2 performance targets will be
established separately for each subgroup and all students in reading and mathematics.
Reading and mathematics
• AMO-2 targets will be used to determined whether the students are making progress in the current year to be on track to reduce the % of levels 1 and 2 by half by 2016-17.
Monitoring Progress
• Any subgroup fail to meet AMO-2 target
Not making satisfactory
progress52
Lunch Break
Please be back on time at 12:30 p.m.Thank you!
School Grade Components
2008 to 2012 School Grade Performance
Year School Grade
% Meeting High Standards % Making Learning Gains
% of Lowest 25% Making Learning
Gains Total Points
R M W S R M R M
2012 B 55% 57% 81% 47% 67% 67% 67% 64% 505
2011 B 64% 71% 83% 47% 61% 67% 60% 66% 519
2010 B 64% 71% 88% 41% 63% 69% 58% 67% 521
2009 B 62% 69% 88% 40% 63% 69% 63% 67% 521
2008 B 60% 67% 87% 39% 61% 71% 60% 70% 515
School Grade Scaling
F=0-394, D=395-434, C=435-494, B=495-524, A = 525-800
* State assessment scores include FCAT, FCAT 2.0, end-of-course assessments (EOCs), and Florida Alternate Assessment (FAA**) scores, as applicable.**The FAA is administered to students with cognitive disabilities for whom the FCAT or FCAT 2.0 would not be appropriate assessments.
Which students are included?All full-year enrolled students, including students
with disabilities (SWDs) and English language learners (ELLs), have state assessment scores applied in all school grading measures, with one exception. ELLs who have less than one year of school in the U.S. are not included in the performance components for reading, math, writing, and science.
Which students are included in the lowest 25% of students?
• Meet all criteria for inclusion in school grade,
• Have both a prior year score and current year score,
• Are ranked in the lowest 25% based on their prior year FCAT 2.0 scores (separate by grade), and
• Have a prior year score less than an achievement level 3 score.
• Include all retained students
Elem. & Combination Schools up to grade 7School Grade of 800 Points
% of students performing at or above satisfactory level of
success
Reading – 100
Math – 100
Science – 100
Writing – 100
% of student making annual learning gains
Reading - 200• Overall - 100• Low 25% - 100
Math - 200• Overall - 100• Low 25% - 100
F: 0-394; D: 395-434; C: 435-494; B: 495-524, A: 525-800
2011-12 through 2013-14 School Grade:Middle School (900 Points)
% of students performing at or above satisfactory level of
success
Reading – 100
Math – 100
Science – 100
Writing – 100
% of student making annual learning gains
Reading - 200• Overall - 100• Low 25% - 100
Math - 200• Overall - 100• Low 25% - 100
F: 0-444; D: 445-489; C: 490-559; B: 560-589, A: 590-900
Algebra EOC – 100• Participation - 50• Performance - 50
2014-15 School Grade:Middle School (1000 Points)
% of students performing at or above satisfactory level of
success
Reading – 100
Math – 100
Science – 100
Writing – 100
% of student making annual learning gains
Reading - 200• Overall - 100• Low 25% - 100
Math - 200• Overall - 100• Low 25% - 100
Algebra EOC – 100
Civics EOC - 100
2011-12 High School GradeFCAT Component (800 points)
• Reading (100 Points)• Math (100 Points)• Writing (100 Points)
Meeting High Standards
• Reading (200 Points)• Math (200 Points)
Making Learning Gains
• Reading• Math
FCAT Retake Bonus Point (10 Points)
Non-FCAT (800 points)
• Overall (200 points)• At Risk (100 points)
Graduation
• Participation (150 Points)• Performance (150 Points)
Acceleration Courses
• Reading (100 Points)• Math (100 Points)
Readiness (200 Points)
F: 0-789; D: 790-869; C: 870-989; B: 990-1049, A: 1050-1600
Bonus Points for High Schools: High schools are eligible for an additional 10 points if at least 50% of students retaking assessments required for graduation in reading and math score high enough to meet graduation requirements in both areas.
2013-14 High School GradeFCAT Component (800 points)
• Reading (100 Points)• Math (100 Points)• Writing (100 Points)• Science (100 Points)
Meeting High Standards (400 Points)
• Reading (200 Points)• Math (200 Points)
Making Learning Gains (400 Points)
• Reading• Math
FCAT Retake Bonus Point (10 Points)
Non-FCAT (800 points)
• Overall (200 points)• At Risk (100 points)
Graduation (300 Points)
• Participation (100 Points)• Performance (100 Points)
Acceleration Courses (200 Points)
• Reading (100 Points)• Math (100 Points)
Readiness (200 Points)
US History (100 Points)
F: 0-789; D: 790-869; C: 870-989; B: 990-1049, A: 1050-1600
Testing participation• Schools must test at least 90%
of eligible students (at least 95% to be eligible for an “A”) to be assigned a regular letter grade.
• Schools testing below 90% are initially assigned an “I” and are reviewed further to determine whether a grade penalty will apply.
Letter-grade drop limit for 2011-12.• For 2011-12 only, no school’s
assigned grade will be more than one letter grade lower than the school grade assigned for 2010-11.
Adjusted Scores for Letter-grade drop limit for 2011-12
R M W S R Gain
M Gain
L25 R
Gain
L25 M
GainTotal Pts.
2012 Grade
2011 Grade
50 49 68 26 68 54 59 30 404 D BMin. points needed for C is 435 C
Gap points 31 PointsAdjusted Scores: Divided the gap points by 3 and added to reading, math and writing
Adjusted Scores Points10 10 1160 59 79 26 68 54 59 30 435 C
F: 0-394; D: 395-434; C: 435-494; B: 495-524, A: 525-800
Adjusted Scores for Letter-grade drop limit for 2011-12
R M W S R Gain
M Gain
L25 R
Gain
L25 M
GainTotal Pts.
2012 Grade
2011 Grade
20 34 59 8 58 57 64 66 366 F CMin. points needed for C is 395 D
Gap points 29 PointsAdjusted Scores: Divided the gap points by 3 and added to reading, math and writing
Adjusted Scores Points9 9 11
29 43 70 8 58 57 64 66 395 D
F: 0-394; D: 395-434; C: 435-494; B: 495-524, A: 525-800
Annual Learning Gains
2011FCAT
Annual Learning Gains
2012 CurrentFCAT
School Year
Fall Interim Assessment
Winter InterimAssessment
Baseline.
Annual Learning Gains
Performance
Performance
70
3-Ways to Make Annual Learning Gains1. Improve
achievement level
FCAT 2.0 Achievement
Level
EOC Assessment Achievement
Level
FAA Performance
Level
2. Maintain Achievement
Level
FCAT 2.0 L3-5 (3-3, 4-4, 5-5)
EOC L3-5(3-3, 4-4, 5-5)
FAA – L 4-9(4-4, 5-5, 6-6, 7-7, 8-8, 9-9)
3. Demonstrate a year’s growth for
students remain with low proficient levels
FCAT 2.0: 1-1, 2-2
EOC: 1-1, 2-2
FAA: 1-1, 2-2,3-3
Annual Learning Gains for FCAT 2.0Start
Additional Weight for DSS Gains
Example: A 4th grader scoring at level 1 in prior-year would need to increase score by at least 16 DSS points to qualify
for 1.1. (12+ 33% more than 12 = 16)
1.1 Points1.0 Points
Annual Learning Gains for EOC
Start
Annual Learning Gains for FAA
Start
Level 5
2011 FCAT 2.0 Level
2012 FCAT 2.0 Level
Level 4
Level 3
Level 5
Level 3
Level 3
Level 1
Level 2
Level 1
Level 2
-2
5
-8
11
5
DSS Change
2012 LG?
?
?
?
?
?
Y
N
Y
N
N
Reading Learning Gains
3
2011 FCAT Tested Grade
2012 FCAT Tested Grade
6
9
4
7
10
3
10
3
10
Student2011
Tested Grade
2012Tested Grade
2011 FCAT 2.0 DSS
2012 FCAT 2.0 DSS
2011 FCAT 2.0 Level
2012 FCAT 2.0 level DSS Change 2012 LG
Points2012 PF
Point
1 10 10 215 219 1 1 4 2 9 10 221 245 1 3 24 3 9 9 231 235 2 2 4 4 3 4 225 221 4 4 -4 5 7 8 230 NM 2 NA 6 9 10 250 256 3 4 6 7 3 4 185 210 2 3 25 8 6 7 238 240 4 3 2 9 4 5 230 247 4 5 17
10 10 10 240 244 2 2 4 11 5 6 210 217 2 2 7 12 4 5 221 227 4 3 6 13 8 9 241 224 3 2 -17 14 6 7 225 260 3 5 35 15 3 3 145 158 1 1 13 16 7 8 250 249 4 4 -1 17 10 10 225 228 1 2 3 18 5 6 205 237 2 4 32 19 7 8 175 181 1 1 6 20 8 9 245 242 3 3 -3 21 8 9 269 256 5 4 -13 22 5 6 162 170 1 1 8 23 4 4 179 190 1 1 11 24 6 7 200 215 1 2 15 25 8 9 296 277 5 5 -19
Worksheet 4: Learning Gains – FCAT 2.0 Reading
Student2011
Tested Grade
2012Tested Grade
2011 FCAT 2.0 DSS
2012 FCAT 2.0 DSS
2011 FCAT 2.0 Level
2012 FCAT 2.0 level DSS Change 2012 LG
Points2012 PF Points
1 10 10 215 219 1 1 4 0 02 9 10 221 245 1 3 24 1.1 13 9 9 231 235 2 2 4 0 04 3 4 225 221 4 4 -4 1 15 7 8 230 NM 2 NA NA 06 9 10 250 256 3 4 6 1.1 17 3 4 185 210 2 3 25 1.1 18 6 7 238 240 4 3 2 0 19 4 5 230 247 4 5 17 1.2 1
10 10 10 240 244 2 2 4 0 011 5 6 210 217 2 2 7 0 012 4 5 221 227 4 3 6 0 113 8 9 241 224 3 2 -17 0 014 6 7 225 260 3 5 35 1.2 115 3 3 145 158 1 1 13 1 016 7 8 250 249 4 4 -1 1 117 10 10 225 228 1 2 3 1 018 5 6 205 237 2 4 32 1.1 119 7 8 175 181 1 1 6 0 020 8 9 245 242 3 3 -3 1 121 8 9 269 256 5 4 -13 0 122 5 6 162 170 1 1 8 0 023 4 4 179 190 1 1 11 0 024 6 7 200 215 1 2 15 1.1 025 8 9 296 277 5 5 -19 1 1
Worksheet 3: Learning Gains – FCAT 2.0 Reading
Adequate Progress Criteria for the Low25%
Made Learning Gains
50% - 100%
Between40% to 49%
Below 40%
Made adequate progress
Higher than that of prior year by 1 percentage point
Made adequate progressAND
Higher than that of prior year by 5 percentage points
Made adequate progressAND
To avoid having the school grade reduced:
• Must show adequate progress of the low25% in both reading and math for the current year
School Grade A
• Must show adequate progress of the low25% in both reading and math for either the current or previous year
School Grades B or C
2012R
2012M
2013R
2013M
School Grade A
No No Yes Yes
School Grades B or C
Yes No No Yes
No Yes Yes No
Yes Yes
Meet Adequate Progress Criteria for the Low25%?
Suspend the adequate progress requirements for reading and math in
2011-12
Analyze School Grades Using Excel Pivot Table
Pivot Table
81
Tool for Data
Analysis
Data Analysis Questions for School Grade
How many schools are listed in each school types?
For each school type, how many schools earned letter grade A, B, C, D, and F? Which Schools ?
How many schools increase their grades from last year? Which schools?
How many schools decrease their grades from last year? Which schools?
Which schools have the highest learning gains in reading/math?
Student Performance Indicators Data Elements
83
Direction• Create a folder call SPI• Select a school • Download data• Save it into the SPI folder
On ActionData Website• Download SPI Splitter• Wait for more
instructions
SPI School Data Elements1. CLASS_SCHOOL
2. STUDENT_NAME
3. STUDENT_ID
4. STUDENT_STATUS_CODE
5. GENDER
6. STUDENT_ETHNICITY
7. STUDENT_GRADE
8. STUDENT_HOMEROOM
9. LEP_Entry_Date
10. LUNCH_CODE
11. Birthdate
12. ESE_INFO
13. LEP_INFO
14. FCAT_CURR_GROUP
15. FCAT_TEST_YEAR
16. FCAT_TEST_MONTH
17. FCAT_GRADE
18. FCAT_NRT_MATH_SCALE
19. FCAT_NRT_MATH_PERCENT
20. FCAT_NRT_MATH_STANINE
21. FCAT_NRT_READ_SCALE
22. FCAT_NRT_READ_PERCENT
23. FCAT_NRT_READ_STANINE
24. FCAT_SSS_MATH_SCORE
25. FCAT_SSS_MATH_LEVEL26. FCAT_SSS_MATH_DEVELOP27. FCAT_SSS_MATH_NS (Rpt. Cat. 1)28. FCAT_SSS_MATH_M (Rpt. Cat. 2)29. FCAT_SSS_MATH_GS (Rpt. Cat. 3)30. FCAT_SSS_MATH_AT (Rpt. Cat. 4)31. FCAT_SSS_MATH_DA32. FCAT_SSS_READ_SCORE33. FCAT_SSS_READ_LEVEL34. FCAT_SSS_READ_DEVELOP35. FCAT_SSS_READ_WP (Rpt. Cat 1)36. FCAT_SSS_READ_MIP (Rpt. Cat 2)37. FCAT_SSS_READ_C (Rpt. Cat 3)38. FCAT_SSS_READ_RR (Rpt. Cat 4)39. FCAT_SSS_SCI_SCORE40. FCAT_SSS_SCI_LEVEL41. FCAT_SSS_SCI_PC (Rpt. Cat 1)42. FCAT_SSS_SCI_ES (Rpt. Cat 2) 43. FCAT_SSS_SCI_LE (Rpt. Cat 3)44. FCAT_SSS_SCI_ST (Rpt. Cat 4)45. FCAT_SSS_WRITE_PT46. FCAT_SSS_WRITE_SCORE47. FCAT_READ_PASS_FAIL 48. FCAT_MATH_PASS_FAIL
Data Analysis Questions for SPI Data
How many students on this report?
How many students scoring at each achievement level in 2012? What are the %? Who scored in Level 1?How many students scoring at each achievement level in 2011 and 2012?
How many students scoring at or above satisfactory levels in 2012? Which student?
What is the range of % correct by achievement level?
Which student performed below 51% in each reporting category? How many students?
Which student performed above 70% in each reporting category? How many students?
What is the average % correct for each reporting category by achievement level?
2012 % Correct of Reporting Category by FCAT 2.0 Achievement LevelReporting Category
# of Stu < 51%
What%?
# of Stu >= 70%
What%?
Avg. % Corr.
Avg. % Corr.
Level 1
Avg. % Corr.
Level 2
Avg. % Corr.
Level 3
Avg. % Corr.
Level 4
Avg. % Corr.
Level 5
2012 % Correct Range by FCAT 2.0 Achievement Level
Grade:________ Assessment:__________ Total Students:______________
Level 1 Level 2 Level 3 Level 4 Level 5 L 3-5 L 1-2
Number of students
Range of % Correct
Worksheet 5: Looking at Student Data
2012 % Correct Range by FCAT 2.0 Achievement Level – Math(Sample based on data from couple of schools)
Grade Level 1 Level 2 Level 3 Level 4 Level 5
3 0%-48% 45%-68% 68%-86% 86%-93% 93%-100%
4 0%-53% 53%-70% 68%-85% 83%-95% 95%-100%
5 0%-43% 35%-57% 57%-74% 72%-79% 89%-100%
6 0%-36% 30%-52% 50%-73% 73%-89% 89%-100%
7 0%-41% 30%-55% 50%-73% 68%-86% 84%-100%
8 0%-40% 35%-56% 50%-73% 69%-88% 85%-100%
ALG 0%-26% 13%-37% 31%-61% 57%-74% 78%-100%
Day 2 Topics
Data Elements from Accountability Report
Data Elements from File Download Manager
Use of Excel Vlookup
Use of Excel Pivot Table for Data Analysis
Conversion of 2012 FCAT/EOC PDF Student Data
Report File to Excel File
Student Report in PDF File
90
Conversion Process
PDFCombined
Grades
TextCombined
Grades
Templateby Grade
Level/EOC
Excel Report by Grade
Level/EOC
91
2012 FCAT
Reading1. R-Templates
2. R-PDF3. R-Text4. R-Excel
Math1. M-Templates
2. M-PDF3. M-Text4. M-Excel
Science1. S-Templates
2. S-PDF3. S-Text4. S-Excel
Folder and File Structure
If you do not have student report in PDF file, use the one from the website.
Instructions for Conversion PDF File• Open Adobe Reader. • On the File menu, open the student report, and select Save As- Text • Name the file and save into the PDF folder• Wait until the export process is completed• Close the student report file
Step 1Export PDF File to
Text
• Open the 2012 Action Data Template• Click on “Import Data”• Locate the appropriate text file and click Open• Wait until the import process is completed
Step 2Import Text to Template file
• Under “Check your data!”, click on the hyper text “inputData…”
• Spot check data from beginning to end
Step 3Verify Data
• On worksheet “Direction”, click Data Button• On worksheet “Direction”, click Raw Score Distribution
Button
Step 4Review the Results
• On File menu, select Save As• Use appropriate name (remove “Template 06”• Save as type: select “Excel workbook”• Click Save
Step 5Save as the file
Instructions for Calculating LG PointsPreparation Steps1. Insert two empty columns:
Step 1 – Highlights Columns R and S, right click, then click on Insert Step 2 – On the Home menu, click on Conditional Formatting, and select “Clear Rules from Selected Cells”. Next, under Number group of the Home menu, select “General”. Next, under Font group of the Home menu, select Borders and select All Borders. Step 3 – In Cell R2, type “Learning Gains Points” Step 4 – In Cell S2, type “Performance L3-5 Points”
2. Hide all columns with the exception of the following:• Student Name ( Column A),• 2012 DSS (Column C),• 2012 Level (Column D),• 2011 level (Column I),• 2011 DSS (Column J),• DSS Change (Column K),• Learning Gains Points (Column R)• Performance L3-5 Points (Column S)
3. Highlight Cell A2 to S2. On the DATA menu, under Sort & Filter group, click Filter twice.4. Cell A2, filter out “Blanks” from Student Name.
Instructions for Calculating LG PointsFollow the leaning gain flow chart to determine learning gains points1. Filter “NM and NA” 2011 Level. Next, in the first empty cell under “Learning Gains Points”, type “NA” and highlight to the last cell. Next, fill down.
Clear filter from 2011 Level.2. Increase achievement level one or more in 2011 level to Level 5 in 2012:
– Step 1: Filter 5 under 2012 Level and 1-4 under 2011 level– Step 2: Column “Learning Gains Points”, in the first empty cell, type “1.2” and highlight to the last cell. Next, fill down. – Step 3: Clear filter from 2011 Level and 2012 Level
3. Increase achievement level one or more in 2011 level to Level 4 in 2012:– Step 1: Filter 4 under 2012 Level and 1-3 under 2011 level– Step 2: Column “Learning Gains Points”, in the first empty cell, type “1.1” and highlight to the last cell. Next, fill down. – Step 3: Clear filter from 2011 Level and 2012 Level
4. Increase achievement level from Level 1 in 2011 to Level 3 in 2012:– Step 1: Filter 3 under 2012 Level and 1 under 2011 level – Step 2: Filter DSS change greater than or equal to the 33% more than the min. required gain. See table 33% point gain.– Step 3: Column “Learning Gains Points”, in the first empty cell, type “1.1” and highlight to the last cell. Next, fill down. – Step 4: Clear filter from DSS Change and this time filter value less than 33% more than the required gain.– Step 5: Column “Learning Gains Points”, in the first empty cell, type “1.0”, highlight to the last cell. Next, fill down– Step 6: Clear filter from DSS Change, 2011 Level, and 2012 Level
5. Increase achievement level from Level 2 in 2011 to Level 3 in 2012: Follow steps in item 46. Increase achievement level from Level 1 in 2011 to Level 2 in 2012: Follow steps in item 47. Maintain Level 3-3, Level 4-4, and Level 5-5
– Step 1: Filter 3 under 2012 Level and 3 under 2011 Level– Step 2: Column “Learning Gains Points”, in the first empty cell, type “1.0”, highlight to the last cell. Next, fill down– Step 3: Clear filter from 2012 Level and 2011 Level– Repeat above steps 1 to 3 for L4-4 and L5-5
8. Retain at Level 1-1 and Level 2-2– Step 1: Filter 1 under 2012 Level and 1 under 2011 level – Step 2: Filter DSS change greater than or equal to the 33% more than the min. required gain. See table 33% point gain.– Step 3: Column “Learning Gains Points”, in the first empty cell, type “1.1”, highlight to the last cell. Next, fill down– Step 4: Clear filter from DSS Change and this time filter value at or higher than the min. required gain and less than 33% point gain.– Step 5: Column “Learning Gains Points”, in the first empty cell, type “1.0”, highlight to the last cell. Next, fill down– Step 6: Clear filter from DSS Change and this time filter value less than the min. required gain– Step 7: Column “Learning Gains Points”, in the first empty cell, type “0”, highlight to the last cell. Next, fill down– Step 8: Clear filter from DSS Change, 2011 Level, and 2012 Level– Repeat above steps 1 to 8 for retain at Level 2-2
9. Under Learning Gains Points, Filter Blanks. In the first empty cell, type “0”, highlight to the last student. Next, fill down. 10. Next, clear filter from Learning Gains Points
Student Database
96
Student Database
Demographics Information
Course Enrollments
FCAT, FCAT2.0, EOC scores,
FAA
Accountability Information
Interim Assessments
Monthly Assessment
2011-2012 Ideal Data File
97
2011-12Data File
2011-12 Demographics
Information
2010-11 FCAT Scores
2011-12 Interim
Assessments
2011-12 FCAT2.0 and EOC Scores
2011-12 Course
Enrollment
2011-12 Student
Accountability Information
Student ID
Student ID
Student ID
Stu
dent
ID
Student ID
Student ID
Student Data Sources
98
Student Data
Sources
Student Performance
Indicators (SPI)
Accountability Reports on
Principal Portal
Edusoft
File Download Manager
“Student ID” is used as a lookup value to merge the data from different files using Excel formula “V-Lookup”
=VLOOKUP(LOOKUP_VALUE, TABLE_ARRAY, COLUMN INDEX NUMBER, FALSE)
99
Accountability Reports on Principal Portal
Accountability Reports on Principal Portal
Bubble
Reading
Math
Gains
Reading
Math
Regress
Reading
Math
Lowest 25, 35, 45
Reading
Math
101
Accountability Reports on Principal Portal
Gain(Annual Learning
Gains)
YN
Bubble
PPossibility to be at
the next level
NNeutral
RRisk to decline the
level
RegressRN
Ranking: Percentile Ranking based on DSS
0-25 26-35 36-45 45-100
Edusoft Report Builder-1
104
Edusoft Report Builder-2
105
Result
Edusoft Report Builder-3
106
A
B
Result
Edusoft Report Builder-4
107
2. Type Report Name
Note:Create a new folder and name “Edusoft Files”
Save the export file under “Edusoft Files” Folder
VLOOKUP FUNCTION (P8)
=VLOOKUP(LOOKUP_VALUE, TABLE_ARRAY , COLUMN INDEX NUMBER, FALSE)
Lookup_Value:What value are you searching for?Excel will look for a match to this value in the leftmost column of the lookup table
Table_Array:Where do you want to search?Use absolute references to “lock” the range by pressing F4 key
Col_index_numWhich column contains the search result?Count over from the first column to figure out what this number should be, starting with 1.
FALSETo force Excel to lookup value be exact match
=VLOOKUP(b2,‘Homeroom'!$A$2:$B$37,2,FALSE)
VLOOKUP Formula
109
1 2 3 4 5A B C D E F G
1 Name Grade Student ID Gender Fall IA
PF ELL Winter IA PF
2 1818181 I S
3 1212121 S S
4 6666666 I L
5 11111111 L I
6 22222222 S S
7 33333333 S S
8 4444444 L S
9 5555555 L S
10 7777777 I I
11 8888888 L L12 9999999 S L13 1010101 S S14 1313131 L I
=VLOOKUP(LOOKUP_VALUE, TABLE_ARRAY, COLUMN INDEX NUMBER, FALSE)
C2 =vlookup(A2,‘Interim PF’!$C$2:$G$14,5,false)
A B C
1 Student ID 2012 Level
Winter PF
2 4444444 3 3 5555555 5 4 1111111 1 5 7777777 1 6 1515151 4 7 9999999 2 8 1010101 3 9 2020202 5
10 1212121 5 11 3333333 5
Column Index Number
Worksheet “Interim PF”
Worksheet “2012 FCAT”
Download File Download Manager
111