Date: Thursday, 7/12/12

Time: 1:30 – 2:30 PM

Location: Pennsylvania

Introduction of Santa Ana Team • Alexandra Ito, Director of Education Technology, SAUSD

• Ricardo Enz, Director of Technology, SAUSD

• Lisa McNicholas, Manager, Customer Education, eScholar

2

Presentation Overview

• Introduction

• Data Warehouse Infrastructure

• Student Success Metrics

• Analytics Reports and Dashboard

• Next Steps:

– Cloud Reports for Students

– College and Career Readiness

3

4

American Recovery and Reinvestment Act (ARRA)

Enhancing Education Through Technology (EETT)

Data Systems to Support Student Success

Early Warning Systems August 2008

Chicago Public Schools’ graduates and dropouts

were accurately identified 80 percent of the time

using an “on-track” indicator.

Some indicators are usually strong predictors

“In the high-poverty districts, we have not found

one district where grades, credits, and

attendance are not highly predictive…” Johns

Hopkins University

5

Strategic Use of Data: Early warning systems use

available school data to

identify students who are

beginning to show signs that

they are at risk of dropping

out.

This identification helps

educators to support

students with early and

targeted interventions.

6

Data into Knowledge

Knowledge into Action Action into

Improvement

7

Student-Centric Data Technology

7

Infrastructure: Data Warehouse

District Systems

Business Intelligence

Dashboard Access

Dashboards Adhoc Bursting Self-Service Desktop Tools

Centralized Portal

Data Governance

Training & Knowledge Security & Accountability

Business Intelligence Engine

Data Mining Technology

Metadata

Repository

Data Integration Technology (Link, Cleanse & Profile)

Service Oriented Architecture (Data Movement )

Enterprise

Data

Warehouse

Multidimensional

Data Analysis

CA STAR,

etc.

External Data Internal Data

SIS Financial HR Projects/ GIS …

People & Process

Information Delivery

Analysis

Data Integration

Data Sources

8

Data Warehousing & Business Intelligence Framework

9

OLTP & ODS Systems

Data Warehouse Data Mart

Packaged Applications

(Oracle, SAP, Others)

Excel XML/Office

Business Process

OLAP Sources

Exadata Unstructured & Semi-

Structured

Interactive Dashboards

Reporting & Publishing

Ad-hoc Analysis

Detect & Alert

Office Integration

Search Embedded Data Integration

Mobile Scorecards Collaborate

Common Enterprise Information Model

• Common Metadata Foundation across all Data Sources • Common Security, Access Control, Authorization, Auditing

• Common Request Generation and Optimized Data Access Services

• Common Clustering, Workload Management, & Deployment

• Common Systems & Operational Lifecycle Management

10 Oracle Stock Photos – permission to use on file

Data Warehouse Infrastructure: Software

Oracle Database

11

11g Database

• Extreme performance

• Lower costs

• Open – Standards based

• Secure

• Simplified enterprise architecture

Data Warehouse Infrastructure: Schema

• The eScholar Complete Data Warehouse® for PK-12

is a comprehensive software product which enables

state and local education agencies to gather,

integrate and manage key education-related data

from a wide variety of operational systems and data

sources.

12

Data Warehouse Infrastructure: Analytics

13

Office Integration

Ad-hoc Analysis

Scorecards

Secure Search

Strategy Maps

Geographic Visualization

Embedded in Applications

Interactive Dashboards

Scenario

Analysis

Production Reporting

Business Processes

Predictive Analysis Tablet / Mobile

Oracle Business Intelligence

Enterprise Edition

• What happened?

• Why did it happen?

• How to Optimize

Across Alternatives?

•Take Action - Who Does

What?

Data Warehouse Infrastructure: Reporting

• Stoneware's webNetwork 6 is a software solution that

allows organizations to deploy their own private and

hybrid clouds.

• webNetwork is installed inside of the data center on

servers and creates a secure cloud that provides

users with access to data center applications and

resources through a desktop built in a browser.

14

15

Student-Centric Data

15

Student Success Metrics: Data dictionary

Indicators

Metrics

16

Graduation Indicators (2011-12)

Spring 2011

Stakeholders – District, school site, partners

Data Interviews

provide data to establish data dictionary

identify existing analytics

Identify Metrics

Finalization of graduation indicators (July 2011)

Staff Development (beginning July 2011)

Implementation at high schools fall 2011,

intermediate schools spring 2012

17

Graduation Indicators

The graduation readiness score is made

up of five indicators:

1.Attendance

2.Assessments

3.Academics

4.Discipline

5.Mobility

18

Attendance – in order to learn, students must be present in the classroom. • High rates of absence are linked to course failure.

• Attendance, not prior test scores, is the single largest

variable in course failures among Chicago freshmen.

(Allensworth & Easton, 2007).

• 90% of Chicago ninth graders who miss less than a

week of school per semester graduate in four years,

compared to about 60% of students who missed one

week. (Allensworth & Easton, 2007).

• Philadelphia sixth and eighth graders with less than 80%

attendance for the year had a 75% chance or greater of

dropping out of school. (Neild & Balfanz, 2006).

Weight Sub- Indicator 30% Attendance rate (days present) < 95% for the

current year

30% 3 or more days absent in the current year

Excused & Unexcused absences combined

-OR-

3 or more tardies in the current year

20% 3 or more consecutive days absent in the

current year

20% 10 or more days absent in the current year 19

Attendance Early Warning Indicator – 35%

20

Assessments Indicator

• Standardized tests align with state content

standards and the results tell educators

what students have mastered as well as

what needs to be addressed.

Weight Sub- Indicator 30% 9th grade indicator: Failing mock CAHSEE score

-OR-

10th grade (+) indicator: Failing CAHSEE score

40% CELDT: deviations in proficiency (past 5 years)

EL student with 9+ years in an EL program, with a CELDT

score or Advanced or Early Advanced, and Reading and

Writing Subsections 2 levels below overall score

EL student with 9+ years in an EL program, with a CELDT

overall score of Intermediate, and Reading and Writing

subsections below Intermediate.

30% CST deviations in proficiency: assessment score or proficiency

level tracked over the past 3-5 years. 21

Assessments Early Warning Indicator – 20%

22

Academics Indicator

A

• Over 95% of Chicago freshman who earn a

B average or above in their freshman year

graduate and have an 80% chance of

graduating with at least a 3.0 GPA.

(Allensworth & Easton, 2007)

• In Chicago Public Schools, the likelihood of a

student graduating from high school in four

years decreases with each course failure,

and students with three or more failing grades

are not likely to graduate. (Allensworth &

Easton, 2007)

Weight Sub- Indicator 40% GPA < 2.4: based on 6 week progress reports

30% 1 or more courses failed in the current year

-OR-

Any course grade “F” or “D”

30% Student did not pass both semesters of Algebra:

List of Algebra classes provided as supplement*

-OR-

Core course failed in the current year: List of core

courses provided as a supplement* 23

Academics Indicator – 20%

24

Discipline Indicator

• Disruptive behavior affects the learning of

the student misbehaving as well as other

students in the classroom.

• Only 20% of Philadelphia students

receiving one or more suspensions in

sixth grade graduated on time. (Balfanz,

Herzog, & Maclver, 2007).

Weight Sub- Indicator

40% 3 or more serious infractions for the

current year

60% Specific types of infractions

25

Discipline Early Warning Indicator – 15%

• Students who move often do not have the

benefit of developing a relationship with

teachers and often experience gaps in their

knowledge due to differences in curriculum

scope and sequence.

• High mobility puts students at risk for

academic and behavior problems

(Hartman & Leff, 2002).

26

Mobility Indicator

27

Weight Sub- Indicator 100% 3 or more moves or enrollments

during the current school year

Mobility Early Warning Indicator – 10%

28

Student-Centric Use of Data

28

Data Warehouse Infrastructure

Student Success Metrics

Analytics Reports & Dashboard

Professional Development

Use Analytic Reports

Align Resources, Interventions

Assess Progress

Cloud Reports for Students

29

Project Arrow

Professional Development Plan

Training Model

Introduction: Data warehousing concepts and input on indicators

Site Expert Training: Training for the designated school expert.

Mechanics of Reporting: School site training on navigation and

usage of the dashboard reports.

Interpreting Reports to Drive Instructional Decisions: Review

indicators and apply knowledge to current student data.

On-site, Jon-Imbedded Training: School visits to target individual

skills, extend learning and support masterful use of the data.

eScholar U: Online learning resources.

30

Overall Early Warning Score

31

• Student ID

• Student Name

• Special Ed

Indicator

• ELL Indicator

• 504 Indicator

##

##

##

##

##

##

Paz, Sam

Smith, Karl

Valdes, Jen

Massa, Paul

Chan, Shara

Perez, Tom

Counselor

Counselor

Counselor

Counselor

Counselor

Counselor

School Year Guidance Counselor

School Grade

Spec Ed Indicator ELL Indicator

504 Indicator

Overall Early Warning Score Fictitious student names

32

Student Demographics

• Contact Information

• Spec Ed Indicator

• ELL Indicator

• ELL Reclassification Indicator

• Years in ELL program

• 504 Status

33

Attendance Reports & Dashboard

34

##

##

##

##

##

##

##

Paz, Sam

Smith, Karl

Valdes, Jen

Massa, Paul

Chan, Shara

Perez, Tom

Drill Down Details

Attendance Start Date

Attendance Date

School Level Attendance Counts

Attendance Reports Drill Down

Fictitious student names

35

Assessment Reports & Dashboard

36

Assessment Report Drill Down

Paz, Sam

Smith, Karl

Valdes, Jen

Massa, Paul

Chan, Shara

Perez, Tom

Fictitious student names

37

Academics Reports & Dashboard

38

Academics Report Drill Down

##

##

##

##

##

Drill Down Details

Grading Period

Course ID

Course Name

Course Grade

39

Discipline Reports & Dashboard

40

Discipline Reports Drill Down

##

##

##

##

##

41

Mobility Reports & Dashboard

42

Mobility Reports & Dashboard - drilldown

##

##

##

##

##

43

Next Steps: Cloud Reports for Students

Students/Parent

login to access

graduation and

college readiness

reports

Provides

student with

access to

data report

and resources

through a

desktop built

in a browser

44

Next Steps: Cloud Reports for Students

Student

has not

passed the

CAHSEE

and is at

risk of not

graduating

(Red)

Student’s credits

earned towards

graduation

(Green)

SAUSD Strategic Plan Superintendent Thelma Meléndez de Santa Ana, Ph.D.

• Seven Building Blocks to SAUSD Success

– Preparing all students to be college and

career ready

• Comprehensive Accountability

– Establishing Key Performance Indicators

That Support Student Success For College

And Career

45

Key Performance Indicators

• Cycle of Development

– Principal feedback

– Continuous improvement team

– District office data experts

46

Step 9 A-G course completion in Grade 12

Step 8 PSAT/SAT/ACT in Grade 10-12

Step 7 AP courses in Grade 10-12

Step 6 Algebra 2 proficiency in Grade 11

Step 5 Algebra 1 proficiency in Grade 8

Step 4 Math proficiency in Grade 4

Step 3 EL proficiency and reclassification, Grade 5 & 7

Step 2 Writing proficiency in Grade 4 & 7

Step 1 Reading Proficiency in Grade 1, 3 & 6

48

Indicator Measure Kinder Ready by the end of PreK

DRDP- Desired results Developmental Profile assessment.

Reading Proficiency in Grades 1, 3, and 6

DIBELS Next - Dynamic Indicators of Basic Early Literacy Skills Next DIBELS MAZE - used as a measure of reading comprehension

Writing proficiency at grade level or above in Grades 4 & 7

SAUSD Performance Based Writing Assessment

English Language proficiency growth

The CELDT (California English Language Development Test) AMAO 2 (annual measurable achievement objectives)

English Language Reclassification

CELDT - Students who are English learners must participate in the annual administration of the CELDT until they are reclassified as RFEP.

Math proficiency in Grade 4 Math Benchmark 3

College and Career

Readiness Indicators (2012)

49

College and Career

Readiness Indicators (2012)

Indicator Measure Algebra I proficiency by Grade 8

CST - measure students' progress toward achieving California's state-adopted academic content standards

Algebra 2 proficiency by Grade 11

CST - measure students' progress toward achieving California's state-adopted academic content standards

PSAT by grade 11 PSAT- The Preliminary SATis a standardized test that provides firsthand practice for the SAT®.

SAT at 1650 SAT - the SAT is the benchmark standardized assessment of the critical skills students need to be successful in college.

ACT at 24 The ACT® test is an educational and career planning tool that assesses students' academic readiness for college.

AP Courses in Grade 10-12

AP (Advanced Placement) course enrollment

A-G course completion in Grade 12

A-G course codes on student records will provide information on A-G course completion

Attendance rate Attendance records captured in Aeries student information system

Suspension rate Suspension records captured in Aeries student information system

Expulsion rate Expulsion records captured in Aeries student information system

50

SAUSD Website – Project Arrow Webpage

http://www.sausd.us/Page/13358

Alexandra.ito@sausd.us

Ricardo.enz@sausd.us