florida education data warehouse project overview feb 26th, 2001
TRANSCRIPT
Florida Education Data Warehouse
Project Overview Feb 26th , 2001
2
AgendaAgenda
1
2
4
Background
3
Targeted Content
6
5
Technical Aspects
High-Level Plan
Challenges
For more information
1Project Background and Goals
4
A normal day in the education fieldA normal day in the education field
What happened in
previous year ?
Where and how can we
improve Education in Florida?
What’s going to
happen in the future ?
Did we make the right/best decision?
Hi, I’m a researcher looking for infomation
on...
How does that compare to what was expected to happen this year (last year)?
What’s happening right now ?
5
Current EnvironmentCurrent Environment
Operational systems isolated
by business functions
Limited data readily
available
Various data and technical architectures
Users support
Lack of reliable, consistent data across
delivery systems
Technical barriers
No Pre K-20data
integration
6
Proposed K-20 Proposed K-20 Performance/Accountability SystemPerformance/Accountability System
How are individual higher education institutions, school districts and schools performing their responsibility to
educate their students?
How are the major delivery systems
performing (K-12, CC, SUS)?
How is Florida’s K-20 system performing in terms of educating its students?
What is the public getting for the funds invested in Education?
7
The objectivesThe objectives
Complete, timely,
accurate data
Comprehensive data definitions
Data from multiple sources and
organizations
Easy access and
manipulation
Cross-functional data management and support
group
Historical data merged with current in a
structured repository
Integrated technical
environment
Statewide view
8
Our MissionOur Mission
Provide stakeholders in public Provide stakeholders in public education - including, but not limitededucation - including, but not limitedto, administrators, educators, parents,to, administrators, educators, parents,
students, state leadership, and students, state leadership, and professional organizations - professional organizations -
with the capability of receiving with the capability of receivingtimely, efficient, consistent responses to timely, efficient, consistent responses to inquiries into Florida’s pre-kindergarteninquiries into Florida’s pre-kindergarten
through university education system through university education system by December 2002.by December 2002.
9
Collaborative development effort with
Department of Education State Board of Community Colleges State University System DMR Consulting
Built in increments (phases)
Project Unique CharacteristicsProject Unique Characteristics
10
Includes all functional parts of the education delivery system K-20
School districts Community colleges State universities
Statewide picture
Historical and current data
Over a 2 year period…we’re just beginning
Project Unique CharacteristicsProject Unique Characteristics
11
A wide array of usersA wide array of users
School DistrictsState
Universities
Community Colleges
ReportersMediaEducation Community
StudentsTeachersParents
LegislaturePoliticians
Researchers
2Targeted content of the EDW
13
From Pre K-12From Pre K-12
EDW Central Repository and Datamarts (Current year + 5)
- 2,376,128 students (1999)- 10 years of data - Demographic - Course/Program - Funding
Staff source data- 268,983 FTS (1999)- 10 years of data - Demographic - Salary/Benefits - Experience - Degrees - In Service - Job Codes (4 times/ year)
Selection Process
End of Year discipline,retention/ promotion, dropout, graduate/completer Incidents of crime and violence
(6 times/Year)
Students source data
14
Staff source data- 56,400 empl. (1999)- 10 years of data - Demographic - Salary - Benefits - Course Schedule - Employment Activities - Instruction Activities - Reassignments(3 submissions / year)
From Community CollegesFrom Community Colleges
EDW Central Repository and Datamarts (Current year + 5)
Students source data- 717,561 students (1999)- 10 years+ of data - Demographic - Entry/Exit testing - Acceleration placement - Courses/Programs - Programs - Completion - Financial aid ( 5 submissions / Year)
Facilities- 156 Sites- 2,219 Facilities- 64,000 rooms
Selection Process
(+ 1 annual submission)
15
From State University SystemFrom State University System
EDW Central Repository and Datamarts (Current year + 5)
Students Source Data- 234,016 students (1999)- 25 years+ of data - Demographic - Admission - Acceleration placement - Courses/grades/credits - Discipline/ academic history - Stipends/waivers/fellows - Financial aid ( 5 times / Year)
Staff Source Data- 33,552 empl. (1999)- 10 years of data - Demographic - Salary/Benefits… - Classification... - Appointm. period - Employ./ Instruc. Activities -Rank / Tenure(26 times / year)
Facilities- Sites- Facilities- Rooms
Selection Process
16
A complex integration processA complex integration process
EDW Central Repository and Datamarts (Current year + 5)
Identify / MatchReconcile
CleanSynchronize
Integrate
Department ofEducation data
(Pre K-12)
Community Collegedata
State Universitydata
3High level plan
18
High Level High Level Schedule (Schedule (work in progress)work in progress)
Final Design
Release 1Prototype
PreliminaryDesign
Release 2
Release 3
Release 4
Ongoing
June 2001
Dec. 2001
June 2002
Dec. 2002
Target: 1 release every 6 months
4Technical aspects
20
Generic InfrastructureGeneric Infrastructure
DB2, OracleSQL-Server
VSAM, SAM,
Sequential
Access to source dataAccess to source data
Transform& load
Data transformation & integrationData transformation & integration
Data Warehouse
Pre-formatted Query/reports OLAP
Store
Access
Data movementData movement
Metadata & DW
management tools
Extract
Specialized Data Marts
Web tools / portal (Web-DB)
ARDENT TOOLS(Datastage)
ORACLE ToolsStorage & Access
Access,Dbase, Foxpro
21
Technical environmentTechnical environment
MainframeData Source
Ethernet
Internet
Ethernet
Data SourceServers Standard
Users
OC-3100-
155Mbps
Sun 10000Data SourceData Target
199.250.30.78
STO
} DMZEthernet
Outside WorldUsers
DOE
NWRDC
Data SourceServers
DevelopmentApplication
ServerDevelopers
Ethernet
Montreal
Developers
WebUsers
VPN
Cisco Pix 520Novell ICS
v1.2.05
Cisco Pix
HighlightsSun 10000UnixOracle 8i to 9ArdentOr-WebDBOr-DiscovererOr-Express4 terabytes
4Challenges
23
Management ChallengesManagement Challenges
Reconcile various missions and objectives ofagencies involved
Agencies’ involvement,
collaboration,synergy
ManageScope and
Expectations Budget and time boxing
Data Warehouseorganizational
issues
Communication
24
Technical ChallengesTechnical Challenges
Reconcile Current and
Historical Data
Common-ID
Tools Integration
DataQuality
Size of theData Warehouse
Multiplesites/platforms
Privacy and Security
25
Utilization ChallengesUtilization Challenges
Usersupport and
training
Data & DWMastering
Metadata (comprehensive
dictionary)gathering
New Toolsto learn
User Friendliness
Trust theDW results
6Who to contact….
27
Karen Weaver: [email protected] Bernard Sévigny: [email protected] Kim McDougal: [email protected] Kathy Peck: [email protected] Robert McMullen: [email protected] Shirley Roddenbery: [email protected]
DOE Internet site: http://www.firn.edu/doe/bin00050/dataweb/database.htm SBCC Internet site: http://www.dcc.firn.edu SUS Internet site: http://www.borfl.org/irm/default.asp Transition Task Force Internet site:
Contact Names and E-mail Contact Names and E-mail AddressesAddresses
http://www.myflorida.com/myflorida/education/learn/egrt_taskforce/index.html