an opportunistic approach to data warehouse integration: or how to make a chicken sandwich
DESCRIPTION
An Opportunistic Approach to Data Warehouse Integration: or How to Make a Chicken Sandwich. April 19, 2005 Bernhard Kluger, Associate Director Student Information Systems Columbia University, New York, NY Best Practices in Data Warehousing in Higher Education - PowerPoint PPT PresentationTRANSCRIPT
An Opportunistic Approach An Opportunistic Approach to to Data Warehouse Data Warehouse Integration:Integration:
oror How to Make a Chicken How to Make a Chicken SandwichSandwich
An Opportunistic Approach An Opportunistic Approach to to Data Warehouse Data Warehouse Integration:Integration:
oror How to Make a Chicken How to Make a Chicken SandwichSandwich
April 19, 2005April 19, 2005
Bernhard Kluger, Associate DirectorBernhard Kluger, Associate DirectorStudent Information SystemsStudent Information Systems
Columbia University, New York, NYColumbia University, New York, NY
Best Practices in Data Warehousing in Higher EducationBest Practices in Data Warehousing in Higher EducationNorthwestern University, Evanston, ILNorthwestern University, Evanston, IL
April 19, 2005April 19, 2005
Bernhard Kluger, Associate DirectorBernhard Kluger, Associate DirectorStudent Information SystemsStudent Information Systems
Columbia University, New York, NYColumbia University, New York, NY
Best Practices in Data Warehousing in Higher EducationBest Practices in Data Warehousing in Higher EducationNorthwestern University, Evanston, ILNorthwestern University, Evanston, IL
Presentation GoalPresentation Goal
Identify specific examples of how Columbia has used its data warehouse to provide a single, integrated view of enterprise data…
…and where we have not.
Identify specific examples of how Columbia has used its data warehouse to provide a single, integrated view of enterprise data…
…and where we have not.
Presentation OverviewPresentation Overview
i. The Big Ideaii. Columbia and SISiii. SIS Reporting
Servicesiv. Three Casesv. What’s Next?
i. The Big Ideaii. Columbia and SISiii. SIS Reporting
Servicesiv. Three Casesv. What’s Next?
The Big IdeaThe Big Idea
One view of all data…any one, any way, right now.One view of all data…any one, any way, right now.
ERP System
s
Legacy Archive
s
Dept Apps
Off-Campus System
s
Reporting
Web PortalDept Apps
Ad Hoc
Where we are today…Where we are today…
DeptApps
Off-Campus Systems
Archive Data
SIS FinancialsHR
Data Warehouse:Daily Replication AIX Sybase 12.5
SIS(Legacy)
Financials (Legacy)
HR (PeopleSoft
)
VSAM & DB2
on zOS & AIX
Canned PortalDept Apps
Ad Hoc Data Access:“Siloed”Support
SIS Reporting (Infomaker) Fin & HR Reporting (Brio)
the lin
e o
f “n
o s
upp
ort
”
How to Make a Chicken SandwichHow to Make a Chicken Sandwich
Columbia and SIS ReportingColumbia and SIS ReportingColumbia and SIS ReportingColumbia and SIS Reporting
Columbia UniversityColumbia University
• Located in New York• Founded 1754• 23,400 Students• 7,700 Degrees
Conferred • 8,900 Faculty and Staff• 17 Schools• 4 campuses• Highly Decentralized…
• Located in New York• Founded 1754• 23,400 Students• 7,700 Degrees
Conferred • 8,900 Faculty and Staff• 17 Schools• 4 campuses• Highly Decentralized…
http://www.columbia.edu/cu/opir/Facts2003.htm
What Is SIS?What Is SIS?
Mission Statement
At SIS we provide the best possible integrated student information services to the Columbia University community by working collaboratively to ensure the accessibility, integrity, and security of student information.
Mission Statement
At SIS we provide the best possible integrated student information services to the Columbia University community by working collaboratively to ensure the accessibility, integrity, and security of student information.
What Is SIS?What Is SIS?
• A Partnership of Administrative Information Services and the Division of Student Services
• 25 employees in application development, maintenance, help desk, training, business process consulting, and reporting
• In 2003, received 2,436 requests from 426 distinct users in 99 departments
• A Partnership of Administrative Information Services and the Division of Student Services
• 25 employees in application development, maintenance, help desk, training, business process consulting, and reporting
• In 2003, received 2,436 requests from 426 distinct users in 99 departments
SIS Reporting ServicesSIS Reporting ServicesSIS Reporting ServicesSIS Reporting Services
An Evolving ToolkitAn Evolving Toolkit
From green screens and green bar paper…
…to one-click online reports via personalized portal.
SIS Systems: In the beginning…SIS Systems: In the beginning…
The Student Information System
Initiation: 1992• Users: 980• Platform: 0S/390
Mainframe• Ad Hoc: none• Reports: minimal
CICS/VSAM/Cobol
The Student Information System
Initiation: 1992• Users: 980• Platform: 0S/390
Mainframe• Ad Hoc: none• Reports: minimal
CICS/VSAM/Cobol
First Generation ReportingFirst Generation Reporting
SISUMENU (SIS User MENU)
Initiation: 1992• Users: 25 and falling• Platform: 0S/390
Mainframe• Ad Hoc: FOCUS in CMS• Reports: ~100• Integration: None
SISUMENU (SIS User MENU)
Initiation: 1992• Users: 25 and falling• Platform: 0S/390
Mainframe• Ad Hoc: FOCUS in CMS• Reports: ~100• Integration: None
Green Bar Paper, Green Screens
Second Generation: Ease of AccessSecond Generation: Ease of Access
SIS Report Server
Initiation: 1994• Users: 50 and falling• Platform: Sybase, AIX Unix• Ad Hoc: SQL, InfoMaker• Reports: None• Integration: Possible
SIS Report Server
Initiation: 1994• Users: 50 and falling• Platform: Sybase, AIX Unix• Ad Hoc: SQL, InfoMaker• Reports: None• Integration: Possible
Table design based 1:1 on SIS Screens
Third Generation: Ease of UseThird Generation: Ease of Use
SIS Desktop Reports
Initiation: 2000• Users: 296 and rising• Platform: InfoMaker • Ad Hoc: None• Reports: 505 and rising• Integration: None
Sybase stored procedures, parameter-driven, easier-to-use.
SIS Desktop Reports
Initiation: 2000• Users: 296 and rising• Platform: InfoMaker • Ad Hoc: None• Reports: 505 and rising• Integration: None
Sybase stored procedures, parameter-driven, easier-to-use.
Third Generation: Ease of UseThird Generation: Ease of Use
Third Generation: Ease of UseThird Generation: Ease of Use
Third Generation: Ease of UseThird Generation: Ease of Use
Three Cases: Platypus, Rubber Three Cases: Platypus, Rubber Chicken, or DodoChicken, or DodoThree Cases: Platypus, Rubber Three Cases: Platypus, Rubber Chicken, or DodoChicken, or Dodo
Simple Questions…Not Simple to AnswerSimple Questions…Not Simple to Answer
Is our department collecting as much application fee revenue as last year?
How many international students are in my department?
How many faculty are in my department?
SISFinancials
Ad Hoc
Case One: SIS-Financial ReportingCase One: SIS-Financial Reporting
Am I collecting enough application fee revenue?
Am I collecting enough application fee revenue?
DeptApps
Off-Campus Systems HR
Archive Data
SIS(Legacy)
Financials (Legacy)
HR (PeopleSoft
)
VSAM & DB2
on zOS & AIX
Canned PortalDept Apps
Data Access:“Siloed”Support
Data Warehouse:Daily Replication AIX Sybase 12.5
SIS Financials
Ad Hoc
Case One: SIS-Financial ReportingCase One: SIS-Financial Reporting
Am I collecting enough application fee revenue?
Am I collecting enough application fee revenue?
SIS Tables
FAS Table
AccountIDTransactionIDAmount ($$)
SIS-FAS Account
Mapping Table
PaymentCodeAccountID
FAS TableMapping Table
APPL Table
ApplicationIDStudentIDDeptIDPaymentTypeFeePaid (Y/N)FeeAmount($$)
Account Code Table
DeptIDPaymentTypePaymentCode
Case One: SIS-Financial ReportingCase One: SIS-Financial Reporting
Am I collecting enough application fee revenue?
Am I collecting enough application fee revenue?
APPL Table
ApplicationIDStudentIDDeptIDPaymentTypeFeePaid (Y/N)FeeAmount($$)
Account Code Table
DeptIDPaymentTypePaymentCode
SIS Tables
Design Issue: Will each user require FAS authorization?
• SIS database authorizes by DeptID• FAS database authorizes by AccountID• Is mapping table accurate?
Resolution: • SIS stored proc hands user ID to FAS database• Publish mapping report
FAS Table
AccountIDTransactionIDAmount ($$)
SIS-FAS Account
Mapping Table
PaymentCodeAccountID
FAS TableMapping Table
SIS Financials
Ad Hoc
Case Two: SIS-SEVIS ReportingCase Two: SIS-SEVIS Reporting
How many international students are in my department?How many international students are in my department?
DeptApps
Off-Campus Systems HR
Archive Data
SIS(Legacy)
Financials (Legacy)
HR (PeopleSoft
)
VSAM & DB2
on zOS & AIX
Canned PortalDept Apps
Data Access:“Siloed”Support
Data Warehouse:Daily Replication AIX Sybase 12.5
SIS Financials
Ad Hoc
Case Two: SIS-SEVIS ReportingCase Two: SIS-SEVIS Reporting
How many international students are in my department?How many international students are in my department?
DeptApps
Off-Campus Systems HR
Archive Data
SIS(Legacy)
Financials (Legacy)
HR (PeopleSoft
)
VSAM & DB2
on zOS & AIX
Canned PortalDept Apps
Data Access:“Siloed”Support
Data Warehouse:Daily Replication AIX Sybase 12.5
add to batch production cycle
SIS Financials
Ad Hoc
Case Three: SIS-HR ReportingCase Three: SIS-HR Reporting
How many faculty are in my department?How many faculty are in my department?
DeptApps
Off-Campus Systems HR
Archive Data
SIS(Legacy)
Financials (Legacy)
HR (PeopleSoft
)
VSAM & DB2
on zOS & AIX
Canned PortalDept Apps
Data Access:“Siloed”Support
Data Warehouse:Daily Replication AIX Sybase 12.5
SIS Financials
Ad Hoc
Case Three: SIS-HR ReportingCase Three: SIS-HR Reporting
How many faculty are in my department?How many faculty are in my department?
DeptApps
Off-Campus Systems HR
Archive Data
SIS(Legacy)
Financials (Legacy)
HR (PeopleSoft
)
VSAM & DB2
on zOS & AIX
Canned PortalDept Apps
Data Access:“Siloed”Support
Data Warehouse:Daily Replication AIX Sybase 12.5
What’s a “faculty”?
Next Steps at ColumbiaNext Steps at ColumbiaNext Steps at ColumbiaNext Steps at Columbia
Next Steps at ColumbiaNext Steps at Columbia
• Advertise the availability of integrated reports
• Monitor “freshness” of mapping tables…or create new mapping tables
• Add off-campus system to data warehouse
• Seek more projects that push the limits of existing data warehouse design
• Advertise the availability of integrated reports
• Monitor “freshness” of mapping tables…or create new mapping tables
• Add off-campus system to data warehouse
• Seek more projects that push the limits of existing data warehouse design
Lessons “Learning”Lessons “Learning”
• Listen to today’s users• Seek partners• Promote the BIG VISION
• Today’s chicken sandwich might be tomorrow’s jet liner…
• Listen to today’s users• Seek partners• Promote the BIG VISION
• Today’s chicken sandwich might be tomorrow’s jet liner…
Bernie KlugerBernie [email protected]@columbia.edu
212-854-1361212-854-1361
Columbia UniversityColumbia UniversityStudent Information SystemsStudent Information Systems
www.columbia.edu/cu/siswww.columbia.edu/cu/sis
Bernie KlugerBernie [email protected]@columbia.edu
212-854-1361212-854-1361
Columbia UniversityColumbia UniversityStudent Information SystemsStudent Information Systems
www.columbia.edu/cu/siswww.columbia.edu/cu/sis
Thank you !Thank you !