An eye on the future: A review of Data Virtualization Techniques to improve research Presenter: Jack A Richter
Authors: Jack A Richter, Lela McFarland, Christine Bredfeldt, Ph.D
Contributors: Rajesh V DevKaran (KPIT), Wayne Little (KPIT), Sriram Thiruvenkatachari (KPIT), Sean Mikha (Teradata), Steven C Werntz (KPGA) .,
MID-ATLANTIC PERMANENTE RESEARCH INSTITUTE
2 | © 2011 Kaiser Foundation Health Plan, Inc. For internal use only.April 10, 2023
What is “Data Virtualization”?
— "Clearly Defining Data Virtualization, Data Federation and Data Integration“Rick Van der Lans - Industry analyst and author specializing in DW, SOA, and Database technology The Hague, The Netherlands - Dec 16, 2010
"Data virtualization is the process of offering data consumers a data access interface that hides the technical aspects of stored data, such as location, storage structure, API, access language, and storage technology."
3 | © 2011 Kaiser Foundation Health Plan, Inc. April 10, 2023
Data Virtualization
Data Virtualization Technique Data Virtualization Technique
Flat Files, Spreadsheets, etc.
Oracle Oracle
SQL/Server SQL/Server Enterprise DW Enterprise DW
Virtualized Data
3rd Party Data Sources
TeradataTeradata
Source: Data Virtualization Use Cases 12-23-2011.docx By Wayne Little and Rajesh V DevKaran
4 | © 2011 Kaiser Foundation Health Plan, Inc. For internal use only.April 10, 2023
Enterprise Data Warehouse (EDW)
All pertinent data moved to one physical database
CRMLabLab Radiology Radiology MembershipMembership
Enterprise Data Warehouse (EDW)
ClaimsClaims Scheduling Pharmacy HR, Payroll, etc. Etc.
Multiple Custom ETL ProcessesMultiple Custom ETL Processes
5 | © 2011 Kaiser Foundation Health Plan, Inc. For internal use only.April 10, 2023
Data Marts – A Subset of the EDW
Data Subject area consolidated in one database
CRMLabLab Radiology Radiology MembershipMembershipClaimsClaims Scheduling Pharmacy Oncology
Lab Data Mart
Membership and Utilization Data Mart
Micro Labs
Multiple Custom ETL ProcessesMultiple Custom ETL Processes
Multiple Custom ETL ProcessesMultiple Custom ETL Processes
6 | © 2011 Kaiser Foundation Health Plan, Inc. For internal use only.April 10, 2023
Distributed Database Links and Synonyms Create links between databases with synonyms so data can be
accessed and used between databases without knowledge of the source database.
CRMLabLab Radiology Radiology MembershipMembershipClaimsClaims Scheduling Pharmacy Oncology Micro Labs
Link Definitions with synonymsLink Definitions with synonyms
Claims Data Mart (Views)
Claims Data Mart (Views)
Link Definitions with synonymsLink Definitions with synonyms
Membership and Utilization Data Mart (Views)
Membership and Utilization Data Mart (Views)
7 | © 2011 Kaiser Foundation Health Plan, Inc. For internal use only.April 10, 2023
SQL or Tool “Views”
Views – Creating a “view” to the data
Procedure Definition TableProcedure Definition Table
PATIENT_PROCEDURES (View)PATIENT_PROCEDURES (View)
Patient EncountersPatient Encounters
Encounter ProceduresEncounter Procedures
Back Office ProceduresBack Office Procedures
Claims ProceduresClaims ProceduresPatientPatient
8 | © 2011 Kaiser Foundation Health Plan, Inc. April 10, 2023
A Data Virtualization Diagram
Source: Data Virtualization Use Cases 12-23-2011.docx By Wayne Little and Rajesh V DevKaran
Data Virtualization ToolData Virtualization Tool
Flat Files, Spreadsheets, etc.
Oracle Oracle
SQL/Server SQL/Server Enterprise DW Enterprise DW
Business ObjectsBusiness Objects
Web Application/ Browser
SOASOACognosCognos
Virtual Schema
SASSAS
SQL ClientsSQL Clients
3rd Party Data Sources
TeradataTeradata
Mobile Clients/AppsMobile Clients/Apps
The Forecast for Databases is Partly Cloudy
9 | © 2011 Kaiser Foundation Health Plan, Inc. For internal use only.April 10, 2023
What is a “Cloud Database” ?
Database Hosting Service accessible via the Internet
An Internet Service that connects users to Databases accessible via the internet.
10 | © 2011 Kaiser Foundation Health Plan, Inc. April 10, 2023
Cloud Database as a Hosting Service
Flat Files, Spreadsheets, etc.
Your Cloud Hosting System
Your Cloud Hosting System
TeradataTeradata
Public or Private Approved User or Application
Internet Cloud
Enterprise DW Enterprise DW
Oracle Oracle
SQL/Server SQL/Server Library of Congress Cloud Database Hosting System
Library of Congress Cloud Database Hosting System
LOC Access Point
Databases
Access Point - Virtual Schema orPass through direct to databases
11 | © 2011 Kaiser Foundation Health Plan, Inc. April 10, 2023
Cloud Database as a Database Access Service
Flat Files, Spreadsheets, etc.
Your Cloud Hosting System
Your Cloud Hosting System
Your Virtual Schema
TeradataTeradata
Public or Private Approved User or
Application
Internet Cloud
Generic Vendor Cloud Database Access System
Generic Vendor Cloud Database Access System
Enterprise DW Enterprise DW
Oracle Oracle
SQL/Server SQL/Server Library of Congrwess Cloud Database Hosting System
Library of Congrwess Cloud Database Hosting System
LOC Access Point
Business B database
Business A database
Databases
Generic Access Point
12 | © 2011 Kaiser Foundation Health Plan, Inc. For internal use only.April 10, 2023
Special Thanks to: Kaiser Permanente IT
– Rajesh V. DevKaran Consultant Specialist, Analytic Solutions & Standards, Enterprise
Architecture/Information Management
– Sriram Thiruvenkatachari Principal Solutions Consultant, Infrastructure Mgt Group, Systems Integration
– Wayne Little Principal Information Architect, Information Architecture and Standards Mgt,
Enterprise Architecture/Information Management
Kaiser Permanente Georgia– Steven C. Werntz
Manager, Business Intelligence Solutions, KPGA
Teradata– Sean Mikha
Solution Architect, Finance, HealthCare and Insurance (FIH)
13 | © 2011 Kaiser Foundation Health Plan, Inc. For internal use only.April 10, 2023
Contacts, Vendors and Links
Contacts for this presentation– Jack Richter – [email protected]
– Lela L McFarland – [email protected]
– Christine E Bredfeldt – [email protected]
Some Vendors & Links– Data Virtualization
Vendor- Composite Software, Inc. - http://www.compositesw.com/
Vendor - Denodo Technologies, Inc. - http://www.denodo.com/en/index.php
Vendor – IBM - http://www.ibm.com/search/csass/search?sn=mh&q=cloud%20database&lang=en&cc=us&en=utf
Vendor – Informatica Corporation - http://www.informatica.com/us/products/data-virtualization/
White Paper – Data Virtualization reaches Critical Mass - http://purl.manticoretechnology.com/ImgHost/582/12917/2011/resources/white_papers/DataVirtualizationReachesCriticalMass.pdf