an eye on the future a review of data virtualization techniques to improve research analytics...

An eye on the future: A review of Data Virtualization Techniques to improve research Presenter: Jack A Richter

Authors: Jack A Richter, Lela McFarland, Christine Bredfeldt, Ph.D

Contributors: Rajesh V DevKaran (KPIT), Wayne Little (KPIT), Sriram Thiruvenkatachari (KPIT), Sean Mikha (Teradata), Steven C Werntz (KPGA) .,

MID-ATLANTIC PERMANENTE RESEARCH INSTITUTE

2 | © 2011 Kaiser Foundation Health Plan, Inc. For internal use only.April 10, 2023

What is “Data Virtualization”?

— "Clearly Defining Data Virtualization, Data Federation and Data Integration“Rick Van der Lans - Industry analyst and author specializing in DW, SOA, and Database technology The Hague, The Netherlands - Dec 16, 2010

"Data virtualization is the process of offering data consumers a data access interface that hides the technical aspects of stored data, such as location, storage structure, API, access language, and storage technology."

3 | © 2011 Kaiser Foundation Health Plan, Inc. April 10, 2023

Data Virtualization

Data Virtualization Technique Data Virtualization Technique

Flat Files, Spreadsheets, etc.

Oracle Oracle

SQL/Server SQL/Server Enterprise DW Enterprise DW

Virtualized Data

3rd Party Data Sources

TeradataTeradata

Source: Data Virtualization Use Cases 12-23-2011.docx By Wayne Little and Rajesh V DevKaran


Enterprise Data Warehouse (EDW)

All pertinent data moved to one physical database

CRMLabLab Radiology Radiology MembershipMembership

Enterprise Data Warehouse (EDW)

ClaimsClaims Scheduling Pharmacy HR, Payroll, etc. Etc.

Multiple Custom ETL ProcessesMultiple Custom ETL Processes


Data Marts – A Subset of the EDW

Data Subject area consolidated in one database

CRMLabLab Radiology Radiology MembershipMembershipClaimsClaims Scheduling Pharmacy Oncology

Lab Data Mart

Membership and Utilization Data Mart

Micro Labs




Distributed Database Links and Synonyms Create links between databases with synonyms so data can be

accessed and used between databases without knowledge of the source database.

CRMLabLab Radiology Radiology MembershipMembershipClaimsClaims Scheduling Pharmacy Oncology Micro Labs

Link Definitions with synonymsLink Definitions with synonyms

Claims Data Mart (Views)

Claims Data Mart (Views)

Link Definitions with synonymsLink Definitions with synonyms

Membership and Utilization Data Mart (Views)

Membership and Utilization Data Mart (Views)


SQL or Tool “Views”

Views – Creating a “view” to the data

Procedure Definition TableProcedure Definition Table

PATIENT_PROCEDURES (View)PATIENT_PROCEDURES (View)

Patient EncountersPatient Encounters

Encounter ProceduresEncounter Procedures

Back Office ProceduresBack Office Procedures

Claims ProceduresClaims ProceduresPatientPatient


A Data Virtualization Diagram

Source: Data Virtualization Use Cases 12-23-2011.docx By Wayne Little and Rajesh V DevKaran

Data Virtualization ToolData Virtualization Tool


Oracle Oracle

SQL/Server SQL/Server Enterprise DW Enterprise DW

Business ObjectsBusiness Objects

Web Application/ Browser

SOASOACognosCognos

Virtual Schema

SASSAS

SQL ClientsSQL Clients

3rd Party Data Sources

TeradataTeradata

Mobile Clients/AppsMobile Clients/Apps

The Forecast for Databases is Partly Cloudy


What is a “Cloud Database” ?

Database Hosting Service accessible via the Internet

An Internet Service that connects users to Databases accessible via the internet.


Cloud Database as a Hosting Service


Your Cloud Hosting System


TeradataTeradata

Public or Private Approved User or Application

Internet Cloud

Enterprise DW Enterprise DW

Oracle Oracle

SQL/Server SQL/Server Library of Congress Cloud Database Hosting System

Library of Congress Cloud Database Hosting System

LOC Access Point

Databases

Access Point - Virtual Schema orPass through direct to databases


Cloud Database as a Database Access Service




Your Virtual Schema

TeradataTeradata

Public or Private Approved User or

Application

Internet Cloud

Generic Vendor Cloud Database Access System

Generic Vendor Cloud Database Access System

Enterprise DW Enterprise DW

Oracle Oracle

SQL/Server SQL/Server Library of Congrwess Cloud Database Hosting System

Library of Congrwess Cloud Database Hosting System

LOC Access Point

Business B database

Business A database

Databases

Generic Access Point


Special Thanks to: Kaiser Permanente IT

– Rajesh V. DevKaran Consultant Specialist, Analytic Solutions & Standards, Enterprise

Architecture/Information Management

– Sriram Thiruvenkatachari Principal Solutions Consultant, Infrastructure Mgt Group, Systems Integration

– Wayne Little Principal Information Architect, Information Architecture and Standards Mgt,

Enterprise Architecture/Information Management

Kaiser Permanente Georgia– Steven C. Werntz

Manager, Business Intelligence Solutions, KPGA

Teradata– Sean Mikha

Solution Architect, Finance, HealthCare and Insurance (FIH)


Contacts, Vendors and Links

Contacts for this presentation– Jack Richter – [email protected]

– Lela L McFarland – [email protected]

– Christine E Bredfeldt – [email protected]

Some Vendors & Links– Data Virtualization

Vendor- Composite Software, Inc. - http://www.compositesw.com/

Vendor - Denodo Technologies, Inc. - http://www.denodo.com/en/index.php

Vendor – IBM - http://www.ibm.com/search/csass/search?sn=mh&q=cloud%20database&lang=en&cc=us&en=utf

Vendor – Informatica Corporation - http://www.informatica.com/us/products/data-virtualization/

White Paper – Data Virtualization reaches Critical Mass - http://purl.manticoretechnology.com/ImgHost/582/12917/2011/resources/white_papers/DataVirtualizationReachesCriticalMass.pdf

an eye on the future a review of data virtualization techniques to improve research analytics...

Documents