paul moxon denodo technologies - alberta data...

© 2014 Denodo Technologies

Data Virtualization

Paul Moxon Denodo Technologies

Alberta Data Architecture Community

January 22nd, 2014

© 2014 Denodo Technologies

25 35 45 55 65 75

The Changing Speed of Business

85 95 100

© 2014 Denodo Technologies

Gartner – The Nexus of Forces

© 2014 Denodo Technologies

Today’s Data Realities

■ Data volumes are growing and will continue to grow at an accelerating rate

■ As new sources of data are exploited, data complexity is here to stay

■ There is no such thing as a ‘batch window’ – the business wants the data now

■ Users want more than ‘canned reports’…they want self-service with access to data as resources

■ Costs of traditional data solutions are escalating

© 2014 Denodo Technologies

Traditional Methods - Too Slow, Too Limited, Too Costly

■ The Data Warehousing Institute - Orgs. on avg.

• 8 wks. - add new data source to a DW

• 7 wks. - build complex dashboard or report

■ Forrester - IT spends avg. 1% of Rev. on Storage

• 75% of the data stored - inactive, rarely accessed

• 90% of all data access requests in production OLTP are serviced by new data

■ Gartner –Top Technology Trends 2013

Data Virtualization - “Central to success is an enabling technology infrastructure that helps information producers and information consumers organize, share and exchange any type of data and content, anytime, anywhere”

© 2014 Denodo Technologies

Business Need for Information Agility

■ Business entity views

■ Pre-integrated information

■ Discovery, self-service

■ Fast access, ~ real-time

■ Trustworthy, accurate

■ Flexible, mobile

data

semantic

relations

information

knowledge

wisdom

understanding

relations

understanding

patterns

understanding

principles

understanding

© 2014 Denodo Technologies

Information Gap

Information Gap

© 2014 Denodo Technologies

What is Data Virtualization?

BASE VIEW

BASE VIEW

BASE VIEW

DERIVED VIEW

Data Virtualization combines disparate data sources into a single “virtual” data layer that provides unified access and integrated data services to consuming applications in real-time (right-time)

Connect &

Virtualize

Combine &

Integrate

Publish as a Data Service

© 2014 Denodo Technologies

Data Virtualization – Key Tenets

■ Realize Value from all Data

• Universal data access across internal, external, web, structured or unstructured

■ Virtualization Minimizes Replication

• Flexible integration options with fine control – virtual real-time, cached or scheduled batch

■ Abstracted and Unified Data Services

• Abstracted data delivered as reusable data services Managed access control, service levels

■ Enterprise Class – Powerful and Agile

• Performance and scalability

• Data governance, lineage, management

• Easily integrated into existing IT infrastructure

© 2014 Denodo Technologies

Core Data Virtualization Capabilities

Data Virtualization

Unified Data Governance

Agile Data Services

Provisioning

Semantic Integration of

Structured, Web, Unstructured

Logical Abstraction &

Decoupling

On-demand, real-time access to

disparate data

© 2014 Denodo Technologies

Denodo Data Virtualization Platform

© 2014 Denodo Technologies

Denodo Data Virtualization Platform

Logical

Abstraction &

Decoupling

© 2014 Denodo Technologies

Denodo Data Virtualization Platform

Semantic

Integration of

Structured, Web,

Unstructured

Logical

Abstraction &

Decoupling

© 2014 Denodo Technologies

Denodo Data Virtualization Platform

Agile Data

Services

Provisioning

Semantic

Integration of

Structured, Web,

Unstructured

Logical

Abstraction &

Decoupling

© 2014 Denodo Technologies

Denodo Data Virtualization Platform

On-demand, real-

time access to

disparate data

Agile Data

Services

Provisioning

Semantic

Integration of

Structured, Web,

Unstructured

Logical

Abstraction &

Decoupling

© 2014 Denodo Technologies

Denodo Data Virtualization Platform

On-demand, real-

time access to

disparate data

Agile Data

Services

Provisioning Unified Data

Governance

Semantic

Integration of

Structured, Web,

Unstructured

Logical

Abstraction &

Decoupling

© 2014 Denodo Technologies

Denodo Platform Demo

© 2014 Denodo Technologies

Analytics / Informational

Operational / Transactional

Web, Cloud, and B2B Integration

Data Management & Data Services Infrastructure

Broad Spectrum Data Virtualization Patterns

© 2014 Denodo Technologies

Analytics / Informational

Operational / Transactional

Web, Cloud, and B2B Integration

Data Management & Data Services Infrastructure

Broad Spectrum Data Virtualization Patterns – Analytical/Informational

•Real Time Reporting

•Operational BI / Analytics

•Prototyping EDW

•Logical DW

•Virtual Data Marts

•Hybrid DV-ETL

Mainstream BI & DW

•NoSQL as Sandbox

•NoSQL for Cold Data Storage

•NoSQL Staging Area

•Hybrid Data Storage

•NoSQL for ETL

•Expose Big Data Results

Big Data Analytics

•Data Discovery, ‘What If’ Analytics

•Self-Service BI and Reporting

Data Discovery / Self-Service

© 2014 Denodo Technologies

Analytics / Informational

Operational / Transactional

Web, Cloud, and B2B Integration

Data Management & Data Services Infrastructure

Broad Spectrum Data Virtualization Patterns – Operational/Transactional

•Agile Mobile and Cloud App Development

•Agile SOA and BPM Development

•Agile Portal and Collaboration Development

Data Services for Application Development

•Legacy Application Modernization

•Migration from Enterprise to Cloud/SaaS

•Mergers & Acquisitions – Data Consolidation

Data Abstraction for Migration & Modernization

•Data Services for Partners

•B2B Integration through Web Automation

B2B Data Services & Integration

•Customer Service & Call Centers

•Products/Product Catalogs

•Vertical Specific (e.g. Well or Physician Data)

Single View Applications

© 2014 Denodo Technologies

Analytics / Informational

Operational / Transactional

Web, Cloud, and B2B Integration

Data Management & Data Services Infrastructure

Broad Spectrum Data Virtualization Patterns – Web, Cloud, and B2B Integration

•Web Extraction (data.gov, public sources, etc.)

•Competitive BI

•Data Services in Cloud

•Social Media Integration

•Cloud/SaaS Application Integration

•B2B Integration through Web

Web, Cloud, and B2B Integration

© 2014 Denodo Technologies

Analytics / Informational

Operational / Transactional

Web, Cloud, and B2B Integration

Data Management & Data Services Infrastructure

Broad Spectrum Data Virtualization Patterns – Data Management & Data Services Infrastructure

•Canonical Views of Data Entities

•Enterprise Business Data Glossary

•Virtual MDM

•Integrated SOA – Data, Logic, & Business Services

•Enterprise Data Services

Data Management & Data Services Infrastructure

© 2014 Denodo Technologies

Patterns: Analytical/Informational

Logical Data Warehouse

Hybrid Data Storage

Hybrid DV-ETL

NoSQL for ETL

© 2014 Denodo Technologies

Patterns: Operational/Transactional

Agile SOA & BPM Development Migration - Enterprise to Cloud/SaaS

Customer Call Center Mergers & Acquisitions

© 2014 Denodo Technologies

Biogen Idec - Agile BI Real-time Sales Reporting Across 90 Countries

© 2014 Denodo Technologies

Biogen Idec Key Benefits and ROI from Data Virtualization

Biogen Idec executives now have access to new partner and public data sources that they could not leverage before : 60% faster with change requests

met in just a few days with IT using 40% less analyst time to support.

Business Problem • Manual process • Data freshness and quality

concerns • Fragile and complex to change

Business Benefits

• Automated • Validated and trusted data • Self service enabled for changes • Available on-demand

IT Challenges • Diverse data sources • Structured and semi-structured data • Data structure complexity • Constantly changing sources and

data

IT Benefits • Implementation - 4 weeks • Changes – 2,4 days • Low maintenance and support costs

Biogen Idec Example Executive report – Global Drug Sales (units) across all products

© 2014 Denodo Technologies

The Climate Corporation – Data Environment

© 2014 Denodo Technologies

The Climate Corporation – Data Architecture

© 2014 Denodo Technologies

The Climate Corporation – Data Virtualization

© 2014 Denodo Technologies

The Climate Corporation – Impact

■ First use-cases for Sales implemented

• 3X improvement in time-to-market with 1/3rd the team

■ Other use cases:

• Risk reporting automations using Hive/Denodo

• Linked Data Services and BI Portal

• Operational Data Integration

© 2014 Denodo Technologies

R- Single View of Customer

© 2014 Denodo Technologies

R – Services Architecture

© 2014 Denodo Technologies

Broad Spectrum Data Virtualization Webinar Series

Four Sessions Covering Trends and Wide-Range of Use Case

Patterns of Data Virtualization for 2014 & Beyond

Data Virtualization is more than just Agile BI. Broad spectrum data virtualization is about building a common semantic data layer that serves both Informational and Operational/Transactional business needs. Join leading industry analysts,

including Claudia Imhoff and Rick van der Lans, for a webinar series that examines the wide range of use cases for broad spectrum data virtualization.

Join the conversation on twitter #broadspectrumDV

© 2014 Denodo Technologies

Q & A

© 2014 Denodo Technologies

View Demo

Data Virtualization Fast, Flexible and Unified Data Access

© 2014 Denodo Technologies