© 2014 Denodo Technologies
Data Virtualization
Paul Moxon Denodo Technologies
Alberta Data Architecture Community
January 22nd, 2014
© 2014 Denodo Technologies
25 35 45 55 65 75
The Changing Speed of Business
85 95 100
© 2014 Denodo Technologies
Gartner – The Nexus of Forces
© 2014 Denodo Technologies
Today’s Data Realities
■ Data volumes are growing and will continue to grow at an accelerating rate
■ As new sources of data are exploited, data complexity is here to stay
■ There is no such thing as a ‘batch window’ – the business wants the data now
■ Users want more than ‘canned reports’…they want self-service with access to data as resources
■ Costs of traditional data solutions are escalating
© 2014 Denodo Technologies
Traditional Methods - Too Slow, Too Limited, Too Costly
■ The Data Warehousing Institute - Orgs. on avg.
• 8 wks. - add new data source to a DW
• 7 wks. - build complex dashboard or report
■ Forrester - IT spends avg. 1% of Rev. on Storage
• 75% of the data stored - inactive, rarely accessed
• 90% of all data access requests in production OLTP are serviced by new data
■ Gartner –Top Technology Trends 2013
Data Virtualization - “Central to success is an enabling technology infrastructure that helps information producers and information consumers organize, share and exchange any type of data and content, anytime, anywhere”
© 2014 Denodo Technologies
Business Need for Information Agility
■ Business entity views
■ Pre-integrated information
■ Discovery, self-service
■ Fast access, ~ real-time
■ Trustworthy, accurate
■ Flexible, mobile
data
semantic
relations
information
knowledge
wisdom
understanding
relations
understanding
patterns
understanding
principles
understanding
© 2014 Denodo Technologies
Information Gap
Information Gap
© 2014 Denodo Technologies
What is Data Virtualization?
BASE VIEW
BASE VIEW
BASE VIEW
DERIVED VIEW
Data Virtualization combines disparate data sources into a single “virtual” data layer that provides unified access and integrated data services to consuming applications in real-time (right-time)
Connect &
Virtualize
Combine &
Integrate
Publish as a Data Service
© 2014 Denodo Technologies
Data Virtualization – Key Tenets
■ Realize Value from all Data
• Universal data access across internal, external, web, structured or unstructured
■ Virtualization Minimizes Replication
• Flexible integration options with fine control – virtual real-time, cached or scheduled batch
■ Abstracted and Unified Data Services
• Abstracted data delivered as reusable data services Managed access control, service levels
■ Enterprise Class – Powerful and Agile
• Performance and scalability
• Data governance, lineage, management
• Easily integrated into existing IT infrastructure
© 2014 Denodo Technologies
Core Data Virtualization Capabilities
Data Virtualization
Unified Data Governance
Agile Data Services
Provisioning
Semantic Integration of
Structured, Web, Unstructured
Logical Abstraction &
Decoupling
On-demand, real-time access to
disparate data
© 2014 Denodo Technologies
Denodo Data Virtualization Platform
© 2014 Denodo Technologies
Denodo Data Virtualization Platform
Logical
Abstraction &
Decoupling
© 2014 Denodo Technologies
Denodo Data Virtualization Platform
Semantic
Integration of
Structured, Web,
Unstructured
Logical
Abstraction &
Decoupling
© 2014 Denodo Technologies
Denodo Data Virtualization Platform
Agile Data
Services
Provisioning
Semantic
Integration of
Structured, Web,
Unstructured
Logical
Abstraction &
Decoupling
© 2014 Denodo Technologies
Denodo Data Virtualization Platform
On-demand, real-
time access to
disparate data
Agile Data
Services
Provisioning
Semantic
Integration of
Structured, Web,
Unstructured
Logical
Abstraction &
Decoupling
© 2014 Denodo Technologies
Denodo Data Virtualization Platform
On-demand, real-
time access to
disparate data
Agile Data
Services
Provisioning Unified Data
Governance
Semantic
Integration of
Structured, Web,
Unstructured
Logical
Abstraction &
Decoupling
© 2014 Denodo Technologies
Denodo Platform Demo
© 2014 Denodo Technologies
Analytics / Informational
Operational / Transactional
Web, Cloud, and B2B Integration
Data Management & Data Services Infrastructure
Broad Spectrum Data Virtualization Patterns
© 2014 Denodo Technologies
Analytics / Informational
Operational / Transactional
Web, Cloud, and B2B Integration
Data Management & Data Services Infrastructure
Broad Spectrum Data Virtualization Patterns – Analytical/Informational
•Real Time Reporting
•Operational BI / Analytics
•Prototyping EDW
•Logical DW
•Virtual Data Marts
•Hybrid DV-ETL
Mainstream BI & DW
•NoSQL as Sandbox
•NoSQL for Cold Data Storage
•NoSQL Staging Area
•Hybrid Data Storage
•NoSQL for ETL
•Expose Big Data Results
Big Data Analytics
•Data Discovery, ‘What If’ Analytics
•Self-Service BI and Reporting
Data Discovery / Self-Service
© 2014 Denodo Technologies
Analytics / Informational
Operational / Transactional
Web, Cloud, and B2B Integration
Data Management & Data Services Infrastructure
Broad Spectrum Data Virtualization Patterns – Operational/Transactional
•Agile Mobile and Cloud App Development
•Agile SOA and BPM Development
•Agile Portal and Collaboration Development
Data Services for Application Development
•Legacy Application Modernization
•Migration from Enterprise to Cloud/SaaS
•Mergers & Acquisitions – Data Consolidation
Data Abstraction for Migration & Modernization
•Data Services for Partners
•B2B Integration through Web Automation
B2B Data Services & Integration
•Customer Service & Call Centers
•Products/Product Catalogs
•Vertical Specific (e.g. Well or Physician Data)
Single View Applications
© 2014 Denodo Technologies
Analytics / Informational
Operational / Transactional
Web, Cloud, and B2B Integration
Data Management & Data Services Infrastructure
Broad Spectrum Data Virtualization Patterns – Web, Cloud, and B2B Integration
•Web Extraction (data.gov, public sources, etc.)
•Competitive BI
•Data Services in Cloud
•Social Media Integration
•Cloud/SaaS Application Integration
•B2B Integration through Web
Web, Cloud, and B2B Integration
© 2014 Denodo Technologies
Analytics / Informational
Operational / Transactional
Web, Cloud, and B2B Integration
Data Management & Data Services Infrastructure
Broad Spectrum Data Virtualization Patterns – Data Management & Data Services Infrastructure
•Canonical Views of Data Entities
•Enterprise Business Data Glossary
•Virtual MDM
•Integrated SOA – Data, Logic, & Business Services
•Enterprise Data Services
Data Management & Data Services Infrastructure
© 2014 Denodo Technologies
Patterns: Analytical/Informational
Logical Data Warehouse
Hybrid Data Storage
Hybrid DV-ETL
NoSQL for ETL
© 2014 Denodo Technologies
Patterns: Operational/Transactional
Agile SOA & BPM Development Migration - Enterprise to Cloud/SaaS
Customer Call Center Mergers & Acquisitions
© 2014 Denodo Technologies
Biogen Idec - Agile BI Real-time Sales Reporting Across 90 Countries
© 2014 Denodo Technologies
Biogen Idec Key Benefits and ROI from Data Virtualization
Biogen Idec executives now have access to new partner and public data sources that they could not leverage before : 60% faster with change requests
met in just a few days with IT using 40% less analyst time to support.
Business Problem • Manual process • Data freshness and quality
concerns • Fragile and complex to change
Business Benefits
• Automated • Validated and trusted data • Self service enabled for changes • Available on-demand
IT Challenges • Diverse data sources • Structured and semi-structured data • Data structure complexity • Constantly changing sources and
data
IT Benefits • Implementation - 4 weeks • Changes – 2,4 days • Low maintenance and support costs
Biogen Idec Example Executive report – Global Drug Sales (units) across all products
© 2014 Denodo Technologies
The Climate Corporation – Data Environment
© 2014 Denodo Technologies
The Climate Corporation – Data Architecture
© 2014 Denodo Technologies
The Climate Corporation – Data Virtualization
© 2014 Denodo Technologies
The Climate Corporation – Impact
■ First use-cases for Sales implemented
• 3X improvement in time-to-market with 1/3rd the team
■ Other use cases:
• Risk reporting automations using Hive/Denodo
• Linked Data Services and BI Portal
• Operational Data Integration
© 2014 Denodo Technologies
R- Single View of Customer
© 2014 Denodo Technologies
R – Services Architecture
© 2014 Denodo Technologies
Broad Spectrum Data Virtualization Webinar Series
Four Sessions Covering Trends and Wide-Range of Use Case
Patterns of Data Virtualization for 2014 & Beyond
Data Virtualization is more than just Agile BI. Broad spectrum data virtualization is about building a common semantic data layer that serves both Informational and Operational/Transactional business needs. Join leading industry analysts,
including Claudia Imhoff and Rick van der Lans, for a webinar series that examines the wide range of use cases for broad spectrum data virtualization.
Join the conversation on twitter #broadspectrumDV
© 2014 Denodo Technologies
Q & A
© 2014 Denodo Technologies
View Demo
Data Virtualization Fast, Flexible and Unified Data Access
© 2014 Denodo Technologies