jboss enterprise data services (data virtualization)

Download JBoss Enterprise Data Services (Data Virtualization)

Post on 17-Aug-2015




3 download

Embed Size (px)


  1. 1. 1 JBoss Enterprise Data Services Peter Larsen JBoss Solutions Architect, Red Hat Inc. plarsen@redhat.com
  2. 2. 2 Agenda Motivation for Data Services EDS in the community / History Positioning Data Services in an Enterprise Architecture Use Case Domains / Customer Examples Technical Architecture Demo
  3. 3. 3 The Business Inflexibility Trap Inflexibility: The essential Business Problem With agility all problems are solvable With enough eyes, all bugs are shallow
  4. 4. 4 Agility is Key Because change is the only constant Technologies Requirements Regulations Standards Models Processes ??? What is the single most important problem preventing Agility?
  5. 5. 5 Problem: Data Challenges Challenges Different physical structure Different terminology and meaning Different interfaces May need to federate/integrate May be locked in to database Must ensure performance Maintain/Improve security Tremendous value in existing information assets, but... Time consuming and costly to implement new applications that leverage this information Data Warehouse Packaged Applications Operational Data Stores Data Gap
  6. 6. 6 Problem: Data Challenges Alternatives Time consuming difficult/costly No re-use of data logic Any changes break the application Data Gap Data Gap Hard Code Replicate/Data Mart Data not fresh Costly additional licenses More copies of data = more silos Governance/security
  7. 7. 7 Solution: JBoss Enterprise Data Services JBoss Enterprise Data Services Data Service Data ServiceData Service SQL Web Services Access to multiple data stores in real time Standards-based read/write access Speeds application development Transform data structure and semantics Consolidates data into a single view Centralized access control Enterprise-proven flexible, scalable, high-performance Turns the Data You Have Into the Information You Need
  8. 8. 8 Data Services Platform Where it fits JBoss Enterprise Data Services Platform Other Vendor Portal / ESB/SOA Platforms Data Service Data Service Data Service Data Service Data Service
  9. 9. 9 Integration Technologies ETL SOA EDS Data ProcessIntegration Style DataIntegrationTimeliness Real Time Batch
  10. 10. 11 Data Services Platform Common Use Cases Service Oriented Architecture Federate/transform data efficiently use by higher-level services Insulate business processes from data access details Business Intelligence, Operational Analytics, Reporting Consolidated financial reports/dashboards/KPIs Virtual data marts Information Consolidation, Reference Data Management Single/360 view of Customer Single/360 view of Supplier Single/360 view of Employee Regulatory Compliance Provide common security, central access and auditing of data VISA PCI, Sarbanes Oxley, Basel II, HIPAA
  11. 11. 12 JDBC/ODBC Query Engine Data Virtualization, Federation JBoss Enterprise Data Services JBoss ModeShape Repository Services JBoss jBPM JBoss Rules JBoss Enterprise SOA Platform JBossESB JBoss Enterprise Application Platform Red Hat Enterprise Linux Windows, UNIX, other Linux Turns the data you have into the information you want Augments and extends SOA Platform to address data access, integration and abstraction. SOA Patterns, best practices Reporting/Analytics enablement Information Consolidation, Data Mgmnt Data Governance, Compliance Real-time read/write access to heterogeneous data stores Speeds application development by simplifying access to distributed data Centralized access control, auditing JBoss Enterprise Data Services
  12. 12. 13
  13. 13. 14 Data Services Platform Architecture
  14. 14. 15 Query Performance & Optimization Minimal overhead for simpler requests Control enforce mandatory criteria with certain requests enforce time and size limitations on requests Rule-based optimization use criteria to avoid unnecessary fields and records removal of unnecessary joins across data sources merge all transformation logic for a single source Cost-based optimization join algorithms (nested loop, merge, dependent, hash) cost profile of each data source Data caching and staging (materialized views) Manage dataflow buffer management
  15. 15. 16 Designer Tooling Virtual Models Physical Models representing actual data sources Shows structural transformations Defines transformations with Selects Joins Criteria Functions Unions User Defined
  16. 16. 18 Semantic Mediation/Integration T Authoritative Sources: Mapped to logical view Multiple Internal/External Information Sources Application views of information: Relational, XML, Java T T XML Document T T T Web Services Web Services Workflow/ ESB Workflow/ ESB Business Applications Business Applications Claims, Billing, Policies, bldg_id SITENUM Facility_ID Location_ID bldg_type Depot_Number Location_Type Semantic Data Services Data Dictionary: Based on logical data model or XML schema Support for multiple COIs Support for multiple versions
  17. 17. 19 Data Services and the ESB User-facing Logic (Service Consumers) Business Logic Data Logic Process and Other Integration Logic Rich or Thin Desktop Process, Integraion Services Business Services ESB Direct ODBC, JDBC ODBC, JDBC WSDL, SOAP, MOM, other WSDL, SOAP, MOM, other Process Orchestration Services Data Services
  18. 18. 20 JBoss Enterprise SOA Platform Enables Business Process Automation by integrating and orchestrating application components and services running on JBoss Enterprise Middleware and/or any other standards-based AS Single distribution that integrates JBoss ESB, jBPM, JBoss Rules, Enterprise, Application Platform Enables multiple integration styles: SOA integration, EAI, EDA, process and business rules technologies to automate business processes to improve business productivity Certified Platform for Service Integration and Orchestration Simple, Flexible, and Scalable Light footprint, simple installation JBoss ON platform management and services monitoring Scalable clustering to support high transaction volumes A flexible, standards-based platform to integrate applications, SOA services, business events and automate business processes. Red Hat Enterprise Linux Windows, UNIX, other Linux Workflow Rules JBoss Enterprise SOA Platform JBossESB Transformation, Routing, Registry JBoss Enterprise Application Platform Container services, Hibernate, Web Services stack, Seam, Clustering, Cache, Messaging, Transactions
  19. 19. 22 Enterprise Data Services 5.2 EDS 5.2 Released December 2011 Tighter data services/ESB tooling integration Performance tweaks LOB handling Cost-based optimizer enhancements Programmatic view creation Repository enhancements Versioning support More artifact types Cloud-based data sources Fixes, minor enhancements, additional platform certs
  20. 20. 23 Business Value of Enterprise Data Services Greater agility, faster time to solution Increased ROA Improved organizational performance Better control of information Improved utilization of data assets Derive more value from existing investments Complements existing systems Jumpstart Your SOA Initiatives! Better/faster than hand coding Faster, less costly than data replication Data virtualization provides loose coupling The right data at the right time to the right people Decision support, BI with a complete view of information across the enterprise Powerful security, Auditing, Data Firewall Avoid data silo proliferation Central data access and policy, Compliance
  21. 21. 24 A Comprehensive Middleware Portfolio JBoss Enterprise Data Services Platform JBoss Enterprise SOA Platform JBoss Enterprise Application Platform JBoss Enterprise Web Platform JBoss Enterprise Web Server Red Hat Enterprise Messaging JBoss Enterprise Portal Platform JBoss Enterprise Business Rules Management System JBossDeveloper Studio Seam Hibernate WebFramework Kit JBoss Operations Network RedHatServices Cloud Implementation Cloud GovernanceCloud Strategy & Selection VMWare Microsoft Hyper-V Red Hat Enterprise Virtualization PrivatePublic Amazon EC2 Other RHEL,Unix,Windows
  22. 22. 25 Where did Teiid come from? Project lineage is from MetaMatrix starting in ~1999. Teiid - http://www.jboss.org/teiid Teiid Designer - http://www.jboss.org/teiiddesigner DNA - http://www.jboss.org/dna/ MetaMatrix was the leader in Enterprise Information Integration (EII) hence Teiid. Red Hat acquired MetaMatrix in 2007. Last major MetaMatrix product release, 5.5.4 11/09
  23. 23. 26 Project Status (March 2011) Open source 2/2009 heavily refactored from 5.5 line 7.0 Initial release 6/2010 7.1 Teiid / Teiid Designer release 8/2010 Basis for EDS 5.1 release with hundreds of issues resolved and targeted enhancements 7.4 Coming Soon! More source integration (MDX via XMLA, Ingres), expanded function support, etc. should be picked up along the work in 7.1-3 by the next service pack release.
  24. 24. 27 Community Version Community web site: www.jboss.org/teiid Teiid sub-projects: Teiid Runtime, Teiid Designer Teiid 7 is built for AS7
  25. 25. 28 JBoss Enterprise SOA Platform (SOA-P) and Enterprise Data Services (EDS) Roadmap Q4 08 Q1 09 Q2 09 Q3 09 2.8 SOA-P 5.0 Q4 09 3.0 Q1 10 Q4'09 Q1'10 Q2'10 Q3'10 Q4'10 Q1'11 Q2'11 Enterprise Q3'11 Q4'11 Q1'12 Platform Release March 2010 Calendar Quarters Platform Release January 2011 (target) SOA-P 5.1 Platform Release January 2011 (target) SOA-P/EDS 5.2 EDS 5.1 Platform Releases Mid-Q2 2011 (target) MetaMatrix 5.5.4 Platform Release November 2009
  26. 26. 29 Generating New Value with JBoss Enterprise SOA Platform and Enterprise Data Services
  27. 27. 30 The context Organizations Significant assets already deployed or otherwise in use Applications, databases, services, spreadsheets, file extracts, manual pro


View more >