tal end metadata bridge
DESCRIPTION
11TRANSCRIPT
1
©2015 Talend Inc. Presentation under NDA
Talend Metadata Bridge Jean-Michel Franco – Talend (@jmichel_franco)
2
Welcome
• To access to the online webinar : https://info.talend.com/en_di_introduction_metadatabridge.html?type=productspage
3
• Metadata describes the characteristics of any data object:
- Name, type, location, author, date created, size
- Relationships with other data
• Metadata Management is the end-to-end process and governance framework for creating, controlling, enhancing, attributing, defining and managing a metadata model
Metadata Management 101
4
Business needs for Metadata Management
Modeling & Design Real-time Real-time Implementation Maintenance Real-time Business users
Access
Increase development
speed & agility
Increase Developer
Productivity & Quality
Improve continuously & minimize the
impact of change
Provide Self Service, Deliver
Lineage & Auditability
5
Introducing Talend Metadata Bridge
Modeling & Design
Import/Export from design and
modeling environments
Real-time Real-time Implementation
Integrate with other data and development
platforms
Continuous Improvement
Reduce update & conversion costs and accelerate ETL offloading
projects
Real-time Utilization
Provide Self Service access for
Designers and Analysts
• General Availability in March 2015 • Based on OEM with Meta Integration Inc.
• Available for all Talend Enterprise and Platform customers • More that 100 connectors
6
Over 100 connectors
Data modeling
DB, ETL & Big Data Productivity Tools
Business Intelligence
Real-time
7
1. Import Data Models
• Enterprise and Data Architects define authoritative models in their modeling tools
• The Bridge propagates changes to the Talend Repository
• Conversely the Bridge allows Talend to export and maintain physical metadata back into the modeling tools
- CA ERwin Data Modeler
- Embarcadero ER/Studio
- SAP Sybase PowerDesigner
- IBM InfoSphere Data Architect
- …
Talend Repository
8
2. Business Intelligence
• Propagate / sync integration metadata with BI tools’ semantic layer
• Ensures consistent metadata definition from modeling, through integration, to reporting
Talend Repository - IBM Cognos
- Microsoft SQLServer
- Microstrategy
- Oracle Essbase and OBI
- QlikView
- SAP BW or Business Objects
- Tableau
9
3. ETL Conversion and offloading to Hadoop
• Accelerates migration project with an automated process
• Semantic mappings to convert 50-80% (subject to the jobs complexity)
• Migration ETL directly to Hadoop
Talend Repository
Load
Trans form
Extract
Talend Job
10
3. ETL Migration and offloading to Hadoop
• Talend Metadata Bridge accelerate the migration process through direct import/export of schema and job metadata including between 2 different ETLs : IBM Infosphere Datastage and Informatica
• Talend is committed to work with partners to facilitate migration projects
• Note: Some manual migration will be required
11
4. Define Mapping in Excel for Non-IT People
• Edit mappings & transformations in a spreadsheet
• Generate a job with no ETL skill
• Empower users to author or stewardship ETL jobs
Talend Repository
Talend Job
Talend Mapping Tool for Excel Talend Repository
12
Talend Metadata Management roadmap
• Import / Export to modeling tools, BI, Excel, Database, ETL, standards…
• Centralize metadata authoring and sync it across the Enterprise Metadata Bridge
• Business Glossary
• Enterprise Semantic Flow a lineage Data Governance
• Import/Export data model to/from modeling tools
• Content Marketplace Master Data Management
• Full Enterprise Version & Configuration Management
• Impact analysis, Visual modeling and cross referencing across tools
Enterprise Architecture & Life Cycle Change Management
• Referencing Big Data flows inside and outside Hadoop or other Big Data environment Big Data Lineage
A complete Enterprise Metadata management solution
13
Meta Integration Roadmap
• Talend Metadata Bridge
- Bi-directional metadata import/export from/to a wide range of tools (databases, modeling tools, data integration tools, BI tools, other metadata repositories)
- Standards (CWM, XMI, MS XIF…)
STEP 1 – Talend 5.6.2
STEP 2 – Talend 6.0
• Talend Metadata Management - Comprehensive Enterprise Metadata Management console
- Business Glossary
STEP 3 -Talend 6.1
• Talend Metadata Bridge for MDM - Import/export of Master Data Models
14
What it brings to Talend’s solution
Talend is Open -> now also at the Metadata level
Empowering data governance and self service
Addressing the challenge of Big Data re-platforming and lineage
15
©2015 Talend Inc. Presentation under NDA
Talend Metadata Bridge
Contact us:
Learn more:
www.talend.com