etl overview training

19
Business Intelligence - BI - ETL - Developer -Training

Upload: mondy-holten

Post on 19-May-2015

1.862 views

Category:

Technology


0 download

DESCRIPTION

ETL, Business Intelligence, DWH, BI Training

TRANSCRIPT

Page 1: Etl overview training

Business Intelligence - BI - ETL - Developer -Training

Page 2: Etl overview training

Index1. Data Warehousing Concepts2. What is Data Warehouse (DHW)?3. Difference between OLTP and DWH?4. Data Acquisition5. Data Extraction6. Data Transformation7. Data Loading8. Data Marts9. Dependent Data Mart

10. Independent Data Mart11. Database Design12. Star Scheme

13. Basic Concept in SQL14. Overview of ETL Tool Architecture15. White Box Testing Functionality on

Different transformation Rules16. Data Warehouse Life Cycle17. Types of Testing Techniques in ETL

Page 3: Etl overview training

What is ETL?In computing, extract, transform, and load (ETL) refers to a process in database usage and especially in data warehousing that:

● Extracts data from outside sources● Transforms it to fit operational needs, which can

include quality levels● Loads it into the end target (database, more

specifically, operational data store, data mart, or data warehouse)

ETL

Data Sources A

Data Warehouse Data Sources B

Data Sources C

Page 4: Etl overview training

ETL Scenario ● When there are many source systems to be

integrated

● When source systems are in different formats

● When this process needs to be run repeatedly

(e.g. daily, hourly, real time)

● To take advantage of pre-built

warehouses/marts. Many of these exist for

popular platforms such as PeopleSoft, SAP, JD

Edwards.

Page 5: Etl overview training

ETL Process

Page 6: Etl overview training

From Data -> Business Value

Page 7: Etl overview training

ETL Testing ConceptsSource System ETL Layer Data and Meta data Layer Presentation Layer

EnterpriseDataWarehouse

MetadataRepository

ODS

Data

Data

Data

Extract.Transformation, and load (ETL) Layer

● Clease Data● Filter Records● Standardizad Value● Decode Values● Apply Business

Rules● Householding● Dumpe records● Merge record

Transaction system● SAP ERP● SAP CRM● E-Commerce

External Data● Excel●

● Reporting Tools

● OLAP TOOLS

● Ad Hoc Query Tools

● Data Mining Tools

External Data● Excel●

ETL Tools:- BODS 4.0- Informatica PowerMart

- Oracle- SQL Server- Teradata- DB2

ETL Tools:- Business Objects 4.0- HTML ReportsCognos

Page 8: Etl overview training

Source systems

Page 9: Etl overview training

ETL Vendors

Page 10: Etl overview training

ETL Reporting tools

Page 11: Etl overview training

2. BI Launchpad

Page 12: Etl overview training

3. BO Dashboard

Page 13: Etl overview training

4. Information design Tool

Page 14: Etl overview training

5. Crystal Reports 2011

Page 15: Etl overview training

6. BO Analysis for OLAP

Page 16: Etl overview training

7. BI Workspaces

Page 17: Etl overview training

SAP BO 4.0 Interactive Analysis

Page 18: Etl overview training

Next step?

Page 19: Etl overview training

Contact Me● ETL Design● ETL Building● ETL Testing● ETL Support● ETL Training

BSc. Mondy HoltenSoftware Engineer (ETL, BI, SAP, HCM)

[email protected]+31629446309