how is sap data services unique for sap hana integration
DESCRIPTION
TRANSCRIPT
How is SAP Data Services Unique
for SAP HANA Integration?
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 2
SAP Data Services for SAP HANA Integration – What’s
Unique?
1. DS Workbench is a visual environment enabling unparalleled developer
productivity to migrate data into HANA as a target from a variety of sources
2. Metadata Management within SAP Information Steward can publish
information from HANA views and tables to perform Data Lineage and Data
Impact Analyses
3. Ability to push down data transformations leveraging HANA attribute,
analytical, and calculation views for faster and more efficient processes
4. Faster loads with parallel data extraction, partitioned data reads and
consolidated updates
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 3
SAP Data Services and SAP HANA
Any Source
Data Load
Metadata
Open Hub
*SAP Data Services 4.x
In-Memory
Computing Engine
Modeler
SAP HANA
BW
Repository
Server
Designer and
Management
Console
• * Data Integrator license (for ETL only) is included with most HANA
packages. A full Data Service license is required to utilize Data Quality.
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 4
DS Workbench for unparalleled developer productivity Design your data movement job in very simple steps
Support complex data movement with dataflow editor for transformations and cleansing
Increase dataflow development productivity • Automatic flat file formatting & data type discovery
• Automatic table joins and mappings
• Usable expression macros
Improve dataflow development quality • Design-time column-level lineage analysis
• Automatic mapping expression repair
• Automatic profiling and data analysis
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 5
Monitor progress as job runs via DS Workbench
and view history for that job
Built-in capabilities to monitor the data loading
See load progress in real-time
Compare historic load times
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 6
SAP Information Steward collects Metadata from HANA
Ability to collect standard relational objects and information models in HANA:
Attribute View, Analytic View, and Calculation View.
Fast searching of any metadata content such as attributes and measures in HANA
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 7
Metadata Integration from SAP HANA Extending the number of available Objects …
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 8
Metadata Integration from SAP HANA … allows best data lineage
1. From the Report
2. Through the BI Platform
3. Through HANA DB and Views
4. Through the DS ETL Jobs
5. To the Source Tables
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 9
Metadata Management within BI Launchpad, WebI Trusted Information: Where does it come from AND how good is it?
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 10
Just how accurate is my data? Even in HANA?
My data has more
issues than I thought !
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 11
Profile operations pushed-down to HANA up to 1000x faster Understand the content and quality of your HANA data
Lightening fast insight about my
HANA data
30% of
addresses
are NULL?!
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 12
Dataflow execution is optimized for HANA targets HANA views auto-generated, very fast execution via transformation pushdown
HANA
App
Web File
Database
End-to-end DS Modeling
Data is transferred as fast as
possible from external sources
to HANA first, any filters are
executed at the source
Rest of the transformations are
converted to HANA stored procs
using Views and SQL, and
executed completely within HANA
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 13
Data Services supports Hadoop/Hive systems Just as other systems or applications are supported as native source, target
Same Familiar UI paradigm for design,
development
High Performance reading from and
loading into Hadoop
Extended Optimizer HIVEQL and PIG
aware
Files
Web & Others
Hadoop Databases
HANA, IQ, other
Target Systems
Data
Services Data
Services
Processing pushed down
Joins
Sorting
Filter and Projection
Aggregate functions
Executes as MapReduce job
Unstructured Text Data Processing
(Entity Extraction)
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 14
NOUN_GROUP
FACILITY/PATH
2012 Toyota Highlander, 1G1JF27W8GJ178227. Policy
#456-788-99. $500 deductible. Insured are William Thomas Snow
and Christine W. Snow. On 1/09/13, received via text message "In
accident! Need tow truck." and "Corner of Winter & Cross Rd". Dr.
Snow slid through a stop on the snowy road and hit the stop sign.
Significant damage to front of the car. He was unhappy at tow truck
response time. Contact [email protected] or
651.772.1234. Advance Appraisals Inc. to come out at 8:30am
Monday to make further assessment.
Data Services integrates data from Unstructured Text Automatically identify the entities, facts, and feelings hidden within
VEHICLE/LAND
VEHICLE/VIN
POLICY NUMBER (CUSTOM)
CURRENCY
PERSON
SENTIMENT
WEAK NEGATIVE SENTIMENT
DATE
MAJOR PROBLEM
REQUEST
URL/EMAIL
ORGANIZATION/ COMMERCIAL
TIME
DAY
PHONE
Who, What, Where, When, How much, as well as Feelings