copyright © 2003, sas institute inc. all rights reserved

27
Copyright © 2003, SAS Institute Inc. All rights reserved. New Features in SAS® ETL Studio 3.2 Peter Cullen 14 April 2005

Upload: tess98

Post on 30-Jun-2015

702 views

Category:

Documents


9 download

TRANSCRIPT

Page 1: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved.

New Features in SAS® ETL Studio 3.2Peter Cullen14 April 2005

Page 2: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 2

ETL Designer Administrationenhanced to provide capabilities to terminate

in process jobs, copy/paste capabilities, session and table information

Full functional data viewer to provide better control and more

functionality when viewing source/target contents

Extended EFI capabilities allow greater reach to external files

including delimited, fixed/variable length, FTP/URL, VSAM and COBOL

SAS® ETL Studio3.2 Enhancements

Impact Analysis enhancementsthat now provides impact reports into OLAP

Cubes, Look-up tables and Information Maps

Page 3: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 3

SAS® ETL Studio3.2 Enhancements

New and Enhanced Transformationto integrate SAS High Performance

Forecasting, improved performance and functionality

More robust Transformation Generator

to more easily build repeatable and reusable processes

Additional Source Designersadded for SPD Server, OLE DB, Excel and

MySQL

Page 4: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 4

SAS® ETL StudioExtended EFI Functionality

Definitions can be modified

Definitions can be re-used

Definitions can be imported from COBOL Copybooks and CSV files

Flat files now behave like tables, they can be viewed and added to a Job using drag-and-drop

Flat files can be used for both input and output

User-written code is now supported

Page 5: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 5

SAS® ETL StudioExtended EFI Functionality

Page 6: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 12

SAS® ETL StudioFull Functional Data Viewer

Column Viewing Options

Column type identification (Character

or Numeric)

Record scrolling by page, to scroll through all

observations

Page 7: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 13

SAS® ETL StudioETL Designer Administration – Session Information

Metadata Connection Profile

Page 8: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 14

SAS® ETL StudioETL Designer Administration – Copy/Paste

You can copy and paste the metadata objects for jobs, tables, external files, notes, and documents

You can also select multiple objects and a mixture of objects

Works both in the Inventory and Custom Tree

You can copy from the Inventory to the Custom Tree and vice versa

Page 9: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 15

Original Job

Pasted Job

Transformation icons have been copied. New metadata objects have been created and all

properties have been copied.

Table icons have not been modified. They point to the exact

same metadata object.

SAS® ETL StudioETL Designer Administration – Copy/Paste

Page 10: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 16

SAS® ETL StudioETL Designer Administration – Job Termination

• Cancel a submitted job (appserver session remains)

• Kill a submitted job (appserver session closed)

Page 11: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 17

SAS® ETL StudioETL Designer Administration – Job Completion Status

Page 12: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 18

SAS® ETL StudioETL Designer Administration – Job Status Manager

Shows an overview of all interactively

submitted jobs

You can double-click here in the status bar to activate the Job

Status Manager

Page 13: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 19

SAS® ETL StudioETL Designer Administration – View Table Information

Page 14: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 20

SAS® ETL StudioImpact Analysis Enhancements

OLAP Cubes

Tables

New

Information Maps

Page 15: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 21

SAS® ETL StudioImpact Analysis Enhancements

New

Look-up Tables

Transformations

Page 16: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 22

This transformations provides a quick and automatic way to generate forecasts for many sets of time-series or transactional data. It is using the HPF procedure.

An example would be that you extend time-series based data in an existing SAS pricing information data set, to generate a detailed forecast that includes tabular data and graphical plots.

This transformations provides a quick and automatic way to generate forecasts for many sets of time-series or transactional data. It is using the HPF procedure.

An example would be that you extend time-series based data in an existing SAS pricing information data set, to generate a detailed forecast that includes tabular data and graphical plots.

SAS® ETL StudioHigh Performance Forecasting Transformation

Page 17: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 23

Macro’s are now part of generated code, no longer using autocall macros

Performance enhancements• Input data is read fewer times

• Less sorting

• In case of DBMS load, temporary work tables are stored in temporary DBMS location

50% faster in ETL Studio 3.2 compared to 9.1.3 for initial loads

80% faster in ETL Studio 3.2 compared to 9.1.3 for updates

50% faster in ETL Studio 3.2 compared to 9.1.3 for initial loads

80% faster in ETL Studio 3.2 compared to 9.1.3 for updates

SAS® ETL StudioSCD Type II Loader – Performance enhancements

Page 18: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 25

SAS® ETL StudioLoader Transformation Enhancements

Loaders now support derived

mappings

Page 19: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 26

SAS® ETL StudioTransformation Generator Enhancements

Page 20: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 27

SAS® ETL StudioTransformation Generator Enhancements

Page 21: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 28

SAS® ETL StudioTransformation Generator Enhancements - Summary

Support for Modification of Properties

Support for Multiple Inputs/Outputs

Support for more Metadata-Driven Parameters

Specify Text for Placeholder

Move to another Group

Impact Analysis (where used)

You can use all of the power of the underlying SAS system and still make it metadata driven and re-usable by non-programmers.

No JAVA knowledge required to accomplish this!

Page 22: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 29

SAS® ETL StudioAdditional Source Designers

Extensive list of Source/Target data types. Wizard driven interface to define metadata about all data sources/targets.

Page 23: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 30

SAS® ETL StudioMiscellaneous enhancements - Details

Add Input and Outputs to Transformations

Newly created objects get unique name

Impact Analysis now also supports the Overview Window

Flat files can also be used for output

Calculated Members Definition Window (for OLAP)

Enhanced validation for generated code

Codegen Updates

Page 24: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 31

SAS® ETL StudioCodegen Updates

Block comments for better readability• Job header

• Pre-/Post-processing header

• Includes text from Notes entries (for both Job as Individual Transformations)

Lines are now split if they are too long

Job steps

Error messages when column mappings are not defined

Sections in larger steps (like loader)

Page 25: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 32

/****************************************************************************** * Job: Job 1: Purchase Records-Valid & Invalid A5OOLY72.B900025Y * * Description: * * * * Repository: Foundation A0000001.A5OOLY72 * * Server: SASMain A5OOLY72.AQ000001 * * * * Source Table: Customer Purchase data - l_sdata.Xactionm A5OOLY72.B10000XM * * Target Tables: Purchase Detail Table - l_wdata.Product A5OOLY72.B10000XE * * Invalid Purchase Records - l_wdata.InvPur A5OOLY72.B10000XU * * * * Generated on: Mon Dec 13 16:26:29 CET 2004 * * Generated by: NLSSTRWIH\sasdemo * * Version: 9.1.20041201.4043 * ****************************************************************************** * Notes: * * Note_123 * * This note is to explain that this job is now support by developer * * XYZ * ******************************************************************************/…

Notes that were defined for the Job are shown here.

Page 26: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 33

SAS® ETL Studio3.2 Enhancements

More information on SAS ETL Studio 3.2

What’s New section in Online HelpHelp Contents from within ETL Studio

SAS ETL Studio Users Guidehttp://support.sas.com/documentation/onlinedoc/etls/index.html

Page 27: Copyright © 2003, SAS Institute Inc. All rights reserved

Copyright © 2003, SAS Institute Inc. All rights reserved. 34Copyright © 2003, SAS Institute Inc. All rights reserved. 34