datamigrator update release 7.7.04

56
Clif Kranish Director, Data Management Division DataMigrator Update Release 7.7.04 1

Upload: quinta

Post on 22-Feb-2016

52 views

Category:

Documents


0 download

DESCRIPTION

DataMigrator Update Release 7.7.04. Clif Kranish Director, Data Management Division. Data Management Console. Autosave. Edit Undo / Redo Specify limit for Flows and Synonyms. Edit - Undo / Redo Synonym and Flow editors . Tabbed Windows. Tab Groups Window > New Horizontal Tab Group. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: DataMigrator Update Release 7.7.04

Clif KranishDirector, Data Management Division

DataMigrator UpdateRelease 7.7.04

1

Page 2: DataMigrator Update Release 7.7.04

Data Management Console

2

Page 3: DataMigrator Update Release 7.7.04

Autosave

3

Page 4: DataMigrator Update Release 7.7.04

Edit Undo / RedoSpecify limit for Flows and Synonyms

4

Page 5: DataMigrator Update Release 7.7.04

Edit - Undo / RedoSynonym and Flow editors

5

Page 6: DataMigrator Update Release 7.7.04

Tabbed Windows

6

Page 7: DataMigrator Update Release 7.7.04

Tab GroupsWindow > New Horizontal Tab Group

7

Page 8: DataMigrator Update Release 7.7.04

Tab GroupsView two Data Profiling reports at once

8

Page 9: DataMigrator Update Release 7.7.04

Data ProfilingCount

9

Page 10: DataMigrator Update Release 7.7.04

Browser See all files in application directories

10

Page 11: DataMigrator Update Release 7.7.04

Edit flat files

11

Page 12: DataMigrator Update Release 7.7.04

Edit XML and XSD

12

Page 13: DataMigrator Update Release 7.7.04

Print Preview

13

Page 14: DataMigrator Update Release 7.7.04

Data Flows and Process Flows

PartitioningSUB QUERIES

Database Default Values

14

Page 15: DataMigrator Update Release 7.7.04

Quick CopyGenerates Data Flow for entire table(s)

15

Page 16: DataMigrator Update Release 7.7.04

For source with a numeric key columnAutomatic partitioning

16

Page 17: DataMigrator Update Release 7.7.04

Automatic PartitioningGenerated Process Flow

17

Page 18: DataMigrator Update Release 7.7.04

Automatic PartitioningParameter Passing

18

Page 19: DataMigrator Update Release 7.7.04

Automatic PartitioningLog

19

Page 20: DataMigrator Update Release 7.7.04

WHERE FilterNew SQL Operators

20

Page 21: DataMigrator Update Release 7.7.04

Function AssistEXISTS

21

Page 22: DataMigrator Update Release 7.7.04

Function AssistSUBQUERY

22

Page 23: DataMigrator Update Release 7.7.04

Sub Query In Select List

23

Page 24: DataMigrator Update Release 7.7.04

Database Default ValuesCOUNTRY default is ‘USA’

24

Page 25: DataMigrator Update Release 7.7.04

Database DefaultsTransformations – No value assigned to COUNTRY

25

Page 26: DataMigrator Update Release 7.7.04

Database Defaults

Data type Nullable Default Old NewCharacter Yes No NULL NULLNumeric Yes No NULL NULLCharacter Yes Yes NULL DefaultNumeric Yes Yes NULL DefaultCharacter No No Blank ErrorNumeric No No 0 ErrorCharacter No Yes Blank DefaultNumeric No Yes 0 Default

Database defaults are now respected.

But for NOT NULL columns without a default…You must assign a value!

26

Page 27: DataMigrator Update Release 7.7.04

Set VariablesHelp for Statistical Variables

27

Page 28: DataMigrator Update Release 7.7.04

IndexesTimestamps

Slowly Changing Dimensions

28

Page 29: DataMigrator Update Release 7.7.04

Slowly Changing DimensionsType I changes – Overwrite History

Skey Empid Br Name Start End

7 JG088 BOS Gamola, Jan 01-Jan-12 .

Empid Br NameJG088 BOS Gamola, Jan

Dimension

Source

Newcomb, Jan

Newcomb, Jan

29

Page 30: DataMigrator Update Release 7.7.04

Slowly Changing DimensionsType II changes – Record History

Skey Empid Br Name Start End

8 RI083 STL Iddles, Roger 01-Jan-12 .

Empid Br NameRI083 STL Iddles, Roger

Dimension

Source

LA

06-Jun-1214 RI083 LA Iddles, Roger 07-Jun-12 .

30

Page 31: DataMigrator Update Release 7.7.04

Faster Load with Indexes in RDBMS Tables

31

Page 32: DataMigrator Update Release 7.7.04

Index Fields EditorAccept Index on REPNO (key column)

32

Page 33: DataMigrator Update Release 7.7.04

IndexesAdded Index on REPNO and EMPID

33

Page 34: DataMigrator Update Release 7.7.04

IndexesRecreate Database Table

34

Page 35: DataMigrator Update Release 7.7.04

IndexesAs seen in RDBMS

35

Page 36: DataMigrator Update Release 7.7.04

Slowly Changing Dimension tablesDatetime / Timestamp for begin / end dates

36

Page 37: DataMigrator Update Release 7.7.04

Scheduler

• Start/Stop Scanning• Manage Scheduled Flows• Run When Server Starts

37

Page 38: DataMigrator Update Release 7.7.04

SchedulerStart / Stop Scanning and Scheduler Agents

38

Page 39: DataMigrator Update Release 7.7.04

Scheduler AgentsSelect and Activate / Deactivate

39

Page 40: DataMigrator Update Release 7.7.04

Real Time CDC Log or File Listener Source

40

Page 41: DataMigrator Update Release 7.7.04

Scheduled FlowsRun when server starts

41

Page 42: DataMigrator Update Release 7.7.04

New and Improved Adapters

• Load• Salesforce• AddressDoctor• JSON• Hadoop and Hive

42

Page 43: DataMigrator Update Release 7.7.04

Improved Adapters

Concurrent fastload inserts

Teradata Parallel Transport API

Change Data Capture

43

Page 44: DataMigrator Update Release 7.7.04

Salesforce.comQuery Adapter based on SOQL

44

Page 45: DataMigrator Update Release 7.7.04

Salesforce.comCreate Cluster Join – using relationships in data model

45

Page 46: DataMigrator Update Release 7.7.04

AddressDoctorSynonym for procedure created at configuration

46

Page 47: DataMigrator Update Release 7.7.04

AddressDoctorPass parameters in JOIN

47

Page 48: DataMigrator Update Release 7.7.04

AddressDoctorCleansed Addresses

48

Page 49: DataMigrator Update Release 7.7.04

JSONJavaScript Object Notation

49

Page 50: DataMigrator Update Release 7.7.04

JSONSynonym created using document itself

50

Page 51: DataMigrator Update Release 7.7.04

JSONSample Data

51

Page 53: DataMigrator Update Release 7.7.04

Ribbon

53

Page 54: DataMigrator Update Release 7.7.04

Ribbon

54

Page 55: DataMigrator Update Release 7.7.04

RibbonHome

55

Page 56: DataMigrator Update Release 7.7.04

RibbonFlow, Metadata and Report

56