oregon iug_pc productivity pack_101712

7/29/2019 Oregon IUG_PC Productivity Pack_101712

1/21

1

Informatica Productivity Pack

Save Time and Money while Increasing theQuality of Your PowerCenter Deployment

Louis Hausle


2/21

2

Are these issues you have run into?

Best Practices Violations even though you havethem documented!

Abuse and misuse of SQL overrides, log

verbosity or commit/cache/dtm buffer size?

Zombie Workflows?


3/21

3

Development

38%

DataValidation and

Testing29%

Monitoring ofPowerCenter

21%

Code Reviewand Best Practices

Enforcement10%

Where is Time Spent in a PowerCenter Environment?(source Informatica World 2012 Poll)

Developmentaccounts for lessthan 50% of time

More Time and MoneySpent on Testing andMonitoring

You can shrink theTCO of PowerCenterby automated Testingand Monitoring


4/21

4

What Exactly is the Productivity Pack?

( it is a Sales Bundle of Three Products)

PowerCenter Productivity Pack

ProactiveMonitoring for

PowerCenter- Governance

ProactiveMonitoring for

PowerCenter- Operations

Data

ValidationOption

DEV TEST PROD


5/21

5

Agenda

Development Proactive Monitoring forPowerCenter Governance

Testing The Informatica Data ValidationOption DVO

Production Proactive Monitoring for

PowerCenter - Operations


6/21

6

Every PowerCenter Customer Has Best Practices,Nearly Every One Struggles to Enforce Them!


7/217

Challenges in Data Integration & Governance

Best Practice Enforcement Most companies have no way to

enforce best practices

Production Impact Unchecked Development Practices

and Choices can lead to FatalMistakes in Production

Measure and QuantifyDevelopment Work

How can you track many developers indifferent locations?


8/218

1. Enforcement of Best Practices

Customer Challenges

How do you monitor many developers in many locations, all the time?

How do make your Best Practices Actionable and enforceable as theyhappen?

Mappings arecreated and savedwithout comments

Next Developerhas no idea of

what logic is doing

Time is wastedand Mistakes can

be made


9/219

2. Production Impact of Development Options

Customer Challenges

There are hundreds of development flags and options on Mappings,Workflows, Sessions and Transformations

Customers can have dozens, hundreds and thousands of Workflows

A developer uses thetruncate target table

option for testing indevelopment

He forgets to changethe flag, and the

workflow is migratedinto production

Data is lost, andrecovery steps can take

time and introduce newdata problems


10/2111

Agenda






11/2112

The Data Validation and Testing Dilemma

Informatica has over 4,000 PowerCenterCustomers who believe using ametadata driven, graphical tool to movedata is better than writing SQL andhand coding.

15 years later, 99% of those 4,000

Customers still use SQL and Excel totest the data they have moved in dataintegration products.

There has to be a better way


12/2113

Current Approach: Like a Photo Hunt


13/2114

Source A

Source B

Target(DW or Operational

System

SalesOrders

SalesAmount

23 $150,000

SalesOrders

SalesAmount

30 $150,000

SalesOrders

SalesAmount

52 $290,000

DVO - tells you 1 Order and $10,000 is MissingIn a few clicks it does set, aggregation and value tests.

Data IntegrationOr Movement

Data Validation Simple Illustration


14/2115

DVO: Test CreationLeverage your PowerCenter Metadata!GUI with Pre-Built Test Operators with NO SQL


15/2116

DVO: Test ResultsSummary of Test Results


16/2117

Agenda






17/2118

Informatica built these solutions to address threecommon customer concerns

1. Customers asked for a Complete, PowerCenterCentric Monitoring Solution

2. Customers want to become Proactive in seeing issuesbefore they turn into problems. Send email alerts insteadof logging in to a monitor.

3. Scalable way to identify anomalies such as Workflowsrunning longer/shorter than normal or returningmore/less rows than normal.


18/2119

What is Proactive PowerCenter Monitoring?

Prebuilt Rules to MonitorInformatica PowerCenter

Delivers Alerts to people,dashboards and systems

Complete Operational andBest Practices

Extensiblebuild unlimited

number of new rules


19/2120

Solution OverviewProactive PowerCenter Monitoring

Alert Enrichment

DBs, Web Services and more

Alert Editing, Creation and Management

Custom:Environmental(CPU, Memory..)

DB (SQL)JMS

Web Services

Operational Design Time

Start/Stop Workflows Create Help Desk Ticket Update Control Tables

Operational Monitoring viaContinuous Correlation

(Sample Rules)

1Workflow/session was successful but zero(0) records loaded

2 Rejected Records in Session

3Disproportionate elapsed time betweenWorkflow and Session

4 Session/Workflow Failures

5Correlate session changes to workflowfailures

6SLA Violations: Workflow/Folder/RepositoryLevel

7Significant increase in Workflow/SessionElapsed Times

8 Significant decrease in applied row counts

9 Workflows missing schedules

10 Too many concurrent workflows

11 Automatic Restart of Zombie Workflows

12Ping Domain/Integration Service/Repository

Service

SQL Sources toExpose RepositoryFeatures and AllowEasy Rule andReport Building

EnvironmentalMonitoring

Runtime StatisticsReceiver via Web

Services Hub

Ping PowerCenterServices

NotificationFramework for Alerts

Prebuilt EMAIL

Responses

Prebuilt DashboardAlerts

PowerCenterWorkflow Response

to ExecuteCommands

P ti M it i f P C t


20/2121

PowerCenter

Domain

Repository

Service

IntegrationService

Administrator

Database

Se

rver

ApplicationServer

Proactive Monitoring for PowerCenterIllustration of Components that are Monitored

1. The PowerCenter Domain, Integration

Services and Repository Services areMonitored

2. The PowerCenter Repository Databaseis Monitored for Up/Down and

Tablespace Usage

3. The PowerCenter Server OS isMonitored for Memory and CPU Usage

4. Running Workflows and Sessions areMonitored

5. Over 500 Attributes can be used in rules


21/21

DEMONSTRATION ofPROACTIVE MONITORING FOR

GOVERNANCE

Check for Commit size violations Check On Rollback Transactions on Errors Naming Conventions and Check for

Comments

oregon iug_pc productivity pack_101712

Documents