1

Agile BI Delivering Intelligence Faster

Rob Meyer

Product Marketing

Informatica

2

I Need a Single View of All Enterprise Data

NOW

Applications Partner Data

SWIFT NACHA HIPAA …

Unstructured Databases Social Warehouses NoSQL Cloud Computing

SOA

ESB/EAI

ETL

EII Hand Coding

Business

Intelligence

Business

Intelligence

Business

Intelligence

Business

Intelligence

Business

Intelligence

Business

Intelligence

Business

Intelligence

3

• Identify new business opportunities

• Easily up-sell/cross-sell to customers

• Take business decisions on “current” data

Agile Businesses Can’t

Wait 3-6 Months to…

• Comply with changing regulations

• Identify and correct problems

• Respond to competitive threats

4

It Takes Months to Deliver New Critical Data and Reports…

On average, how long does it take to add a new

source of data to your data warehouse?

On average, how long does it take to create a complex

report or dashboard with about 20 dimensions, 12

measures, and 6 user access roles?

2011

TDWI BI BENCHMARK REPORT Organizational and Performance Metrics

for Business Intelligence Teams

1 week

2 weeks

3 weeks

1 month

2 months

3 months

4-6 months

6 months or more

11%

7%

7%

22%

20%

14%

12%

7%

On average, how long does it take to change a

hierarchy (e.g. a new way of classifying products

or organizing sales regions)?

1 week

2 weeks

3 weeks

1 month

2 months

3 months

4-6 months

6 months or more

25%

13%

8%

25%

10%

6%

8%

4%

1 week

2 weeks

3 weeks

1 month

2 months

3 months

4-6 months

6 months or more

15%

9%

13%

16%

16%

16%

9%

5%

5

Why Does it Take So Long?

It takes too long to explain

requirements

It takes months to change a

DW/add new critical data

It takes many iterations to get

the right data/reports

Changes break integrations &

impact applications

Directly accessing operational

systems is not possible / ideal

Typical Data Integration Process

IT Has

a Huge Backlog

a

b

c

d

1

2

3

4

5

6

Design

Change

Integrate

Unit Test

Validate

Deploy

Business is

Involved Too Late

As-Is Value Stream Map (LOT OF WAIT & WASTE) e

6

You Can’t Solve it in the BI Layer…

Unstructured Data Spread Marts EDW Applications Mainframe

Data Federation Here = No Reuse

No Easy Way to Handle Change

No Data Quality & No Data Consistency

No Common Data Access Layer

Need a Common Data Access Layer

DATA MART

7

BI Agility is Top of Mind

“Agile BI addresses a broad need to enable

flexibility by accelerating the time it takes to

deliver value with BI projects.”

8

Solution Architecture

DATA

DISCOVERY

DATA

VIRTUALIZATION Rules Logical

Data Object Logical

Data Object Rules

DATA

REPLICATION

X MAP

PROD

CONNECTIVITY

9

High Performance Connectivity to Any Data

WebSphere MQ JMS MSMQ SAP NetWeaver XI

JD Edwards Lotus Notes Oracle E-Business PeopleSoft

Oracle DB2 UDB DB2/400 SQL Server Sybase

ADABAS Datacom DB2 IDMS IMS

Word, Excel PDF StarOffice WordPerfect Email (POP, IMPA) HTTP

Informix Teradata Netezza ODBC JDBC

VSAM C-ISAM Binary Flat Files Tape Formats…

Web Services TIBCO webMethods

SAP NetWeaver SAP NetWeaver BI SAS Siebel

Messaging, and Web Services

Relational and Flat Files

Mainframe and Midrange

Unstructured Data and Files Flat files

ASCII reports HTML RPG ANSI LDAP

EDI–X12

EDI-Fact

RosettaNet

HL7

HIPAA

ebXML

HL7 v3.0

ACORD (AL3, XML)

XML

LegalXML

IFX

cXML

AST

FIX

Cargo IMP

MVR

Salesforce CRM

Force.com

RightNow

NetSuite

ADP Hewitt SAP By Design Oracle OnDemand

Packaged Applications

Industry Standards

XML Standards

SaaS/BPO

Social Media

Facebook Twitter

LinkedIn EMC/Greenplum Vertica

AsterData

MPP Appliances

10

Non-Invasive Access to the Most Up-to-Date / Current Information

Source

Transactional

Applications

Target

Operational

Data Store

JMS

11

Automated Discovery of Data, Metadata, Relationships and Domains

Enterprise Domains

12

Support for Complex Data

Web Services

Mobile Data

Web Log Data

Partners

GS1

GDSN XML

Reporting

R H H R

13

Informatica

Data Services

DW

Microsoft SQL

IBM DB2

Mainframe Application

Target virtual

tables

Challenge:

• Requirement is to verify that the data from virtual layer is consistent with data from physical tables • Manual testing can be time consuming, costly and error prone hindering the agility of data virtualization Solution:

• Perform automated data validation using DVO, no more SQL coding needed Benefits:

• Complete , accurate and faster testing with GUI based DVO tool. No more SQL coding needed • Ensure data integrity and reduce business risk of untrusted data that is typical in data integration projects

Reduce Testing Development 2-10x and Automate

14

Fast, Direct Access to New Critical Data and Reports that Business Needs and Trusts

PROFILE AND CLEASE DATA SO

IT CAN BE READILY TRUSTED

DELIVER REUSABLE DATA

SERVICES TO CONSUMERS

CREATE A COMMON ACCESS

LAYER ACROSS DATA SOURCES

Enterprise

Data Sources

Data

Virtualization (Built-On Lean

Principles) … PRODUCT CUSTOMER ORDER

Logical View of All Underlying Data

QUICKLY & DIRECTLY ACCESS

DATA WITHOUT MOVEMENT

00110101

00100101

01011010

10010110

Portal BI Composite Apps Data

Consumers

15

HealthNow Accelerates Value through Data Virtualization

• Rapidly prototype

• Analyze & profile anytime

• Transform & cleanse in real time

• Provision to BI

The Solution The Result

DW

Virtual View

Change

Request Deploy to

Production

Business IT

5x Faster

1/3rd Cost

The Challenge. Business users had to wait 1700 hours for IT to make one

small change in a report, so they created their own custom workarounds –

30,000 MS Access data marts

16

Summary / Takeaways

Business IT

Identify a Small, Critical BI Project in the Company

Involve the Business Early & Often in the Process

Bake-In Data Quality

Demonstrate Business Value Early

Self-Service + Data Virtualization = ROI

New data &

reports take

too LONG…

“YOU” can

now do it in

DAYS!

Have the Critical Conversation

1

2

3

4

5