s317061 lost in transaction-.ppt• btm tool is necessary before implementing any distributed...

41
<Insert Picture Here> Lost in the Transaction: S317061 Managing Business Transactions Across Distributed Systems Ed Horst Ed Horst VP, Product Management

Upload: others

Post on 04-Mar-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

<Insert Picture Here>

Lost in the Transaction: S317061Managing Business Transactions Across Distributed Systems

Ed HorstEd HorstVP, Product Management

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver anycontract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development release and timing of anyThe development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

2

Program Agenda

<Insert Picture Here>• Quick Overview of Oracle Business Transaction Management

• Two Customer Case StudiesH lth– Healthways

– Farmers Insurance• Wrap Up / Q&Ap p

3

Business Transaction

Management

4

Today's Applications:Distributed across Diverse InfrastructureDistributed across Diverse Infrastructure

Process Engine Service BusAppliance

DBMSWeb

Partner and Cloud

5

Today's Applications:Support Distributed Business TransactionsSupport Distributed Business Transactions

Process Engine Service BusAppliance

DBMSWeb

Partner and Cloud

Health Claim Processing Transaction

6

Today's Applications:Support Distributed Business TransactionsSupport Distributed Business Transactions

Process Engine Service BusAppliance

DBMSWeb

Partner and Cloud

CRM Transaction

7

Business Transactions:The Key Problem for SOAThe Key Problem for SOA

• Transactions prone to vanish without a trace because of delays failures errorsbecause of delays, failures, errors

– IT staff typically unaware until end-user complains

– No single source for status of each transaction

• Problem diagnosis and managing exceptions is

ecommerceService

Enterprise Service Bus• Problem diagnosis and managing exceptions is laborious, high mean-time-to-resolve

– Manual effort, based on log mining– 80% of effort spent merely isolating the issue– Diverts valuable developer resources to IT fire-drills

EJB Application

Credit Service

ShipService

Enterprise Service Bus

InventoryService

– Diverts valuable developer resources to IT fire-drills

• System-centric monitoring is not sufficient– Lacks critical business context

– Customer name, order size, part numbers

EJB Application

JMS/MQ-based

WarehouseDBMS

Service

– Ignores a range of business-oriented errors & faults

8

8

Oracle Business Transaction Management (BTM) Provides Tracking Transactions across SOA

End-to-End, Application Level View

Process Engine Service Bus

• Real-time tracking of each transaction• Follows transactions across all infrastructure and applications

A S A li ti ESB' BPM' Et– App Servers, Applications, ESB's, BPM's, Etc.• Leverages message content – the business value flowing

through the applicationP id thi ith t dif i t i th• Provides this without modifying or tagging the messages– Message Fingerprinting– Non-invasive; doesn’t break applications

999

Mapping DependenciesReal-time view of application across componentspp p

W bProcess Engine Service Bus

ApplianceDBMS

Web

P t d Cl d

10

Partner and Cloud

Mapping DependenciesAcross JVMs, Platforms, Processes, and TechnologiesReal-time view of application across componentsService Bus

Packaged

li iApplications

Process Engine Data

Access

DB

Process Engine Service BusAppliance

DBMSWeb

11

11

Partner and Cloud

Measuring Transaction PerformanceMeeting Agreements on Responsiveness, Availability & Throughputg g p , y g p

Performance MetricsAvailability

Service

Le el

y

Throughput

Response time

Etc.

Level

AgreementsMonitor againstbaselines andthresholds

Historical

• Enforces agreements in real

Historical

Reporting

End-to-End

time• Enables preventative and

corrective actions– Not just reporting violations

Process Engine Service Bus

12

Not just reporting violations after its too late

Monitor for ExceptionsDetecting Exceptions in Real-time

• Continuously evaluates critical transactions

– Flexible instrumentation model: doesn't require isibilit into e er stepvisibility into every step

• Detects Exceptions both Business &Technical

– Stalled processes, Rejected Order

Alert p ,missing steps, dropped transactions

– Business errors, such as credit denied, orders over $1M shipment longer$1M, shipment longer than 7 days

– App faults, protocol errors

• Notifies stakeholders, i k th t

Process Engine Service BusAppliance

DBMSWeb

invoke other systems –trouble ticketing, other exception handlers, etc

Partner and Cloud

13 13

Monitor for Exceptions Quickly pinpoint errorsy p p

Transaction

History Drill into TransactionContent & Context

Message Flow

‐ Per Transaction

Content & Context

• Eliminates costly manual search through log files across containers

Unified view of transaction across

End-to-End

– Unified view of transaction across different keys, IDs, etc.

• Inspect related request/reponse pairs for entire flow

Process Engine Service Bus

14

Leverage Business ContextAd-hoc searching across logged business transactions

• Locate transactions based on monitored and logged information

g gg

information• Comprehensive searching

– Business content & context –order # customer name etcorder #, customer name, etc.

– Time range– Specific faults

• Look for specific conditions Transaction History psuch as slow response times or faults as well as broad textual content

12‐105 Borders 02‐15‐09 $4,600 OK

14‐448 Amazon 02‐16‐09 $9,304 OK

14‐843 Barnes 02‐22‐09 $11,938 Error

• Optimize search on specific, frequently used attributes

30‐336 Borders 03‐01‐09 $21,103 OK

33‐596 Amazon 03‐02‐09 $7,338 OK

41‐908 Amazon 03‐13‐09 $33,301 Error

$

151515

42‐308 Borders 03‐14‐09 $23,901 OK

Customer Examples

• Farmers InsuranceFarmers Insurance• Healthways

16

Managing Business TransactionsManaging Business Transactions Across Distributed Systems

Suresh Murthy, SOA ArchitectSeptember 2010

AGENDA

1. Farmers Insurance - General Information2. Farmers SOA Overview2. Farmers SOA Overview3. Farmers Oracle-BTM Setup4. Farmers Oracle-BTM Usecases5. Lessons Learned6. Q & A

- 18 - Farmers Confidential

Farmers Insurance - General Information

• Wholly owned subsidiary of Zurich Financial Services

Founded in 1928 Headquartered in Los Angeles and doing• Founded in 1928, Headquartered in Los Angeles and doing

business in 41 states

• Diversified product portfolio• Diversified product portfolio

– Auto, business, homeowners, life & specialty insurance

– Financial services (e.g., annuities, IRAs, 529 plans, etc.)a c a se ces (e g , a u t es, s, 5 9 p a s, etc )

• Serves more than 15 million customers

• 20,000 employees (approx)

• Strategic business unit within Zurich’s $50 billion global

operation

- 19 - Farmers Confidential

1. Farmers Insurance - General Information2. Farmers SOA Overview2. Farmers SOA Overview3. Farmers Oracle-BTM Setup4. Farmers Oracle-BTM Usecases5. Lessons Learned6. Q & A

- 20 - Farmers Confidential

Farmers SOA Overview

• In 2007, Zurich rolled out an enterprise-wide SOA initiative known as ZSOA

• Goals of the initiative– Accelerate time to market for new products & services

– Improve operational efficiency & flexibilityImprove operational efficiency & flexibility

– Provide LOBs with visibility into projects going on across the Zurich enterprise

– Reduce the IT cost structure

f• In addition to providing a shared physical infrastructure, ZSOA is used to:– Define the strategic direction of SOA across Zurich

– Define the policies, procedures, frameworks and standards for service

development

– Define how services are implemented and governed• As part of the initiative, Farmers SOA Competency Center is established

- 21 - Farmers Confidential

As part of the initiative, Farmers SOA Competency Center is established to realize the SOA within Farmers

ZSOA Reference Architecture

Support &

System Management

er

Internal user External userUser / Enterprise B2B Gateway

Support &

System Management

erer

Internal user External userUser / Enterprise B2B Gateway

rvic

e C

onsu

m Process Orchestration

gem

ent

, Rep

ortin

g

rvic

es

Serv

ices

Process

Services

ZZrvic

e C

onsu

mrv

ice

Con

sum Process

Orchestration

gem

ent

, Rep

ortin

g

rvic

es

Serv

ices

Process

Services

Process

Services

ZZOpen Stds: BPEL, WSC

Prov

ider

Ser

Service Orchestration Orchestrated / Composed

Services

Syst

em M

anag

oggi

ng, A

uditi

ng

Secu

rity

Ser

Polic

y

Tran

sfor

mat

ion

Orchestrated / Composed

Services

ZSAZSA

-- ESBESB

Prov

ider

Prov

ider

Ser

Ser

Service Orchestration Orchestrated / Composed

Services

Syst

em M

anag

oggi

ng, A

uditi

ng

Secu

rity

Ser

Polic

y

Tran

sfor

mat

ion

Orchestrated / Composed

Services

ZSAZSA

-- ESBESB

O Std WS P li

Serv

ice

P

Service Enablement

Business

Lo

Basic Business Services Common Services

Serv

ice

PSe

rvic

e P

Service Enablement

Business

Lo

Basic Business Services Common Services

Open Stds: WS-Policy

Open Stds: SOAP JMSBusiness Logic

ServiceRegistry /Directory

Data Source

Legacy

Application

Commercial

Package

Custom

Component

Business Logic

ServiceRegistry /Directory

Data Source

Legacy

Application

Commercial

Package

Custom

Component

Open Stds: SOAP, JMS

- 22 - Farmers Confidential

Oracle BTM

1. Farmers Insurance - General Information2. Farmers SOA Overview2. Farmers SOA Overview3. Farmers Oracle-BTM Setup4. Farmers Oracle-BTM Usecases5. Lessons Learned6. Q & A

- 23 - Farmers Confidential

Need for Business Transaction Management (BTM)

• Enable support for different types of service level objectives

• Provide support for proactive monitoring & alerts

ManageSLAs

FacilitateDiagnostic

s

j• Manage and enforcing

the policies.• Alerts & Notifications

alerts• Support corrective

actions on errors/exceptions.P id d di

S t

• Provide deep-dive service diagnostic facilities

Provide Reporting

Support Multi-

Platform• Deployable to a ZFS standard infrastructure

• Provide standard out of the box reports

• Provide platform coverage for different ZFS service providers

• Integrate with the ZSOA

t e bo epo ts• Enable report

customization• Provide a role-based

h

- 24 - Farmers Confidential

• Integrate with the ZSOA infrastructure.

access to the reports or portal

Oracle-BTM Setup

WAS Webservice

Client

CICS Webservice

Client

B2B Gateway Client

Service Consumers Administrator

Proxy Agent

OSB

Proxy Agent

OSB

Proxy Agent

OSB

Sphere

Performance

ORACLE BTM

Service Orchestration/Enablement

OSBOSB OSB

Windows

EXM

Windows

Proxy Agent

Weblogic Webservice

Proxy Agent

WAS WebserviceSAP S

RFC Function Modules

- 25 - Farmers Confidential

Service Providers

WebserviceWebserviceSAP Server

Oracle-BTM Setup Cont’d..Oracle BTM Service Monitoring Oracle BTM Exception DetailsOracle BTM Service Monitoring Oracle BTM Exception Details

Oracle BTM Services SummaryOracle BTM Policies

- 26 - Farmers Confidential

1. Farmers Insurance - General Information2. Farmers SOA Overview2. Farmers SOA Overview3. Farmers Oracle-BTM Setup4. Farmers Oracle-BTM Usecases5. Lessons Learned6. Q & A

- 27 - Farmers Confidential

Oracle-BTM for Online Insurance Verification

• Requirements:f f f– To provide a service for online insurance verification to the Department of Motor Vehicles.

– Log every message as part of compliance– Service needs to be available 99.9%– Service needs to respond within 2secs.

• Oracle BTM Solution:– Logs each and every message. – Notifies incase of service performance degradation.

- 28 - Farmers Confidential

– Send alerts when the service is either partially or completely not available.– Correlates the messages to provide individual system response times.

Oracle-BTM for Billing System

t B nctio

n

CICS Webservice

Client

nctio

n

nctio

n

Pro

xy A

gent

ALS

B/O

SB

SAP Server

RFC

SAP

RFC

Fun

Con

sum

ers

WAS Webservice

Client

SAP J2EE

SOAP-HTTP

SAP

RFC

Fun

SAP

RFC

Fun

• Requirements:

SAP Server

Inte

rnal

CWebservice Client

– System provides the billing to the online consumers and agents through the service interface.– Availability of the services are very critical.– Needs an ability to audit all the business transactions.– Service SLA are utmost important having not more than 2-5 seconds response time. p g p

• Oracle BTM Solution:– Send alerts when services are either partially or completely not available.

T t d i th d f t t d ti

- 29 - Farmers Confidential

– Trace request and response messages improves the defect turn around time.– Provides Transaction reports that violates the SLAs.

1. Farmers Insurance - General Information2. Farmers SOA Overview2. Farmers SOA Overview3. Farmers Oracle-BTM Setup4. Farmers Oracle-BTM Usecases5. Lessons Learned6. Q & A

- 30 - Farmers Confidential

Lessons Learned

• BTM tool is necessary before implementing any distributed enterprise

strategy such as SOA, Cloud.

• Oracle BTM tool is not a replacement for the Systems Management• Oracle-BTM tool is not a replacement for the Systems Management

tool instead it complements the existing System Management tools.

• Automate the tasks of Registration, Management and Monitoring of

Business Transaction using Oracle BTM.

• Involve the BTM team early in projects would help in realizing the

fpotential of BTM tool.

• Communication and Collaboration between the development and BTM

team is key to successful BTM tool deployments.team is key to successful BTM tool deployments.

- 31 - Farmers Confidential

Questions

- 32 - Farmers Confidential

<Insert Picture Here>

Q & AQ & A

33

34

Kevin ForbesEnterprise ArchitectHealthways

35

Healthways

Healthways' solutions help healthy individuals stay healthy, mitigate and slow the progression of disease associated g p gwith family or lifestyle risk factors and promote the best possible health for those already affected by disease.

• The industry’s leading provider of specialized, e dust y s ead g p o de o spec a ed,comprehensive Health and Care Support solutions

• More than 50 million members nationwideFY2009 f $670 illi• FY2009 revenues of $670 million

• 2010 CIO Magazine Top 100 (Enterprise Architecture)• # 35 on the Information Week Top 500 for 2009# 35 on the Information Week Top 500 for 2009

36

Key Technologies

• Database‐Oracle 11G (RAC)a abase O ac e ( )

• Distributed Data Grid‐Oracle Coherence

• Service Platform‐ .Net Framework 3.5 (WCF)/IBM ( )/Message Broker

• Enterprise Service Bus‐ IBM DataPower/Message Broker

• Runtime Governance‐ Oracle BTM (aka "AmberPoint")

• Enterprise Decision Management‐ Blaze Advisor

• Web Portal‐ IBM WebSphere

• Security‐ Oracle Identity Management

37

SOA Landscape

38

BTM Challenge

• Extremely Complex Service Oriented/Event DrivenExtremely Complex Service Oriented/Event Driven Architecture

• 25 million+ messages/dayg / y

• Mixed environment of service/ESB platforms

• Grid Everywhere environment requires a capableGrid Everywhere environment requires a capable monitoring/management infrastructure

39

Services Snapshot

40

BTM Benefits

• Tremendous ROI – eases pain of troubleshootingTremendous ROI  eases pain of troubleshooting complex service interactions and runtime exceptions

• Real‐time notification allows us to address technical issues before they become "business issues"

• Heterogeneous platform support gives us g p pp garchitectural flexibility – not "just for Oracle"

• Oracle acquisition of AmberPoint allows us to now manage the majority of our environment from a single console (Grid Control)

41