s317061 lost in transaction-.ppt• btm tool is necessary before implementing any distributed...
TRANSCRIPT
<Insert Picture Here>
Lost in the Transaction: S317061Managing Business Transactions Across Distributed Systems
Ed HorstEd HorstVP, Product Management
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver anycontract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development release and timing of anyThe development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
2
Program Agenda
<Insert Picture Here>• Quick Overview of Oracle Business Transaction Management
• Two Customer Case StudiesH lth– Healthways
– Farmers Insurance• Wrap Up / Q&Ap p
3
Today's Applications:Distributed across Diverse InfrastructureDistributed across Diverse Infrastructure
Process Engine Service BusAppliance
DBMSWeb
Partner and Cloud
5
Today's Applications:Support Distributed Business TransactionsSupport Distributed Business Transactions
Process Engine Service BusAppliance
DBMSWeb
Partner and Cloud
Health Claim Processing Transaction
6
Today's Applications:Support Distributed Business TransactionsSupport Distributed Business Transactions
Process Engine Service BusAppliance
DBMSWeb
Partner and Cloud
CRM Transaction
7
Business Transactions:The Key Problem for SOAThe Key Problem for SOA
• Transactions prone to vanish without a trace because of delays failures errorsbecause of delays, failures, errors
– IT staff typically unaware until end-user complains
– No single source for status of each transaction
• Problem diagnosis and managing exceptions is
ecommerceService
Enterprise Service Bus• Problem diagnosis and managing exceptions is laborious, high mean-time-to-resolve
– Manual effort, based on log mining– 80% of effort spent merely isolating the issue– Diverts valuable developer resources to IT fire-drills
EJB Application
Credit Service
ShipService
Enterprise Service Bus
InventoryService
– Diverts valuable developer resources to IT fire-drills
• System-centric monitoring is not sufficient– Lacks critical business context
– Customer name, order size, part numbers
EJB Application
JMS/MQ-based
WarehouseDBMS
Service
– Ignores a range of business-oriented errors & faults
8
8
Oracle Business Transaction Management (BTM) Provides Tracking Transactions across SOA
End-to-End, Application Level View
Process Engine Service Bus
• Real-time tracking of each transaction• Follows transactions across all infrastructure and applications
A S A li ti ESB' BPM' Et– App Servers, Applications, ESB's, BPM's, Etc.• Leverages message content – the business value flowing
through the applicationP id thi ith t dif i t i th• Provides this without modifying or tagging the messages– Message Fingerprinting– Non-invasive; doesn’t break applications
999
Mapping DependenciesReal-time view of application across componentspp p
W bProcess Engine Service Bus
ApplianceDBMS
Web
P t d Cl d
10
Partner and Cloud
Mapping DependenciesAcross JVMs, Platforms, Processes, and TechnologiesReal-time view of application across componentsService Bus
Packaged
li iApplications
Process Engine Data
Access
DB
Process Engine Service BusAppliance
DBMSWeb
11
11
Partner and Cloud
Measuring Transaction PerformanceMeeting Agreements on Responsiveness, Availability & Throughputg g p , y g p
Performance MetricsAvailability
Service
Le el
y
Throughput
Response time
Etc.
Level
AgreementsMonitor againstbaselines andthresholds
Historical
• Enforces agreements in real
Historical
Reporting
End-to-End
time• Enables preventative and
corrective actions– Not just reporting violations
Process Engine Service Bus
12
Not just reporting violations after its too late
Monitor for ExceptionsDetecting Exceptions in Real-time
• Continuously evaluates critical transactions
– Flexible instrumentation model: doesn't require isibilit into e er stepvisibility into every step
• Detects Exceptions both Business &Technical
– Stalled processes, Rejected Order
Alert p ,missing steps, dropped transactions
– Business errors, such as credit denied, orders over $1M shipment longer$1M, shipment longer than 7 days
– App faults, protocol errors
• Notifies stakeholders, i k th t
Process Engine Service BusAppliance
DBMSWeb
invoke other systems –trouble ticketing, other exception handlers, etc
Partner and Cloud
13 13
Monitor for Exceptions Quickly pinpoint errorsy p p
Transaction
History Drill into TransactionContent & Context
Message Flow
‐ Per Transaction
Content & Context
• Eliminates costly manual search through log files across containers
Unified view of transaction across
End-to-End
– Unified view of transaction across different keys, IDs, etc.
• Inspect related request/reponse pairs for entire flow
Process Engine Service Bus
14
Leverage Business ContextAd-hoc searching across logged business transactions
• Locate transactions based on monitored and logged information
g gg
information• Comprehensive searching
– Business content & context –order # customer name etcorder #, customer name, etc.
– Time range– Specific faults
• Look for specific conditions Transaction History psuch as slow response times or faults as well as broad textual content
12‐105 Borders 02‐15‐09 $4,600 OK
14‐448 Amazon 02‐16‐09 $9,304 OK
14‐843 Barnes 02‐22‐09 $11,938 Error
• Optimize search on specific, frequently used attributes
30‐336 Borders 03‐01‐09 $21,103 OK
33‐596 Amazon 03‐02‐09 $7,338 OK
41‐908 Amazon 03‐13‐09 $33,301 Error
$
151515
42‐308 Borders 03‐14‐09 $23,901 OK
Managing Business TransactionsManaging Business Transactions Across Distributed Systems
Suresh Murthy, SOA ArchitectSeptember 2010
AGENDA
1. Farmers Insurance - General Information2. Farmers SOA Overview2. Farmers SOA Overview3. Farmers Oracle-BTM Setup4. Farmers Oracle-BTM Usecases5. Lessons Learned6. Q & A
- 18 - Farmers Confidential
Farmers Insurance - General Information
• Wholly owned subsidiary of Zurich Financial Services
Founded in 1928 Headquartered in Los Angeles and doing• Founded in 1928, Headquartered in Los Angeles and doing
business in 41 states
• Diversified product portfolio• Diversified product portfolio
– Auto, business, homeowners, life & specialty insurance
– Financial services (e.g., annuities, IRAs, 529 plans, etc.)a c a se ces (e g , a u t es, s, 5 9 p a s, etc )
• Serves more than 15 million customers
• 20,000 employees (approx)
• Strategic business unit within Zurich’s $50 billion global
operation
- 19 - Farmers Confidential
1. Farmers Insurance - General Information2. Farmers SOA Overview2. Farmers SOA Overview3. Farmers Oracle-BTM Setup4. Farmers Oracle-BTM Usecases5. Lessons Learned6. Q & A
- 20 - Farmers Confidential
Farmers SOA Overview
• In 2007, Zurich rolled out an enterprise-wide SOA initiative known as ZSOA
• Goals of the initiative– Accelerate time to market for new products & services
– Improve operational efficiency & flexibilityImprove operational efficiency & flexibility
– Provide LOBs with visibility into projects going on across the Zurich enterprise
– Reduce the IT cost structure
f• In addition to providing a shared physical infrastructure, ZSOA is used to:– Define the strategic direction of SOA across Zurich
– Define the policies, procedures, frameworks and standards for service
development
– Define how services are implemented and governed• As part of the initiative, Farmers SOA Competency Center is established
- 21 - Farmers Confidential
As part of the initiative, Farmers SOA Competency Center is established to realize the SOA within Farmers
ZSOA Reference Architecture
Support &
System Management
er
Internal user External userUser / Enterprise B2B Gateway
Support &
System Management
erer
Internal user External userUser / Enterprise B2B Gateway
rvic
e C
onsu
m Process Orchestration
gem
ent
, Rep
ortin
g
rvic
es
Serv
ices
Process
Services
ZZrvic
e C
onsu
mrv
ice
Con
sum Process
Orchestration
gem
ent
, Rep
ortin
g
rvic
es
Serv
ices
Process
Services
Process
Services
ZZOpen Stds: BPEL, WSC
Prov
ider
Ser
Service Orchestration Orchestrated / Composed
Services
Syst
em M
anag
oggi
ng, A
uditi
ng
Secu
rity
Ser
Polic
y
Tran
sfor
mat
ion
Orchestrated / Composed
Services
ZSAZSA
-- ESBESB
Prov
ider
Prov
ider
Ser
Ser
Service Orchestration Orchestrated / Composed
Services
Syst
em M
anag
oggi
ng, A
uditi
ng
Secu
rity
Ser
Polic
y
Tran
sfor
mat
ion
Orchestrated / Composed
Services
ZSAZSA
-- ESBESB
O Std WS P li
Serv
ice
P
Service Enablement
Business
Lo
Basic Business Services Common Services
Serv
ice
PSe
rvic
e P
Service Enablement
Business
Lo
Basic Business Services Common Services
Open Stds: WS-Policy
Open Stds: SOAP JMSBusiness Logic
ServiceRegistry /Directory
Data Source
Legacy
Application
Commercial
Package
Custom
Component
Business Logic
ServiceRegistry /Directory
Data Source
Legacy
Application
Commercial
Package
Custom
Component
Open Stds: SOAP, JMS
- 22 - Farmers Confidential
Oracle BTM
1. Farmers Insurance - General Information2. Farmers SOA Overview2. Farmers SOA Overview3. Farmers Oracle-BTM Setup4. Farmers Oracle-BTM Usecases5. Lessons Learned6. Q & A
- 23 - Farmers Confidential
Need for Business Transaction Management (BTM)
• Enable support for different types of service level objectives
• Provide support for proactive monitoring & alerts
ManageSLAs
FacilitateDiagnostic
s
j• Manage and enforcing
the policies.• Alerts & Notifications
alerts• Support corrective
actions on errors/exceptions.P id d di
S t
• Provide deep-dive service diagnostic facilities
Provide Reporting
Support Multi-
Platform• Deployable to a ZFS standard infrastructure
• Provide standard out of the box reports
• Provide platform coverage for different ZFS service providers
• Integrate with the ZSOA
t e bo epo ts• Enable report
customization• Provide a role-based
h
- 24 - Farmers Confidential
• Integrate with the ZSOA infrastructure.
access to the reports or portal
Oracle-BTM Setup
WAS Webservice
Client
CICS Webservice
Client
B2B Gateway Client
Service Consumers Administrator
Proxy Agent
OSB
Proxy Agent
OSB
Proxy Agent
OSB
Sphere
Performance
ORACLE BTM
Service Orchestration/Enablement
OSBOSB OSB
Windows
EXM
Windows
Proxy Agent
Weblogic Webservice
Proxy Agent
WAS WebserviceSAP S
RFC Function Modules
- 25 - Farmers Confidential
Service Providers
WebserviceWebserviceSAP Server
Oracle-BTM Setup Cont’d..Oracle BTM Service Monitoring Oracle BTM Exception DetailsOracle BTM Service Monitoring Oracle BTM Exception Details
Oracle BTM Services SummaryOracle BTM Policies
- 26 - Farmers Confidential
1. Farmers Insurance - General Information2. Farmers SOA Overview2. Farmers SOA Overview3. Farmers Oracle-BTM Setup4. Farmers Oracle-BTM Usecases5. Lessons Learned6. Q & A
- 27 - Farmers Confidential
Oracle-BTM for Online Insurance Verification
• Requirements:f f f– To provide a service for online insurance verification to the Department of Motor Vehicles.
– Log every message as part of compliance– Service needs to be available 99.9%– Service needs to respond within 2secs.
• Oracle BTM Solution:– Logs each and every message. – Notifies incase of service performance degradation.
- 28 - Farmers Confidential
– Send alerts when the service is either partially or completely not available.– Correlates the messages to provide individual system response times.
Oracle-BTM for Billing System
t B nctio
n
CICS Webservice
Client
nctio
n
nctio
n
Pro
xy A
gent
ALS
B/O
SB
SAP Server
RFC
SAP
RFC
Fun
Con
sum
ers
WAS Webservice
Client
SAP J2EE
SOAP-HTTP
SAP
RFC
Fun
SAP
RFC
Fun
• Requirements:
SAP Server
Inte
rnal
CWebservice Client
– System provides the billing to the online consumers and agents through the service interface.– Availability of the services are very critical.– Needs an ability to audit all the business transactions.– Service SLA are utmost important having not more than 2-5 seconds response time. p g p
• Oracle BTM Solution:– Send alerts when services are either partially or completely not available.
T t d i th d f t t d ti
- 29 - Farmers Confidential
– Trace request and response messages improves the defect turn around time.– Provides Transaction reports that violates the SLAs.
1. Farmers Insurance - General Information2. Farmers SOA Overview2. Farmers SOA Overview3. Farmers Oracle-BTM Setup4. Farmers Oracle-BTM Usecases5. Lessons Learned6. Q & A
- 30 - Farmers Confidential
Lessons Learned
• BTM tool is necessary before implementing any distributed enterprise
strategy such as SOA, Cloud.
• Oracle BTM tool is not a replacement for the Systems Management• Oracle-BTM tool is not a replacement for the Systems Management
tool instead it complements the existing System Management tools.
• Automate the tasks of Registration, Management and Monitoring of
Business Transaction using Oracle BTM.
• Involve the BTM team early in projects would help in realizing the
fpotential of BTM tool.
• Communication and Collaboration between the development and BTM
team is key to successful BTM tool deployments.team is key to successful BTM tool deployments.
- 31 - Farmers Confidential
Healthways
Healthways' solutions help healthy individuals stay healthy, mitigate and slow the progression of disease associated g p gwith family or lifestyle risk factors and promote the best possible health for those already affected by disease.
• The industry’s leading provider of specialized, e dust y s ead g p o de o spec a ed,comprehensive Health and Care Support solutions
• More than 50 million members nationwideFY2009 f $670 illi• FY2009 revenues of $670 million
• 2010 CIO Magazine Top 100 (Enterprise Architecture)• # 35 on the Information Week Top 500 for 2009# 35 on the Information Week Top 500 for 2009
36
Key Technologies
• Database‐Oracle 11G (RAC)a abase O ac e ( )
• Distributed Data Grid‐Oracle Coherence
• Service Platform‐ .Net Framework 3.5 (WCF)/IBM ( )/Message Broker
• Enterprise Service Bus‐ IBM DataPower/Message Broker
• Runtime Governance‐ Oracle BTM (aka "AmberPoint")
• Enterprise Decision Management‐ Blaze Advisor
• Web Portal‐ IBM WebSphere
• Security‐ Oracle Identity Management
37
BTM Challenge
• Extremely Complex Service Oriented/Event DrivenExtremely Complex Service Oriented/Event Driven Architecture
• 25 million+ messages/dayg / y
• Mixed environment of service/ESB platforms
• Grid Everywhere environment requires a capableGrid Everywhere environment requires a capable monitoring/management infrastructure
39
BTM Benefits
• Tremendous ROI – eases pain of troubleshootingTremendous ROI eases pain of troubleshooting complex service interactions and runtime exceptions
• Real‐time notification allows us to address technical issues before they become "business issues"
• Heterogeneous platform support gives us g p pp garchitectural flexibility – not "just for Oracle"
• Oracle acquisition of AmberPoint allows us to now manage the majority of our environment from a single console (Grid Control)
41