5. rational testing of soa application

®

IBM Software Group

© 2007 IBM Corporation

IBM Rational Proof of Technology

Discovering the Value of IBM Rational’s Web Services Testing Solution

IBM Software Group | Rational software

2

TechWorks

Agenda

Overview of Quality Management of SOA Applications

Challenges of Testing SOA Applications

Overview of IBM SOA Quality Management Solution

Key SOA Concepts and Terminology

Functional Testing of Services

Performance Testing of Services

Management and Monitoring of Services


3

TechWorks

Decades of proven processexpertise & customer success

IBM Rational softwareA strategic partner in business innovation & transformation

Go

vern

an

ce &

lif

ecy

cle

man

agem

en

t

Business flexibility

Global capability

Time to value

Risk & compliance management

Business imperativesBusiness innovation& transformation

Alignment

Control

Efficiency

Governing the businessprocess of software& systems delivery


4

TechWorks

March ‘07

Oct ‘06

Service Development & Delivery

Management

Apr ‘06

Infrastructure and Management

In Support of SOA

Service Development and

Delivery Management

SOA Governance Method

Dec ‘06

What is IBM SOA Quality Management? An Integral Part of SOA Governance & Service Lifecycle Management


5

TechWorks

SOA Quality Management is the process to assure services meet business requirements by validating service

functionality and operations throughout the SOA Lifecycle

SOA Lifecycle

SOA Quality Management is continuous and takes place within each phase of the SOA Lifecycle

What is SOA Quality Management?


6

TechWorks

The SOA Testing Strategy

Test early, test often is more important now than ever (due to the domino affect a bug in a service may have on a given business process and the

possibility of that service being in many business processes)

The only way to effectively test SOA projects is to…. start from the ground up.

test the inputs and outputs of individual modules.

assemble sections of logic together and test smaller sections of the integration flow.

Assemble those smaller sections into a finished SOA project and perform an end-to-end test on the fully assembled project.

Key tenants Focus on the business processes in requirements and testing

Create test plans that account for assembly of services

Create an automated and repeatable testing process Plan for typical SOA testing hurdles (e.g. security access, unavailable systems)


7

TechWorks

Agenda









8

TechWorks

SOA adoption increases modularity & changeBringing quality to the forefront

Pain of modularity

Lower level of functionality & performance both at individual service level & composite application

Increased risk and need to manage distributed assets

Increased management of a larger number of services including custom, outsourced & packaged

Business impact

Service and application SLAs will be impacted by more frequent updates

Cross-organization Business/IT organizations will have increased complexity

Decentralization, modularity and increased risk drives need for a structured approach of integrated requirements, architecture & lifecycle quality management


9

TechWorks

Quality Management of Service Oriented ApplicationsExamining the fundamental challenge…

Challenges of testing Service Oriented Architecture

Applications

Ensuring system fulfils requirements

Validating system functionality

Validating system performance

Validating component web services

Tracking test cases and defects


10

TechWorks

Quality Management of Service Oriented ApplicationsA new twist on an old problem…

Challenges of testing Service Oriented Architecture

Applications

Validating component web services


11

TechWorks

Quality Management of Service Oriented ApplicationsThe IBM Rational Solution.

Quality Management of Service Oriented Architecture Applications

The IBM Rational Solution is a three pronged approach

Traditional user centric requirement, test and defect management

New Web Service Quality functionality to address building blocks of SOA Apps

Post Deployment monitoring of service oriented architecture applications


12

TechWorks

“Everyone uses different tools – there’s no way to share data between the team.”

“There’s too much to test. Where do we begin ?”

“I have requirements, I have tests and I have defects…but nothing ties them together”

Challenge: The Cost - Time - Quality TradeoffGovernance of the software delivery process

Your job is to deliver quality applications. On Time. On Budget. You need to coordinate teams, data, schedules, requirements, models, code, tests, results and reports. Are you ready?


13

TechWorks

Challenge: Validating SOA component functionality & performanceEnsuring functionality of composite application units

“The Web Service is ready for testing, but there is no user interface to exercise it.”

“How can we leverage our Business Process analysis in our services testing efforts?”

“We don’t want to pull Programmers off their projects to write complex test harnesses.”

Web Services are the building blocks of SOA applications. A single service is a stand-alone component but may be used in dozens of systems. Some of those services will be yours, some not. How do you test a service without the rest of the system? Does it work? All the time? Under load? Are you sure?


14

TechWorks

Challenge: Post Deployment Monitoring of ServicesCreating a feedback loop from operations to development

Congratulations you’ve gone live. How are things going out there? Do you know? What happens when you need to make a change? And what if operations found a problem – how would it get back to development? Do these groups communicate?

“How can I monitor web services running on many different platforms against thousands of users?”

“How do I change policies and ensure those changes don’t break the implementations?”

“How can I communicate problems foundin the field back to development?”


15

TechWorks

Agenda









16

TechWorks

IBM Rational Quality Management Solutions Process and products to ensure quality throughout the delivery lifecycle and deployment

Define & AnalyzeEnable requirements

based testing

ImplementIncrease

code quality

Build & Deploy Automate & trace

the quality process

Test & ProductionEnsure functionality,

system performance & compliance

Assessbusinessanalytics


17

TechWorks

SOA Lifecycle

Validate the business requirements

Discover and assess against current services

Model service requirements

Create service update plan Create/modify the service to meet the

business requirementsAssess service against governance

policies Approve assembly completion

Manage & monitor the service throughout its lifecycle

Track the service in the registry Report on the service against

SLAs

Quality assure the servicesFunction testing Performance testingCompliance testing Approve service deployment

IBM Rational Quality Management Solutions Process and products to ensure quality throughout the delivery lifecycle and deployment


18

TechWorks

Create, document and prioritize business requirements

Rational RequisitePro WebSphere Business Modeler

Define, approve & monitor Rational Portfolio Manager Rational ClearCase Design, code, build Rational Application Developer Rational Build Forge

Deploy, build & monitor in production environment

Tivoli CompositeApplication Manager

Tivoli Provisioning Manager

Evaluate & execute functional & performance test cases

Rational Tester for SOA Quality and Performance Tester Extension for SOA Quality

Rational ClearQuest

Publish Find Enrich GovernManage

WebSphere Service Registry and Repository

What does the toolset provide? Automate business processes to achieve improved business flexibility Proactive response to quality issues earlier in the lifecycle Collaborative process automation & enforcement Extensible framework and registry/repository

SOA Lifecycle

IBM Toolset


19

TechWorks

Test Management with ClearQuest The Hub for Life-Cycle development

Track requirements, test cases, change requests and defects from a single interface

Consolidated reporting for full lifecycle process governance

Global test project coordination unifies distributed teams on a centralized data infrastructure

Configurable, enforceable processes ensures the tool adapts to your process


20

TechWorks

Service Quality Management Functional and Performance Testing of Web Services from a common interface

Rational Tester for SOA Quality

Automated regression and functional testing for GUI-less Web services

Rational Performance Tester Extension for SOA Quality

Performance Testing for Web Service based applications


21

TechWorks

Agenda









22

TechWorks

Service (in the context of SOA)

A self contained business function in which consumers interact through a well defined interface (contract).

The consumer does not know (or care) "how" the service implements the requested business action - only that the service performs "what" is defined by its published interface (contract).

A service in the context of

an SOA

An abstracted view of SOA concepts


23

TechWorks

WSDL – Web Service Description Language

An XML-based service description on how to communicate using web services.

Defines services as collections of network endpoints, or ports.

Specification provides an XML format.

The abstract definition of ports and messages is separated from their concrete use or instance, allowing the reuse of these definitions.

WSDL is often used in combination with SOAP and XML Schema to provide web services over the Internet.


24

TechWorks

Agenda









25

TechWorks

Functional & Regression Testing Strategy

Quickly test Web Services and setup desired regression Test Cases.

Ease-of-use in setting up these tests will help promote testers to test their Web Services early and often.

Easy Test Case Management and Setup is vital to a productive establishment and maintenance of functional & regression tests.

Setup an environment where the impact of requirement and business process changes can be quickly analyzed and realized


26

TechWorks

IBM Rational Tester for SOA QualityCode free test development

Simplify testing of GUI-less service Automated generation of web service test client

No programming knowledge is necessary to create, comprehend, modify, and execute a functional or performance test

Support a wide variety of users Automated data correlation and data driven testing

through a code-free test environment

Simplify service integration testing Automated test creation from WebSphere Business

Process Execution Language resources

Create, comprehend, modify, and execute a functional or performance test Graphical test editor enables both high-level and

deeper detail views

Support Web services standards (e.g. SOAP, HTTP(S), JMS, WS-Security, UDDI)

Code FreeTest Editor


27

TechWorks

Agenda









28

TechWorks

Performance Testing Strategy

QA Testers & Network Engineers should test the scalability and robustness of web services and determine performance and endurance characteristics of their WSDL operations.

Performance Tests should determine: response times

latency

throughput profiles

endurance

robustness

scalability


29

TechWorks

IBM Rational Performance Tester Extension for SOA QualityPerformance testing for Web applications

Web Service Response Time

Validate system scalabilityAutomated generation of web service

performance tests

Real-time reporting of server response time and throughput

Eliminate need for costly development of test codeAutomated generation of web service

test client

Get real time feedback on SOA efficiencyBroad platform monitoring support for

deployed web services

User action throughput


30

TechWorks

Agenda

Overview of Quality Management of SOA Applications Challenges of Testing SOA Applications





Manage and Monitoring of Services


31

TechWorks

Analyze SOA Service Quality Deploy with confidence with Tivoli Provisioning Manager

Dependency CheckingAnalyzing the environment to ensure the

change will be successful

Integrity Checking Analyzing relationships and the impact the

change will have on them

Increased service modularity within SOA will require additional and regular dependency and integrity checking


32

TechWorks

Health Monitoring of SOA components NEW! Application Management dashboards for IT and

business reporting supports Web Services, ESB and Process Server

Performance Monitoring and Transaction Management Populate WSRR with live service performance data NEW! Response Time dashboards

Change and Configuration management DataPower configuration support

Reroute services by making changes and upgrades while staying in full production mode

Auto-discover services for populating WSRR with services information

Monitor Deployed Services and Service QualityTivoli Composite Application Management (ITCAM)

“Show me the flow details in my service development tool!”

ITCAM supports production and development needs with a unified

console!


33

TechWorks

Response Time BreakdownMapping imported operations monitoring data to code

Import ITCAM and ITM data to your development environment to discover bottlenecks in hardware and code

Feed back operations data to development to provide insight into live deployed application response

Monitor both resource data such as CPU, Network and RAM as well as code performance data

Export operations alert data for analysis by

development


34

TechWorks

Next Steps – Learn and Explore Rational Tester for SOA Quality

http://www-306.ibm.com/software/awdtools/tester/soa/index.html

IBM Rational Tester for SOA Quality test execution and performance reports http://www-128.ibm.com/developerworks/ration

al/library/07/0327_kelly2/index.html?ca=drs-

IBM SOA http://www-306.ibm.com/software/solutions/soa

/

Tutorials on developerWorks http://www-128.ibm.com/developerworks/

views/rational/libraryview.jsp?search_by=Design+SOA+services+with+Rational+Software+Architect,+Part/


35

TechWorks

Enable quality management

throughout the lifecycle

IBM Rational software quality management: Connecting software results to business objectives

Continuous, comprehensive, and collaborative quality

management throughout the lifecycle reduces costs and

improves credibility

Ensure businessflexibility

Enhanceorganizational

efficiencies

Functional and performance testing of business services

helps ensure compliance and improve customer

satisfaction

Automating workflows across business processes by

streamlining and eliminating redundancies to improve

return on investment

Quality Management of Service Oriented Applications A complete solution

5. rational testing of soa application

Documents

quality applications

soa adoption

soa projects

soa testing strategy

service functionality

typical soa testing

finished soa project

single service