market leading continuous testing and service ... · pdf file1| stuart feasey ibm hybrid cloud...
TRANSCRIPT
![Page 1: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/1.jpg)
1 |
Stuart FeaseyIBM Hybrid Cloud - Test and Virtualization Specialist
Market Leading Continuous Testing and Service Virtualization Capability for WebSphere
![Page 2: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/2.jpg)
2 |
Whatdoesanenterpriseenvironmentmeantoyou?
![Page 3: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/3.jpg)
3 |
Today’sRealityforTesters
28%ofTestersarenottesting50% (ormore) ofthetime!
40%ofTestersarenottestingatleast1dayper
week!
![Page 4: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/4.jpg)
4 |
MiddlewareChanges
4 InternalSoftwareUpgrades
§ Standardsbodyupdates
4 NewInitiatives
§ Regulatorychanges
4 VendorChanges
§ Stackupgrades/EOLdates
§ Fromonevendortoanother
4 Consolidation
§ CorporateM&A
![Page 5: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/5.jpg)
5 |
Today’sRealityforTesters
TesterswanttospendMORE time
TesterswanttospendLESS time
![Page 6: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/6.jpg)
6 |
TheRoleofTestingintheContextofDevOps
Top15challengesidentifiedafteranalysisofaround20IBMDevOpsworkshopreports:
• FlexibleenvironmentprovisioningrequiredbyDevOpsteams(67%)• ThereisalackofcollaborationbetweenBus,DevandOps(58%)• Thereisnocoordinationofthedeliveryenvironmentelements(e.g.aDevOpsCoE)(58%)• GovernancewhenapplyingDevOps(50%)• Deploymentsarelargelymanual(anderrorprone)(50%)• TherearenoorlimitedDevOps-specificmetricsinplace(50%)• Insufficientandinconsistenttestautomation(42%)• Testdatamanagement(42%)• Testingisnotperformedearlyusingcapabilitiessuchasservicevirtualisation (33%)• Thereisnointegratedtoolsarchitectureinplace(42%)• NoDevOpsvocabularyisinplace(33%)• NoDevOpsvisionorstrategyhasbeendefined(33%)• Missingorinconsistentmechanismsforgettingfeedback(33%)• ApplyingDevOpsinaregulatedenvironment(33%)
![Page 7: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/7.jpg)
7 |
Presentation layer
Integrations, data and business logic
Traditional UI testing:
Automated Integration Testing and Service Virtualization:
The majority of risk in modern systems is seldom tested as it is unseen.
![Page 8: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/8.jpg)
8 |
Shiftingleft;Testingsmarter
UNIT SERVICE UI
Automated Integration Testing
Service Virtualization
Traditional UI Tools
Development Testing Staging Production
![Page 9: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/9.jpg)
9 |
![Page 10: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/10.jpg)
10 |
Gartner - Magic Quadrant for Software Test AutomationPublished: 15 November 2016
IBM STRENGTHS•IBM's test automation tools can give many enterprises a jump-start in their continuous testing efforts. They are strongest as an integrated solution, delivering a combination of products and services.•IBM provides automated testing support for many technologies and applications, including legacy systems, client/server applications, packaged applications, and Web and mobile applications. It offers integration across the development and delivery life cycle.•IBM is well-positioned for cloud-based testing and advanced cognitive analysis to aid in adaptive testing and decision making.IBM CAUTIONS•IBM's portfolio is comprehensive and can be perceived as too complex, especially in the early stages of investing in test automation or for simpler testing needs.•While IBM provides a powerful portfolio, it is not optimized for nontechnical users and may require additional services to set up and implement.•IBM supports packaged application testing, but relies on partners for business process analysis and validation.
![Page 11: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/11.jpg)
HTTP(S)Web Services / RESTJSON / SwaggerXML (XSD, WSDL)SOAP
![Page 12: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/12.jpg)
JDBC
WASMQ
z/OS SI BUS
IIB
RR
HTTP(S)WebSphere MQJMS (multiple)RESTS/MIMEJava RMI (virtualization)JVM (virtualiazation)SAP IDOC, BAPI, RFC, XI 3.0Software AG’s IB & ISTCP/(S), IP, UDPCICS TGCICS IPICCICS DPLIMS ConnectTIBCO Rendezvous, Smart Sockets & EMSActive MQEmail (SMTP, IMAP)FilesFTP/S
Websphere Application ServerIBM Integration Bus (WSMB)Websphere MQWebsphere SI BusWebsphere RRUDDIWeb Services / RESTWSDL / WADL / SwaggerSystem z (CICS and IMS)Software AG IS, BrokerOracle FusionTIBCO ActiveMatrixDatabasesLog FilesCentraSiteSCA Domain
XML (XSD, WSDL, WADL)SOAPJSON / SwaggerCOBOL CopybookPL/1ASC X12UN/EDIFACTDFDLISO8583ISO20022Fixed WidthJava ObjectsAS2Software AG Broker Docs.Net ObjectsBytesSWIFTCHIPSFedWireFIXTIBCO ActiveEnterpriseCustom
![Page 13: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/13.jpg)
13 |
IBMDevOpsSolutionforContinuousTesting
Presentationlayer
Middleware,Data, Services
Systems of Recordcomponents
Functional Tester
Web UI Tester
Rational Test Workbench
Integration Tester
Rational Performance Test Server
Performance TesterRational Test
Virtualization Server
RPTonCloud
RPTVTPacks
![Page 14: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/14.jpg)
14 |
MiddlewareTestingChallenges
4 Whatisitthatneedstesting
§ Unknownsystemcomponents
§ Wherearethesystemendpoints
§ Variationfromdocuments
4 Whatmessagesarebeingexchanged
§ Goodsourceofdata
§ Mirrorrealliferatherthanhistory
4 Identifyingchanges
§ Helptargettesting
§ Optimizecreationofnewtestassets
![Page 15: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/15.jpg)
15 |
ContinuousTesting
Execute test assets in headless mode§ Regression test new code quickly§ Continuous test cycles§ Build / Deploy / Test / Virtialize / Report�
Integrate into new or existing process§ Urban Code Plugin§ ANT task integration with Jenkins, CruiseControl, Bamboo, etc§ Command line execution§ Native integrations RTC, RQM, HP QC etc
Integration Tester reports served through a web browser (via Control Panel)
15
![Page 16: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/16.jpg)
16 |
TopologyDiscovery
Clients
Web Services
Database
Mainframe
HTTP Proxy
JDBC Driver
CICS TG Exit
![Page 17: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/17.jpg)
17 |
Synchronization
![Page 18: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/18.jpg)
18 |
Buildingasystemmodelfromrecordedevents
Queue.A.Reply
Queue.A
Application servers
Clients Queue.B.Reply
Queue.B
Queue.C.Reply
Queue.C
![Page 19: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/19.jpg)
19 |
WebSphere
4 RationalIntegrationTestercansynchronizewith:
§ IBMIntegrationBus
§ WebSphereApplicationServer
§ WebSphereRegistryandRepository
4 Discover:
§ HTTPEndpoints,MQconnections,JMSproviders,WSDLs,Databases,CICSandIMSconnections
4 Import
§ DFDLschemas
§ WSDL,WADL,XSD,Swagger
§ Copybooks,ProtocolBufferDefinitions
§ FromAPIConnect,Z/os ConnectEnterpriseEdition
![Page 20: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/20.jpg)
20 |
SiftandpassthroughwithMQ
MQQueueManager
Queue
RealTestSystem
MQExit
Clientthatinitiatestransaction(orRIT)
MQExitisinstalledontheMQQueueManager.Directsinboundandoutboundtrafficforexecutionpurposes.
Stub
MQExitInterceptsmessagebeforeithitstheinboundqueue.
Ifstubisdown,thenMQExitdirectsmessagetoLivesystem.
Passthroughroute.
![Page 21: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/21.jpg)
21 |
TypicalScenariosEncountered
![Page 22: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/22.jpg)
22 |
BUSINESSWORKS
SAPPI
CICS
DATABASE
APP SERVER
SWIFT/MQ
HL7/TCP
X12/SOAP
JSON/REST
MostOrchestrationEngineshavetheirownproprietaryruntime(unlikeJ2E)whichmeansmigrationbetweenvendorsisariskpropositionasdevelopmentisrequired.Testenvironmentsareexpensiveanditisextremelydifficulttofault-findinanenvironmentwithmanymovingparts
Scenario1:AMigrationChallenge
![Page 23: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/23.jpg)
23 |
IntegrationTestingandServiceVirtualizationcansignificantlyde-riskthemigrationandreducethetimerequired.
Development/testteamscanbuildagainstvirtualservicesandtestearlyandtestcontinuouslyusingmessagescapturedfromtherealsystems.Exception/edgecasetestingismucheasiertodo.
RITunderstandsawiderangeoftechnologiesandmessagingprotocols(includingDFDL)makingitwell-alignedtoIIBusers
Scenario1:FromTIBCOtoIIB
IBMINTEGRATIONBUS
SAPPI
CICS
DATABASE
APP SERVER
SWIFT/MQ
HL7/TCP
X12/SOAP
JSON/REST
![Page 24: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/24.jpg)
24 |
Step1– Recordrealmessages(usingRITAgents)
Step2– Createtestsandvirtualservices
Step3– Enhancetestsandvirtualservicestoincludeedge/errorcases
Step4– Migrationteamusetests/servicestobuildIIBsolutionandgainconfidence
Step5– Swapvirtualservicesforrealtestenvironmentsoneatatimeandre-runtests
Step6– Endtoendtest(confidentoflessriskofexpensiveerrorsatthisstage)
Scenario1:Details
IBMINTEGRATIONBUS
SAPPI
CICS
DATABASE
APP SERVER
SWIFT/MQ
HL7/TCP
X12/SOAP
JSON/REST
![Page 25: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/25.jpg)
25 |
Scenario2:IncreasingBuild/DeliveryVelocity
4 FinancialServicesCompany
§ AModernEnterprise
4 Complexity
§ Business
§ Technology
§ Organization
4 Getnextversionofweb/mobileofferingstomarketASAP
4 Maintainqualitywhilstprogressingtowardscontinuousdelivery
![Page 26: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/26.jpg)
26 |
Scenario2:MeetthatChallengewithDevops Capabilities
4 Understandtheissuesandfindopportunitiestoimprove
4 Automate andsimplify toenablecontinuousintegration
§ Openinterfacestotesttools
• ANTscripting
• Comand line
• RESTinterface
• UrbanCode plugins
4 LeadingtoasmoothpathtoContinuousTestingandultimatelyContinuousDelivery
![Page 27: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/27.jpg)
27 |
Scenario2a:CICSRegionunavailable
4 AppdevelopmentandtestteamuseUItestinginRationalTestWorkbench
4 AccessesrecorddataandservicesthroughCICSviaTransactionGateway
4 Resourceconstraints- won’tbeavailablefor2weeks
4 DevelopmentteamuseServiceVirtualizationtosimplify
§ PrototypetheservicewithRationalTestVirtualizationServer
CICSTransactionGateway
TestAutomation
VirtualService
New
![Page 28: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/28.jpg)
28 |
Scenario2b:DependentProgramNotAvailable
4 Exposedfunctionalityinvokesprogramcross-LPARoverDPL
4 DevelopandunittestinisolationusingRationalDevelopmentandTestEnvironmentforSystemz
4 UseRationalTestWorkbench toautomatefunctional/regressiontests
4 BeforelinkedprogramavailableuseServiceVirtualizationtosandboxonmainframe
RationalDevelopment&Test(RD&T)
VirtualService
![Page 29: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/29.jpg)
29 |
Adoption
![Page 30: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/30.jpg)
30 |
Thejourney– continuousintegration
Successivepracticesbuildoneachother,witheachpracticeaddinggreaterandgreaterbusinessvalueandhavinggreaterscopeoverthesoftwaredevelopmentprocess.
• Instant feedback to developers on quality issues• Supports Agile development• Unit test automation & more• Pre-cursor to Continuous Delivery and DevOps
![Page 31: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/31.jpg)
31 |
Multiple technologySome Open Source
Provide Virtual
Services
TESTER
Continuous deployment to
test environments
OPS
API TestingPerformance Testing
UI Automation
TESTER
Design & Build
DEVELOPER
Shippingcodefasterwithouttestingmeansthatbadcodecanbeshippedfaster.TestingisanintegralpartofDevOps.
Usingservicevirtualizationincreasestheabilitytotestearly,whiletestautomationprovidesrapidfeedbackonthequalityofthesoftwarebeingshipped.
WithoutContinuousTesting,thereisnoDevOps
![Page 32: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/32.jpg)
32 |
Resources
ContinuousTestingondeveloperWorks athttps://developer.ibm.com/testing/ContinuousTesting:AnIBMpointofview:http://www.ibm.com/developerworks/library/d-continuous-testing-shift-left-trs/index.htmlDevOpsROI:https://developer.ibm.com/urbancode/docs/devops-managers-organization-leaders-making-roi-case-executives/TheForresterWaveModernApplicationFunctionalTestAutomationTools,Q42016:https://reprints.forrester.com/#/assets/2/581/'RES123866'/reportsGartnerMagicQuadrantforSoftwareTestAutomation:https://www.gartner.com/doc/reprints?id=1-3NWQQJB&ct=161214&st=sgGartnerMagicQuadrantforApplicationReleaseAutomation:https://www.gartner.com/doc/reprints?id=1-3FNG0BR&ct=160822&st=sg
![Page 33: Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud -Test and Virtualization Specialist Market Leading Continuous Testing and Service Virtualization](https://reader031.vdocuments.mx/reader031/viewer/2022022004/5aa950a97f8b9a90188ca6f3/html5/thumbnails/33.jpg)
33 |
ThankYou