pre-con ed: who moved my ui? api testing in a headless world

World®’16

Pre-Con:WhoMovedMyUI?APITestinginaHeadlessWorldUlrichVogt– SrPrincipalEng.ServicesArchitect- CATechnologies

DO5X08E

DEVOPS

HeatherPeyton- PrincipalMarketingManager- CATechnologies

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

ForInformationalPurposesOnlyTermsofthisPresentation

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.Thepresentationprovided atCAWorld2016isintendedforinformationpurposesonlyanddoesnotformanytypeofwarranty.Someofthespecificslideswith customerreferencesrelatetocustomer'sspecificuseandexperienceofCAproductsandsolutionssoactualresultsmayvary.

CertaininformationinthispresentationmayoutlineCA’sgeneralproductdirection.Thispresentationshallnotserveto(i)affecttherightsand/orobligationsofCAoritslicenseesunderanyexistingorfuturelicenseagreementorservicesagreementrelatingtoanyCAsoftwareproduct;or(ii)amendanyproductdocumentationorspecificationsforanyCAsoftwareproduct.Thispresentationisbasedon currentinformationandresourceallocationsasofNovember1,2016,andissubjecttochangeorwithdrawalbyCAatanytimewithout notice.Thedevelopment,releaseandtimingofanyfeaturesorfunctionalitydescribedinthispresentationremainatCA’ssolediscretion.

Notwithstandinganythinginthispresentationtothecontrary,uponthegeneralavailabilityofanyfutureCAproductrelease referencedinthispresentation,CAmaymakesuchreleaseavailabletonewlicenseesintheformofaregularlyscheduledmajorproductrelease.SuchreleasemaybemadeavailabletolicenseesoftheproductwhoareactivesubscriberstoCAmaintenanceandsupport,onawhen andif-availablebasis.Theinformationinthispresentationisnotdeemedtobeincorporatedintoanycontract.


Abstract

LearnhowtoaddresstheproblemoftestingdataonthewirewithtestingsolutionsfromCATechnologies.TraditionalUATtestingalwayslookstotheworkflowoftheUserInterface(UI)tomanuallyorscriptouttesting.ManymodernAPIsdon’thaveUIsorUIsthatarenotavailabletotheendofthedevcycle.LearnhowmovingtheuserjourneytestjustbelowtheUItothesupportingAPI’scanprovidemorerobusttests,drivemoreautomationandshift-testingleft.

UlrichVogt

CATechnologiesSeniorPrincipalEngineeringServicesArchitect


Agenda

INTROANDCHANGESINDEVTEST10

FOLLOWINGTHEUSERSJOURNEY

DEMO

WEBSERVICESANDBACKENDS

OUTSIDEANDINSIDEOFANAPPLICATION

EXTENDINGANDEMBEDDINGTESTSAUTOMATICALLY

1

2

3

4

5

6


IntroandChangesinDevTest10

HeatherPeyton,PrincipalMarketingManager,CATechnologies

@[email protected]


APITesting– Value-Driven?APIsnowserveastheprimaryinterfaceforapplicationlogic1

IfanAPIbreaks,itcanbreakawholeendtoendvaluechain,notjustanapp!

1- https://en.wikipedia.org/wiki/API_testing


ContinuousTestingHowdoYouGetThere?TestingTechnologyAdoptionandMaturity

OptimizedOrganizationforDevOps

*Applicationreleaseautomationview

AGILEMAT

URITY

Silos,manualhandovers,waterfall,onerelease/year,monolithicapps,longtermproject/resourceplanning,errorpronereleaseprocesses

DevOps,end-to-enddelivery,incrementalagile/sprintreleasecadence,multi-

componentmicroapps,automationenabled,therightpeoplewiththerightskills.

Whereareyou?

UI Test Automation

Modeling & Test Generation Automation

API Test Automation & Service Virtualization

Continuous Testing


ServiceVirtualization

ApplicationTest

DevTestPortalDevTestWorkstation

ApplicationTest


+AdditionalRunTime

andAppTestLicensesSold


ApplicationTest


CAI– AutoGenerate

VirtualServices

CAI– FindAPIs,GenerateAPI

Tests

CAI

ApplicationTest


CAApplicationTest

+CAI– FindAPIs,GenerateAPITests


CAServiceVirtualizationPowerUser

+AdditionalRunTimeandAppTest LicensesSold


AppTest

+CAI– FindAPIs,GenerateAPITests

CASVPowerUser+CAI

+CAI– AutoGenerateVirtualServices

CAApplicationTest

CAServiceVirtualizationPowerUser

DevTest 9.5 DevTest 10.0


CATestDataManager•Find,createandprovisiontestdataautomaticallyandfast.

CAAgileRequirementsDesigner•Automaticallygenerateandmaintainthesmallestsetoftestcasesneededformaximumcoverage.

CAApplicationTest•EditandextendAPItestswithoutwritingcodeandtestthefulltechnologystack.

CAServiceVirtualization•Virtualize3rd partyAPIsandunavailablesystemsforagiletesting.

CAAPIManagement•ManageAPIsandcreateadirectoryofvirtualAPIsforsecureaccess.

https://www.itcentralstation.com/products/ca-test-data-manager

https://www.itcentralstation.com/products/ca-service-virtualization

AModernToolsetforAPITestingTransformation


FollowingtheUser’sJourney

UlrichVogt,SeniorPrincipalEngineeringServicesArchitect,CATechnologies


ChangestoWebSites– StatictoDynamic

§ Early2000’sHTTPposttoHTMLresponse– <FormAction=mypage.jsp>

– POSTorGETname=valuepairs

– SimpleformattingofHTMLresponse

§ Mid2005’sAJAXbasedwebpages– SOAPorXMLdatarequested

– Thereisnowa“applicationwithbugs”inthebrowserparsingthedataandpresentingdata

§ Enter2010’sHTML5applications– RESTful requestfordata

– ResponseXMLorJSON

– Browsercodeisstilla“applicationwithbugs”

Static

Dynamic


WhyCreateTeststhatFollowtheUserJourney?

§ UserInterface(UI)testingfollowsthemovementofauserthroughtheapplication.

§ ThetestdataforaUIteststartswithinputandthen“builds”withmoreuserdataorsystemreturneddata.

§ Datapresentedoneachscreenaddingnewdatacreatesthejourney


WhatistheGeneratedDataandHowitisHandled?

§ Inputdataonfirstpagebecomesadataset

§ Createpropertiesbaseson“value”forsharing

§ DatareturnedtothepageviaAPIispotentialdataintonextstep

Showmecars

Showmemileage

AcuraBuick…

VINNbrAcura

GetacarloanTermsVINNbrAcura


FindingtheAPIs

Mobileapplicationsandrichbrowserapplications

ServicesprovidedbytheESBDatabeing

servicedupbyESB

ESB


KeyConsiderationsWhenLookingattheLayer

§ WhatbusinessrulesandvalidationisattheMobilelayer?

§ AretheAPI/Serviceendpointschangingdata?

§ ESBallthedataonthewire?

§ Backendsystems– havetheychanged?ESB


ConsiderationsforAPIandServiceDeliveryLayers

§ Where’stheUI?– SOAPXML,RESTJSON– HTTP,TP&MessageQueue’s

§ Testingorchestrationofmultipleservicecallstoaccomplisharequirement

§ APIcallsarelessbrittlethanUItesting

§ Nonfunctionalloadtestingtounderstandcompositeresponsetimes

ESB


HowdoIFindtheAPI’sandtheOrderingforGeneration?

§ UsetheCAApplicationTest(CAI)Chromeplugin toseeAPI’s– ‘Developertool’inChrome– Pluginlivesinbrowserandsee’s

requestsandresponsedata– Viewbeforeencryptionand

signatures– Workswithanybackendserver,

notonlyjavabased

AcuraBuick

/get/cars

TLRTX

/get/cars/model/Acura

/get/cars/Vin/ABC123DEF

MilesNotsalvageColor

+InstallPlugin

CAContinuousApplicationInsightServerGenerateCAApplicationTests

Transactions


HowdoIFindtheAPI’sandtheOrderingforGeneration?

§ StartDocumentTransactions– Limitscopeoftransactionsby

IPaddress– Associatetransactionswith

startandstoptime– Worksforanyclient

applications– Requiresjavaagentin

backend

10:25am192.168.168.44

“Acura”“Buick”

GET/get/cars

“TL”“RTX”

GET/get/cars/model/Acura

GET/get/cars/Vin/ABC123DEF

“Miles”“Notsalvage”“Color”

10:25am192.168.168.44

J2EEDevTest Agent


DemoGoogleChromePlugin


DemoDocumentTransactions


ExtendingandEmbeddingTestCasesAutomatically

§ Needastandardprefixtoyourtestforauthentication?

§ Wanttovalidatethedatabaseafterexecutingateststepthatupdatesthedatabase?

§ Wanttorunatestwithadditionaldata?


DemoEmbeddingIntoaTestTemplate


DemoTestWithEmbeddedDatabaseValidation


DemoCreateDataDrivenTests


HandleDynamicData

Theuserdataalongwithreturneddatafromtheapplicationisdynamic.Generatedtestsaredata

drivenandparameterdriventoensuretheyactuallyrun.

FollowtheuserJourney

ApplicationsareAPI’susedintheorderoftheUserJourneythroughtheapplication.TheorderoftheAPI’smakesa

difference.

GenerateAPItest

APItestsareeasilygeneratedtofollowtheuserjourney.TheAPI’saremorestablethen

automatingtheUI’s.TheAPI’sshouldbeleveraged

inmultipleapplications.

SummaryAFewWordstoReview


Questions?


RecommendedSessions

SESSION# TITLE DATE/TIME

DO5X09ESoyouimplementedaservicebuss?Howya'gonna testthatmonster?

11/15/2016at10:45am

LagoonK

DO5X10ESharingtheresponsetime?Nothankyou.I’llhaveanotherpieceofpie!

11/15/2016at1:00pm

LagoonK

DO5T12T IntegratedTestingfromAtoZ(SV/Test)11/16/2016at11:30am

DevOpsTheater


MustSeeDemos

ModernizeAppDeliveryIntegratedCDTheater5- DOV501P

DeliverTestDataFasterTestDataManagerTheater5- DOV511P

DeliverBetterAppsServiceVirtualizationTheater5- DOV507P

OrchestrateYourReleaseReleaseAutomationTheater5- DOV513P


DevOps.comAlanShimel

DO5T21P11/16/201611:30am

PanelSessions

DevOpsLeadership

DO5T02P11/16/20161:45pm

FinancialIndustry

DO5T03P11/16/20164:30pm


BaselineTestCreationUsingCAContinuousApplicationInsight– OnYoutube§ EnvironmentIntroduction:BaselineTestCaseAutomationwithCACAI8- Part1 -

https://www.youtube.com/watch?v=juH9yVJ9fVY

§ FilteringTransactionsandCreationOptions:BaselineTestCaseAutomationwithCACAI8- Part2 –https://www.youtube.com/watch?v=i6_bLJeGmKQ

§ CreateaBaseline:BaselineTestCaseAutomationwithCACAI8- Part3 -https://www.youtube.com/watch?v=84vcPiMvfPY

§ ReviewaBaseline:BaselineTestCaseAutomationwithCACAI8- Part4 -https://www.youtube.com/watch?v=BAetSXMfpxA

§ AdvancedBaselineReview:BaselineTestCaseAutomationwithCACAI8- Part5 -https://www.youtube.com/watch?v=vycy3hzLX5E

§ ExecuteExpandedBaselines:BaselineTestCaseAutomationwithCACAI8- Part6 -https://www.youtube.com/watch?v=2UOCh-yjAc0

§ ExecuteData-DrivenBaselines:BaselineTestCaseAutomationwithCACAI8- Part7 -https://www.youtube.com/watch?v=jyJD4mUDafg


Thankyou.

Stayconnectedatcommunities.ca.com