eli stull stpcon spring 2017 keynote

Performance Testing in the Evolving API Economy

02

Audience Poll:

Who ‘s API’s?

Who really ‘s API’s?API’s have become the cornerstone of modern

innovation

03

04

Change in the landscape

API

APIAPI

AppApp

AppAPI

PublicSpace

PublicSpace

PublicSpace

Publ

icSp

ace

PublicSpace

Public

Space PublicSpace

NowThen

App

AppAppApp

App

AppApp

05

Application Programming Interface

- Protocols and tools for building software applications

- Allow applications to talk to one another

API Overview

{A}

06

”Without change there is no innovation, creativity, or

incentive for improvement. Those who initiate change will have a better opportunity to manage the change that is

inevitable. - William Pollard, Physicist

• Platform based business model• Creates new product services and categories• Allows for user / customer production contribution – opening the

doors for any developer to develop and build on an API

07

API Economy Overview

08

Organizations that are thriving in the new economy are built specifically to innovate and build on the platform

• Structured to innovate and disrupt• Openly shares and distributes information and ideas • Chain of command structured on platform vs. products

API Economy Organizational Characteristics

Examples of industry disruptors and newly created categories

• Home Automation • P2P Asset Rental (home, car, tools)• Exercise Tracking• Ride Sharing• Navigation• Authentication

09

What is it?

• Everyday devices that are connected to the internet and are sending / receiving data to perform a task

10

Internet of Things (IoT)

IoT adoption / implementation shows no signs of slowing down….

• 6.65 Billion devices in 2016• Increase by ~16 Billion in 5 years (2021)• Translates to a ~$4.8 Trillion investment in technology in 5 year

span

11

IoT 5 year trend

http://www.businessinsider.com/the-internet-of-things-2017-report-2017-1

Where does this go?12

13

42

Customer experience

1Unit Test

QuickAutomation

2 4

53

15

Essential to platform release success

Integrate“Real World”

Stress Test

ReleaseProductionize

Code

MonitorEnvironment

User Experience

IteratePrioritize defects

and enhancements

Testing during development

Automation reduces operational cost while increasing speed to market

• Dev Ops• Load Testing• Deployment

16

Automate, automate, and automate some more

17

Don’t

Test the end-to-end experience based on target product audience

• Devices• Networks• Full experience (including 3rd party interactions)

18

Performance test simulating the users environment

Baseline performance and monitor the experience with all methods available

• Synthetic Monitoring• RUM (Real User Monitoring)• Infrastructure (Backend)

19

On-going platform monitoring

Capital One Examples20

21

22

23

Thanks