enterprise monitoring shifting left by continuous ...€¦ · who we are: founded 7,900 employees...
TRANSCRIPT
![Page 1: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/1.jpg)
#Perform2018
Enterprise monitoring
Shifting Left by Continuous Performance Testing
Sumit Nagal
Principal Engineer in Quality
Intuit
![Page 2: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/2.jpg)
Sumit NagalJan, 2018
Shifting Left by continuous Performance Testing
![Page 3: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/3.jpg)
About
Work:
Play:
![Page 4: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/4.jpg)
Consumers Small Businesses Self-Employed
Who we serve:
![Page 5: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/5.jpg)
Our mission:Powering Prosperity Around the World
![Page 6: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/6.jpg)
Who we are:
Founded
7,900
Employees
42M
Customers
1993
IPO
$4.7B
Revenue
24
Locations
1983
![Page 7: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/7.jpg)
Intuit global locations: NA SA EU AS AU
24 locations in 11 countries
BrazilSão Paulo
EuropeLondon, UKParis, France
Munster, Germany
AustraliaMelbourneSydney
IndiaBangalore Singapore
IsraelTel Aviv
United StatesCal i fornia:
Mounta in ViewSan DiegoSan FranciscoWoodland Hills
Cambridge, MAFredericksburg, VAPlano/Dallas, TXQuincy, WAReno, NVTucson, AZWashington, D.C.
CanadaEdmontonMississauga/Toronto
Updated February 2017
New ZealandAuckland
![Page 8: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/8.jpg)
Intuit Confidential and Proprietary8 Intuit Confidential and Proprietary8
Agenda
• What
– Strategy
• How
– Setup / Configuration
– Execution
– Analysis
• Why
– Benefits
![Page 9: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/9.jpg)
Performance - What
![Page 10: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/10.jpg)
Intuit Confidential and Proprietary10 Intuit Confidential and Proprietary10
SBG Performance Testing
10
On Development
On Commit/PR
On Deployment
![Page 11: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/11.jpg)
Intuit Confidential and Proprietary11 Intuit Confidential and Proprietary11
SBG Performance Testing
11
Shifting Left
Debug ability
Traceability
![Page 12: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/12.jpg)
Intuit Confidential and Proprietary12 Intuit Confidential and Proprietary12
SBG Performance Testing
Test Tracking
Application Log
Analysis & Report
![Page 13: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/13.jpg)
Intuit Confidential and Proprietary13 Intuit Confidential and Proprietary13
SBG Performance Testing – On Development
Developers DO
Local Tests
Local Validations
Local Reproduction
![Page 14: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/14.jpg)
Intuit Confidential and Proprietary14 Intuit Confidential and Proprietary14
SBG Performance Testing – on PR
Quality Team
Performance Quality Gate
This is Work in Progress!
![Page 15: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/15.jpg)
Intuit Confidential and Proprietary15 Intuit Confidential and Proprietary15
SBG Performance Testing – Deployment
Quality Team
Validate Deployment
Research Regressions
Still Manual -> To Be Automated!
![Page 16: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/16.jpg)
Performance - Dynatrace
•What
–Memory Profiling tool
–Detail in depth analysis for JVM, thread and CPU Sampling
•How–Integrated with CICD process and enable via config
–Available to find RCA for performance problem
–Enable at Perf CI to track single call via Test Edition
•Why
–Solved complicated problem of Java Application
–PurePath technology to get full insight of api, code,DB, etc .
–Effective with performance testing
![Page 17: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/17.jpg)
Performance - How
![Page 18: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/18.jpg)
Intuit Confidential and Proprietary18 Intuit Confidential and Proprietary18
Performance CI – GitHub
![Page 19: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/19.jpg)
Intuit Confidential and Proprietary19 Intuit Confidential and Proprietary19
Performance CI – Code Change
![Page 20: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/20.jpg)
Intuit Confidential and Proprietary20 Intuit Confidential and Proprietary20
Performance CI – Jenkins Template
![Page 21: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/21.jpg)
Intuit Confidential and Proprietary21 Intuit Confidential and Proprietary21
Performance CI
![Page 22: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/22.jpg)
Intuit Confidential and Proprietary22 Intuit Confidential and Proprietary22
Performance CI - Configuration
![Page 23: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/23.jpg)
Intuit Confidential and Proprietary23 Intuit Confidential and Proprietary23
Performance CI – Perf Portal
![Page 24: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/24.jpg)
Intuit Confidential and Proprietary24 Intuit Confidential and Proprietary24
Performance CI – Analysis from Baselines -1
![Page 25: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/25.jpg)
Intuit Confidential and Proprietary25 Intuit Confidential and Proprietary25
Performance CI – Analysis from Baselines - 2
![Page 26: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/26.jpg)
Intuit Confidential and Proprietary26 Intuit Confidential and Proprietary26
Performance CI - Analysis
![Page 27: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/27.jpg)
Intuit Confidential and Proprietary27 Intuit Confidential and Proprietary27
Performance CI - Analysis
![Page 28: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/28.jpg)
Intuit Confidential and Proprietary28 Intuit Confidential and Proprietary28
Performance CI - Analysis
![Page 29: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/29.jpg)
Intuit Confidential and Proprietary29 Intuit Confidential and Proprietary29
Performance CI - Analysis
![Page 30: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/30.jpg)
Intuit Confidential and Proprietary30 Intuit Confidential and Proprietary30
Performance CI - Analysis
![Page 31: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/31.jpg)
Intuit Confidential and Proprietary31 Intuit Confidential and Proprietary31
Performance CI - Analysis
![Page 32: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/32.jpg)
Performance - Why
![Page 33: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/33.jpg)
Intuit Confidential and Proprietary33 Intuit Confidential and Proprietary33
Benefits
• Self Service
• Tracing single Txn
• Handle common end point – /graphql OR /entities
• Preserve Session State for debugging
• Quick Feedback to team
• Integrated with various tools to get code level insight
• Identifying commit caused degradation ( WIP )
• Development and PR process ( WIP )
![Page 34: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/34.jpg)
Intuit Confidential and Proprietary34 Intuit Confidential and Proprietary34
Appendix
• https://github.com/Dynatrace/Dynatrace-AppMon-Jenkins-Plugin - Jenkins Plug-in
• https://www.youtube.com/watch?v=O0SQL8DJxaI&list=PLqt2rd0eew1bmDn54E2_M2uvb
hm_WxY_6&index=64&t=2072s Performance clinic
• https://community.dynatrace.com/community/display/DOCDT65/Web+API+Tests
![Page 35: Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees 42M Customers 1993 IPO $4.7B Revenue 24 Locations 1983](https://reader034.vdocuments.mx/reader034/viewer/2022052614/6055c9ff8f62f678cf4e095c/html5/thumbnails/35.jpg)
Thank you