techwell accelerating software delivery with continuous integration feat. dan boutin
TRANSCRIPT
![Page 1: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/1.jpg)
August 26, 2015
“Accelerate Software Delivery with Continuous Integration”Dan Boutin – Senior Product Evangelist
[email protected] (404) 304-9529@DanBoutinSOASTA
![Page 2: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/2.jpg)
© 2014 SOASTA. All rights reserved. 2
In This Discussion Today
Agenda: • SOASTA Introduction• The need for “Continuous”• The “Big 3”• CI with mobile and performance testing
![Page 3: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/3.jpg)
© 2014 SOASTA. All rights reserved. 3
SOASTA – Performance Analytics
100 BillionUser Experiences Tested
10 MillionTests Performed
Actual CloudTest view
![Page 4: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/4.jpg)
© 2014 SOASTA. All rights reserved. 4
In This Discussion Today
Agenda: • SOASTA Introduction• The need for “Continuous”• The “Big 3”• CI with mobile and performance testing
![Page 5: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/5.jpg)
© 2014 SOASTA. All rights reserved. 5
CI Offers Speed of DeliveryWhat’s not to like?
![Page 6: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/6.jpg)
© 2014 SOASTA. All rights reserved. 6
CI Offers Speed of Delivery
o Small Batch Sizes
What’s not to like?
![Page 7: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/7.jpg)
© 2014 SOASTA. All rights reserved. 7
CI Offers Speed of Delivery
o Small Batch Sizeso Comprehensive Version Control
What’s not to like?
![Page 8: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/8.jpg)
© 2014 SOASTA. All rights reserved. 8
CI Offers Speed of Delivery
o Small Batch Sizeso Comprehensive Version Controlo Simple Branch Strategies
What’s not to like?
![Page 9: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/9.jpg)
© 2014 SOASTA. All rights reserved. 9
CI Offers Speed of Delivery
o Small Batch Sizeso Comprehensive Version Controlo Simple Branch Strategieso Automation
What’s not to like?
![Page 10: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/10.jpg)
© 2014 SOASTA. All rights reserved. 10
CI Offers Speed of Delivery
o Small Batch Sizeso Comprehensive Version Controlo Simple Branch Strategieso Automation o Continuous Feedback
What’s not to like?
![Page 11: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/11.jpg)
© 2014 SOASTA. All rights reserved. 11
CI Offers Speed of Delivery
o Small Batch Sizeso Comprehensive Version Controlo Simple Branch Strategieso Automation o Continuous Feedbacko Emphasis on working builds
What’s not to like?
![Page 12: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/12.jpg)
© 2014 SOASTA. All rights reserved. 12
CI Offers Speed of Delivery
o Small Batch Sizeso Comprehensive Version Controlo Simple Branch Strategieso Automation o Continuous Feedbacko Emphasis on working buildso Consistent environments
What’s not to like?
![Page 13: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/13.jpg)
© 2014 SOASTA. All rights reserved. 13
CI Offers Speed of Delivery
o Small Batch Sizeso Comprehensive Version Controlo Simple Branch Strategieso Automation o Continuous Feedbacko Emphasis on working buildso Consistent environmentso Developer – Tester Collaboration
What’s not to like?
![Page 14: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/14.jpg)
© 2014 SOASTA. All rights reserved. 14
In This Discussion Today
Agenda: • SOASTA Introduction• The need for “Continuous”• The “Big 3”• CI with mobile and performance testing
![Page 15: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/15.jpg)
© 2014 SOASTA. All rights reserved. 15
What’s Been Missing?
![Page 16: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/16.jpg)
© 2014 SOASTA. All rights reserved. 16
So, let’s break down DevOps – What is it, really?o It’s not what’s within the siloso It’s about the relationships
![Page 17: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/17.jpg)
A typical silo’d organization lacks end-to-end integration
Performance Engineering & Continuous Integration-Full Lifecycle
Operational Configuration
Continuous Integration touchpoints
ADLC QA/Test Pre-Production
Production
QA/Test Environment
Operational Production
Environment
Application Development Environment
![Page 18: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/18.jpg)
Development Test
Configuration management
Release management
Change management
Performance management
CI Focus Areas – The assembly line Hand-offs
Key Processes
![Page 19: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/19.jpg)
© 2014 SOASTA. All rights reserved. 19
Software is simple: It’s Manufacturing & BOMo Bill of Materials (BOM!)o The “Big 3” => Change, Configuration & Release
• That is your software assembly line conveyor belt
![Page 20: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/20.jpg)
© 2014 SOASTA. All rights reserved. 20
So, what?
• We can only test as fast as the conveyor belt allows.
• If the conveyor belt is moving slow, testing is delayed.
• The Big 3 drives testing cycle.
o Why is CI critical?• Speed
• New features, functions, etc. need to get to the customer, ASAP!
![Page 21: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/21.jpg)
© 2014 SOASTA. All rights reserved. 21
So, let’s break that down…o CI is a key component of Performance Engineeringo Performance Engineering spans the silos
BIG 3
Testing
ApplicationDevelopment Life Cycle
ITOperations
CapacityManagement
PerformanceManagement
PerformanceEngineering
![Page 22: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/22.jpg)
© 2014 SOASTA. All rights reserved. 22
Laying the FoundationA factory streamlines for quality and speed
Does it work as designed?
Does it perform under
extreme circumstance
s?
Approve materials
Real Drivers
What happens in actual conditions?
Assembly Line
![Page 23: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/23.jpg)
© 2014 SOASTA. All rights reserved. 23
Laying the FoundationCI streamlines for continuous quality
Functional validation
Performance,reliability,scalability tests
Real Users
Build
What happens in actual conditions?
Unit-tested code
![Page 24: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/24.jpg)
© 2014 SOASTA. All rights reserved. 24
In This Discussion Today
Agenda: • SOASTA Introduction• The need for “Continuous”• The “Big 3”• CI with mobile and performance testing
![Page 25: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/25.jpg)
© 2014 SOASTA. All rights reserved. 25
Continuous QualitySOASTA’s Lifecycle
![Page 26: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/26.jpg)
© 2014 SOASTA. All rights reserved. 26
Continuous QualitySOASTA’s LifeCycle
I JUST MADE A CODE CHANGE
Jenkins runs any unit tests as usual
![Page 27: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/27.jpg)
© 2014 SOASTA. All rights reserved. 27
Continuous QualitySOASTA’s Lifecycle
Run iterative load tests via Jenkins
Spin up suitable, consistent test environments in the
cloud or the lab
I JUST MADE A CODE CHANGE
Jenkins runs any unit tests as usual
![Page 28: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/28.jpg)
© 2014 SOASTA. All rights reserved. 28
Continuous QualitySOASTA’s Lifecycle
Run iterative load tests via Jenkins
Mobile? Run functional automation on real devices for functional & performance validation
Spin up suitable, consistent test environments in the
cloud or the lab
I JUST MADE A CODE CHANGE
Jenkins runs any unit tests as usual
![Page 29: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/29.jpg)
© 2014 SOASTA. All rights reserved. 29
Continuous QualitySOASTA’s Lifecycle
Run iterative load tests via Jenkins
Daily (or more frequent) updates keep teams quality focused
Embedded failure details & bottleneck data isolate issues
Mobile? Run functional automation on real devices for functional & performance validation
Spin up suitable, consistent test environments in the
cloud or the lab
I JUST MADE A CODE CHANGE
Jenkins runs any unit tests as usual
![Page 30: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/30.jpg)
© 2014 SOASTA. All rights reserved. 30
Continuous QualitySOASTA’s Lifecycle
Run iterative load tests via Jenkins
Daily (or more frequent) updates keep teams quality focused
Embedded failure details & bottleneck data isolate issues
Manage to a performance
baseline
Mobile? Run functional automation on real devices for functional & performance validation
Spin up suitable, consistent test environments in the
cloud or the lab
I JUST MADE A CODE CHANGE
Jenkins runs any unit tests as usual
![Page 31: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/31.jpg)
© 2014 SOASTA. All rights reserved. 31
Continuous QualitySOASTA’s Lifecycle
Use real user data toiterate dev & test plans
Run iterative load tests via Jenkins
Daily (or more frequent) updates keep teams quality focused
Embedded failure details & bottleneck data isolate issues
Manage to a performance
baseline
Mobile? Run functional automation on real devices for functional & performance validation
Spin up suitable, consistent test environments in the
cloud or the lab
I JUST MADE A CODE CHANGE
Jenkins runs any unit tests as usual
![Page 32: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/32.jpg)
![Page 33: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/33.jpg)
SOASTA – Branch Build from CloudTest
![Page 34: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/34.jpg)
SOASTA – Test Results
![Page 35: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/35.jpg)
SOASTA – Drill Down (Test Failures)
![Page 36: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/36.jpg)
SOASTA – UI Testing Bundle Results
![Page 37: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/37.jpg)
SOASTA – UI Testing Failure Drill down into SOASTA CloudTest from Jenkins
![Page 38: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/38.jpg)
SOASTA – Successful regression test results
![Page 39: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/39.jpg)
SOASTA – Release Promotion
![Page 40: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/40.jpg)
© 2014 SOASTA. All rights reserved. 40
Continuous Quality for Continuous Delivery
o SOASTA’s Process Metrics• 3 Main Products
• (2) Builds per day of each product (Dev branch + Customer branch)• 8,000 tests executed per build• For Mobile (TouchTest), Over 300 fully-automated tests each for iOS &
Android
SOASTA - Takeaways
![Page 41: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/41.jpg)
© 2014 SOASTA. All rights reserved. 41
The Path to Continuous Testing
o Understand your requirements
o Identify the cloud advantages for you
o Automate the obvious and most critical
o Connect to a continuous process
o Align teams with actionable information
SOASTA - Takeaways
![Page 42: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/42.jpg)
© 2014 SOASTA. All rights reserved. 42
The Path to Continuous Testing
o Understand your requirements
o Identify the cloud advantages for you
o Automate the obvious and most critical
o Connect to a continuous process
o Align teams with actionable information
SOASTA - Takeaways
![Page 43: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/43.jpg)
© 2014 SOASTA. All rights reserved. 43
The Path to Continuous Testing
o Understand your requirements
o Identify the cloud advantages for you
o Automate the obvious and most critical
o Connect to a continuous process
o Align teams with actionable information
SOASTA - Takeaways
![Page 44: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/44.jpg)
© 2014 SOASTA. All rights reserved. 44
The Path to Continuous Testing
o Understand your requirements
o Identify the cloud advantages for you
o Automate the obvious and most critical
o Connect to a continuous process
o Align teams with actionable information
SOASTA - Takeaways
![Page 45: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/45.jpg)
© 2014 SOASTA. All rights reserved. 45
The Path to Continuous Testing
o Understand your requirements
o Identify the cloud advantages for you
o Automate the obvious and most critical
o Connect to a continuous process
o Align teams with actionable information
SOASTA - Takeaways
![Page 46: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/46.jpg)
© 2014 SOASTA. All rights reserved. 46
CONFIDENTIAL – Not for Distribution
Final TakeawayWhy is CI important?
RevenueBrandCompetitive advantage
![Page 47: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/47.jpg)
© 2014 SOASTA. All rights reserved. 47
We will close with some Mobile Trivia
@DanBoutinSOASTA
![Page 48: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/48.jpg)
© 2014 SOASTA. All rights reserved. 48
Questions?
Dan Boutin – Senior Product [email protected]
Mobile (404) 304-9529@DanBoutinSOASTA
Visit our Blog: http://goo.gl/TA2HKP
Questions? @DanBoutinSOASTA
![Page 49: TechWell Accelerating Software Delivery with Continuous Integration feat. Dan Boutin](https://reader036.vdocuments.mx/reader036/viewer/2022062821/588886681a28ab3e658b4ec5/html5/thumbnails/49.jpg)
August 26, 2015
“Accelerate Software Delivery with Continuous Integration”Dan Boutin – Senior Product Evangelist
[email protected] (404) 304-9529@DanBoutinSOASTA