jira performance testing in pictures - edward bukoski michael march
DESCRIPTION
TRANSCRIPT
#atlassian
NOTES:
• If it’s important for the
audience to remember where
they are in the chapter
sequence and see forward /
backward, use this slide for
chapter titles. Move the white
lozenge style to whichever
section you’re introducing
Ed Bukoski • Lead Architect • JP Morgan Chase • @EBUKOSKI
Michael March • Senior Consultant • Isos Technology • @COWMIX
JIRA Performance Testing in Pictures
Measuring Big JIRA at JP Morgan Chase
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Introduction
• Speakers
• Michael March (@cowmix)
• Senior Consultant
• Isos Technology • Ed Bukoski (@ebukoski)
• Lead Architect
• Developer Collaboration Tools Group
NOTES:
• This file is set to a 16:9 aspect ratio, which works for Summit Preview Day, Training Day, and Summit’s Session Talks.
• Make sure you’ve downloaded and loaded the fonts, which should have come with this presentation file. The fonts are: Helvetica Neue
• Some page template will have notes with instructions to the right of the art board.
• You should’ve also received an “Assets” file with icons and graphic assets and color palette. Updated “meeple” avatar graphics are coming soon.
• This deck has been made slightly darker than average because the projector will lighten everything by 10 or 15% and add a little extra contrast. If you create new assets, keep this in mind.
This presentation deck is designed as a canvas for you to craft your stories. "The best presentations are focused on connecting to the audience by enhancing and punctuating your stories rather than describing it with text. "With this in mind, the presentation template is filled with slides for using images, videos, screenshots, and large punchy text. "While we did include a few slides with small text and bullets we hope you only use those sparingly when necessary and avoid creating SLOCUMENTS (noun: the combination of document style prose on a presentation slide). Slocuments force your audience to multi-task by reading and listening at the same time – this typically results in a drop in engagement. "Go on and create the best presentation of your lives!
Read me Introduction
• JIRA Performance Testing in Pictures
• Performance testing is critical
• The right tools are important: • Generate load • Measure • Evaluate • Communicate
• Four years of performance testing tools at JPMC • Current tools
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
JIRA at JP Morgan Chase
Instances
19
Projects
7,059
Issues
2,427,650
Users
55,394
Servers
76
NOTES:
• If it’s important for the
audience to remember where
they are in the chapter
sequence and see forward /
backward, use this slide for
chapter titles. Move the white
lozenge style to whichever
section you’re introducing
2011
4.2
2013
5.1.8
2014
6.2.6
2012
4.4.5
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
HP Load Runner
• Used for testing JIRA 4.2.2 and JIRA 4.4.5
• JPMC Standard load testing tool • Centralized performance testing team
• “Ivory Tower” model
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence. Nice Static
SharePoint
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence. Noisy
? Drill Down?
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Scorecard
Load Runner
Compare performance between runs X
Easy publishing X
Correlated client and server data X
Easy report generation X
Easy to execute/rerun tests
Drill down to individual tests
Open source
Tests available from Atlassian
Control tests and data
Web based execution and reporting
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
2011
4.2
2013
5.1.8
2014
6.2.6
2012
4.4.5
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Apache JMeter
• Used for testing JIRA 4.2.2, 4.4.5, and Confluence 3.3
• Open source
• Easy to get started
• Stock testing scripts available from Atlassian
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Run
Some…
…assembly…
…required.
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Excel charts
Confluence
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Scorecard Load Runner JMeter
Compare performance between runs X
Easy publishing X
Correlated client and server data X
Easy report generation X
Easy to execute/rerun tests X
Drill down to individual tests
Open source X
Tests available from Atlassian X
Control tests and data X
Web based execution and reporting
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
2011
4.2
2013
5.1.8
2014
6.2.6
2012
4.4.5
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
nGrinder
• Used for testing JIRA 4.4.5 and 5.1.8
• Open source
• Easy to get started
• Stock testing scripts available from Atlassian
• Web based
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence. Python/Groovy
Test Single SVN Built-In
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Ramp Up Agents/Users
Host Capture
Duration/Count
Agents
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Client Server
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Scorecard
Load Runner JMeter nGrinder
Compare performance between runs X
Easy publishing X X
Correlated client and server data X
Easy report generation X
Easy to execute/rerun tests X X
Drill down to individual tests
Open source X X
Tests available from Atlassian X X
Control tests and data X X
Web based execution and reporting X
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
2011
4.2
2013
5.1.8
2014
6.2.6
2012
4.4.5
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Gatling/InfluxDB/Grafana
• For JIRA 6.2.6, we wanted a testing suite that could do it all
• nGrinder was good, but it still forced us to manage client and server data separately
• Multiple tools approach
• Gatling
• InfluxDB
• Grafana
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Gatling/InfluxDB/Grafana
sysinfo_influxdb
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence. Scenarios, DSL
IDE (IntelliJ)
Test
VCS of our choice
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Normal job/plan
History
Trend
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Demo: Starting the Test
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Demo: Viewing Data in Grafana
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Demo: Viewing Data in Gatling
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Demo: Creating Charts In Grafana
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Client
Server
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Scorecard
Load Runner JMeter nGrinder Gatling, InfluxDB, Grafana
Compare performance between runs X X
Easy publishing X X X
Correlated client and server data X X
Easy report generation X
Easy to execute/rerun tests X X X
Drill down to individual tests X
Open source X X X
Tests available from Atlassian X X
Control tests and data X X X
Web based execution and reporting X X
NOTES:
• If you use the Chaper Title with
sections system, you can place
a lozenge at the top of the page
to indicate the section, like this
example
• Use this only if it’s important to
remind people of where they’re
at in the Chapter sequence.
Performance Factors
• Factors that impact JIRA performance
• Issue Count
• Custom Field Count • Permissions • Concurrent Users
Source: https://confluence.atlassian.com/display/ENTERPRISE/Scaling+JIRA
NOTES: ���
• If you have short reminders or
highlights that you want people to
tweet, use this. • Pick the right tools for the job • Know your constraints • Know your goals • Reach out • Atlassian • Atlassian Partners • User Groups
Key takeaways:! #atlassian!
Thank you!
And a special thanks to George Simpson, Lead Architect, JP Morgan Chase, for
helping us put this presentation together!