jira performance testing in pictures - edward bukoski michael march

35
#atlassian

Upload: atlassian

Post on 18-Nov-2014

259 views

Category:

Software


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

#atlassian

Page 2: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If it’s important for the

audience to remember where

they are in the chapter

sequence and see forward /

backward, use this slide for

chapter titles. Move the white

lozenge style to whichever

section you’re introducing

Ed Bukoski • Lead Architect • JP Morgan Chase • @EBUKOSKI

Michael March • Senior Consultant • Isos Technology • @COWMIX

JIRA Performance Testing in Pictures

Measuring Big JIRA at JP Morgan Chase

Page 3: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Introduction

•  Speakers

•  Michael March (@cowmix)

•  Senior Consultant

•  Isos Technology •  Ed Bukoski (@ebukoski)

•  Lead Architect

•  Developer Collaboration Tools Group

Page 4: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

•  This file is set to a 16:9 aspect ratio, which works for Summit Preview Day, Training Day, and Summit’s Session Talks.

•  Make sure you’ve downloaded and loaded the fonts, which should have come with this presentation file. The fonts are: Helvetica Neue

•  Some page template will have notes with instructions to the right of the art board.

•  You should’ve also received an “Assets” file with icons and graphic assets and color palette. Updated “meeple” avatar graphics are coming soon.

•  This deck has been made slightly darker than average because the projector will lighten everything by 10 or 15% and add a little extra contrast. If you create new assets, keep this in mind.

This presentation deck is designed as a canvas for you to craft your stories. "The best presentations are focused on connecting to the audience by enhancing and punctuating your stories rather than describing it with text. "With this in mind, the presentation template is filled with slides for using images, videos, screenshots, and large punchy text. "While we did include a few slides with small text and bullets we hope you only use those sparingly when necessary and avoid creating SLOCUMENTS (noun: the combination of document style prose on a presentation slide). Slocuments force your audience to multi-task by reading and listening at the same time – this typically results in a drop in engagement. "Go on and create the best presentation of your lives!

Read me Introduction

•  JIRA Performance Testing in Pictures

•  Performance testing is critical

•  The right tools are important: •  Generate load •  Measure •  Evaluate •  Communicate

•  Four years of performance testing tools at JPMC •  Current tools

Page 5: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

JIRA at JP Morgan Chase

Instances

19

Projects

7,059

Issues

2,427,650

Users

55,394

Servers

76

Page 6: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If it’s important for the

audience to remember where

they are in the chapter

sequence and see forward /

backward, use this slide for

chapter titles. Move the white

lozenge style to whichever

section you’re introducing

2011

4.2

2013

5.1.8

2014

6.2.6

2012

4.4.5

Page 7: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

HP Load Runner

•  Used for testing JIRA 4.2.2 and JIRA 4.4.5

•  JPMC Standard load testing tool •  Centralized performance testing team

•  “Ivory Tower” model

Page 8: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence. Nice Static

SharePoint

Page 9: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence. Noisy

? Drill Down?

Page 10: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Scorecard

Load Runner

Compare performance between runs X

Easy publishing X

Correlated client and server data X

Easy report generation X

Easy to execute/rerun tests

Drill down to individual tests

Open source

Tests available from Atlassian

Control tests and data

Web based execution and reporting

Page 11: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

2011

4.2

2013

5.1.8

2014

6.2.6

2012

4.4.5

Page 12: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Apache JMeter

•  Used for testing JIRA 4.2.2, 4.4.5, and Confluence 3.3

•  Open source

•  Easy to get started

•  Stock testing scripts available from Atlassian

Page 13: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Run

Some…

…assembly…

…required.

Page 14: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Excel charts

Confluence

Page 15: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Scorecard Load Runner JMeter

Compare performance between runs X

Easy publishing X

Correlated client and server data X

Easy report generation X

Easy to execute/rerun tests X

Drill down to individual tests

Open source X

Tests available from Atlassian X

Control tests and data X

Web based execution and reporting

Page 16: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

2011

4.2

2013

5.1.8

2014

6.2.6

2012

4.4.5

Page 17: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

nGrinder

•  Used for testing JIRA 4.4.5 and 5.1.8

•  Open source

•  Easy to get started

•  Stock testing scripts available from Atlassian

•  Web based

Page 18: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence. Python/Groovy

Test Single SVN Built-In

Page 19: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Ramp Up Agents/Users

Host Capture

Duration/Count

Agents

Page 20: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Client Server

Page 21: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Scorecard

Load Runner JMeter nGrinder

Compare performance between runs X

Easy publishing X X

Correlated client and server data X

Easy report generation X

Easy to execute/rerun tests X X

Drill down to individual tests

Open source X X

Tests available from Atlassian X X

Control tests and data X X

Web based execution and reporting X

Page 22: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

2011

4.2

2013

5.1.8

2014

6.2.6

2012

4.4.5

Page 23: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Gatling/InfluxDB/Grafana

•  For JIRA 6.2.6, we wanted a testing suite that could do it all

•  nGrinder was good, but it still forced us to manage client and server data separately

•  Multiple tools approach

• Gatling

• InfluxDB

• Grafana

Page 24: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Gatling/InfluxDB/Grafana

sysinfo_influxdb

Page 25: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence. Scenarios, DSL

IDE (IntelliJ)

Test

VCS of our choice

Page 26: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Normal job/plan

History

Trend

Page 27: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Demo: Starting the Test

Page 28: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Demo: Viewing Data in Grafana

Page 29: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Demo: Viewing Data in Gatling

Page 30: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Demo: Creating Charts In Grafana

Page 31: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Client

Server

Page 32: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Scorecard

Load Runner JMeter nGrinder Gatling, InfluxDB, Grafana

Compare performance between runs X X

Easy publishing X X X

Correlated client and server data X X

Easy report generation X

Easy to execute/rerun tests X X X

Drill down to individual tests X

Open source X X X

Tests available from Atlassian X X

Control tests and data X X X

Web based execution and reporting X X

Page 33: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES:

• If you use the Chaper Title with

sections system, you can place

a lozenge at the top of the page

to indicate the section, like this

example

• Use this only if it’s important to

remind people of where they’re

at in the Chapter sequence.

Performance Factors

•  Factors that impact JIRA performance

•  Issue Count

•  Custom Field Count •  Permissions •  Concurrent Users

Source: https://confluence.atlassian.com/display/ENTERPRISE/Scaling+JIRA

Page 34: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

NOTES: ���

• If you have short reminders or

highlights that you want people to

tweet, use this. •  Pick the right tools for the job •  Know your constraints •  Know your goals •  Reach out •  Atlassian •  Atlassian Partners •  User Groups

Key takeaways:! #atlassian!

Page 35: JIRA Performance Testing in Pictures - Edward Bukoski Michael March

Thank you!

And a special thanks to George Simpson, Lead Architect, JP Morgan Chase, for

helping us put this presentation together!