open source load testing
TRANSCRIPT
#1 Load Testing #2 Open Source lasting legacy
#3 Continuous Load Testing#4 Let’s build one and scale it
RedLine13.com(Almost) Free Load Testing
Richard [email protected]@richardfriedman@redlinethirteen
The Common Sense of Load Testing
• Everyone expects it to scale• Always run a load test• Start simple• Model User Behavior• Set realistic goals • Load Tests expose issues, they don’t fix them
Performance and ThroughputTesting
Performancems
Loadper sec
Stressredline
Soakleaks
Find Bottleneck.
Performance Throughput
Build, [Run, Analyze, Fix]
Recordor
create
Play on single
machine
Scaleon
singleagent
Run at scaletests
Analyze
Fix
Tweak
Configure
Scratch Head
Define Requirements
Build Test Environment
Load Testing is
Boring Tedious Detailed Precise
Then it becomes hard, time consuming, and frustrating
Fun Create Run Data
And at some point it becomes very rewarding, personally and for users.
Load Testing priority
After QA, During Beta Launch When it falls
over
Continuous Investment in Operations and Development
Invest as needed
usergrinder
How it used to work?
Minions Start Your Test Plan
Servers
grindergrindergrindergrindergrindergrindergrindergrinder
grindergrindergrindergrindergrindergrindergrindergrindergrinder user
How it should work
Launch Test Plan
Servers
You
Analyzing with Open Source Monitoring
Launch Test Plan
Monitoring & Logs
Production
Open Source Load Testing
And every script you ever wrote.
Tsung
Gatling
Seige
Tank
JMeter
clif
Yandex
locust
iago
The Grinder
10+
15+
12+
15+
14+
15+
4-5
2-3
3-4
1.60 7/2015
1.60 7/2015
2.177/2015
1.7.136/2015
2.133/2015
abhttperf
2.2.110/2014
0.7.39/2014
0.6.142/2014
3.1110/2012
GPL 2
GPL 3
LGPL 2.1
APACHE
LGPL 2
MIT
APACHE
BSD-STYLE
APACHE
X X X X X
X X X X X X
X X X
X X X X X X
X X X X X
X X
X ½ X ½
X X X X X X
python
java
java
c
erlang
java
scala
python
scala
15+15+
2/20152/2011
APACHEGPL 2
6/2015
dist
ribut
ed
reco
rder
char
ts
plug
ins
grap
hite
jenk
ins
X
BeesWithMG 3-4 MIT1/2013 python
Continuous Delivery
• Faster Iterations• Master Location of data• Performance Trend Lines• Recorded Tests = Work Done• Agile Development Process• Unit Performance Tests
Why is it interesting?
Time Permitting
• Anyone want to build a test?– Record JMeter Test• (or hand build)
– Run Locally– Scale Locally– Scale in cloud
Thank You
RedLine13.com(Almost) Free Load Testing
Richard [email protected]@richardfriedman@redlinethirteen