performance testing of storage stack for cloud (openstack) · performance testing of storage stack...
TRANSCRIPT
Performance Testing of Storage Stack for Cloud (OpenStack)
Venkata Krishna Vedams Inc.
Agenda
Storage stack components involved
How to attach volumes to vm’s in Cloud
Performance Testing in cloud
Different ways of running FIO on Linux distributions
StorPerf Features
StorPerf introduction and work flow
ELK stack Work flow
Summary
Storage stack components
Storage array
Switch
Volume server Controller server
Compute server
VM
VM
VM
Attach volumes to instances in a Cloud Environment
What is Performance testing in cloud
Process of determining the speed or effectiveness of a computer, network, software program or device.
name rw iodepth group_reporting numjobs time_based_filename ioengine size direct fsync_on_close runtime invalidate
bs
Run FIO in different ways
Command for a single job FIO test configuration fio –name=sqread --rw=read --bs=512b --ioengine=libaio --iodepth=16 --numjobs=64 - -runtime=60 --size=100m --direct=1 --invalidate=1 --group_reporting --fsync_on_close=1 --time_based --filename=/dev/vdb
Run single test configuration FIO parameters
name rw iodepth group_reporting numjobs time_based bs
ioengine size direct fsync_on_close runtime invalidate
Run multiple jobs using job file Create a job file with fio parameters. Run the below command # fio <jobfile>
Run FIO in different ways
Client-Server Model Allows to run FIO test on single client/multiple clients at a time. Setup client-server model Client machine Run the fio server(listen on 8765 port) by running below command # fio –server Server machine Run fio by providing client details # fio –client <client Ip1> <job file1> --client <client ip2> <job file 1> …
FIO test output for a single test configuration
StorPerf – Storage performance testing for the cloud
StorPerf workflow
Instance1
Instance 2
Instance 3 Run StorPerf UI Instance 4
LINUX Machine
fio
fio
fio
fio
FIO Output Directory ELK Stack
FIO Output
Indexing & Save FIO Output
Visualize the data in Graphs
StorPerf – Features
Simple UI to setup tests
Allows to provide multiple Instance login details as inputs
Allows to choose FIO parameters using check boxes
Easily setup single or multiple FIO Job configurations
Provides multiple visualization graphs/charts (Area chart, line chart)
Visualize single or multiple graphs in the same pane/tab/dashboard
StorPerf - FIO parameters selection
StorPerf – Visualization parameters selection
ELK stack – Work Flow
GS Logs (FIO output)
Log stash Elastic search
Kibana
Process the data through filters
Store the data and can do search and analyze
Build dashboards for data visualization
StorPerf – Visualization through Kibana graphs
Summary : StorPerf – Value-Add
Easy to scale test runs on compute instances - using “+ button“
Multiple checkboxes allows users to select tests with more granularity
Graph parameters are customizable, allows for various comparative graphs
Allows user to visualize data in multiple graphs with different parameters
Easily re-run tests after changing any component in the storage stack
Thank You Questions ?