leveraging hp performance center
TRANSCRIPT
![Page 1: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/1.jpg)
Leveraging HP Performance Center
Martin Spier (Expedia)Rex Black (J9)
![Page 2: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/2.jpg)
IntroductionsRex (Red) Black – Principal Consultant (J9)
• Has worked with Load and Performance tools, processes and methodology for over 10 years
• Works as a Performance Consultant & Instructor• Previous clients include: Dell, WalMart, ESPN and Expedia• Speaks at SQE & HP conferences on performance
engineering topics• Formerly Manager of Performance Engineering at Expedia
![Page 3: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/3.jpg)
IntroductionsMartin Spier – Performance Engineer, Expedia
• 5+ years working with performance engineering tools, processes and methodologies
• Currently part of the Expedia performance engineering team
• Previously led a performance engineering team @ Dell• Writes (whenever possible) about performance engineering
and related subjects on his blog (martinspier.co.uk)
![Page 4: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/4.jpg)
Agenda
• Performance Engineering• Performance Center• The Expedia Case
![Page 5: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/5.jpg)
Performance EngineeringCan I deploy my application to other regions?
Why is my application slow sometimes?
How many more users can I support?
If I patch that OS am I risking performance?
My application is fast…but I have to reboot it periodically!
What is the variance of my application’s performance?
Can my application support X users and maintain a X second response time?
How much hardware do I need?
Why is my application is intermittent?
![Page 6: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/6.jpg)
Performance Engineering
How can we answer all those questions?
![Page 7: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/7.jpg)
Performance EngineeringDefinition
“Performance engineering within systems engineering, encompasses the set of roles, skills, activities, practices, tools,
and deliverables applied at every phase of the Systems Development Life Cycle which ensures that a solution will be
designed, implemented, and operationally supported to meet the non-functional performance requirements defined for the
solution.”
Source: Wikipedia
![Page 8: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/8.jpg)
Performance EngineeringQuestions
What do you want to learn from your system?• How fast is it?• How does it scale?• Where does it break?
What do you want to prove about your system?• Response times are X.• Thoughput is Y.• Scales to Z users.
![Page 9: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/9.jpg)
Performance EngineeringActivities
Performance Engineering
Capacity and Performance
Modeling
Infrastructure Tuning
Benchmarking
Code Profiling and
Optimization
Unit / Component Performance
Testing
System Validation
Testing
Production Support
![Page 10: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/10.jpg)
Performance EngineeringKey Performance Indicators
• Responsiveness• Throughput• Stability• Scalability
![Page 11: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/11.jpg)
Performance EngineeringTypes of Test
• Load Testing is asserting how the architecture performs under load with a view to monitoring the response times for key transactions.
• Stress Testing is asserting what the upper bounds are for the scalability of the architecture, understanding how it reacts when stressed.
• Soak Testing is asserting that the performance of the architecture remains stable over longer periods of time.
![Page 12: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/12.jpg)
Performance EngineeringMethodology
Prepare TestsExecute and
Collect Metrics
Analyze Results
![Page 13: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/13.jpg)
Performance EngineeringTools
• You will need tools to provide a meaningful performance assessment.
• Even a simple stopwatch test will require a stopwatch.
• The more complex your tests get, the better tools you will need to support them.
![Page 14: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/14.jpg)
Performance EngineeringTools
• Open Source – JMeter, Grinder, openSTA, loadUI
• Commercial – Silk Performer, VSTS, LoadRunner, Performance Center
• In-House Development
![Page 15: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/15.jpg)
Performance Center
“HP Performance Center is a suite of integrated performance testing solutions that can emulate hundreds or thousands of concurrent users to
apply production workloads to virtually any environment; identify potential performance bottlenecks; and help diagnose and fix the root cause of the
problems.”
Source: Performance Center Brochure
![Page 16: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/16.jpg)
Performance Center
• LoadRunner– Standalone set of tools to prepare, execute and analyze
performance tests– Supports a wide variety of protocols– Can collect metrics from a wide variety of systems
• Performance Center– Centralized test environment– Web interface– Leverages capabilities of LoadRunner
![Page 17: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/17.jpg)
Performance Center
![Page 18: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/18.jpg)
Performance Center
• Protocols– HTTP, WebService, FTP, RMI, LDAP, Citrix, MQ, Ajax ...– SQL Server, Oracle ...– Oracle EBS, SAP, Siebel, PeopleSoft ...
• Monitors– Windows, Unix ...– WebLogic, IIS, Apache, SiteScope ...
• Scripting Language– C, .NET, Java
![Page 19: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/19.jpg)
Performance Center
• Centralized repository– Scripts, test scenarios, results and reports– Versioning (new on PC 11)
• Dedicated resource pools– Load generators and controllers
• User management– Integrate with AD and LDAP
• Organized by domain and project– Usage limits can be applied per project
![Page 20: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/20.jpg)
Performance Center
• Web interface– Create test scenarios– Setup system probes– Execute and monitor tests– View reports
• Desktop clients– Connect to Performance Center server– Script development (VuGen)– Analysis
![Page 21: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/21.jpg)
VuGen
![Page 22: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/22.jpg)
Web Interface
![Page 23: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/23.jpg)
Analysis
![Page 24: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/24.jpg)
ExpediaEnvironment
• Multiple organizations inside the same company• Geographically dispersed teams (Global development)
• Wide variety of technologies• Agile development• Continuous delivery (Weekly releases)
• Pressure to reduce costs
![Page 25: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/25.jpg)
ExpediaChallenges
• Reduce Costs– Efficient Use of Resources
• Test Early and Often– Distributed Testing Capabilties
• Don’t Reinvent the Wheel!– Avoid Custom Solutions for Each Team– Re-use Test Artifacts
![Page 26: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/26.jpg)
ExpediaEfficient Use of ResourcesWhy?• Hardware and tools used for performance tests are usually
high-end and expensive• Idle time is costly• Tool licensing costs are also expensive
![Page 27: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/27.jpg)
ExpediaEfficient Use of ResourcesHow?• Sharing resources
Timeslot reservation enables resources to be shared without
creating an environment management nightmare.
Resource pools and per project limits enable a fair
share of resources to be distributed per team.
![Page 28: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/28.jpg)
ExpediaEfficient Use of ResourcesHow?• Test scheduling
The hability of scheduling tests to executed in the future enable teams to
use precious resources even when no one is around
24/7 test coverage
![Page 29: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/29.jpg)
ExpediaEfficient Use of ResourcesHow?• Leveraging software licenses
License costs would be higher if each team had their own set of controller
and virtual user licenses
There is only one global limit for virtual users.
Simple math, 26 independent teams would 26 controller licenses.
Sharing resources enables teams to do the same thing, using less than half licenses for concurrent runs, just by reducing
idle time. That’s economy of scale.
![Page 30: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/30.jpg)
ExpediaEfficient Use of ResourcesHow?• Better capacity planning
Centralized resource usage metrics serve as a great tool for capacity planning
![Page 31: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/31.jpg)
ExpediaDistributed Testing Capabilities
Why?• Limited number of performance engineers• Increasing number of requests for early and frequent
performance tests• Test earlier in the process• Execute small and more specialized tests
![Page 32: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/32.jpg)
ExpediaDistributed Testing Capabilities
How?• Enabling non-performance
engineering teams to participate
A simple web interface enables non-performance egineering teams to execute
and analyze simple tests
Support for a wide variety of protocols enable specialized tests such as database
specific, web services, etc
![Page 33: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/33.jpg)
ExpediaAvoid Custom Solutions
Why?• Quickly and Easily Enable New Teams• Minimize Support
![Page 34: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/34.jpg)
ExpediaAvoid Custom Solutions
How?• Single load test tool
Flexibility and support for a wide variety of protocols and and systems enabled
Performance Center to be a single solution capable of attending requirements from all
teams.
Central administration makes it easy to add new users, create new projects and
set up new resource pools.
Less than ½ FTE is necessary to support the tool.
Integration with LDAP/AD avoids the hassle of remembering another
password.
![Page 35: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/35.jpg)
ExpediaRe-Use Test Artifacts
Why?• Be more productive• Spend less time on recurring
tasks
![Page 36: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/36.jpg)
ExpediaRe-Use Test Artifacts
How?• A Central Repository for Test
Artifacts
A central repository for scripts and scenarios with version control makes it easy to find and
reuse test artifacts
A single location for results and reports helps keeping track and comparing executions
![Page 38: Leveraging HP Performance Center](https://reader031.vdocuments.mx/reader031/viewer/2022013003/558a618ad8b42a5d6e8b46b1/html5/thumbnails/38.jpg)
Backup Slides