performance on demand
TRANSCRIPT
©2009 Ness Technologies – Proprietary and Confidential
Ness. We Make it HappenNess. We Make it Happen
Achieving Environment Stability Achieving Environment Stability with with
Performance On DemandPerformance On Demand
V-Nesshttp://web.ness.com/forms/contact
www.ness.comwww.ness.com
Understanding the Stability of Your EnvironmentUnderstanding the Stability of Your Environment
How confident are you during environment transitions and releases?
How often do changes (e.g. releases, upgrades, maintenance, issue handling) put your environment stability at risk?
How important is environment stability to you?Have you ever suffered from unplanned downtime?
How difficult is it for you to investigate accurately the root cause of instability of your environment?
www.ness.comwww.ness.com
Ness’ Testing Line of Business
Performance on Demand
Performance Testing
Environment Comparison
Why Performance on Demand?
Summary
AgendaAgenda
Ness’ Testing Line Of Business Ness’ Testing Line Of Business
www.ness.comwww.ness.com
Our AdvantagesOur Advantages
>15 years of experience
100s of successful projects
Global backbone / local presence
>2,000 testing engineers
Broad technical know-how(e.g. databases, telecom networks, operating systems)
www.ness.comwww.ness.com
Our ExpertiseOur Expertise
ManagedManaged ServicesServices
TestTest StrategyStrategyDevelopmentDevelopment
SAPSAP Testing Testing LeaderLeader
TestTest AutomationAutomation
AviationAviation && EmbeddedEmbedded SystemsSystems
RetailRetail BankingBanking InsuranceInsurance
Business segment expertise
QA methodology expertise
www.ness.comwww.ness.com
Selected CustomersSelected Customers
Performance on DemandPerformance on Demand
www.ness.comwww.ness.com
Testing on Demand Family of ServicesTesting on Demand Family of Services
Performance On Demand
Security Testing on Demand
ELM and Environment Comparison on Demand
Test Automation on Demand
Functional Testing on Demand
Daily Site Sanity Testing on Demand
www.ness.comwww.ness.com
Internet
Tested Application
Send OrderGenerate Load
Collect Results
NESS HQ - Performance COE
Technical Infrastructure Based on Ness Global Spread
Performance Testing and Application Monitoring of Production Environments in Real-World Conditions
www.ness.comwww.ness.com
5 Performance “dream team”
4 Ongoing (24/7) availability monitoring
3 Results analysis (end-to-end view)
Scope of Services and PackagesScope of Services and Packages
1 Performance testing (load creation)
2 End-user view analysis
www.ness.comwww.ness.com
Benefits
Technical Benefits► Improved testing, monitoring and analysis► Enhanced performance and uptime► Worry-free testing and monitoring environment► Increased confidence in application launch/adjustment
Business Benefits► Significantly reduced TCO (~55%)► Greater focus on core business area► Increased customer loyalty► Faster time to market
Performance TestingPerformance Testing
www.ness.comwww.ness.com
Performance Testing MethodsPerformance Testing Methods
Load Test
Stress Test
Stability & MTBF Test
Interactive Test Sessions► Failover Test► Targeted Infrastructure Test► Performance Test► Network Sensitivity Test► Volume Test
www.ness.comwww.ness.com
Load TestLoad Test
End-to-end performance test based on anticipated production load in order to:► determine response times for various time-critical transactions and business
processes to ensure they meet service level agreement (SLA)► measure the ability of Internet applications to function correctly under load by
measuring transaction pass/fail/error rates
Users
Real World LoadReal World Load
Test Elapsed Time
www.ness.comwww.ness.com
Stress TestStress Test
Evaluate system’s behavior at or beyond the limits of its specified load and volume requirements, tracking the system until it either crashes or delivers abnormal response times
UsersKnee Point
Tran
sact
ion
Res
pons
e Ti
me
Users
Transaction Response Times
Stress TestStress Test
Test Elapsed Time
Abnormal Response
time
Normal Response
time
www.ness.comwww.ness.com
Stability & MTBF TestStability & MTBF Test
System is run at high load levels for prolonged periods until it reaches failure so as to determine the mean time between failures (MTBF)
Users
Thro
ughp
ut
Users
Stability TestStability Test
Test Elapsed Time(days:hours:minutes)Throughput
MTBF
MTBF = 3days, 12h and 20m1:0:0 2:0:0 3:0:0
www.ness.comwww.ness.com
Interactive Test SessionsInteractive Test Sessions
A range of test sessions in which multiple test runs and re-runs are managed interactively with the customer:
Failover TestVerification of redundancy mechanisms while the system is under load
Targeted Infrastructure TestIsolation of each layer and/or component in an end-to-end application configuration
Performance TestEnd-to-end timing (benchmarking) of various time-critical business processes and transactions while the system is under load with a production-sized database
Network Sensitivity TestSet-up of various network activity scenarios (e.g. traffic, error rates), and measurement of their impact on a range of bandwidth-dependent applications
Volume TestMeasurement of batch processing under load
Environment ComparisonEnvironment Comparison
www.ness.comwww.ness.com
Environment Comparison Solution OverviewEnvironment Comparison Solution Overview
Helps to achieve and maintain environment stability
Identifies and analyzes changes and differences that put environment stability at risk by:► comparing different environments► comparing current environment with a historical snapshot or its golden baseline
www.ness.comwww.ness.com
End-to-End Environment ComparisonEnd-to-End Environment ComparisonIntegrative, top-down comparisonIntegrative, top-down comparison
Compares entire environment – applications and their underlying software infrastructure stack
► Applications► Front-end servers► Middleware► Databases► Messaging layer ► Operating systems► Hardware
Applies environment perspective rather than particular server or point technology
Compares logical environment architecture (i.e. independent of physical topology)
www.ness.comwww.ness.com
In-Depth Comparison In-Depth Comparison ““The devil is in the details”The devil is in the details”
Compares all facets of the environment► Architecture ► Configuration ► Bill-of-materials
Drills down to most granular level of configuration parameter in any configuration source
► Configuration files► Registry► Database schema / stored procedures► Reference data in database
Compares content of each environment component
► Version ► Size► Last modification
www.ness.comwww.ness.com
Comparison Analytics ApplicationComparison Analytics ApplicationFocus only on the “important stuff”Focus only on the “important stuff”
Applies comparison analytics in order to:► Classify changes and differences by
impact ► Prioritize and highlight critical
changes ► Ignore insignificant changes ► Compare inherently different
environments (test vs. production)
Visualizes comparison results for faster analysis
Leverages customizable comparison logic to ensure meaningful comparison
www.ness.comwww.ness.com
Test/Staging
Production
Cut Release Deployment and Stabilization TimeCompare production with pre-production environment after deployment to verify accurate transition of key release configurations
Cut Incident Investigation TimeCompare production environment with a golden baseline to identify changes that might be causing the incident
Cut Incident Investigation TimeCompare a non-working environment with a working environment to identify configuration differences that might be causing the incident
Avoid Risk of Negative Impact of ChangesCompare current environment with its historical snapshot before a change in order to identify and review all granular impact points caused by the change
LIVE
TEST
Production
Production
LIVE
Test/Production
Test/Production
Test/Production
Test/Production
Common Compression Scenarios Common Compression Scenarios How companies use EVOLVEN ComparisonHow companies use EVOLVEN Comparison
Why Performance on Demand?Why Performance on Demand?
www.ness.comwww.ness.com
Why Performance on Demand?Why Performance on Demand?
Our experts have performed
100s of successful on-site load tests
over the last 12 years
www.ness.comwww.ness.com
Why Performance on Demand?Why Performance on Demand?
We provideload injectors worldwide,
which you can use immediately
Our experts have performed 100s of
successfulon-site load tests
over the last12 years
www.ness.comwww.ness.com
Why Performance on Demand?Why Performance on Demand?
We are committedto your performance
improvement
We provideload injectors worldwide,
which you canuse immediately
Our experts have performed 100s of
successfulon-site load tests
over the last12 years
www.ness.comwww.ness.com
Why Performance on Demand?Why Performance on Demand?
We provideexternal web load testing
outside the firewallthrough the cloud
We are committed to your performance
improvement
We provideload injectors worldwide,
which you canuse immediately
Our experts have performed 100s of
successfulon-site load tests
over the last12 years
www.ness.comwww.ness.com
Why Performance on Demand?Why Performance on Demand?
We provideinternal load testingbehind your firewall
We provide external web load testing
outside the firewall through the cloud
We are committed to your performance
improvement
We provideload injectors worldwide,
which you canuse immediately
Our experts have performed 100s of
successfulon-site load tests
over the last12 years
www.ness.comwww.ness.com
Holistic and Synergistic OfferingHolistic and Synergistic Offering
Performance
Testing
EnvironmentComparison
Holistic Performance Testing & Monitoring
Solution
www.ness.comwww.ness.com
Summary
Proven Testing Experience and Expertise
Holistic Performance Testing & Application Monitoring Solution► Performance Testing► Environment Comparison
Technical Benefits► Improved testing, monitoring and analysis► Enhanced performance and uptime
Business Benefits► Significantly reduced TCO (~55%)► Greater focus on core business area
©2009 Ness Technologies – Proprietary and Confidential
Ness. We Make it HappenNess. We Make it Happen
Thank YouThank You
www.ness.com
http://web.ness.com/forms/contact