intuit continuous performance testing for code camp temp
DESCRIPTION
Continuous performance testing without any manual effort. Check-in is the input to this framework and out put is: Result based on the analysis Pinpoint the issues Graphs generation for each metric AWR reports Trend of the performanceTRANSCRIPT
people
Intuit Continuous Performance Testing
Thiru – Principal EngineerRamki – Staff Engineer in Quality
•Takeaway•Context & overview•Solution details•Samples•Q & A
Agenda
Takeaway
•Performance Testing Landscape•Building blocks•Achieve automation•Available tools•Benefits of automation
Overview
Build
• What: – Code to artifact
• Challenges:– Wait time– Failures
• Technology:
Deploy
• What: – Artifacts to system
under test– Setup
• Challenges:– Multiple subsystems– Configuration change
• Technology:
Test
• What: – Simulate load and
observe system under test
• Challenges:– Too many systems and
parameters to watch for– Babysitting to detect
failures– Decide test
• Technology:
Metrics collection and Monitoring
• What: – CPU, load average, JVM
heap, Memory, swap, disk IO, network IO, sockets, DB connections etc
• Challenges:– Too many systems and
parameters to watch for– Babysitting to detect
failures– Decide test
• Technology:–Twiddle –Oracle AWR (automatic workload repo)
Analyze
• What: – Gather measurements
and extract meaning information
• Challenges:– Too many systems and
parameters– Consolidation– Volume
• Technology:
Report
• What: – Meaning information
to easy to digest form
• Challenges:– Make reports
available– Communication out– Format/Layout– Consolidated graphs– Volume
• Technology:
Solution
CPU graph
Tool: gnuplot (open source)
14
Challenges
Challenges
• Collecting system resources usage
• Grouping of system resource graphs for all servers
• Multiple subsystems/technologies
Benefits
• Quick Turnaround• Reduce resource cost• Effectively using hardware• No human errors• Accurate • Multiple iterations on demand• History and trend
What’s Next
• Integrate with bug tracking system
• Find out the severity• Pinpoint the issue• Provide all necessary info
Q & A
Want to talk more?We’ll be at the Intuit booth today 11:30am-3:30pm.
Intuit Speakers @ Silicon Code Camp 2013:SATURDAY9:45 a.m. - Ramakrishna Kollipara – “Complete Automation of Performance Testing” 1:45 p.m. - Joe Wells - “QBO: Journey From legacy Java app to a Client-side HTML5 app”3:30 p.m. - Naga Addagadde & Sangeeta Narang – “Intuit APIs for Financial Transaction Aggregation”5:00 p.m. Ted Drake –“Hitting the Accessibility High Notes with ARIA”
SUNDAY9:15 a.m. - Eugene Krivopaltsev –“Building Native Mobile Apps with Custom Views” 1:15 p.m. - Tim Hobson – “Developing Highly Instrumental Applications with Minimal Effort”
You don't want to miss out on a chance to win this cool headset. Stop by our booth to enter!
For more information about joining our organization visit our booth or connect with our onsite recruiter: