an webinar feb 23 2012 - assure.fi webinar feb 23 2012 shir goldberg ... • set on milestones to...
TRANSCRIPT
An Webinar
Feb 23 2012
Shir Goldberg
Co-Founder & VP Biz Dev
Tel: +1 919 827 1194
David White
Senior Product Manager
Tel: +972-54-6750323
This presentation
Overview of HP ALM & QC reporting features
Key ALM metrics
Hear about customers experiences and customized
solutions for reporting
Learn about Assure TotalView – the ultimate BI solution for
HP ALM & QC
Practicalities
http://assure.net/almplus
• Webinar recording will be available
• Materials will be available
Please ask questions as we go
Assure – The QC Guys
We know HP ALM & Quality Center
Since 2006, offices in USA, Finland and Israel
Innovative products, solutions and services for HP ALM
& Quality Center customers
Our customers are able to streamline processes, boost
efficiency and decrease overall QA and administration
costs
Assure works with some of the world’s largest and most
demanding HP ALM & Quality Center customers
HP AllianceOne Technology Partner of the year 2011
Reporting Methods in ALM 11
ALM Reporting Features 1/2
Dashboard module For creating tabular reports or graphs based on field values
Excel Reports (SQL queries to QC database)
Dashboard: Combine multiple reports into a single view
Report export to Wiki, Intranet etc
Cross-Project graphs (in HP ALM)
Document Generator for generating project level Word documents
All project data into a single document
Can contain pre-defined Graphs and Attachments • Snapshot of the current situation
Analysis menu in each module Standard Reports and Graphs that can be customized and saved to Dashboard module for future use
Live Analysis in Test Plan and Test Lab Two configurable graphs showing analysis data from selected folders
ALM Reporting Features 2/2
Project Planning & Tracking - Release Analysis Milestones are placed on the release timeline to define a lifecycle of a product
Scopes define assets involved in test effort
Key Performance Indicator (KPI)
• Measure your release objectives
• Set on Milestones to track performance vs. plan
Graphs can be published on web pages (SharePoint, Wiki, etc.)
Project Reports Easy design of fully customable report templates
Rich style and layout options using MS Word templates
Create a centralized report template repository
Multiple output file types (doc, docx, html)
HP Executive Scorecard
Define milestones
Define KPI’s for milestone
Define releases
Project Planning & Tracking: Release Milestones and KPIs
Define & Preview Thresholds
Define Scope
Project Planning &Tracking : Release Scorecard
In a Release Scorecard you can easily follow the performance of a
release based on KPI`s
KPI Analysis Graphs provide the ability to drill down to find the root
cause of a problem
How KPI Thresholds are met is indicated by different colors: green
(OK), yellow (warning) or red (critical)
Project Planning &Tracking : Release Analysis Graphs
Used to provide extended analysis of a KPI
Click the KPI cell in the scorecard
KPI Type = ”Analysis”
Project Reports : Create Templates
Easily create an MS Word report template with a custom
layout
Project Reports : Customize Templates
Edit MS Word report templates by selecting fields from
ALM
Project Reports : Generate Reports
Populate template reports with ALM data
Save the reports as public or private
Key ALM Metrics
Valuable data in your ALM & QC databases
Quality and maturity of releases / products / apps / features
Which areas have the best/worst test coverage
Where are most defects detected
Where are my critical defects
When can we release the product?
Valuable data in your ALM & QC databases
Effort and efficiency
How much time and effort was put into testing
How well testing has been executed
How effective was testing
Effectiveness of the QA team
Team performance
Individual performance
Valuable data in your ALM & QC databases
Quality of your test assets
Are they managed effectively – linking, coverage
Do test cases find defects
Are test cases reused
Valuable data in your ALM & QC databases
Multi-Project Comparison of metrics across projects
Trends of metrics over time
Slice the metrics by any user defined field(s)
And much more….
What Are Customers Doing?
Customized reporting with HP ALM & QC data
Majority of customers access their HP ALM & QC database directly to create reports. Why do they do that?
What are the challenges?
Not enough visibility with ‘out of the box’ HP ALM
Solutions of operative system not flexible enough
Multi project reports are a challenge
Trend reports are limited
What is in HP ALM?
Customizable reports
Excel reports
Project Planning & Tracking
Future - DB views possibly coming
IT Executive Scorecard
Past QC solutions - (advanced reports - Actuate, 9.0 dashboard)
The levels of reporting - Maturity B
usin
ess Insig
ht
Maturity of Reporting Culture and Tools
Out of the Box
Operational Reports
Customized
Operational Reports
Islands of Information
Business Driven
Reports
Centralized Effort
Centralized dedicated
Reporting
Team & Environment
Business Awareness
Strategic BI Solution One Version of the Truth
Why is the operational level not enough?
Limitations
Operational systems are not reporting platforms
Complex Data structure – not ‘reporting friendly’
Performance Impact
Access to underlying databases is limited by security
In the Industry it is common practice to separate the reporting
platform from the operational system
SAP with Business Objects – separate BW
IBM – Rational Common Reporting with Cognos
Microsoft TFS with Reporting Services and DWH
Customized solutions we have seen at customers
External Excel reports – using e.g. OTA API
Offer more flexibility than QC/ALM excel reports
Can capture data from multiple projects
Used to capture data over time manually – create trends
Combine with other data
DB views
Create DB views over the QC/ALM database to ease reports creation
Mirror the DB
Enable reporting on QC/ALM database without a performance impact
External DB
Copy subset of data from QC/ALM DB to an external DB
Data Warehouse
A real BI solution – ETL processes, staging DB and a DWH
Challenges with customized solutions
External excel reports
Difficult to maintain
Not accessible for everyone
No scheduling
DB views
Not supported by HP
Requires DB knowledge
Performance penalty
Mirror DB
Performance and manageability challenges
Does not solve the database complexity
External DB
Need to set up DB jobs
Complex to extract a subset of data
Data warehouse
Very costly to create and requires technical competence
Costly to maintain over ALM/QC version changes
INNOVATIVE PRODUCTS FOR HP ALM & QUALITY CENTER
ASSURE PROJECT HARMONIZER
ASSURE TOTALVIEW
ASSURE ADMIN CONSOLE
ASSURE TRASHBIN
ASSURE DATA STANDRDIZER
ASSURE BUGZILLA ADAPTER
ASSURE TEST DATA INTEGRITY
Assure TotalView BI for HP ALM/QC
What is Assure TotalView
A revolutionary Data Mart solution specifically designed
for HP ALM & QC, which incorporates BI best practices
and has all the benefits of a BI solution
Why we created it
A clear market need for a best in class, business focused,
BI solution for HP ALM & QC
Who is it for
Mature organizations who look for complete flexibility and
visibility, decision making power and one version of the
truth.
Why BI
“You can't beat a BI solution for reporting. The source system will never be able to compete. It is a proven fact by leading companies all over the world.”
“If a company wants to beat competition it must be one step ahead - BI is the key”
“Most leading software providers supply a separate platform for BI that is not part of any legacy system”
“The source system will never be able to incorporate BI best practices as it is always limited in its resources and capabilities”
Positioning Assure TotalView B
usin
ess Insig
ht
Maturity of Reporting Culture and Tools
Out of the Box
Operational Reports
Customized
Operational Reports
Islands of Information
Business Driven
Reports
Centralized Effort
Centralized dedicated
Reporting
Team & Environment
Business Awareness
ASSURE TOTAL VIEW One Version of the Truth
Why Assure TotalView
TotalView is a BI solution for HP Quality Center & HP ALM A fully extendable and customizable BI platform for HP ALM
For mature HP ALM customers that want complete control and flexibility
Based on Business Intelligence methodology, technology and best practices
Seamlessly integrates with any Enterprise BI solution or BI presentation layer
Data Mart – Dedicated data analysis database
Provides data analysis from summarized to single row data
Fully self-governed – Control, Monitor, Customize
Supports and evolves with customer business culture
Rapid ROI Vs. creating your own QC BI solution
Low TOC Self-governed
HP QC/ALM upgrades delta provided by Assure
Product Components
Data Mart
Management Console
ETL (Extract-Transform-Load) processes
Ready to use dashboard (using QlikView)
Report library
Product Architecture
Star Schema Data Model - a BI Best Practice
Execution Progress
Test Readiness
Defect Detection
Priority Bug Status
Severity
Plan Status
REQ
TEST
Release Cycle
Release
Test Set
Person
Time Exec
Status
Test Instance
Summary of Key Features
Without TotalView
Complex table structure
Limited Depth
No QC/ALM version support
Complex maintenance
Short-term solution
Analysis on Prod. DB
Complex data management
Complex report build
Limited “Multi-QC Project”
With TotalView
Intuitive table structure
Strategic - Trend and Progress
QC/ALM version support
Minimal maintenance
Long-term solution
Dedicated analysis DB
Management console
Simple report build
Unlimited “Multi QC Projects”
Demo of TotalView
Multi-Project Analytics Key Considerations
Multi-Project Analytics requires an uniform data structure
QC10 Premier / ALM11
Strict Policies for project creation and changes
Assure Project Harmonizer
Quality Analytics requires quality data - uniform data
values
QC10 Premier / ALM11
Strict Policies for project creation and changes
Assure Admin Console
Assure Data Standardizer
Q&A and Next Steps
ALM+ Current State Analysis
Gain visibility into how well you are running ALM/QC
Get a clear plan for the next steps to better reporting
10 days (7 on-site), $9500 (plus travel cost)
Assure TotalView
Contact us for details, demo, POC or questions
Web: www.assure.net
Email: [email protected]
Twitter: http://twitter.com/assureqc
Presenters