using hp quality center 10.0 workflow and customization interface to manage testing process flows
DESCRIPTION
TRANSCRIPT
1 ©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
Using HP Quality Center 10.0 Premier to introduce processes and control into existing testing Michael Deady, CPCTest Tool Administrator
JC Penney Inc.
2 ©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
Introduction About JCPenney Inc JCPenney Application Testing Center Business Problem
Quality Center 10 Premier ATC & Quality Center Decision Process
The Implementation Plan Plan, Train, Design and Development
In Closing Things to Know Hints and Tips Other Premier advantages Summary
3
About JCPenneyAbout JCPenney
Department Store Retailer with 1,110 stores
Locations in United States and Puerto Rico
Largest Apparel & Home Furnishing site on the internet (JCP.COM)
Stores also provide styling salon, optical, portrait photography, and custom decorating services
Corporate Headquarters: Plano, Texas
Employees: 150,000
4
• Other Benefits• Centralized administration• Framework creation• Vendor management• Aggregated purchase
• Other Benefits• Centralized administration• Framework creation• Vendor management• Aggregated purchase
JCPenney Application Testing CenterJCPenney Application Testing Center
• What we Provide JCP I.T.• Processes • Services
• Test automation engineers• Performance engineers
• Training• Templates• Forum for best practices sharing
• What we Provide JCP I.T.• Processes • Services
• Test automation engineers• Performance engineers
• Training• Templates• Forum for best practices sharing
The Application Testing Center (ATC) was founded to create a Center of Excellence (COE) for JCPenney I.T. division by providing the Application Testing Teams, the best tools, services, and resources to improve the quality and consistency of application testing across JCPenney.
The Application Testing Center (ATC) was founded to create a Center of Excellence (COE) for JCPenney I.T. division by providing the Application Testing Teams, the best tools, services, and resources to improve the quality and consistency of application testing across JCPenney.
5
Test Management JCP Business ProblemTest Management JCP Business Problem
Pitfalls:• After consolidating Quality
Center into a single environment, we had over 250 projects, several housing 10 defects or less. ???
• Each Quality Center project was unique, and highly customized
• Testing groups were very isolated and had very little interaction with peers or staff
• High use of Excel upload processes
• A lot of manual rework causing user frustration with the tools
• No training around the tools• Contractor-driven testing
Pitfalls:• After consolidating Quality
Center into a single environment, we had over 250 projects, several housing 10 defects or less. ???
• Each Quality Center project was unique, and highly customized
• Testing groups were very isolated and had very little interaction with peers or staff
• High use of Excel upload processes
• A lot of manual rework causing user frustration with the tools
• No training around the tools• Contractor-driven testing
Huddles:• Most of the QC projects were still
active• Admin permissions were very loose• Most Admin personnel had no formal
training• The level of understanding of the tool
was limited• No environment management• An understanding of the tools
• Defect vs. Test Management
Huddles:• Most of the QC projects were still
active• Admin permissions were very loose• Most Admin personnel had no formal
training• The level of understanding of the tool
was limited• No environment management• An understanding of the tools
• Defect vs. Test Management
6
JCPenney Application Testing Teams Top Ten (Why HP-QCP)JCPenney Application Testing Teams Top Ten (Why HP-QCP)
1. Keep It Simple or K.I.S. - A.T.C.
2. Sharing information across projects and development tools
3. The capability goes back in time or compares historic information (Version Control)
4. The ability to customize an individual HP Quality Center project to better fit the Development project, while maintaining a level of uniformity.
5. Consistent KPI's across projects
6. Use templates and build a process.
7. Reduce the level of duplication and redundancy
8. Customize control capability
9. The ability to test in any environment (Production, Test, and Development) at the same time -- (baselines)
10.The capability to manage every facet of QDLC and/or SDLC
1. Keep It Simple or K.I.S. - A.T.C.
2. Sharing information across projects and development tools
3. The capability goes back in time or compares historic information (Version Control)
4. The ability to customize an individual HP Quality Center project to better fit the Development project, while maintaining a level of uniformity.
5. Consistent KPI's across projects
6. Use templates and build a process.
7. Reduce the level of duplication and redundancy
8. Customize control capability
9. The ability to test in any environment (Production, Test, and Development) at the same time -- (baselines)
10.The capability to manage every facet of QDLC and/or SDLC
What ATT’s want in a (Test) Management System?What ATT’s want in a (Test) Management System?
7
Relation between ATC & Quality Center Relation between ATC & Quality Center
In 2008 ATC selected HP’s Quality Center as the enterprise solution for test management to ensure continuity and consistency across JC Penney. ATC was tasked with aiding our IT and business partners in the conversion and consolidation of all leagues of defect tracking and testing repository systems and/or test applications into the Approved Test Management system.
ATC has been so successful at integration of the testing tools into the approved testing process and methodology that if you login into the newer QC projects you are more than likely following ATC’s Processes.
“Quality Center acts as the Backbone to our
Methodology”
“Quality Center acts as the Backbone to our
Methodology”
8
Decision ProcessDecision Process
Why Quality Center 10.0?JCP needed the ability version artifacts and establish points reference
Why Quality Center 10.0?JCP needed the ability version artifacts and establish points reference
Why Quality Center Premier• Structure and best practices into the environments
that could not afford the cost or the time to implement.
• The capability to share information across several projects to eliminate the duplication of artifacts and reduce test development time (Test Case, Requirements, Resources, etc.)
Why Quality Center Premier• Structure and best practices into the environments
that could not afford the cost or the time to implement.
• The capability to share information across several projects to eliminate the duplication of artifacts and reduce test development time (Test Case, Requirements, Resources, etc.)
ATC Objectives• Upgrade legacy Quality Center projects • Lower maintenance model for 2010• To better align the Quality Center projects with the
AUT • Reduce the amount of training across JCPenney
ATC Objectives• Upgrade legacy Quality Center projects • Lower maintenance model for 2010• To better align the Quality Center projects with the
AUT • Reduce the amount of training across JCPenney
9
Quality Center 10.0 Premier’s Point of Interest for ATCQuality Center 10.0 Premier’s Point of Interest for ATC
• The ability to enforce processes and methodology • The capability to change the process, fields or workflow
without negatively impacting the project• The ease of moving information from one project to
another • The ability to introduce change with speed and accuracy • The capacity to share and control the flow of data across
projects• Built-in cross project reporting• Real-time dashboard• The new friendly dashboard user interface• Etc..
• The ability to enforce processes and methodology • The capability to change the process, fields or workflow
without negatively impacting the project• The ease of moving information from one project to
another • The ability to introduce change with speed and accuracy • The capacity to share and control the flow of data across
projects• Built-in cross project reporting• Real-time dashboard• The new friendly dashboard user interface• Etc..
• Then attract the Projects to the new template by enticing them with QC Premier’s new functionality
• Then attract the Projects to the new template by enticing them with QC Premier’s new functionality
• Create the template which incorporated the ATC methodology and processes
• Create the template which incorporated the ATC methodology and processes
10
The Implementation PlanThe Implementation Plan
The plan was straightforwardThe plan was straightforward
Brown Bags including Tool Overview by HP and Open Deep Dive training
Brown Bags including Tool Overview by HP and Open Deep Dive training
One on One Meeting with the Application Testing Team
DemosDemos
Meet with the business user
Open Brainstorming ForumsOpen Brainstorming Forums
11
The Road ShowThe Road Show
Application• A program that gives a computer instructions that provide the user
with tools to accomplish a task
System• A group of interacting, interrelated, or interdependent elements
forming a complex whole.
Application• A program that gives a computer instructions that provide the user
with tools to accomplish a task
System• A group of interacting, interrelated, or interdependent elements
forming a complex whole.
Step 1: Define what is a Quality Center ProjectStep 1: Define what is a Quality Center Project
QC Project • Is the logical collection of data relevant to a set of applications that
interacts to serve a business purpose. This data may refer to hardware, software, requirements, tests, defects, and/or any other artifacts used in the validation of the system. The Quality Center project documents the complete lifecycle of the application or system from concept to decommission.
QC Project • Is the logical collection of data relevant to a set of applications that
interacts to serve a business purpose. This data may refer to hardware, software, requirements, tests, defects, and/or any other artifacts used in the validation of the system. The Quality Center project documents the complete lifecycle of the application or system from concept to decommission.
12
13
___ _ ____ ______ ____________ _______ ___ _ ____ ______ ____________ _______Step 1A: HP’s QC Cross-Project Customization OverviewStep 1A: HP’s QC Cross-Project Customization Overview
Creating a Template Project
Linking the Template to
Projects
Customizing the Template Project
Verifying Cross Project
Customization
Applying Customization to Linked Projects
Creating a Template Project Creating a Template Project
Linking the Template to ProjectsLinking the Template to Projects
Customizing the Template ProjectCustomizing the Template Project
Verifying Cross-Project Customization
Applying Customization to Linked ProjectsApplying Customization to Linked Projects
Quality Center Help File 2009 Hewlett-Packard Development Company, L.P.
14
Step 1B: HP’s QC Cross Project Customization ExamplesStep 1B: HP’s QC Cross Project Customization Examples
Set a standard for working with defectsSet a standard for working with defects
Enable consistent reporting by managers. Enable consistent reporting by managers.
Create corporate Policies and Processes for separate sectors of an organization
Create corporate Policies and Processes for separate sectors of an organization
15
Step 2: Training and Planning Step 2: Training and Planning
• Spend some time on understanding all the new features• Warning: the template tool has a large
foot print on the projects and access should be controlled
• Take note of the what the template will or will not change at the project level
• Create a template that reflects your workflow, and can generate the required information for reporting metrics
• Tools and Skills• A understanding of Quality Center project
backend, especially workflow • Quality Center 10.0 Premier• A well documented testing process• Access to both SA and TD • An understanding of roles and
responsibilities within Quality Center
• Spend some time on understanding all the new features• Warning: the template tool has a large
foot print on the projects and access should be controlled
• Take note of the what the template will or will not change at the project level
• Create a template that reflects your workflow, and can generate the required information for reporting metrics
• Tools and Skills• A understanding of Quality Center project
backend, especially workflow • Quality Center 10.0 Premier• A well documented testing process• Access to both SA and TD • An understanding of roles and
responsibilities within Quality Center
16
Step 3: Design and DevelopmentStep 3: Design and Development
• Development of Template Workflow• Template Entity vs. Local Entity• Levels of Access• Version Control• Template Reports• Presentation Layers
• Development of Template Workflow• Template Entity vs. Local Entity• Levels of Access• Version Control• Template Reports• Presentation Layers
17
Create unique policiesCreate unique policies
Enable consistent reporting by managers.
Enable consistent reporting by managers.
Set standardsSet standards
Process using QC Premier Template (Workflow)Process using QC Premier Template (Workflow)
NOT REPORTED
REPORTING CLOSED
REPORTING OPEN
NEW
IS DEFECT VALID
OPEN
ACCEPT DEFECT?
ASSIGNED
FIXED
DEFERRED
DEFECT RETEST SUCCESSFULLY?
REOPEN
CLOSED
RETESTED SUCCESSFULLY
PERMANENT WORKAROUND
No
YES
REJECTED
No
YES
NO
YES
A DEFECT/ENHANCEMENT CAN ENTER DEFERRED STATUS FROM ANY POINT ALONG THE LIFECYCLE AS THIS STATUS USUALLY REQUIRES A RISK
ANALYSIS
INVALID TEST
INVALID REQUIREMENTS
EXTERNAL ISSUE
DUPLICATE
USER ERROR
PENDING REVIEW
FUTURE ENHANCEMENT
PENDING ASSIGNMENT
WAITING FOR VENDOR
WORKING
RESEARCHING
SENT TO VENDOR
PENDING ASSIGNMENT
Clarification
READY FOR QA TEST
Key
DISPOSITION
STATUS
DECISION
DOCUMENTATION FOR
WORKAROUNDS
Operations Impact
Technical Impact
Customer Impact
TEMPORARY WORKAROUND
• Project Entities (Shared) link to customize system fields and create user-defined fields.
• Project Entities (Shared) link to customize system fields and create user-defined fields.
18
Process using QC Premier Template (Entities)Process using QC Premier Template (Entities)
19
What Templates updateWhat Templates update
TaskTemplate UpdateSharing
Local update Only
User Properties
Project Users
Groups
Module Access
Project Entities
Requirement Types
Risk-Based Quality Management.
Project Lists
Auto mail
Alert Rules
Workflow Template With Calls only
Cross Project Customization Linked Projects Linked Template
20
Step 3: ImplementationStep 3: Implementation
To add a project to a template you need to be in the Site Admin screen
To add a project to a template you need to be in the Site Admin screen
To push changes to the projects you need to be in the Project template customization screen
To push changes to the projects you need to be in the Project template customization screen
21
Template VerificationTemplate Verification
Verification Report
Provides results of verification for the linked project.
Verification Report
Provides results of verification for the linked project.
Applied Customization Report
Provides results of template customization applied to the linked project.
Applied Customization Report
Provides results of template customization applied to the linked project.
22
Detailed ReportingDetailed Reporting
Result category
Verification Report
Successful The change can be successfully applied to the linked project.
Warning The change can be applied to the linked project, but may result in data loss.
Failure The change cannot be applied to the linked project.
23
Project Level CustomizationProject Level Customization
Cross-Project Customization • Linked Template page.
• View details about template customization • Send email to the template administrator • Check for conflicts between customization in the
project and customization in the template project• Request to block template customization updates
Cross-Project Customization • Linked Template page.
• View details about template customization • Send email to the template administrator • Check for conflicts between customization in the
project and customization in the template project• Request to block template customization updates
24
Project Update (Pushing)Project Update (Pushing)
• Update one or all of the projects
• Update time stamp• Contact Help • Easy to follow
instructions
• Update one or all of the projects
• Update time stamp• Contact Help • Easy to follow
instructions
• Updates pushed while people logon
• Detail reporting for users• Email Notification• Built-in Process
• Updates pushed while people logon
• Detail reporting for users• Email Notification• Built-in Process
25
Other Premier AdvantagesOther Premier Advantages
Dashboard allows the different Application Testing Teams to consolidate reporting
Dashboard allows the different Application Testing Teams to consolidate reporting
Defect Synchronizer allows users to send defects across projects and external applications (JIRA)
Defect Synchronizer allows users to send defects across projects and external applications (JIRA)
Requirements sharing has helped ATC make the business case that the development and management of business requirements should be managed in Quality Center
Requirements sharing has helped ATC make the business case that the development and management of business requirements should be managed in Quality Center
Sharing test cases and business components development, track, and execute across several projects reducing redundancy and duplication
Sharing test cases and business components development, track, and execute across several projects reducing redundancy and duplication
Resource sharing has greatly added to the automation of applications by drawing on existing functional libraries, object repositories, and data
Resource sharing has greatly added to the automation of applications by drawing on existing functional libraries, object repositories, and data
26
Quality Center Synchronizer Quality Center Synchronizer
The Synchronizer enables you to synchronize data between Quality Center and other applications, or between two Quality Center projects.
The Synchronizer enables you to synchronize data between Quality Center and other applications, or between two Quality Center projects.
Integrity ChecksIntegrity Checks
Incremental SynchronizationsIncremental Synchronizations
Full SynchronizationsFull Synchronizations
Working with Quality Center Version ControlWorking with Quality Center Version Control
QC Project B
QC Project F
QC ProjectJCP
QC Project E
QC Project D
QC Project C
QC Project A
QC Project H
Quality Center
Synchronizer
27
QC 10 Premier Baseline (sharing across SDLC) QC 10 Premier Baseline (sharing across SDLC)
QC Project B
QC Project A
Update
SystemEnd
to E
nd
UAT UNIT
&
Inte
grat
ionRelease 1.0
Develop
Cycle Unit
Cycle SystemCycle Functional
Cycle End to End
Cycle UAT
Update
Syste
mEnd to End
UATUNIT &
Integration
Develop
BaselineProject A
Update
SystemEnd
to E
nd
UAT UNIT
&
Inte
grat
ion
Develop
BaselineProject B
Share Project B
Release 1.1
Update
Syste
mEnd to End
UATUNIT &
Integration
Develop
BaselineProject B
Share Project A
BaselineProject A
BaselineProject B
Share Project B
Update
Syste
mEnd to End
UATUNIT &
Integration
Develop
BaselineProject B
Share Project A
Release 3.10
Release 3.11 Release
4.00
28
Sharing of documents
Incorporated technical and functional documents
Traceability
Sharing of documents
Incorporated technical and functional documents
Traceability
Reduce rework and duplication
Version control documentation
Easy to modify existing documentation
Single repository
Reduce training costs
Easily customized
Reduce rework and duplication
Version control documentation
Easy to modify existing documentation
Single repository
Reduce training costs
Easily customized
Quality Center as part of the SDLC ProcessQuality Center as part of the SDLC Process
29
Things to KnowThings to Know
Key Note: Purge all local workflow before adding project to template - this may cause errors later
Key Note: Purge all local workflow before adding project to template - this may cause errors later
Module access is handled at the Project Level Module access is handled at the Project Level
I recommend that you standup the Synchronizer on independent hardware to avoid any issues.
I recommend that you standup the Synchronizer on independent hardware to avoid any issues.
Remember that sharing defects uses the Quality Center Synchronizer.
Remember that sharing defects uses the Quality Center Synchronizer.
Sharing information from two projects relies on base lining functionality
Sharing information from two projects relies on base lining functionality
(Migration) uses the QC Synchronizer to move Defects from older projects to updated projects using QC 10 Templates
(Migration) uses the QC Synchronizer to move Defects from older projects to updated projects using QC 10 Templates
Limit your support for Excel Add-in Limit your support for Excel Add-in
Backup code manually before making changes to the Template project
Backup code manually before making changes to the Template project
30
Tricks and TipsTricks and Tips
Plan a phased rollout of all the new functionality
This can be overwhelming for the local project administrator and can cause training issues as well.
Plan a phased rollout of all the new functionality
This can be overwhelming for the local project administrator and can cause training issues as well.
Uses Brown Bags or short training sessions
Introduce the new functionality (what’s new)
Uses Brown Bags or short training sessions
Introduce the new functionality (what’s new)
Keep your Template Simple
The number of templates can also be an issue
Keep your Template Simple
The number of templates can also be an issue
Follow best practices
When coding workflow and document everything
Follow best practices
When coding workflow and document everything
Try to keep information and defect sharing inside one templateTry to keep information and defect sharing inside one template
Create a process flow before attempting to share information
Defects, Requirements, Resources, Test cases
Create a process flow before attempting to share information
Defects, Requirements, Resources, Test cases
31
Introducing Processes and Control Into Existing Testing Environments Using HP Quality Center 10.0 Premier
Introducing Processes and Control Into Existing Testing Environments Using HP Quality Center 10.0 Premier
32