Confidential and Proprietary Information of T-Mobile USA 1

January 2009

10/15/2009

Business Process TestImplementation for SAP QualityAssurance and Testing

T-MobileEnterprise QualityManagement

Confidential and Proprietary Information of T-Mobile USA 2

Welcome

Confidential and Proprietary Information of T-Mobile USA 3Confidential and ProprietaryInformation of T-Mobile USA

3

Confidential and Proprietary Information of T-Mobile USA 4

Introduction of Michael CooperEnterprise IT Director of Quality Assurance - T-Mobile USA

Leads a Onshore/Offshore team of 350+ QA, Testing and Infra professionals2009 HP Software Awards of Excellence Winner – IT Transformation2007 to Present HP Software Customer Advisory Board Member (Quality)2006 Quality Leadership Executive of the Year Award Winner (Software –Practitioner)Functional expert in manual and automated software testing techniquesProven track record of success implementing software testing and DefectManagement toolsCertified Software Test Engineer (CSTE)Atlanta Quality Assurance Association (AQAA), President (2005–2007)Frequent speaker at QA and software testing conferencesMBA with CIS concentrationLives in Dunwoody, GA with his wife and three children

Prior QA Leadership ExperienceFair Isaac Corp., Global Director of Quality Assurance and UsabilityInovis, Enterprise Director of Quality AssuranceEquifax, Director of Quality Assurance

Confidential and Proprietary Information of T-Mobile USA 5

Who WeAre

Confidential and Proprietary Information of T-Mobile USA 6

Headquarters: Bellevue, Washington

Coverage: T-Mobile USA is a national provider of wireless voice, messaging, anddata services capable of reaching over 293 million Americans where they live, work,and play. Around the country, our Personal Coverage Check gives customers a clearpicture of their local coverage.

Number of Employees: 36,000

Ownership: T-Mobile USA is the US operating entity of T-Mobile International AG, themobile communications subsidiary of Deutsche Telekom AG (NYSE: DT). DeutscheTelekom is one of the largest telecommunications companies in the world, with nearly120 million customers worldwide.

T-Mobile's commitment to customersatisfaction and quality has earned "highestranking" status in multiple awards this yearfrom J.D. Power and Associates. T-Mobilewas also ranked 96th on FORTUNE’s 12thannual “Best Companies to Work For” list.

Company Overview

Confidential and Proprietary Information of T-Mobile USA 7

WhatWe’reDoing

Confidential and Proprietary Information of T-Mobile USA 8

Add divider title here, up to 8 words

Agenda

T-Mobile EQM SAP QAT Organizational Model

BPT Implementation and Benefits

Case StudiesECC 6.0 UpgradeECOP Release 1 (Tele-Sales)Entity Restructure Phase2

Demonstration

Automated Reports

BUSINESS PROCESS TESTING

WHAT IS IT?Business process is broken down into asingle business component andconnected to create test scriptStreamlines the creation andmaintenance of both manual andautomated test casesIntegrated module within Quality Center

VALUE ADD?ReusableEasy maintenanceLeverage across multiple applicationsand testing teamsCost and Time effective

FUNCTIONAL AUTOMATION

WHAT IS IT?Running a series of tests thatemulate the interaction between theuser and the applicationVerifies whether or not theapplication functions as expectedUses tools QTP, SAP TAO and QC

VALUE ADD?Reusable and RepetitiveIncrease testing capacity withoutadditional resourcesPredictability & ConsistencyReduction in human error andinconsistencies

BPT and Test Automation

Confidential and Proprietary Information of T-Mobile USA 10

SAP QAT Test Strategy

HP Quality Center9.2

Build ScriptedComponent

Review ManualComponent

HP QTP 9.5

Inspect UI Scanner Test DataBest Practice

Business Test &Components

SAP TAOTest Automation

Requirements Business &Test Components Test Plan Test Case Test Set Defect

Manual Testing

Add divider title here, up to 8 wordsLoad and Performance Testing using HP Load Runner 9.5 and HP Performance Center 9.5

BPTs Maintenance and Governance for Ongoing Projects and Operational Efforts

Test Status tracking using HP Quality Center Dash Board

Confidential and Proprietary Information of T-Mobile USA 11

Technology

Confidential and Proprietary Information of T-Mobile USA 12

Add divider title here, up to 8 words

SAP QAT Organizational Model

Confidential and Proprietary Information of T-Mobile USA 13

Add divider title here, up to 8 words

BPT Implementation and Benefits

ImprovedQuality

CostEfficiencies

TimeSavings

• Cut transaction times through automated scripts by approximately 50%

• Gained ability to deliver high availability for ERP applications

• With the help of standardized test methodology, improved application qualityand reduced business risk

• BPT Components developed - 2461• BPT Scenarios developed - 4886• Automation time savings - 1337 hrs

Confidential and Proprietary Information of T-Mobile USA 14

Process

Automation engaged upfrontduring analysis

Defined plan, execution andreporting process andassociated deliverables

Weekly Communicationmechanism and handoffbetween the manual andautomation teams

One automation lead perrelease cycle

Defined milestone in the QA(Test Planning and TestExecution Process)

Manual Automation

Intake

Delivery

Process

Confidential and Proprietary Information of T-Mobile USA 15

BPT (Business Process Testing) - Modular Approach to testing by breaking abusiness process into individual components

QTP (Quick Test Professional) - Functional Automation Tool for Front End Automation

TAO (Test Accelerator and Optimizer) - Functional Automation Tool for SAP R3Automation

QC (Quality Center) - Central Test Management and Defect Tracking Tool

LR (Load Runner) - Technical Automation Tool for Performance Testing

QA Inspect - Security Testing Tool integrated with QC

QA Synchronizer - API Integrates third party tools with QC

Service Test - SOA testing solution that simplifies and accelerates the automatedfunctional testing of SOA services

Technology

Confidential and Proprietary Information of T-Mobile USA 16

Governance

Periodic Health Checks and Score CardBlue Chips aligned with Long term StrategyImprove Leadership through Coaching and MentoringNarrow Focus on ExpectationStrict adherence to established processesStreamlined and effective work flow 24 X 7Knowledge RetentionClear alignment and communication across the variousteams within EQMIncreased output from OffshoreContinuous Process Improvement

Governance

Confidential and Proprietary Information of T-Mobile USA 1717

Case Study 1 – ECC 6.0 UpgradeTeam size

Challenges

Benefitsthrough

HP BPT andSAP TAO

KeyDrivers

• Improved stability and reduced maintenance overhead• Seamless integration between tools and technologies

• Incomplete/outdated business process plan documentation• Aggressive schedule for implementation• Very large scope – 88 Applications/interfaces impacted• Over 2000 Custom objects• 50 parallel projects required remediation

• 83% automation leveraged• Allowed ability to meet aggressive timeline• Improved resource efficiencies by allowing manual test resources to focus on parallel projects• Enabled consiststency of test results

Delivery Model

TechnicalEnvironment

Onsite/Offshore (40/60)

SAP ECC 6.0, SAP TAO,TIBCO,HP Quick Test Pro 9.5,HP Quality Center 9.2

Engagement Profile20 No. Of Test Cycles 3

BusinessProcess Areas

Number of TestScripts

% Automated

OTC 255 95

PTP 394 75

FICO 306 80

Confidential and Proprietary Information of T-Mobile USA 1818

Case Study 2 – ECOP R1 (Telesales)Team size

Challenges

Benefitsthrough

HP BPT andSAP TAO

KeyDrivers

• Retire legacy application• Improved integration and maintenance• Increase stability and uptime• Support ever increasing business needs

• Frequent requirement changes throughout test execution• Heterogeneous test environment• Replacing configuration based legacy application SAP CRM with IBM WCS• Data Synchronization between SAP Product Catalog and WCS• Environment instability

• Ability to run multiple passes for environment shakeout• Reduced cycle time for regression test efforts• Reusable data driven testing with efficient coverage• Enabled consiststency of test results

Delivery Model

TechnicalEnvironment

Onsite/Offshore (20/80)

SAP ECC 6.0, SAP TAO, TIBCO, IBM WCS,SAP PI, HP Quick Test Pro 9.5, HPQuality Center 9.2

Engagement Profile15 No. Of Test Cycles 5

BusinessProcess Areas

Number of TestScripts % Automated

OTC 1200 Functional (55)Regression (100)

Confidential and Proprietary Information of T-Mobile USA 1919

Case Study 3 – Entity Restructure Phase2Team size

Challenges

Benefitsthrough

HP BPT andSAP TAO

KeyDrivers

• Accounting restructuring to enable cost savings• Align business model to new organizational changes

• Aggressive schedule for implementation• Very large scope – 80 applications/interfaces impacted• 5 environment refreshes with 5 mock conversions

• 80% automation leveraged• Allowed ability to meet aggressive timeline• Improved resource efficiencies by allowing manual test resources to focus on multiple

environment stabilization efforts• Enabled consistency of test results

TechnicalEnvironment

Delivery Model Onsite/Offshore (20/80)

SAP ECC 6.0, P2P, O2C, FICO,SAP TAO,TIBCO,HP QTP 9.5, HP Quality Center 9.2

Engagement Profile9 No. Of Test Cycles 3

BusinessProcess Areas

Number of TestScripts

% Automated

OTC 121 100%

PTP 95 47%

FICO 308 94%

Confidential and Proprietary Information of T-Mobile USA 20

Demonstration

Add divider title here, up to 8 words

QTP and SAP TAO automated business process flow

Creation of Automated BPT Component, Script and Execution

QTP Component Framework SAP TAO TransactionalLibrary

Confidential and Proprietary Information of T-Mobile USA 2121

Here you can check or uncheckthese boxes to determine which trendlines are displayed in the report.

Click Refresh View or Export to Excel to view the report. Each of the trend lines is represented by a different symbol.The bars represent the number of planned test cases.

There are several filters available for this report: ReleaseDate, Clarity ID, Test ID, Company Group, Test Group, & TestPass

Release Health Chart

To view this chart for individual projects select the projectsfrom the test id filter list. Then check the box for ‘ShowMultiple Charts’ and click ‘Refresh View.’

Test Case Report

Confidential and Proprietary Information of T-Mobile USA 22Defect Report22

Daily Opened vs. Closed

The bars in the graph represent thenumber of defect that were openedand closed each day.

The Defect Summary shows defect metricsincluding total, number closed, and numberfor each group to work.

Shows thedefect peak forthe release.

Confidential and Proprietary Information of T-Mobile USA 23

Thank You!