accenture application testing services australia … application testing services australia and new...

20
Accenture Application Testing Services Australia and New Zealand Embedding quality into the application lifecycle

Upload: phamdiep

Post on 20-Mar-2018

233 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

Accenture Application Testing Services Australia and New ZealandEmbedding quality into the application lifecycle

Page 2: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

2

Today’s testing challenge: Balancing quality, speed and cost IT budgets continue to be limited. Technology too is getting more complex. Add in the new realities—social, mobility, analytics and cloud—that are fundamentally changing the way companies do business, opening new avenues to customers, markets and growth at an unprecedented rate.

The business demands the highest level of application availability and stability. Development turnaround times are getting shorter, and many large enterprises are adopting DevOps and Agile practices and methodologies. Testing teams are under intense pressure to quickly and thoroughly test applications to support a wide variety of end user devices, such as laptops, tablets and phones, without sacrificing quality and speed of delivery.

IT executives globally are looking for new ways to improve application quality and speed and lower cost while managing their digital transformation. This is especially true when they spend as much as 10 to 12 percent of the annual IT budget fixing core application problems.1

Accenture’s approach: Radically improve productivity and manage complexity with intelligenceOur clients come to Accenture because we help them rise to these challenges. Accenture thinks differently about application testing—more innovatively and holistically. Instead of testing for quality at the end, we focus on it throughout the application lifecycle. In other words, we adopt a “quality in, quality out” mindset to cope with shrinking budgets and increasing technology complexity.

Our decades of experience delivering leading, end-to-end application testing services have taught us that, by adopting industrialised processes and infusing intelligence into delivery, costs can be reduced and application reliability improved.

And we go one step further. We work with you to improve testing productivity through predictive analytics, automation and industry specialisation while also driving higher quality across your application lifecycle. In many cases, we also assume the day-to-day responsibility for your testing operations.

Accenture Application Testing Services offers an intelligent approach to testing strategy and execution to help you unlock the potential of your business and reduce the cost of poor quality to less than five percent of the IT spend.

Quality applications power the high performance business

30+ deliverycenters

1000+ clients served globally

31,000+ professionals

80% of professionals aligned to an industry

Three decades of testing experience

10+ years in digital testing

Page 3: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

3

Accenture Application Testing Services can help improve your company’s financial position through cost reductions, accelerated speed-to-market and productivity improvements with an end-to-end testing strategy.

We conduct comprehensive quality improvement activities in each phase of the application lifecycle—from plan, analyse and design to build, test, deploy and run—across both Agile and waterfall based delivery models.

Shift leftWe complete these critical but often missed series of activities by adopting a ‘shift left’ approach to help improve upstream aspects of the testing process related to requirements, release and software configuration management. Only then do we focus on validating the design, functionality and performance of the application using innovative tools, automation and standardised testing processes to help improve productivity and reduce costs. As a final step, we help you operate your testing capability with a stronger focus on quality at a lower cost.

BenefitsAccenture Application Testing Services can help you deliver benefits such as:

• Up to 50 percent reduction in test operations costs

• 30-50 percent productivity improvements

• Up to 90 percent reduction in critical defects reaching production

• Improved application and environment stability

• Up to 90 percent automation penetration depending on business process complexity

• Greater staffing flexibility with a global delivery model

• Up to 15 percent savings when using 1: many testing ‘solution factories’

• Up to 45 percent reduction in test delivery cost when leveraging cloud-based services

• Up to 50 percent accelerated speed-to-market when using an Agile delivery model

Testing delivers business results

Figure 1: Accenture End-to-End Quality Model

Deploy Run

Operational readiness test facilitation

Performance management and monitoring

Post-deploymentvalidation

Operate the organisation

Design

Design review

Test script development (initial)

Capacity Planning

Plan

Plan review

QA estimates

QA team

Test activity roles & responsibilities

Test strategy development

Analyse

Requirementsdevelopment and/or review

Change control participation

Test condition development

Test cycle development

Testing cycle control

Test

Test script execution (all stages)

Metrics and reporting

Test closure

User acceptance test facilitation

Performance test

Software configuration management - builds/migrations

Metrics trends and risk review

Continuous improvement and innovation initiatives

Knowledge repository and resource proficiency management

Calculate cost of poor quality

Update automation plans and test scripts

Build

Code peer review

Test script development (completion)

Test-driven design

Applied Statistics/Pairs Testing

Test data build

Test environment build

Software configuration management - version control

Service virtualisation

Early performance testing

Optimise regression test packs

Project Management—Release management/end-to-end governance, metrics and reporting

System performance KPI identification

Post-deployment validation

Test model development

Test environment and data requirements

Test approachdevelopment

Page 4: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

4

We bring together comprehensive testing services, industrialised delivery, industry and technology capabilities and intelligent tools to drive quality, speed and automation.

Comprehensive services Accenture offers the entire breadth and depth of testing strategy and execution services—from core to specialised to digital transformation—across a broad array of applications, delivered under flexible business arrangements. Our services include:

Assessment and StrategyBased on the patent-pending Accenture Test Maturity Diagnostics aligned to the Testing Maturity Model (TMMi), we assist you with end-to-end testing assessment processes—from planning through final recommendations. We help assess your organisations’ current quality maturity levels and develop a roadmap to improve it over time.

How we deliver breakthrough quality, speed and automationDelivery MetricsMeasuring the Quality, Cycle Time, Cost and Maturity of not only testing but the entire IT Delivery Cycle is something that we often see companies overlook or pay little attention to. In our experience, those companies that invest in making sure there is consistency and accuracy of data and leveraging this to dynamically report on a set of key metrics is absolutely critical in not only measuring current progress but also demonstrating how investments in more mature development methods has realised true business benefits. In support of this we have developed the Accenture Test Metrics Framework (TMAF) that provides out-of-the-box metrics definitions, suggested target levels and physical dashboards. We have also taken this a step further through the development of delivery maturity models, questionnaires, frameworks and business case models to enable companies to kickstart delivery maturity transformation programs. These frameworks are very focussed on transition to Agile and Continuous Delivery operating models.

AutomationWe offer a robust set of intelligent tools and assets to consistently support the entire spectrum of automation-related testing activities and drive reduced costs and improved speed and quality.

Performance Engineering and TestingWe help conduct a wide range of performance testing and performance engineering services to diagnose and improve the code and architecture that impacts application performance.

Testing Centre of ExcellenceWe can help you manage or set up a dedicated Testing Centre of Excellence either at the enterprise level or within specific business units, thereby enabling delivery of standardised and industrialised testing services that effectively combines our people, processes, tools and reusable assets.

For organisations looking for digital transformation we offer:

Testing as a Service2

We deliver an elastic, on-demand suite of testing tools and environments built on the Accenture Cloud Platform that can be provisioned dynamically and repeatedly to enable consistent testing practices.

Figure 2: Accenture Application Testing Services

ApplicationsSAP, Oracle, Microsoft, Java, Workday, Salesforce.com, Mainframe, Industry-specific

Emerging technologiesAnalytics, Cloud, Mobility, Digital

Business ModelsCapacity, Managed services, Transformation, Output-based

Core services Specialised services*

Assessment and Strategy Domain-led functional

Regression

Security

User experience

SOA

DW/BI

Virtualisation

Test data management

Environment management

Agile

Digital testing

Cloud-based testing

Performance Engineering and Testing

Automation

Testing/Quality Centre of Excellence

*The specialised services list is not exhaustive.

Page 5: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

5

Industry and Technology The majority of Accenture’s testing professionals focus on functional test delivery while also developing industry vertical specialisation. More than 80 percent of our testing professionals are specialised across 40 industries. In addition, a number of our testing team members specialise in various technology platforms, including SAP, Oracle, Workday, Salesforce.com and industry-specific applications among others. Industry and technology specialisation allows Accenture to provide more focused testing services for industry applications and functionality, such as manual and automated testing scripts for health, property and casualty insurance claims, with higher quality and speed. A deep understanding of the industry context also improves our end-to-end focus on quality and productivity, and makes service transitions smooth and less risky.

Additionally, our professionals complete comprehensive industry and testing certification programs including International Software Testing Qualifications Board (ISTQB), Certified Quality Software Analyst (CQSA) and other common testing certifications.

We have a global testing training and certification program—Accenture Technology Academy (ATA) Tester and Test Designer Certifications—developed in collaboration with the Massachusetts Institute of Technology (MIT) Professional Education.

Furthermore, Accenture also certifies our testing practitioners internally through our global Test Architecture Certification rating people in increasing levels of testing experience, skills and maturity form Test Architect to Senior Test Architect and finally Master Test Architect.

Industrialised Delivery Accenture delivers application testing services through our Global Testing Centre of Excellence Network of more than 30 centres located in 17 countries. As part of our Global Delivery Network these centres combine skilled people, industrialised processes and reusable, intelligent assets to offer cost-efficient and consistent access to extensive, industry leading capabilities on a 24/7 basis.

The centres operate at scale and provide you strategic options across specialised skills, time zones, commutability, and especially language and culture. In each centre, our testing professionals focus on providing integrated service delivery and use a successfully demonstrated approach focusing on testing maturity to help establish, maintain and improve operational excellence of your testing organisation.

Given our emphasis on quality, our Global Delivery Network is ISO 27001 and Capability Maturity Model Integration-certified, and has other relevant industry certifications as well.

You can either leverage the existing centres or we can help you set up and run your dedicated Testing Centre of Excellence. In this scenario, we leverage our Test Metrics Framework to drive transparency across the applications lifecycle and serve as the basis for service level agreements.

We also use dashboards and tools to measure various aspects of the testing and delivery process, including how quality and productivity are improving in each testing effort.

As part of our Global Delivery Network these centres combine skilled people, industrialised processes and reusable, intelligent assets to offer cost-efficient and consistent access to extensive, industry leading capabilities on a 24/7 basis.

Page 6: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

6

Figure 3: Assessment and Strategy: Accenture Test Assessment Framework (Testing Maturity Model)

Assessment Results – RatingsRatings Scale Initial Defined Integrated Managed Optimised

Assessment Scope Low Med High Low Med High Low Med High Low Med High Low Med High

Test Strategy

Methodology

Environment & Tools

Organisation & Communication

Test Lifecycle

Approach & Planning

Design & Preparation

Execution & Reporting

Test Disciplines

Performance Testing

Estimation

Test Metrics

Test Project Management

Defect Management & Prevention

Test Automation

Test Data Management

Requirements Management

Configuration Management

(A) Large Discount Retailer (top 40 in the Fortune 500) Projects view

(A)

(A)

(A)

(A)

(A)

(A)

(A)

(A)

(A)

(A)

(A)

(A)

(A)

(A)

Client A should look at a Test Management Tool – Introduce an integrated test management tool that captures all stages and steps within the testing lifecycle per release. Recommendation is the Rational toolset due to the Accenture alliance which will support cost efficiency. Training of resources will have to be considered.

Client C should Assess process to minimise defects and turnaround

Understand why there are so many defects coming out of Build and Fix

Foster developers and test analysts working together, in person or via a phone call, to solve defects

Look at practicality of creating a triage team, that sits within Product Test as first level of defect investigation. Required to have System Analysis skills

Client B should Look at automating the regression test suite which will reduce the end to end time frame of test execution.

Page 7: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

7

Organisations across industries continue to embrace digital to transform their business and operation. While they are focused on complex Digital transformations, technology firms such as Apple, Google and Microsoft continue to disrupt the Digital eco-system with innovation and new product development. Organisations need to consider the following while defining their digital test strategy:

1. Exponential growth of connected products with new features that make the Digital eco-system more complex.

2. Need of scalable Test environment and infrastructure.

3. Newer digital channels and customer’s expectation of a seamless digital experience across channels.

4. Increased security threats due to infinite bytes of data exchange.

5. Shortened test cycles due to faster development and deployment of digital products.

6. Increased CAPEX and OPEX that impacts the Return on Investment (ROI).

Accenture’s Unified Digital Testing Framework for Digital comes equipped with Cross Industry Enablers to help our clients address testing challenges and deliver a comprehensive Digital Testing Solution.

• Accenture’s Digital Test Labs for Applications, IoT Devices and Connected Home products have been leveraged for product testing and global deployment. The test labs comprise of

Industry standard tools, Test Infrastructure, Home grown innovative assets and Accenture’s Test Methodologies and can be easily scaled up/down and operated on a pay-per-use business model.

• Accenture’s Digital Crowd Test Platform is a crowd sourced functional and usability testing solution for testing and deployment of mobile applications globally.

• Accenture’s automated Digital Security Test Platform, built on a cloud SaaS platform, identifies security and privacy vulnerabilities during the app development life-cycle and reduces the chances of vulnerabilities in production, which otherwise would impact the time and cost of recovery. Security test scan reports have helped application

Accenture Unified Digital Testing Framework

Conformance

Security

Performance

Inter Operability

Compatibility

Functional

Customer

Employee Partner

Analytics

Context

Notification/Alert

Presentation

Brochures

POSDelivery

Web KIOSK

Social

Email

StoreTelemarket

Mobile

Smart TV

OMNI-CHANNEL

Content

Security

Mobility

Interactive

Services

Platforms

X-Industry Enablers

Digital App Test Lab

Digital Crowd Test Platform

Security Test Platform

Accenture Omni ChannelTesting Platform

Products

Device Test Analytics

Digital Optimization

IOT Test Lab

Digital Home Test Lab

Figure 4: Digital Test Services

development teams with detailed information on security threats and loopholes along with remediation recommendations.

• Accenture Omni Channel Testing Platform (AOCTP) is an innovative test framework developed by Accenture for accelerated Digital Channel testing during Digital Transformation and Omni Channel deployment by our Clients. Key features of AOCTP listed below:

- Automated test engine with comprehensive reusable Omni channel use-cases that validate seamless integration across digital and legacy channels.

- Business Intelligence Testing to validate web analytics and determine targeted offers and loyalty programs and consumer buying patterns.

• Digital Optimisation: Digital Optimisation lab dedicated for optimising web / mobile implementation across industries. The lab offers a best of breed solution which is a perfect blend of top rated industry tools, Accenture’s intuitive optimisation strategy and unique asset library.

• Accenture Device Field Testing and Analytics Platform provides automated Device Performance testing and simulated voice, messaging, data and video sequences. The platform can be easily integrated with the GSMA™TS11v12.1 and other field test specifications. The analytics engine of the platform correlates the test results and logs synchronised with the server and displays a simple and intuitive dashboard for faster field campaigns. It also provides analytical data to isolate the root cause of network and performance issues on the device.

Accenture Digital Testing

Page 8: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

8

Figure 5: Security Testing for Application

Figure 6: Security Testing included in Accenture Delivery Model

AccentureDelivery Model Design

Service Name Service Name Service Name TVM Assessments TVM Capability ImplementationTVM Capability Operation

Deployment

Analyse DesignPlan DeployBuild Test / Exec

Applications

Servers and Infrastructure Components

Human Behaviour and EnterpriseFunctions

Vulnerability Scanning

Penetration Test

Penetration Test

Design Review

Vulnerability Scanning

VulnerabilityManagement

Configuration Assessment

Social Engineering

Architecture and Design Review

Source Code ReviewRequirements Review Analysis Review

Sec. Risk Assessment

TVM Capability Implementation TVM Capability Operation

Eighty-six percent of all applications have at least one serious vulnerability, and most of the time, the application contains more than one (source: WhiteHat “2015 Website Security Statistics Report”).³ Increasing demand for content over the internet has increased the risk exposure of sensitive and confidential data. With the businesses extending beyond the enterprise into cloud, mobility and social media the threat organisations face today is enormous, and requires robust security testing embedded into the application lifecycle.

Mobile Application Security Testing Native mobile application static or binary source code scan and review; and Mobile backend web application dynamic vulnerability assessment

Web Applications Discovery and Perimeter Security

Discovery of known and unknown web applications and application perimeter security posture analysis

In-Depth Web Application Security Testing Web application vulnerability assessment focused on custom applications, combining dynamic security scanning with source code review and penetration testing

Packaged Application Security Testing Source code review of customised parts of commercial-off-the shelf applications (i.e. ABAP code in SAP); binary code analysis of 3rd party software products

Infrastructure Security Testing Internal and external infrastructure vulnerability assessment and penetration testing

Security Testing

Page 9: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

9

Figure 7: Accenture’s Digital Security Testing Strategy

Digital Security Strategy A comprehensive program and strategy to embed security controls and testing throughout the enterprise’s digital development lifecycle

Device• Security functionality• Control connectivity• Secure remote connections• Disposal and wipe• Synchronisation/Backup• Ability to update• Physical Access• Tracking/Management

Governance• Define processes and policies (ownership, connectivity, applications, privacy, audit/wipe)• Support/Training• Identify preferred suppliers/ service level for business

Users & Identity• Roles and authorisation levels and authentication• Evaluation/monitoring of usage patterns• Program awareness and education

Applications• SDLC development • Testing• Distribution/provisioning• Access Control• Secure connection to backend systems and data (Ex; Cloud)• Monitoring/Management

Data• Classification• Authentication• Secure connection• Strong Encryption• Data loss prevention• Secure storage• Audit and forensics

Network• Secure remote connectivity• Monitoring and Testing• Wireless networking• Use of untrusted and/or public networks

Users & Identity

ApplicationNetwork

Device

Governance

Data

Digital Security Strategy

Accenture provides comprehensive Security Testing services that includes discovery of vulnerabilities and remediation support for mobile platforms and application (including source code), cloud based web applications, network, and backend infrastructure and application. Built on a cloud SaaS Platform, the security test services are embedded within every phase of our delivery methodology from planning and analysis through to production.

In addition to the security testing services, Accenture also provides a full suite of security strategy development and assessment services addressing each component during the solution development lifecycle.

Page 10: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

10

Page 11: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

11

The next testing frontier: Quality Centres of ExcellenceCompanies who are already conducting testing offshore and automating testing to improve productivity may be asking, what is next?

Accenture is breaking new ground in application testing by taking a strategic and methodical approach to improving quality upstream in each phase of the application lifecycle—a strategic concept we call Quality Centre of Excellence.

A Quality Centre of Excellence creates transparency through an end-to-end view of defects, addressing them where they were injected, not where they were detected. Quality Centres of Excellence focus on incorporating measures and visibility into the application lifecycle, and providing insights into where to drive targeted improvements.

A Quality Centre of Excellence identifies root causes and reduces defects earlier in the cycle significantly improving the quality of code sent to testing. Quality code also makes the testing turnaround time even shorter, which translates into improved speed-to-market.

Innovation and IntelligenceAccenture continually strives to be ahead of the curve in application testing. As part of our commitment to quality and productivity in every phase of the application lifecycle, our people collaborate to develop trendsetting testing and end-to-end quality related innovations. We help you achieve your stated IT objectives by offering proprietary, innovative and intelligent testing assets and tools.

Accenture Intelligent Tools for Test OperationsWe use our next generation suite of productivity tools that augment and automate test preparation, execution and management to drive improved quality, efficiency and effectiveness of your test organisation. The tools drive intelligence into the testing lifecycle for modular script reuse, test execution prioritisation, automatic script assignment and defect management. The tools enable savings of 10–30 percent across various phases of testing; 25 – 40 percent during test preparation through reuse of modular scripts.

Accenture Intelligent Tools for Test AnalyticsAccenture Scenario Predictor leverages statistical techniques to analyse and proactively manage key parameters that can influence the project schedule, effort and defect leakage.

Accenture Performance Analytics helps to improve the speed and quality of decision making through root cause analysis based on process variations, performance baselines and augmented visual analytics to identify improvement opportunities.

Accenture Testing as a Service (Taas)Accenture Testing as a Service gives you the opportunity to test-drive our unique testing solutions in real time, providing you an on-demand, scalable and cost-effective model. It provides provisioning and management of test environments, data and tools to enable a significant reduction in the test delivery cost through integrated templates, accelerators, methodology, and a flexible, pay-per-use model.

The solution enables build up and tear down of test environments on an ad hoc basis without requiring the purchase of expensive infrastructure and reducing provisioning time. It also provides testing tool hosting that we manage as a broader managed service (including access to HP, IBM & CA products amongst others).

Accenture Testing Accelerator for SAPThe tool enables intelligent automation without scripting and knowledge of application modules to reduce the test planning and execution effort. It scans the implemented SAP system to provide insight and leverages the relationship matrix to link the configuration and technical objects to test scripts thereby enabling impact analysis and refresh of the scripts. Its diagnostics capability helps determine test scope and process variations based on actual SAP application usage.

Applied Statistics Testing Accenture leverages design tools to incorporate applied statistics based testing into Accenture Delivery Methods for Testing, our industrialised testing approach. Applied statistics-based testing is a method for conducting more rigorous, up-front testing planning to optimise test coverage and quality while minimising test effort.

The method drives significant productivity improvements by determining the combinations of features and data permutations to be tested and helps improve the quality and cost of poor quality by finding problems early in the lifecycle when they are least expensive to fix.

Our relationship with Hexawise also enables us to leverage the product at no cost in our engagements.

Accenture Test RepositoryThe global repository stores Accenture’s proprietary testing assets, including our standardised and reusable testing industry packs which facilitate acceleration of test plan development in specific industries. The asset enables savings of 25–40 percent in test preparation, industry specialisation, efficient knowledge transition and lower cost to serve due to faster ramp-up, productivity gains and improved quality.

Accenture Requirements Engineering SuiteThe asset is a bundle of tools that accelerate requirements gathering and maintenance and automate requirements quality validation. It provides an automated review of documented requirements in order to validate the level of detail, accuracy (from a language perspective) and ’testability’ and generates reports to provide different views of the requirements.

Accenture Automation IntegratorThis innovative asset automates the regression test phase, allowing extensive reuse of test cases for end-to-end application even across different technologies and an estimated saving of 30–70 percent of the test phase effort. The asset reduces the effort for test script creation and maintenance and ensures higher quality of delivery through faster and complete regression test.

Page 12: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

12

Accenture Test Case DesignerThe tool automatically generates test cases from requirements to improve test design productivity. It reduces effort by up to 50 percent and enables test coverage accuracy of more than 90 percent.

Accenture Quality Assistant The tool helps to measure, track and improve application quality using analytical methods to generate the cost of defects and their source.

Third party toolsWe have formed strategic alliances with HP, IBM, SAP, Microsoft, Oracle, Worksoft, TOSCA, SOASTA and also maintain strong relationships with a number of major testing tool suite vendors such as Computer Associates, DeviceAnywhere, Grid Tools, Perfecto Mobile, Experitest and Crittercism and Worksoft in order to quickly assemble an appropriate solution for you. Accenture has been HP’s Partner of the Year for five of the last 10 years. Additionally, our arrangement with IBM Rational enables use of their Application Lifecycle Management tools at no cost to you (with some caveats).

Strategic Testing Models and ApproachesOutput Based TestingThe aim of Output Based Testing is to reduce the cost to serve through higher productivity, shared costs, and shared leading test practices to offer fixed pricing for low level outcomes.

Output Based Testing is a means to define and deliver testing by the artefacts of the processes that yield quality measurements. This means testing needs to be discretely defined and predictable. We rely on measuring quality through a focus on delivering test outcomes based on productivity targets with a flexible and scalable workforce that manages to a queue for testing services.

Our commercial pricing is based on the purchase of units and unit blocks, more specifically:

• Cost to client is based on delivered outputs

• Our approach is based on the definition and use of discrete test factory services from an Accenture Test Factory Model

• Our solution leverages a unit based test factory service menu based on our experience with testing at similar clients

• Units are redeemed for test outcomes/outputs such as test results, test cases, and test metric reports

• Units can be purchased individually or in bulk at discounted rates

Risk Based TestingRisk-Based Testing helps fulfil the mandate to maximise quality where it matters most to the business in order to minimise risk at time of deployment. We do this by:

• Evaluating and improving the quality of requirements

• Improve both test effectiveness and efficiency

• Monitoring and reporting progress in reducing risk

• Adjusting risk reduction actions (e.g. test scope) based upon the effectiveness of prior actions or additional knowledge

• Gain consensus on high risk requirements.

Accenture’s approach is via:

• A targeted effort using early risk analysis to underscore the concerns and objectives of senior management and align the rest of the development lifecycle including the activities of testing organisations behind this

• A structured method and process guiding test managers in focusing their test activities on areas that lead to the greatest reduction of solution delivery risk

• Use of frameworks and tools (risk based and statistical tools) to systematically and dynamically assess testing risk and coverage

Value Based TestingTesting services and engagement models have matured from a primary focus on labour arbitrage cost reduction to a combined focus on operational efficiency and gain share. Accenture has a major focus on shifting testing engagement models and maturity, taking the next major step from offshoring, labour cost arbitrage, basic automation to a focus on overall cost of testing ownership and managing to committed productivity and cost reductions via Value Based and Gain Share engagement models.

Page 13: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

13

Unit Based model: Provides flexibility and predictability. Provider commits to agreed timeline and costs upfront. Managed service (Output based) model moves more responsibility and ownership to provider, thereby reducing e�ort / cost for client.

Outcome Based model focusses only on the final outcome and performance and not individually at each operational service components.

2000<1990

Fully onsite – High cost model Resource Based

Managed Capacity Model

2010

Managed Service – Output Based Model

Blended price reduction

Predictable Quality

Significant cost reduction through resource arbitration

Improved Quality through Industrialised Processes

Increased flexibility through optimised demand management

Risk Transfer via unit based pricing model

Productivity gains via rigorous output based operating model

>2015

Outcome Based Model

Based on outcome / performance

T&M only

Unit / T&M Based

The Evolution of Testing Services

Testing services and engagement models have matured from a primary focus on labour arbitrage cost reduction to a combined focus on operational efficiency and gain share.

Page 14: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

Delivering in the Digital AgeNew Delivery ApproachesCurrent technology trends (like Social, Digital and Cloud) have increased the demand for faster delivery and shorter time to market. In response to this, methods and practices inspired by Lean principles have gained popularity. As such, Agile methods and DevOps practices have become the new norm for delivery. Accenture Delivery Methods include guidance for leveraging these practices in the context of project delivery. For example, testing is included in each sprint and is highly automated so that a working increment can be showcased at the end of each sprint.

Collaboration and Automation at the core of deliveryAccenture defines DevOps as: “Optimising Development and Operations to enable the realisation of business goals through rapid feedback and flexible IT”. The transformational nature of this change towards new delivery models require more than just purchasing tools or implementing certain techniques, it requires changes across the operating model of the organisation. Accenture has defined 10 principles for DevOps delivery, 5 are technical practices and 5 are organisational practices – testing is impacted by all of them. To achieve continuous delivery of value, testing has become a first class citizen that is embedded in every activity. Gone are the days of testing groups being a separate silo to development. Quality is everyone’s business in the new delivery model. This changes the responsibilities of the testing groups towards a more strategic and more technical group of experts – an Agile Testing Centre of Excellence. We are operating many of our engagements leveraging Software

Development Engineer in Test (SDET) functions and roles especially within Agile-based Digital Delivery Teams. Furthermore, as an extension to the TMMi  Assessment, Accenture leverages a DevOps Assessment Framework to assess, measure, score and define a roadmap to enterprise Continuous Delivery. Our experience ranges from Agile and DevOps practices on targeted areas of the business through to increasingly complex mapping of how to approach mixed delivery models across both Waterfall and Agile within the organisation.

Machine Learning and Touchless AutomationGiven limited time and resources, determining “what to test” is one of the biggest challenges facing the quality and testing industry today. Current risk-based-testing approaches are unable to scale up because either they are heuristics based or too rule centric. This is resulting in ‘over-engineering of testing’ leading to excessive cycle time and cost that is not commensurate with increased production quality. Testing needs to be more ‘defect targeted’ through deployment of techniques like usage modelling and failure modelling, multi-layer automation by taking advantage of data mining and machine learning technologies. Accenture is partnering with several private and academic bodies including MIT to develop what we believe will change the way testing is conducted industry-wide. We want to deploy new age and disruptive methodologies, tools and techniques to reduce time-to-go-live and cost of testing by over 50% and have already trialled the techniques at target companies globally.⁴

Figure 8: A combination of a number of components will lead to Agility at Scale

Fine-grained service architecture (API-first)

Cohesive teams with shared objectives

Embrace failure, recover automatically, degrade gracefully

Strong source control

Zero-touch build and deploy

Test early and often

Automate everything (in pipelines)

Lean principles and continuous delivery of value

Elastic supply of cloud resources

Experiment without regret

Continuous Improvement

14

Page 15: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

Why Accenture?

Complex DeliveryContinuous Delivery and DevOps practices have been part of the Accenture methodology for over 15 years. Through our heritage of High Performance Delivery, Accenture has been delivering complex programs using automation across digital and packaged enterprise applications.

Agile in the Real WorldAccenture is a gold partner of the Scaled Agile Framework (SAFe). Accenture combines SAFe with our experience from real-world delivery in large organisations to tailer an Agile delivery approach that works in the context of our clients. This tailoring is what makes Accenture Agile projects successful.

As a Service CapabilitiesBased on the Accenture Cloud platform Accenture offers Testing as a Service and a DevOps Platform as a Service for our clients. These services allow us to stand-up tools preconfigured with leading practices to accelerate the benefits gained from modern development methods.

Cloud PlatformAccenture Cloud Platform gives you the power and flexibility to manage your organisation’s production or test workloads simply and securely across both private and public clouds on demand, at speed and from a single point.

15

Page 16: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

Our Experience in Australia and New ZealandExtensive industry experience In ANZ, Accenture’s testing portfolio consists of a comprehensive list of clients across a variety of industries, including communications, media and technology, financial services, products, resources, and health and public services. Our focus is on engaging long term partnerships with our clients, adhering to our message of a holistic, end-to-end quality strategy as a way to drive cost savings through quality and productivity improvements, and reduce testing costs whilst increasing breadth of testing.

Accenture has a dedicated pool of senior resources with extensive testing experience in ANZ who are ready to provide services in test governance, strategic direction and program test management. We are capable of ramping up onshore and offshore test teams in a short period of time, either in partnership with client teams, or in a fully outsourced or managed service model, at the same time leveraging our extensive global TCoE network for support and experience.

Our experience in ANZ ranges from conducting numerous testing strategy and maturity assessments including definition of TCoE and IT Delivery Operating Models right through to fully managed testing services. We have the breadth and depth of experience and knowledge, drawing upon our local and global resources, to consult on targeted initiatives including (but not limited to) delivery metrics, test strategy, test automation, Continuous Delivery practice establishment, Agile Coach placement services right through to fully managed and outcome-based testing centres. We’ve performed these functions at scale for some of the largest companies in Australia and globally and understand the associated organisational and commercial realities of moving to the next level of enterprise delivery and testing maturity.

16

Page 17: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

17

Page 18: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

Client case studiesA communications leader saves $45 million and dramatically improves application quality with an intelligent test factory

This communications industry leader sought to take its application testing services to the next level. Accenture helped consolidate testing suppliers from five to two and establish an intelligent test factory that will save the company $45M over four years using an output-based commercial model. These dramatic savings are delivered through a greater than 95 percent offshore solution, a rapid transition of 550 FTEs in four months, and extensive automation supported by advanced tools such as the patent-pending Accenture Intelligent Tools for Test Operations.

A large telecom service provider was able to cut production defect rates in half with the help of Accenture’s testing solution

This large telecom service provider wanted to reduce application development and maintenance costs and enhance application performance by streamlining its quality assurance and testing processes. Accenture set up a Testing Center of Excellence (TCoE)—leveraging its global delivery capability—to help the client drastically reduce production defect count by approximately 97 percent, transition from a waterfall to an Agile development model and improve quality by implementing test automation frameworks, leveraging Accenture Intelligent Tools.

A leading bank significantly improves speed-to-market with testing automation solution

Following a series of large acquisitions, this leading bank needed to ensure seamless service to its existing and acquired customers while radically simplifying its application portfolio. Accenture helped the bank achieve these goals and enabled faster time to market for new application releases by establishing a Testing Centre of Excellence to automate the testing efforts for more than 300 applications used by the consumer banking division, including mobile and online banking applications. The automated testing efforts reduced the risk of migration, and ensured error-free applications 98 percent of the time.

18

Page 19: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

Analyst recognitionAccenture Named “Undisputed Number One” in Innovation in HfS Report on Application Testing Services

“Accenture has established itself amongst the Leaders in independent testing services through meaningful investments in building capabilities across the testing services portfolio (testing CoEs, proprietary solutions, delivery workforce, etc.). Legacy strengths in consulting and system integration has helped Accenture position itself strongly in the testing strategy, assessment space.”5

“Largely due to its software testing relevance and to the overall dynamics of Accenture, Accenture Application Testing Services is well positioned to beat the market.”

“Accenture’s IP and tools strategy and breadth of accelerators is comprehensive. One of its main benefits is to expand from test execution purely to include test design. Accenture Application Testing Services’ strategy is to further enhance its IP and tools, focusing on industry-specific test repositories, test execution tools, and test design and QA accelerators. One of the specificities of Accenture is focus on bringing automation and accelerators early in the SDLC.”6

HfS7 Research positions Accenture as an innovative global service provider, focused on business transformation and evolving toward predictive testing.

In August 2015 HfS Research published its “HfS Blueprint Report: Application Testing Services,” placing Accenture firmly in its

“Winners Circle” for both innovation and execution and naming Accenture as “the undisputed number one” in testing innovation.

According to HfS Research, Accenture added a strong narrative focused on business transformation and evolving towards predictive analytics, underpinned by significant R&D in machine learning and cognitive computing, coverage of the emerging digital spectrum and deep vertical and industrialisation capabilities. (footnote link to article)

19

Page 20: Accenture Application Testing Services Australia … Application Testing Services Australia and New Zealand ... Maturity Diagnostics aligned to the Testing Maturity Model (TMMi),

References1 Accenture High Performance IT research

2 Testing as a Service (TaaS)

3 WhiteHat “2015 Website Security Statistics Report”. Read here.

4 HFS Research: Accenture pushes envelope testing services artificial intelligence. Read here.

5 Accenture Technology Vision 2016

6 Copyright NelsonHall: Outsourcing Vendor Profile of Accenture – Software Testing March 2013

7 HfS Research is the leading independent analyst authority and community for the global business services and outsourcing industry. Download the Accenture excerpt.

Contacts To learn more about how Accenture ANZ can help your organisation reduce testing costs and improve productivity while embedding quality into the application development life-cycle, contact:

John Pickering Asia Pacific Testing Practice Lead [email protected]

About AccentureAccenture is a leading global professional services company, providing a broad range of services and solutions in strategy, consulting, digital, technology and operations. Combining unmatched experience and specialised skills across more than 40 industries and all business functions—underpinned by the world’s largest delivery network—Accenture works at the intersection of business and technology to help clients improve their performance and create sustainable value for their stakeholders. With approximately 373,000 people serving clients in more than 120 countries, Accenture drives innovation to improve the way the world works and lives. Visit us at www.accenture.com on

Follow us onfacebook.com/accentureaustralia

twitter.com/Accenture_Aust

youtube.com/accentureaustralia

linkedin.com/company/ accenture_australia

Copyright © 2016 Accenture All rights reserved.

Accenture, its logo, and High Performance Delivered are trademarks of Accenture. 15-4109