sqs der weltweit führende spezialist für software-qualität · pdf...

sqs.com

SQS – der weltweit führende Spezialist für Software-Qualität

RPD - RapidDeploymentPackage für SAP PBT - Prozessorientiertes Testing

SAP Testing

sqs.com


Agenda

• SAP SolutionManager 7.2 • CBTA - ComponentBasedTestAutomation

• SQS RPD – RapidDeploymentPackage for SAP

• Testautomatisierung mittels vorgefertigter Componenten

• SAP SolutionManager 7.2 • Solution Documentation / BusinessBlueprint

• SQS Process Based Testing • Prozessorientiertes Testing

© SQS Software Quality Systems Ges.mbH | Titel der Präsentation | Intern | Version 1.0 | 2

3 © SQS Software Quality Systems Ges.mbH | Titel der Präsentation | Intern | Version 1.0 |

SAP Solution Manager 7.2

CBTA - ComponentBasedTestAutomation

© 2016 SAP SE or an SAP affiliate company. All rights reserved. 4

SAP Solution Manager 7.2 – Test Suite Capabilities

Business Process

Change Analyzer (BPCA)

Test Execution • Manual Test Execution

• Automated Test Execution

• Defect Management

Test Managment Analytics • Gap reports

• Status reports

• Progress reports

• Dashboard

other 3rd party test automation tools

Change Impact Analysis

HP UFT

CBTA (Component Based Test Automation)

WS Certify

Test Plan Management • Test Plan

• Test Packages

• Test Sequences

• Tester assignment

Scope and Effort

Analyzer (SEA) Test scope estimation

before upgrade

Test scope optimization during upgrade

Solution Documentation • Executable Library

• Process Step Library

• Business Processes

Test Automation Framework

S/4HANA Test Experience*

Test Data SAP TDMS • Lean test system setup and refresh

Test Data Container (TDC) • Test data provisioning for manual and automated tests

Test Cases • Manual Tests

• Automated Tests

Solution Documentation Test Planning Test Execution and Analytics Change Impact

Analysis

* planned

HP UFT SAP TAO SAP Solution Manager Adapter for HP QC HP ALM

Supported UI technologies by SAP test tools: SAPGUI, WD-ABAP, CRM Web-Client, SAPUI5, Fiori, … Partner test tools: all other UI technologies

Integration for SAP customers already using

HP test suite


Automated Tests Test Configuration and its building blocks

Test Script

Business Process

…

HP UFT

System under Test Test Data

Test Configuration

other ISV test automation tools

Order Type Customer Product

OR C1000 P-100

OR C2000 P-200

Test Data Container

SAP customers have a choice of test automation tools integrated with SAP Solution Manager 7.2 through the Test Automation Framework

CBTA, eCATT

Certify Launch creation or maintenance

of automated tests

Composite Tests for E2E business processes covering SAP and non-

SAP process steps CBTA 1 CBTA 2 HP UFT 3 CBTA 4


Test Automation with CBTA

Component-based Test Automation (CBTA)

Business Analyst executes

business transaction via CBTA

Test Composition Environment (TCE)

CBTA creates test script based on test

components during execution

Attributes • Business Transaction • Systems under Test

Parameters • Parameters for test data inputs • Dynamic handover between scripts

Script Components

• SAP delivered test components • On the fly generated components

Test Data • Data defined in Test Data

Container • Test Data Assignment Wizard

CBTA (Component-based Test Automation) is part of SAP Solution Manager and

provides test automation for all major SAP UI technologies


Test Management Test Execution with automated test cases

LAB Preview

Test Configuration

Test Script SAP CBTA, HP UFT, …

System under Test

Test Data Container (TDC)

Logon and automated execution of business process

Test data selection

TDC

Test execution: handover of • Test Script + • Test Data + • Test System

User starts test execution

Test Script Test Data System Data

Tester Worklist Test results and logs

1

2

3

5

4


SQS RapidDeploymentPackage

Beschleunigung der Testautomatisierung mit vorgefertigten Componenten

SQS’ new smart business process testing approach for SAP SAP Knowledge Assets as accelerators

Requirements Writing TCs Execution

• Use existing test assets • Readily available for “n”

number of business processes

• Proven methodology • Expedited Testing • Reduced Effort

Traditional Testing methodology

SQS’s Smart Business Process Testing Approach

SQS Group | SQS Global SAP Testing Capabilities, Solutions & Services | 11

Knowledge Asset Management – SAP Functional Regression Testing (e.g. Upgrades, Roll-outs, Run-SAP type of projects)

SAP Reusable Assets/Accelerators

Module

Critical Business Process/Scenarios

Available in SQS Assets Logical Test Cases Finance & Controlling 19 490 Sales and Distribution 24 350

Materials Management 50 530 Production Planning 38 1120 Quality Management 14 210

Warehouse Management 17 160 Plant Maintenance 12 465

Human Capital Management 9 410 CRM Sales

11 600

CRM Marketing CRM Master Data (Account Management, Product

Management) IS-Utilities 73 585 IS-Retail 57 1390

IS-Pharma 82 130

List KAM Assets SQS Group | SQS Global SAP Testing Capabilities, Solutions & Services | 12

13 SQS Group | SQS Global SAP Testing Capabilities, Solutions & Services |

SAP Modules Logical test cases available in SQS Asset repository

Critical Business Process/Scenarios

available in SQS Assets

Business Process Test coverage %

Production Planning 850 38 80 %

Quality Management 120 12 80 %

Plant Maintenance 285 13 70 %

Organizational Management 20 1 80 %

Sales and Distribution 245 24 70 %

Material Management 210 50 85 %

Warehouse Management 115 17 85 % Customer Relationship Management 760 11 60 %

Finance and Controlling 250 18 70 %

COPA – Profitability Analysis 20 10 50 %

Example of SQS Assets Coverage: SAP ECC ERP (Manufacturing Customer)

SQS Test Automation FaQtory™ SAP Test Automation: Approach & Solutions

SQS is listed on the AIM London

Subject Matter Experts Test Architects Test Analysts

Batch runs of test cases

Identify Module & Test Cases

Designing Framework Function

Writing specifications

Accepting developed functions and test cases

Implementing functions

Implementing test cases

Code review

Single runs of test cases

Test specs Test design specs

Test FaQtory Assembly helps achieve scalability • Robust, maintainable & scalable SAP automation framework • Over 600 automated scripts maintained for ECC 6 (various enhancement Packs) • Extremely efficient execution and defect tracking mechanism

Test Assets

Test

Automation

FaQtory

Designing Framework Designing Framework

QC TC Restructuring

QC TC Restructuring

Identify Test Cases

Back


SQS-TEST®/Professional Suite and Solution Manager


Test Management

Solution Manager SQS-TEST®/Professional Suite

Business Process Repository (Business Process Hierarchy)

(B.P.M / BPx)

Business Blue Prints Project Requirements/

Scope

Test Workbench

Test Planning

Design

Planning & Control

Execution

End to End Scenarios

Business Processes

Test Cases

Test Steps

Test Pack (step level control)

Test cases execution

Map hierarchy

Test results

Test Pack (Test Cases, Test Execution,

Test Reporting)

Upload results

Map Test Pack and

upload the Tc’s in

Excel/ Word

SQS RDP -> Solution Manager Übernahme von Testfällen

Business Blueprint

SAP Solution Manager

Download test assets from SQS test Professional

and upload to Solman


SQS SAP Testing Services Portfolio – Rapid Deployment

Quality Management

Health Check 1.1

Master Quality Plan 1.2

QA for Business Blueprints

1.3

QA for Implementation

1.4

Test Management

Test Strategy 2.1

Master Test Plan 2.2

Detailed Test Plan 2.3

Operational Test Management

2.4

Test Manage-ment Office

2.5

Functional Testing

Data Migration Test 3.1

SAP Core Test & Optimization

3.2

Interface Test 3.3

End-to-End Test 3.4

Roles & Autho-rization Test

3.5

User Acceptance Test 3.6

Non-Functional

Testing

Load & Perfor-mance Test

4.1

Code Analysis 4.2

Infrastructure Test 4.3

Security Test 4.4

Operations Acceptance Test

4.5

Test Infrastructure

Test Environment Management

5.1

Test Data Management

5.2

Test Automation for Regression

5.3

Test Tools for SAP Testing

5.4

Training

ERP Testing Overview

6.1

ERP Test Automation

6.2

ERP Load & Performance

Test 6.3

*Further information on each service could be provided upon request


SAP Testing Strategy and Differentiation


SAP Solution Manager 7.2

BusinessBlueprint


SAP Solution Manager 7.2 – Test Suite Capabilities

Business Process

Change Analyzer (BPCA)

Test Execution • Manual Test Execution

• Automated Test Execution

• Defect Management

Test Managment Analytics • Gap reports

• Status reports

• Progress reports

• Dashboard

other 3rd party test automation tools

Change Impact Analysis

HP UFT

CBTA (Component Based Test Automation)

WS Certify

Test Plan Management • Test Plan

• Test Packages

• Test Sequences

• Tester assignment

Scope and Effort

Analyzer (SEA) Test scope estimation

before upgrade

Test scope optimization during upgrade

Solution Documentation • Executable Library

• Process Step Library

• Business Processes

Test Automation Framework

S/4HANA Test Experience*

Test Data SAP TDMS • Lean test system setup and refresh

Test Data Container (TDC) • Test data provisioning for manual and automated tests

Test Cases • Manual Tests

• Automated Tests

Solution Documentation Test Planning Test Execution and Analytics Change Impact

Analysis

* planned

HP UFT SAP TAO SAP Solution Manager Adapter for HP QC HP ALM

Supported UI technologies by SAP test tools: SAPGUI, WD-ABAP, CRM Web-Client, SAPUI5, Fiori, … Partner test tools: all other UI technologies

Integration for SAP customers already using

HP test suite


System Landscape and Solution Documentation

System Landscape

SAP ERP

DEV

QAS

PRD

QAS

DEV

PRD

Single source of truth

SAP CRM

Solution Documentation

SAP SRM

QAS

DEV

PRD

Solution: <Solution title>

Branch: • Production

• Maintenance • <e.g. Innovation>


SAP Solution Manager 7.1 – selected pain points

in Projects and Solutions 2 different directories with different functionality for Projects and Solutions

Performance issues in both Directories

Limitation to 3 level hierarchy (Scenario Business Process Process Step)

Insufficient and nonflexible Lifecycle Management

Architectural limitations for enhancements requested

…

TO DO


How to setup the Business Blueprint

Alternatives to create Process Step Library (PSL) 1. Automated Blueprint generation program

RUTILITY_BLUEPRINT_GENERATION via SAP Note 2061626 (SP10 and beyond)

Application „Scope and Effort Analyzer“ (SP11)

2. Solution Documentation Assistant

3. MS Excel upload

Thousand of users execute SAP transactions every day

Sales:

Create Sales Order, …

Financials

Billing HR:

Employee absence

Usage statistics can be used to build-up the initial Blueprint (PSL)


Solution – Branches - System Landscape

Solution Administration (Transaction SLAN): Business Solution (BUSINESS_SOLUTION)


Solution Documentation Libraries and Business Processes

ERP Scenarios

Sales Scenarios

Quotation

Business Processes

Sales Order STD

Order to Cash V1

Goods Issue

Billing

Delivery

Executables

SD

Quotation (VA21)

Library

Sales Order (VA01)

SD-SLS

Goods Issue (VL02N)

Billing (VF01)

Delivery (VL01N)

SD-BIL

LE-SHP

LE

Technical functions

Z_Price_Determination

FUNC

Customer Exe

Dev Class 1

ZVA01 Process Steps

Sales Order STD

Sales Order Special

Quotation

Sales Order Special

Order to Cash V2

Goods Issue

Billing

Delivery VA01, VA02, VA03

ZVA01, …


Solution Documentation Executable Library

Generated Executables (like transactions) for SAP ERP system


Solution Documentation Process Step Library

Process Steps defined in Process Step Library with reference to executables from Executable Library

and assigned Test Cases


Solution Documentation E2E Business Processes

Business Processes „Order to Cash“ defined in Business Process section with reference to Process Step Library and Executable Library.


Solution Documentation Process Diagram for Business Processes


Solution Documentation with built-in lifecycle Management Branch concept

Production branch

Maintenance branch

Innovation branch Release 1 Implement baseline processes

• Single Function Tests (SFT) – QAS System • User-Acceptance Tests (UAT) - QAS • Functional Integration Tests (FIT) - QAS • Regression Tests (RT) - Pre-PRD System

Go-live of Release 1

Release 1 changes visible

Go-live of Maintenance changes

Release 2 Implement add.processes

• Single Function Tests (SFT) • User-Acceptance Tests (UAT) • Functional Integration Tests (FIT) • Regression Tests (RT)

Maintenance changes • Execute RT

The branch functionality records all changes (blueprint nodes, test cases, TBOMs) and provides life-cycle support


Solution Documentation with built-in lifecycle Management Branch concept – simple example

Production branch

Maintenance branch

Innovation branch Release 1 • Order-to-Cash (O2C) V1 • Procure-to-Pay (P2P) V1

Go-live of Release 1

Release 1 changes visible

Go-live of Maintenance changes

Release 2 • O2C V2 • SFT, UAT, FIT • Define regression tests • Execute regression tests

Maintenance change: • Customizing change for

O2C V1 • Execute RT

sqs.com


Process based Testing: Vision zur Effizienzsteigerung

sqs.com

Act

Akt Akt Akt

SubP Akt Akt

SubP Akt

SubP

BP Step

BP Step BP Step BP Step

BP Step BP Step

BP Step BP Step

System Process / Business Function

Entsch BP Step

System Process

System Process

System Process

Domain A

Domain XYZ

Vorgehen - Die zwei Layer eines Geschäftsprozessmodells Process based Testing (PbT)

Act

Akt Akt Akt

SubP Akt Akt

SubP Akt

SubP

BP Step


BP Step BP Step

BP Step BP Step

Business Process

System Process

Entsch BP Step

System Process

System Process

System Process

BP Step


BP Step BP Step

BP Step BP Step

Business Process

EntschEntschEntschEntschEntsch BP StepBusiness Layer existiert

Act

Akt Akt Akt

SubP Akt Akt

SubPAkt

SubP

System Process

System ProcessSystem Process

System ProcessSystem ProcessSystem Process

System Process

Application Layer (Ebene 4) wird erstellt

Application Layer = • Business (&System) Functions • + Interfaces

Existiert in ARIS,ADONIS oder als ppt-Bild

Systemprozesse werden in VISIO erstellt und sind damit elektronisch auswertbar

Geschäfts-Prozesstest abgeleitet aus der Prozessmodellierung

Process based Testing (PbT) - Ziele

• Es gibt eine Technik „PbT“ (Process based Testing) bei der die Prozessmodellierung die Basis für den GP-Test ist

• Die GP-Modellierung wird erweitert um die bei Ihnen bereits genutzte Systemebene 4. Der Abdeckungsgrad lässt sich risikobasiert definieren

• Das Design der Testfälle wird automatisch (ohne Aufwand) abgeleitet. • Ablage der Testfälle im SolutionManager erfolgt über vorhandene

Schnittstelle • Redundante Informationen werden vermieden – Jede Information existiert

nur an genau einem Ort in einem Modell - der GP-Dokumentation - Inkonsistenzen und Pflegeaufwand werden extrem minimiert

• Einhalten der regulatorischen Vorgaben – Ableitung (Anforderungen zu Test) , Abdeckung, Nachvollziehbarkeit, Dokumentation, Risiko-basiertes Testen (Pfadabdeckungen werden generiert)

33 © SQS Service Management | PbT| 03.06.2016

Das Test-Modell ist eine Erweiterung des Prozessmodells

IT Portfolio gesamt

Geschäftsprozess- Modell

Design, Programmierung, Roll Out, …

Test fälle für Funktionale Tests

(Konfiguratinosabdeckung)

ManuelleTest Ausführung / Automatisierte Ausführung

Systems

Business- und System Requirements

(auch als Delta)

Test Modell

Process based Testing (PbT)


1. Vom “Business Layer” werden die Testfälle ermittelt, die zu einem Integrationstest, Abnahmetest oder auch End-2-End Test gehören

2. Vom “Application Layer” werden die Testfälle für den Funktionstest oder Dialog-Test oder Szenarien-Test automatisch abgeleitet

2. Vorteile PbT Überblick - Optimierter Testprozess

Process Based Testing (PbT)

36 © SQS Service Management | TIRP| 03.06.2016

Effiziente Qualitätssicherung • Auf der Grundlage von Geschäftsanforderungen durch

Prozessmodellierung auf Geschäftsprozessebene • Auf der Grundlage von Systemanforderungen durch Prozessmodellierung

auf Applikationsebene Verbesserung/Erleichterung des Projektmanagements

• Durch vollständige Transparenz (& durch KPI`s) V 0.17 V0.21

Processes Total of designed Processes 204 262Total of designed Processes Prio A, B, C BP 18 27

SP 69 118Unchanged since V0.17 BP x 13

SP x 62Objects/Screens 147 157

Branches Total of integrated Branches 282 362Total of integrated Branches in Prio A, B, C 257 323

Maturity Average completeness of BusinessLayer A, B, C in % BP 85,68 86,48Average completeness of ApplicationLayer A, B, C in % SP 83,18 71,69

2. Vorteile PbT Überblick - Optimierter Testprozess

Process based Testing (PbT)

• Strukturierte und übersichtliche Spezifikationen von Testmodellen, anhand derer Testfälle nach einer formalen Methode generiert werden

• Minimierung des Zeitaufwandes für die Umsetzung von Change-Request bis zu konkreten Testfällen, die in verschiedenen Teststufen ausgeführt werden

• Reduzierung der Kosten für das Testfalldesign im Produkt-Lifecycle. Testfallerstellung erfolgt durch den Generator ‚Process Notation Processor‘ per Knopfdruck

• Steuerung der Abdeckung durch selektive Generierung der Pfade risikobasiert - komplett in Abhängigkeit von Bedarf, Zeit, Kosten

• Wartung der „Testfälle“ zentral im GP-Modell • Systemmodell in Visio ist interpretierbar und damit nutzbar für GP-

Simulationen, Testfall-Generierung, Code Generierung etc. • Fertigstellungsreife ist in Stufen realisier- und nutzbar


In Projekten nachgewiesener Nutzen von PbT Process based Testing (PbT)

• Prozessmodel wird vom Product Owner (Fachbreich) freigegeben • Beschreibung der Testfälle detailliert und wiederverwendbar • Fachbereichsmitarbeiter werden für den Test nicht mehr benötigt • Automatisierung der Testdurchführung, Erstellung der Skripte ist

automatisiert durchführbar • Time-to-Market wird beschleunigt • Regulatorische Anforderungen werden erfüllt – Nachvollziehbarkeit des

Vorgehens, Tracebility Anforderungen - Tests • Durchgängiges Vorgehen, Interpretierbarkeit des Visio-Modelles und GP-

Modelle werden weiter verwendet • Wirtschaftlichkeitsrechnung, RoI < 2 Jahre konnte in Projekten nachgewiesen

werden


PbT ProcesModel contains Epic and extracts UserStory ProcessedBasedTesting im agilen Umfeld


Epic UserStory Incl. Requirements

SCRUM ProcessedBasedTesting im agilen Umfeld


UserStory incl. Req

© SQS Software Quality Systems AG | Industrialisation | Dec 2015 | 42

User-Acceptance-Test

Development / Realization /

Implementation

Actor/Events BP+SP Cutting BPS Creating

Path Design = Concrete TestCases =

Simulations

Business Requirements Specification

BP+SP Design TestConditions

Project Order with high level Requirements

Product(s) maintained, Documentation, etc.

New V-Modell as Baseline for Epic and extracted UserStorys

Integrationtest

Configured Extractions from Constructionplan

Componenttest

Process+Path SignOff

Systemtest

5 % 25 % 70 % 95 % 100 %

Maturity UAT executed here!

Welche Vorgehensweisen aus dem klassischen Umfeld lassen sich im agilen Vorgehen einsetzen?

ProcessedBasedTesting im agilen Umfeld


sqs.com

SQS Software Quality Systems Ges.mbH Hietzinger Kai 67–69 1130 Wien, Österreich Telefon: +43 1 3193523-0 Telefax: +43 1 3193523-24 [email protected]

Vielen Dank für Ihre Aufmerksamkeit.

((Bitte wenn gewünscht ergänzen)) Name der Kontaktperson Telefon: +43 1 XXXXXXX Mobil: +43 XXX XXXXXXXX [email protected]

mailto:[email protected]




sqs der weltweit führende spezialist für software-qualität · pdf...

Documents