gfn performance test volumetrics- v0.2.docx

Horizon 3

Shell Horizon 3 Performance Testing

GFN Performance Test Volumetrics

Customer : ShellContract number : 11/0330/GLPLBusiness/project number : 4014/EC231690Project Manager : Robert McMurdoProject/document reference : H3.15.03.01.02Issue : 0.1Issue date : 20/08/2012

Status : DraftDistribution :

Prepared by : Max HuntPerformance Testing Consultant

Reviewed by : Robert McMurdoPerformance Testing Team LeadDate:

John Quinn Technical ArchitectDate:

Checked by : Robert McMurdoPerformance Testing Team LeadDate:

Approved (Logica) :

Authorised (Logica) :

© Logica plc 2012.This document and its contents are the confidential property of Logica plc. It should not be copied, reproduced, modified, altered, or circulated to any third party, in any form or media, without the prior written consent of Logica plc.

document.docx page 1 of 12

Horizon 3 - H3.15.03.01.02 / Issue 0.1

20/08/2012

Amendment history

Date Issue Status Author0.1 For Level 2 review Max Hunt

References

Reference no.

Date of Issue

Issue Title Author

1

18/01/2011 0.2

Horizon3 (H3) Technical Solution Description:Horizon 3 > 06 Contract > 12 Archive

John Quinn

2

25/05/2011 V1.0

Phase 2 H3 Card Issuing Platform HLD v1 0 Horizon 3 > 31 Transformation Architecture > 01 High Level Design > 01 H3 Phase 2 Card Issuing Platform HLD V1 0

John Quinn

3

Not issued V2

Cards Activities Guilaine v 2

Guilaine Bras

4

Not Issued

GFN Sizing MH

Max Hunt, based on Ref 3.

5 Excel spreadsheet- Not issued separately. Embedded in Appendix B3

n/aH3 Territory Statistics v0.7(Master)

Via John Quinn

8 Excel spreadsheet- Not issued separately. Embedded in Appendix B3

n/a Rollout Volumes Jonathan Hill

document.docx© Logica plc 2012.

page 2 of 12

Horizon 3 - H3.15.03.01.02 / Issue 0.1

20/08/2012

Detailed contents

1 Background................................................................................................................4

2 Document Function....................................................................................................5

2.1 Objectives of this document..............................................................................52.2 Audience for this document..............................................................................52.3 Scope of this document.....................................................................................52.4 Source material.................................................................................................5

3 Peak GFN Transaction per hour estimation................................................................6

3.1 Overview...........................................................................................................63.1.1 Summary of findings.......................................................................63.1.2 Analysis method..............................................................................63.1.3 Analysis for the Philippines..............................................................83.1.4 Analysis of Global throughput.........................................................8

Appendix A - Appendix......................................................................................................12


page 3 of 12

Horizon 3 - H3.15.03.01.02 / Issue 0.1

20/08/2012

1 Background

The Horizon3 (H3) Technical Solution Description (Ref 1) and High-Level Design (Ref 2) documents give further information regarding the business background and an introduction to the new system (H3 IT Platform).

Within the new IT Platform, the core application system is Global Fleet Net (GFN). GFN has its own GUI used by Shell and Logica staff who administer the Fuel Cards service.

A dedicated front-end web based application, Shell Cards OnLine (SCOL) allows Shell customers, i.e users of their Fuel Cards, to do self-service account maintenance operations, for example, view bills and request new cards.

An existing Shell application SuperSiras is to be replaced by GFN. A new version of SCOL is under development to work with GFN, and it has been radically changed for H3. It is critically dependent on web services provided by GFN. GFN is generally immature and the web services used by SCOL or GFN are not believed to have had any performance testing. Once rolled out globally, GFN will be used by the call centre users. The hardware server resources available to GFN and SCOL have not been specifically sized for the anticipated loading, although the GFN servers are powerful.

Altogether, the performance of the SCOL online system in combination with GFN is viewed as one of the higher risk areas within the H3 IT Platform and therefore a priority for performance testing. Given the relatively low user base in the Philippines, the risk for PH is low, but the risk will increase as the rollout progresses and the user numbers increase.

This document is the analysis work that defines the volume requirements for performance testing of GFN.


page 4 of 12

Horizon 3 - H3.15.03.01.02 / Issue 0.1

20/08/2012

2 Document Function

2.1 Objectives of this document

This document specifies the estimated volumes to undertake performance testing of the GFN application.

This document should give enough detail so that the offshore testing team can perform the tests without resorting to other documentation.

2.2 Audience for this document

The audience for this document is the performance testing team and interested parties within Logica H3 programme. They will use this document to help define performance tests scenarios to use with Loadrunner, or any other testing tool against the GFN application.

2.3 Scope of this document

The scope of this document is to detail the assumptions and methodology used in defining the volumetrics for performance testing the GFN application. It details the business transactions per hour for several countries and an estimate of the global throughput for GFN.

2.4 Source material

The main source material is Reference 3 (Cards Activities Guilaine v 2). This material has several features to note:

It is data from 2010, and only covers 10 months

It is only concerned with substantial transactions ie. not just a search but a more complex transaction that will involve a search and editing data.

It only covers 16 countries.

These features were borne in mind and taken account of during the analysis.


page 5 of 12

Horizon 3 - H3.15.03.01.02 / Issue 0.1

20/08/2012

3 Peak GFN Transaction per hour estimation

3.1 Overview

The following section show the analysis methods used to estimate the projected transactions per hour that will be experienced by GFN.

The results in this section are derived from analysis of spreadsheets of calls received in call centres and rollout estimation spreadsheets. This information was imported into Excel, analysed and refined, adding contingency to achieve the final figure.

3.1.1 Summary of findings

The throughput requirements for the performance testing of the perceived global GFN

Global throughput: 2325 business transactions per hour

Philippines throughput: 130 business transactions per hour

Hong Kong throughput: 70 business transactions per hour

3.1.2 Analysis method

The analysis was done in two stages.1. Estimates for the Philippines and Hong Kong were based on real call centre

data available for 16 countries.2. The global throughput figure for the 32 countries expected to use GFN was

extrapolated from the data used in Stage 1.

The main source of call centre data was contained in Reference 3. This Excel spreadsheet gives actual volumes of calls to call centres, split by country, call type and type of transaction. It gives both voice and non-voice received ‘calls’ or transactions for 10 months in 2010. The summary sheet is shown in table 1.


page 6 of 12

For example, table 1 is the summary tab of Reference 3 ( ):Table 1- Summary Page

Total Interactions 01-Jan-10 01-Feb-10

01-Mar-10 01-Apr-10 01-May-10 01-Jun-10 01-Jul-10 01-Aug-10 01-Sep-10 01-Oct-10

Grand Total

Austria 2895 2830 3791 3931 2781 3303 3661 4251 3525 3493 34461Belgium 13613 12015 20836 17074 14624 12856 12260 15110 14396 12613 145397Denmark 24779 23386 27015 21504 23012 23301 22035 24171 23087 19758 232048Finland 5828 4928 5827 4528 3879 4956 4953 5835 4576 4587 49897France 34 5250 6072 9566 9590 30512Germany 21955 21122 24533 24095 23529 26891 26260 24013 25290 21822 239510Hong Kong 5942 4413 8057 6791 6595 6825 10190 9144 7100 7306 72363Italy 20 17709 16856 22967 25509 83061Luxembourg 2364 1920 2963 1472 2116 1430 1627 3875 1717 1377 20861Netherlands 20538 16011 19397 23745 15361 19488 19907 15212 19646 17893 187198Norway 10641 9600 12646 10630 8490 9418 7721 9867 10414 8987 98414Pakistan 23 7743 6141 5951 7339 5911 5712 7711 46531Philippines 13461 14172 18579 16066 12511 11579 14385 13020 12176 11520 137469Sweden 20879 20370 22777 20430 21892 19189 14471 17347 15926 13572 186853Thailand 21195 15210 24562 21034 18757 20977 21214 21921 20422 17952 203244Turkey 10758 28834 39592United Kingdom 31032 27199 30277 26002 22162 21915 23784 22690 22525 21130 248716Grand Total 195122 173176 221283 205045 181850 188133 212766 215295 229803 233654 2056127


3.1.3 Analysis for the Philippines

1. The peak month for PH was March 2010 with 18579 ‘tasks’ (highlighted). This was rounded up to 19000.

2. To estimate the tasks per day 19000 is divided by 30. This equals 633 tasks.3. 633 was rounded up to 650This subtotal gives us the average transactions per day of 650 on a busy month. However we want to estimate the peak hour throughput.

Based on analysis done for SCOL v3 using IIS logs of SCOL v2 logs(ref 6) peak hour throughput rates are approximately 50% higher than the average rate per hour in normal working hours.

4. The average tasks per hour 650/8 = 81.25. Round up to 85.5. Therefore the peak tasks per hour = 85 * 150% = 128. 6. Round this up to 130.

The estimated peak hour throughput for the Philippines is 130 transactions per hour.Using the same rounding up and estimation technique the figure for Hong Kong is 70 business transactions per hour.

3.1.4 Analysis of Global throughput

The source data only covered 16 countries. GFN is due to be implemented in over 30 countries. Therefore the ‘missing’ countries needed to be identified and their predicted use of the system needed to be estimated.

The method used was :1. Identify the missing countries2. Gauge the relative size of each missing country3. Estimate the average transaction per month for each missing country size4. Add those transactions to the global figure 5. Use the same formula as stage 1 to estimate the potential peak hour on average day in a peak month.

1. Using Reference (n) Rollout Volumes and cross checking with reference Nn) the contract 20 countries were identified to have GFN but were not in the source data. These countries were:Malaysia, Czech Republic, Poland, Hungary, Slovakia, Spain, SingaporeBulgaria, Romania, Slovenia, Greece, Russia, Croatia, Lithuania, UkraineMacau, Latvia, Gibraltar, Portugal, Estonia

2. The ‘Size Indicator’ column from Reference x (the ‘Territory Stats Spreadsheet) was used to assign the missing countries into 3 for largest, 2 for medium and 1 for smallest. Of the 20, 4 are medium; Malaysia, Czech, Poland, Thailand. The other 17 came out as small. This categorisation compared to transactions roughly aligned to Largest = >1.5 Mill txn/month, Medium = 0.5Mil to 1.5Mil txn/month and Small = <0.5Mil txn/month from the figures in the ‘Rollout Volumes’.

3. This sizing was then mapped to Guilaines spreadsheet so the original 16 countries listed in the spreadsheet had a 1, 2, or 3 assigned to them, based on their ‘transactions per month figures in Reference x. I then needed to estimate the average transactions per month for medium and small countries in Guilaines Spreadsheet.Ignoring some anomalies I then averaged the ‘transactions/month’ figures from Guilaines sheet for each Sizing group.


Horizon 3 - H3.15.03.01.02 / Issue 0.1

20/08/2012

This gave averages in Guilaines spreadsheet of 23k/month for large, 13k/month for medium and 3.5k/month for small countries. This gives the business transaction information needed to be added to the ‘global’ figures in Guilanes spreadsheet.

4. I then ‘added’ 4 x medium 13k/month entries and 16 x small 3.5k/month entries to Guilanes spreadsheet corresponding to the sizing estimates for the 20 other countries.

The result of adding this information to the original spreadsheet are shown in Table 2. The blue font shows the additional information added. There are two extra rows (“extra 2’s” and “extras 3’s”) that show the extra transactions estimated from the analysis above. They add approximately 108K/month transactions to the worst month, March 2010, giving a figure of 363k/month as a global total for that month.

5. Using the same methods as before , for stage 1 the monthly figure is then divided by 30 for a per day figure, divided by 8 for an average hour in that worst month and then multiplied by 150% for a peak hour uplift, rounded up slightly throughout.

Which gives a figure per peak hour for global ‘substantial’ GFN transactions of 2325/hr.

Therefore the extra 20 smaller countries have added 825 transactions/hr to the previous estimate which was estimated at 1500/hr for the primarily largest 16 countries.


page 9 of 12

Table 2- Edited and amended Source data (font colour blue is added data)

Country01-Jan-

1001-Feb-

1001-

Mar-1001-Apr-

1001-

May-1001-Jun-

1001-Jul-

1001-Aug-

1001-Sep-

1001-Oct-

10Grand Total Per year

Size Band

Ave

Ave for Size band

United Kingdom 31032 27199 30277 26002 22162 21915 23784 22690 22525 21130 248,716 298,459

324872 23000

Germany 21955 21122 24533 24095 23529 26891 26260 24013 25290 21822 239,510 287,412 3 23951Denmark 24779 23386 27015 21504 23012 23301 22035 24171 23087 19758 232,048 278,458 3 23205Thailand 21195 15210 24562 21034 18757 20977 21214 21921 20422 17952 203,244 243,893 3 20324Netherlands 20538 16011 19397 23745 15361 19488 19907 15212 19646 17893 187,198 224,638 2 18720 13000Sweden 20879 20370 22777 20430 21892 19189 14471 17347 15926 13572 186,853 224,224 2 18685Belgium 13613 12015 20836 17074 14624 12856 12260 15110 14396 12613 145,397 174,476 2 14540Philippines 13461 14172 18579 16066 12511 11579 14385 13020 12176 11520 137,469 164,963 2 13747Norway 10641 9600 12646 10630 8490 9418 7721 9867 10414 8987 98,414 118,097 2 9841Italy 20500 20500 20500 20500 20500 20500 17709 16856 22967 25509 83,061 99,673 2 8306Hong Kong 5942 4413 8057 6791 6595 6825 10190 9144 7100 7306 72,363 86,836 2 7236Finland 5828 4928 5827 4528 3879 4956 4953 5835 4576 4587 49,897 59,876 1 4990 3500Pakistan 6500 6500 6500 7743 6141 5951 7339 5911 5712 7711 46,531 55,837 1 4653Austria 2895 2830 3791 3931 2781 3303 3661 4251 3525 3493 34,461 41,353 1 3446France 7500 7500 7500 7500 7500 7500 5250 6072 9566 9590 30,512 36,614 1 3051Luxembourg 2364 1920 2963 1472 2116 1430 1627 3875 1717 1377 20,861 25,033

12086

extra 1's 0 0 0 0 0 0 0 0 0 0 0 0extra 2's 52000 52000 52000 52000 52000 52000 52000 52000 52000 52000 468,000 0Extra 3's 56000 56000 56000 56000 56000 56000 56000 56000 56000 56000 504,000 604,800

3,024,642

Grand Total 229,622 315,676 363,760341,04

5 317,850 324,079320,76

6 323,295 327,045312,82

0


Horizon 3 - H3.15.03.01.02 / Issue 0.1

20/08/2012

Appendix A - Appendix


page 12 of 12

gfn performance test volumetrics- v0.2.docx

Documents