apm - performance management (2)

ETIHAD ETISALAT COMPANYInternal Audit Department (IAD-A)

PLANNING MEMORANDUM

Audit Number: IT 2014-311 Audit Title: Performance & Quality Management

Scheduled: 17 Dec2014 Client: Network PerformanceBudgeted Man Days

50Lead Auditor:

Faisal Khan

Proposed Man Days:

50Assistant Auditor:

Samer Itani/Hamid Masood

Background

Performance Management is performed to ensure network availability, acceptable network quality, and great experience for subscribers, while avoiding additional CAPEX. Performance management involves monitoring the network service activity in order to adjust or improve network performance and traffic management. Network Performance is a continuous process that is required as the network evolves due to subscriber growth, network enhancement or coverage.

Network performance is the target evaluation of the network based on design goals versus the performance achieved, while Network optimization is performed to improve the performance of the network with existing resources. The dynamic nature of mobile network caused by network expansion, subscriber growth and new service launch creates multiple challenges for operators to know exactly where the performance of the network stands compared to the design objectives. However, the optimization goal is to better utilize existing network resources and solve potential problems to identify possible solutions for future planning. Through Network Optimization, the service quality and resources usage of the network are greatly improved to achieve a balance between coverage, capacity and quality.

Performance management evaluates and report upon the behavior of network equipment and the effectiveness of the network. Therefore, a continuous and real-time review of network performance assists inidentifying and eliminating problems before impacting services and customers.

Performance Management Process

At Mobily, Network performance team monitors the performance through Performance Statistical Alarm (PSA) using various tools to report any kind of abnormalities.

Once abnormalities are detected as a KPI trend, the Performance team informs the operation team in the form of a trouble ticket that includes the severity, problem description, affected nodes, and trouble start date and time.Operations analyses the trouble ticket and raise it to the related vendor to take the appropriate actions as needed based on the severity of the ticket as per the Service Level Agreements (SLA).

In order to deliver High-Qualityservices, Mobily have partnered with vendors (Huawei Alcatel, Nokia, Ericsson, and Samsung).Each vendor monitors their Key Quality Indicators (KQIs) and Key Performance Indicators (KPIs)and the associated thresholds through statistics on network availability and service degradations.

1


PLANNING MEMORANDUM

Huawei Network Performance Process Flow

Figure 1AHuawei Network Performance Process

Ericsson Network Performance Process Flow

Figure 1BEricsson Network Performance Process

AlcatelNetwork Performance Process Flow

Figure 1CAlcatelNetwork Performance Process

2


PLANNING MEMORANDUM

NokiaNetwork Performance Process Flow

Figure 1DNokia Network Performance Process

SamsungNetwork Performance Process Flow

Figure 1ESamsungNetwork Performance Process

3


PLANNING MEMORANDUM

Performance Management Organizational Structure

At Mobily, the Network Performance Management is a department under the Network Strategic Planning and Support,headed by Mr. Salim S. Aldweik - Director Networks Performance Management. The Performance team assists Network Operations and Planninginidentifyingand reporting on Network congestionsaimed to further improving

Network Performance and Quality of Services.

Figure 2A Organization Structure of Network Performance Team

In coordination withvarious groups,performance management department grinds on the improvement of network performance based on measured and evaluated utilization,optimization andavailability of network resources. The Department analyzes the network performance across regions providing technical recommendation to manage the network in-line with the global strategy in order to ensure high capability. Major performance processes focus on the preparation of appropriate documentation for assigned projects, while liaising with internal and external customers and third parties, to identify system faults and rectify or escalate them appropriately, to ensure rapid restoration of the network service. This may ensure the ongoing network development and guide reporting activities to oversee the overall performance availability and quality according to communicated KPI’s.

The network performance team is divided into four groups:

International Circuit Switching Core EngineeringMajor activities performed by the international CS Core team are to identify system faults and rectify or escalate them appropriately.

National CS Core EngineeringTeam activities focus on monitoring ofcore Call treatment, Trunk utilization, Signaling, Roaming and MPBN core utilization etc.

PS & Data NetworksThe team focuses on monitoring of packet switching, data network including availability, Nodes utilization and links statistics monitored by performance team.

Chief Technology Operations Officer Mr. Haitham Faraj

(Acting CTO)

Director Networks Performance ManagementMr. Salim S. Aldweik

International Circuit

Switching Core Engineering

Manager Mr.

Judwin Digo

National Network

Performance Engineering

ManagerMr. Frederick G.

Roxas

Executive Manager VAS,

PS & Data NPM Mr. Samer M.

Mahayni

Exec. Manager Access Network

Performance ManagementMr. Bilal El-

Skafi

4


PLANNING MEMORANDUM

Radio Access NetworksThe team focuses onmonitoring of accessibility, capacity, retain ability and data throughput.

Transmission Operations

While Transmission monitoring is not managed under Performance Department,its realized activities areunder the Operation and Maintenance umbrella, led by Mr. Waleed Yousef Laywad. His team is responsible for performance, Quality Assurance (QA) and integration.

5


PLANNING MEMORANDUM

Performance Management Technology & Vendor Distribution

Radio Access Network (RAN)

Region NSN Huawei Alcatel Ericsson SamsungEast - 2G, 3G & 4G 2G, 3G & 4G - -West/South - 2G, 3G & 4G - 2G, 3G & 4G 4GNorth 2G, 3G & 4G 2G, 3G & 4G - - -Central 2G, 3G & 4G 2G & 3G - - 4G

Figure 3AVendor Distribution of BSC/RNC & MME nodes for 2G, 3G & 4G

Figure 3BRegional segregation of BSC/RNC & MME nodes for 2G, 3G & 4G

Northern

NSN 2G, 3G & 4G

Huawei 2G, 3G & 4G

Eastern

ALU 2G, 3G & 4G

Huawei 2G, 3G & 4G

Central

NSN 2G, 3G & 4G

Samsung4G

Huawei2G and 3G

Western

Huawei 2G, 3G and 4G

Ericsson 2G, 3G and 4G

Samsung 4G

CENTRAL EAST NORTH WEST/SOUTH

BSC-2G 25 35 18 37

RNC-3G 94 64 68 22

MME-4G 5 3 5 3

1030507090

BSC/RNC/MME Per Region

BSC-2G RNC-3G MME-4G

6


PLANNING MEMORANDUM

CS Core Network

Nodes Ericsson HuaweiOberthur

TechnologiesRoamware

MSS 28 7 - -MGW 26 9 - -STP 10 2 - -MSC - 2 - -HLR 8 - - -HSS 2 2 - -

GMSC 7 - - -TMGW 5 - - -TMSC 5 1 - -ITSC 8 2 - -DSA - - 4 -RMS - - - 2Total 99 25 4 2

Figure 3CVendor Distribution of CS Core Network Nodes

Figure 3DRegional segregation of CS Core nodes

Ericsson

MSS 28

MGW 26

STP 10

HLR 8

HSS 2

GMSC 7

TMSC 5

ITSC 8

Huawei

MSS 7

MGW 9

STP 2

MSC 2

HSS 2

TMSC 1

ITSC 2

Oberthur Technology

DSA 4

RMS 2

Roamware

MSS

MGWST

PMSC

HLRHSS

GMSC

TMGW

TMSC

ITSC

DRADSA

RMS

2826

108

27

5 5 8

7 9

2 22

1 2 42

Mobily CS Core Device Count

Ericsson Huawei Oberthur Technologies Roamware

7


PLANNING MEMORANDUM

PS Core NetworkNodes Ericsson Huawei Citrix Byte MobileUSN 3 10 -UGW 4 10 -eDNS - 2 -iDNS 3 4 -

WAPGW - 2 3Total 10 28 3

Figure 3EVendor Distribution of PS Core Network Nodes

Figure 3FVendor Distribution of PS Core Network Nodes

Ericsson

USN 3

UGW 4

iDNS 3

Huawei

USN 10

UGW 10

eDNS 2

iDNS 4

WAPGW 2

Citrix Byte Mobile

WAPGW 3

USN UGW eDNS iDNS WAPGW Optimization (Citrix by mobile)

0123456789

10

34

3

10 10

2

4

23

Mobily PS Core Device Count

Ericsson Huawei Citrix Byte Mobile

8


PLANNING MEMORANDUM

Key Performance Indictors and Key Quality Indicators

Key Performance Indicators are used to measure the performance and effectiveness of network elements. KPIs are calculated based on counters maintained by network elements. Key Quality Indicators are used to measure the perceived quality of networks towards end-users. KQIs are calculated using several KPIs. The following are examples of major KPIs and KQI:

Service

Service KQI Service KPIAvailability MTBF, MTBRConnect time Loss of ServiceSuccessful call attempts Voice QualityFailed call attempts Voice DelaySignaling Voice clarityPDP utilization Data browsingPDP success rate Paging

Performance Management Thresholds & Key Performance Indictors

Key Performance Indicator (KPI) is a quantifiable metric of performance essential for operations and their thresholds are based on Key Quality Indicators (KQIs), these threshold values are mutually agreed between Mobily performance management team and vendors.Vendors are penalized if the degradation level or outage time exceeds the maximum threshold for the Hurdle/ Acceptable value. The penalties are charged when the SLAs are breached.

Below are the major Performance& Quality KPIs along with their thresholds and targets as set in the MNS contracts. These KPIs are applicable for the period starting from April 2014 to March 2015. Further, as per the MNS contracts, each vendor is supposed to provide a continuous improvement plan to improve these KPIs yearly.

Major KPIs &Thresholds

Success & Availability

KPI Service TargetHurdle

(Acceptable Value)Weight

1 Server & Link Availability KQI >99.99% >99.9% 1.0%

2Service Request Successful

KQI >99% >98% 1.0%

The service availability shows target key performance indicators for links.

Network Switching Subsystems Voice Service


(Acceptable Value)

Weight

1 Successful Signaling Attempt KQI >= 99.9% >= 99.8% 2.0%3 Call Completion Rate KPI >=98.0% >=97.0% 2.0%

3Location Update successful rate

KPI>=98.0% >=97.0% 2.0%

4 Handover Success Rate KPI >=96.0% >=95.0% 1.0%

5Authentication Successful rate

KQI>=98.5% >=97.5% 1.0%

6 Paging Success Rate KPI >=93.0% >=91.0% 1.0%

9


PLANNING MEMORANDUM

The Network Switching Subsystem (NSS) is the main part of the Mobile Switching Center (MSC) that performs the switching of calls between mobile and fixed network users.

Circuit Switching Fallback Service


(Acceptable Value)

Weight

1LTE to CSFB over SG Success Rate

KQI>=97.0% >=96.0% 1.0%

2 Location Update Success Rate KPI >=98.0% >=97.0% 1.0%3 End to End Paging Success Rate KPI >=92.0% >=91.0% 1.0%

Circuit Switching Fallback is a functionfor combining Long Term Evolution (LTE/4G) and Circuit Switching (CS)services likeVoice over LTE and 3G – Generation voice calls.

Access & Roaming Network Level


(Acceptable Value)

Weight

1Network Efficiency Ratio (NER) outgoing international

KQI>=92.0

%>=90.0% 1.0%

2Network Efficiency Ratio (NER) incoming international

KQI>=96.0

%>=95.0% 1.0%

3Monthly Average LU% SR for Top 10 Outbound Roamers to Preferred Partner/Operator

KQI>=96.0

%>=95.0% 1.0%

4Monthly Average % NER for Top 10 Outbound Roamers Preferred Operators

KQI>=92.0

%>=90.0% 1.0%

5Monthly Average % ASR for Top 10 Outbound Roamers Preferred Operators

KQI>=98.0

%>=96.0% 1.0%

Access and roaming shows the key performance indicators of international roaming which is the ability to automatically make and receive voice calls, send and receive data, or access other services when travelling outside the geographical coverage area.

Radio Access Network Level

KPIServic

eTarget

Hurdle(Acceptable value)

Weight

1 Call Setup Success Rate (%) KQI >=99 >=98.5 2%2 Call Setup Successful Rate(UMTS) KQI >=99% >=98.5% 2%3 PS R99 Connection Setup Success KQI >=98.5 >=97.5 1%4 UMTS Call Drop Rate CS - Speech KPI <=0.45% >=0.5% 2%5 Call Drop Rate (%) KPI <=0.45% >=0.5% 2%6 Handover Success Rate (%) KPI >= 98% >=97.5% 1%7 Overall PS Drop Rate KPI <=2% <=3% Reporting8 PS HSDPA RAB Drop Rate (%) KPI >=0.8% <=1% 1%9 RRC Establishment Success Rate

CSKPI

>=99% >=98.5% 2.5%

10 PS RRC Establishment Success Rate

KQI>=99% >=98.5% 2.5%

11 RAB Establishment Success Rate CS

KQI>=99% >=98.5% 1.5%

12 PS R99 RAB Establishment Success KQI >=97.5% >=96.5% 2.0%13 PS HSUPA RAB Establishment KQI 99.00% 98.50% 1.5%14 HS Accessibility -Overall KPI >=98.5% >=98% Reporting

10


PLANNING MEMORANDUM

Part of a telecommunications network which connects subscribers to their immediate service provider.

11


PLANNING MEMORANDUM

CellLevel

KPIServic

eTarget

Percentage of cells meeting the

thresholdWeight

City NodesRural Node

s1 Call Setup Successful Rate(2G) KQI >98% 90% 70% 1%2 Call Setup Successful Rate(UMTS) KQI >98% 85% 75% 1%3 Drop Call Rate (UMTS) KPI <0.6% 55% 40% 1%4 Drop Call Rate (2G) KPI <0.6% 55% 35% 1%5 HS Accessibility KQI >98% 87% 75% 1%6 HS Throughput KQI >2Mbs 75% 60% 1%7 Call Setup Successful Rate(PS) KQI >98% 85% 70% 1%8 LTE Accessibility KQI >99% 94% 91% 1%9 LTE Throughput KQI >3Mbs 50% 45% 1%10 RAB Blocking Rate PS KQI <0.2% 95% 90% 1%

Network consists of different cells and each cell transmits signals to and receives signals from mobile stations.

GPRS Level

Service Level Service TargetHurdle

(Acceptable Value)Weight

1 Successful PS Attachment 2G KQI >=98.0% >=95.0% 1.0%2 Successful PS Attachment 3G KQI >=99.0% >=98.0% 1.0%3 Successful PDP context activation 2G KQI >=99.0% >=98.0% 1.0%4 Successful PDP context activation 3G KQI >=99.9% >=99.0% 1.0%5 Inter RAU 3G KPI >=99.0% >=98.0% 1.0%6 PDP cut off ratio KQI <=0.0001 <=0.00015 1.0%7 Successful PS Attachment 4G KQI >=99.0% >=98.0% 1.0%

8Successful SAE Bearer context Activation 4G

KQI>=99% >=98.0% 1.0%

9 PDP context SR (Top 20 operator) KQI >=90% >=88.0% 1.0%General Packet Radio Service (GPRS) is a packet oriented mobile data service on the 2G and 3G cellular communication system's global system for mobile communications (GSM).

Tools

Network Performance Management team uses various tools to extract the reports and measure KPIs for RAN, Core & IP networks. Below are the tools that are used by various vendors for measuring the network performance.

Vendor Tool Tools DescriptionEricsson ENIQ Business Object client

Used to monitor Radio access, PS Core and CS core platforms for monitoring.

Ericsson ENIQ PortalEricsson Ericsson DashboardsHuawei Huawei M2000Huawei Huawei U2000 Used to monitor Transmission Platforms.Huawei Huawei PRS

Used to monitor Radio and PS Core platforms.Huawei Huawei MOS5200NSN Nokia NetAct Used to monitor Access and CS Core platforms.NSN Nokia Dashboards

Used to monitor Access platforms.ALU 2G NPO; 3G NPO and LTE NPOALU ALU DashboardsSamsung LSM- Radio (Jeddah)Samsung Samsung DashboardsAnritsu MasterClaw Business Objects

Used to monitor PS Core platforms.Anritsu MasterClaw DashboardsCacti Cacti traffic graphs

12


PLANNING MEMORANDUM

InfoVista InfoVista portal Used to monitor Access and PS Core platforms.Xius Lebara Dashboards Used to monitor CS Core platforms.

Performance Management Monitoring& Reporting

Performance Management involves continuous monitoring of data concerning the network elements; it is designed to measure the overall quality of performance, using monitored parameters to detect degradations.The extracted data is used to analyze faults, growth, and capacity of the network. Reports are useful only if accurate data is presented in a useful manner to the performance team.

At Mobily, various Daily, Weekly and Monthly reports are generated to monitor network performance through KPIs and KQIs for following:

Creating recommendations for performance improvement

Evaluating threshold rates

Forecasting network usage

Capacity analysis of the network

Major Network Performance Reports

CIRCUITSWITCHING PERFORMANCE REPORTS

Daily Weekly MonthlyDaily Core CS Performance Report

Subscriber per BSC and RNC wise

Monthly Core Network Utilization

Daily A Interface Utilization Report

2G Paging Success Rate (LAC wise)

Mobily MNS Monthly Report

Daily IGWs KPI Report3G Paging Success Rate for Huawei 3G LACs

Huawei MSC Level Subscribers& Traffic

Daily HSS Performance ReportWeekly Traffic/Subscriber Report.

2G/3G Subscribers Data

PACKET SWITCHING CORE PERFORMANCE REPORTS

Daily Monthly

Daily GPRS Performance Report Monthly MNS KPIs report

Gb Utilization Report Monthly MNS SLA report

2G REPORTS

Daily Weekly Monthly2G CS Daily Radio Network Performance Report of Huawei on Node Level.

BSC Utilization and CP Load Monthly MNS KPIs report

2G CS Daily Radio Network Performance Report of Huawei on Regional Level.

BSCs Performance KPIs for Huawei 2G

Monthly Meeting Report

2G PS Daily Radio Network Performance Report of Huawei on Node Level.

Weekly QOS KPIs Report on Regional level - Week #

Monthly TT Report

2G PS Daily Radio Network Performance Report of Huawei on Regional Level.

Weekly Hanging TRXs __

13


PLANNING MEMORANDUM

Top 10 of 2G worst and zero traffic cells Report of Huawei 2G.

__ __

3G REPORTS

Daily Weekly Monthly

3G Daily Analysis Report Weekly 3G report Monthly Report & Monthly TT Tracking

Top 10 Worst Cells and sleeping cells

Weekly QoS Report Utilization & congestion report-central & south

3G Key cities main highlightsWeekly Site Utilization, Capacity and Congestion Report-East region

Network topology performance KPIs report

4G – LONG TERM EVALUTION - LTE REPORTSDaily Weekly Monthly

LTE Daily Analysis ReportWeekly core utilization and congestion Report

Monthly Utilization Report

__ Weekly Task Utilization & congestion

MULTI-PROTOCOL LABLE SWITCHING PERFORMANCE - MPLS REPORTSDaily Weekly Monthly

MPLS Core Daily ReportNE 40- E MPLS Core traffic utilization Weekly Report

MPLS Core Monthly Report

__ RNCs & BSCs link Utilization __

14


PLANNING MEMORANDUM

Budget

During initial interactions it was noted that Mobily Performance team is operating on outsourced model through Managed Network Services (MNS) contracts and they don’t manage any budget on their own. However, they use performance services, human resources and tools from vendors having MNS contracts.

Managed Network Service contracts are depicted in the following table:

Vendor Contract IDBegin Date

Expiry Date

LOI Value Per Year *

Alcatel-Lucent318/2013/Alcatel-Lucent

Apr’2014

Mar’2015 SAR 37,794,000 SAR 37,794,000

Ericsson 318/2013/EricssonApr’201

4Mar’2017

SAR 653,084,724

SAR 217,694,908

Huawei 318/2013/HuaweiApr’201

4Mar’2019

SAR 817,153,585

SAR 163,430,717

Nokia Siemens Networks

318/2013/Nokia Siemens Networks

Apr’2014

Mar’2019SAR 408,720,000

SAR 81,744,000

ZTE 318/2013/ZTEApr’201

4Mar’2019

SAR 532,577,862

SAR 106,515,572.4

SAMSUNG 4G(LTE-TDD, Western region)

243/2010/SAMSUNGJan’201

4Dec’2015

SAR 124,994,880

SAR 62,497,440

*Data related to cost of performance has been requested and will be analyzed during fieldwork

15


PLANNING MEMORANDUM

Audit Objectives

The objective of this audit is to review and evaluate the adequacy and effectiveness of process, procedure, and technical controls covering key areas related to Network Performance.The audit will address the following audit objectives:

1. Adequate Governance Practices Pertaining to the Network Performance Function

To ensure that performance department is running in an efficient manner, governance framework is designed, well-structured, functional and regularly monitored.

To assess the adequacy of policies, procedures and its consistent implementation.

To review defined roles & responsibilities of selected staff and their duties are adequately segregated.

To assess and review the availability of skilled and experienced resources for network performance.

To assess the adequacy of documented authority matrix and its implementation showing management involvement in critical issues.

2. Network Performance Strategy

To assess that network performance strategy is driven by well-defined business objectives.

To review the process of considering internal and external factors in the network performance strategy for long term achievement and alignment with Mobily’s vision.

To determine that network performance strategy is approved, communicated, periodically reviewed and implemented.

3. Budget Management

To assess that adequate controls are in place for preparation, dimensioning, allocation & management of budget for applicable MNS contracts pertaining to network performance.

To review the alignment of network performance with business objectives and how performance plays a role in reduction of CAPEX.

4. Vendor Management

To assess and review Management Network System contracts against the approved KPIs, SLA’s & Penalties.

To assess that process is in place to keep KPI formulae definition uniform across all vendors.

To assess that adequate controls are in place for vendor resiliency and fair selection.

16


PLANNING MEMORANDUM

5. Adherence to Performance Principles

To review that performance management mechanisms are considered for network expansion and swap activities to ensure network quality and availability.

To assess that performance management evaluation for the network is conducted on regular basis and observations are considered for improvement.

To assess that approved and acceptable target levels of Key Performance Indicators and Key Quality Indicators are in place, monitored and escalated in timely manner.

6. Effectiveness of Network Performance and Quality Management

To validate that the performance team have effective processes in place to provide the required reports to relevant teams for actions in timely manner for better network availability.

To assess the validation of formulae and effectiveness of reports that are monitored and reviewed by performance team to provide network view for accurate future planning.

To follow up with concerned teams on reported degradations and previous audit results to ensure that proper steps have been taken to remedy the issues and confirm it through updated performance reports.

7. RAN, Transmission & Core Performance

To assess that end to end Key Performance Indicators (KPI) and Key Quality Indicators (KQI) are aligned throughout the call set up and the packet data flow.

To ensure all performance reports for Transmission network are addressing the required KPIs and the Quality of Service (QoS) of the transmission network.

To validate that the Radio Access Network, Transmission, and PS/CS CORE are working according to the desired throughput and that identified degradation are well communicated to the relevant teams in efficient manners.

To assess and ensure that all installed network elements are available and monitored through

Network Management System tools for proper monitoring and KPI evaluation.

To ascertain that performance of transmission links are adequate and compared to the reasonable

level such as power level are in line with Mobily business requirements and industry best practices.

To assess critical rings of Metro, Long-Haul and Back-Haul links bandwidth utilization and

redundancy are in line with Mobily Business requirements and industry best practices.

17


PLANNING MEMORANDUM

Audit ScopeThe review will focus on Network Performance of RAN, Core & Transmission and samples will be selected for the years 2013 & 2014. The main areas that will be reviewed during Network Performance audit are:

Technical Controls: Compliance to vendor’s KPI claims to be assessed technically and to assess Key Quality Definitions that are being used across all regions/vendors as set in the above objective.

Management Controls: Policy and procedures related to performance tasks shall be analyzed with emphasis on Governance, Strategy, in addition to Budget and Vendor compliance as set in the above objectives.

Audit Out of Scope

The review will focus only on Mobile Core (CS and PS) and RAN service performance. Charging System (IN) & VAS will not be part of this review.

Audit Areas

Governance

Strategy

Budget Management

Vendor Management

Adherence to Performance Principles

Effectiveness of Performance & Quality Management

RAN, Transmission& Core Performance

18


PLANNING MEMORANDUM

RISK ANALYSIS OF AUDIT AREAS

NO. AUDIT AREAS NO. OF HOURS

RISK Rating(H/M/L

)

JUSTIFICATION

1. Audit planning 90 First time audit requires meeting with various teams across Mobily.

2. Governance 30 M

Policies and procedures pertaining to network performance features are documented communicated and are adhered.

3. Strategy 30 M

Review if strategy is properly communicated to performance team and complied in routine performance circle.

4. Budget Management 30 H

Review the accuracy of budgeting, allocation, revenue losses and financial discipline on vendor dealings.

5. Vendor Management 40 HReview overall vendor contracts and assess the KQIs, SLAs, Outages and penalties.

6.Adherence to Performance Principles

50 MReview and analyze effective performance utilization as per requirements and growth.

7.Effectiveness of Performance and Quality Management

50 M

Review effectiveness of current performance& quality to analyze if these processes can be further improved.

8. RAN, Transmission& Core Performance

50 H Review effectiveness of RAN, Transmission& Core Performance

9. Audit Reporting 30

Total Work Hours 400

Total Days 50

*Hours mentioned above are SME Hours only, these hours does not include project management and team member hours.

19


PLANNING MEMORANDUM

EXPECTED KEY MILESTONES

Completion of Planning: 17/12/2014Completion of Fieldwork: 02/04/2015Reporting: 15/04/2015

REPORTING

The audit opening meeting will be held on__________________with___________________. The report will be addressed to Chief Audit Executive. Prior to the issuance of the final report, significant finding will be communicated to the client and their comments will be incorporated into the audit report.

Faisal Khan Abdul Rehman ShaikhLead Auditors AGM, IT & Telecoms Audit

Pankaj Jain AbdulKareem D.Al YousifProject Manager EGM, Audit Assurance

20

apm - performance management (2)

Documents