Presented by: For:

© ETSI 2018

13.12.2018

Assessing complianceof 5G device (implementations)

to 3GPP standards

Olivier Genoud (ETSI CTI) Joint ETSI - OSA Workshop

© ETSI 2018 2

Agenda

3GPP RAN5 for UE conformance testing,

The TF160 Project,

Our 5G test suites,

Interworking with OAI.

Agenda

© ETSI 2018

RAN5 & conformance

testing

© ETSI 2018 4

3GPP: Organization structure

TSG = Technical Specification Group

WG = Working Group

TSG RANRadio Access Network

RAN WG1Radio Layer 1 spec

RAN WG2Radio Layer 2 spec

Radio Layer 3 RR spec

RAN WG3lub spec, lur spec, lu spec

UTRAN O&M requirements

RAN WG4Radio Performance

Protocol aspects

RAN WG5Mobile Terminal

Conformance Testing

RAN WG6GSM EDGE

Radio Access Network

TSG SAService & Systems

Aspects

SA WG1Services

SA WG2Architecture

SA WG3Security

SA WG4Codec

SA WG5Telecom Management

SA WG6Mission-critical

applications

TSG CTCore Network & Terminals

CT WG1MM/CC/SM (lu)

CT WG3Interworking with external

networks

CT WG4MAP/GTP/BCH/SS

CT WG6Smart Card Application

Aspects

Project Co-ordination Group (PCG)

© ETSI 2018 5

3GPP RAN WG5 (RAN5) – Scope

RAN5Develops conformance test specifications for the UE

(User Equipment)

Technology scope: 2G, 3G, 4G, 5G

RAN5_SIG sub-group RAN5_RF sub-groupProtocol & signalling tests Radio Frequency (RF) tests

Uu radio interface (including NAS) for NR, E-UTRA, UTRA, GERAN

Radio Resource Management (RRM) tests

Gm interface for IMS, including profiles (e.g. GSMA IR.92/IR.94)

Radio performance tests

Inter-RAT between 3GPP & non-3GPP radio technologies (CDMA2000, WLAN)

RAN-CNInterface

RAN-CNInterface

RAN-CNInterface

(e)LTE

eNBgNBgNB

Inter-BSInterface

Core

The Network

Uu, Gm i/f

The UE

Conformance testing: involves connecting a device to a test system and operating a set of stringently defined tests. This ensures that a (single) product correctly implements the requirements laid down in a standard.

© ETSI 2018 6

RAN5 – Scope

TSG = Technical Specification Group

WG = Working Group

TSG RANRadio Access Network

RAN WG1Radio Layer 1 spec

RAN WG2Radio Layer 2 spec

Radio Layer 3 RR spec

RAN WG3lub spec, lur spec, lu spec

UTRAN O&M requirements

RAN WG4Radio Performance

Protocol aspects

RAN WG5Mobile Terminal

Conformance Testing

RAN WG6GSM EDGE

Radio Access Network

TSG SAService & Systems

Aspects

SA WG1Services

SA WG2Architecture

SA WG3Security

SA WG4Codec

SA WG5Telecom Management

SA WG6Mission-critical

applications

TSG CTCore Network & Terminals

CT WG1MM/CC/SM (lu)

CT WG3Interworking with external

networks

CT WG4MAP/GTP/BCH/SS

CT WG6Smart Card Application

Aspects

Project Co-ordination Group (PCG)

RAN5_SIG

RAN5_RF

Core requirements being subject to conformance tests:

© ETSI 2018 7

RAN5 – DeliverablesSeries of technical specifications in prose specifying the conformance test cases in great details.

But not only…

© ETSI 2018

The TF160 Project

© ETSI 2018 9

RAN5_SIG – Reference implementation of test cases

RAN5 provides also to the industry a formal & standardised implementation of the (RAN5_SIG) protocol/signalling test cases (TC).

Reference implementation developed in TTCN-3 language.

TTCN-3: advanced language for testing, standardized at ETSI.

RAN5 delegated the task of transferring RAN5_SIG test cases from prose to TTCN-3 code to Task Force 160 (TF160).

RAN5 coordinates & provides guidelines to TF160 on the priorities in the implementation of test cases in TTCN-3.

RAN5_SIG

TC prose specification

TF160

TC TTCN implementation

e.g. TS 38.523-1,TS 38.523-2 TTCN files

3GPP core specse.g. TS 38.331

© ETSI 2018 10

3GPP Task Force 160 – Project Tasks1. Specify the test architecture(s) and test model(s) required to be able to implement the RAN5 protocol

conformance test cases of different technologies.

2. Specify a 3GPP standardized system interface, used to control the System Simulator, and built around a modelling of the 3GPP protocol stacks and test cases needs.

3. Develop and maintain:

a reference implementation of the protocol signalling test cases,

in TTCN-3 language.

4. Deliver the test cases TTCN-3 source code to the community

via regular (2-/3-monthly) deliveries,

accessible/downloadable as a 3GPP deliverable.

1

1

2

2

3

3

4

© ETSI 2018 11

3GPP Task Force 160 – Project structure (2018)

Funders Project members

UE/Chipset Vendors TE Vendors Alliance / Institute

20 protocol/testing experts from 3GPP member companies:

Logisticsprovides:

Project management services: an ETSI CTI staff appointed as TF160 leader,

Hosting services: IT, administrative matters, offices.

© ETSI 2018 12

3GPP Task Force 160 – Technical scope

Develops and maintains a set of 20 test suites (over 4000 test cases), for:

3G UTRA/NAS: R99, HSPA, HSPA Evolution, …

4G E-UTRA/EPC: LTE, LTE-Advanced, LTE-A-Pro, LAA, V2X, …

4G IMS: VoLTE, ViLTE, SRVCC, VoWiFi, …

3G/4G Positioning: GPS, Galileo, Beidou, GLONASS, …

4G IoT: NB-IoT, LTE-M(CatM1/M2),

4G Mission Critical: MCPTT (New!),

5G NR/5GC (New!).

Current baseline: 3GPP Rel-15 September 2018.

© ETSI 2018

TF1605G test suites

© ETSI 2018 14

5G – Deployment options

Deployment scenarios supported in 3GPP Rel-15:

Standalone (SA) – Single Connectivity options:

Option2(NR/5GC): NR connected to 5G-CN

Option5(E-UTRA/5GC): LTE connected to 5G-CN

Non-standalone (NSA) – Dual Connectivity options:

Option3(EN-DC): LTE-NR DC via EPC where LTE is master

Option7(NGEN-DC): LTE-NR DC via 5G-CN where LTE is master

Option4(NE-DC): NR-LTE DC via 5G-CN where NR is master.

LTE eNB

MME

gNB LTE eNB

S-GW

gNB

S1

-U

Xx-U

S1-U

EN-DCC-Plane U-Plane

Ref.: 3GPP TR 38.801

gNB

NG-RAN

5GC

AMF/UPF

gNB

NR/5GC

© ETSI 2018 15

NR/5GC (SA Option2) – Component architecture

MTC

SystemAdaptor

IP PTC

IP_SOCKIPsec_CTRLIP_CTRL

IP_SOCKIPsec_CTRLIP_CTRL

IMS PTC

IMS_CTRL

IMS_CTRLIMS_Server IMS_Client

IMS_Server IMS_Client

IP stack

DRB MUX

NR5G_PTC

IPC

ANIP

CA

N

NR

5G

_CTR

L

IP

UT

PTC

_Ut

NAS EMU NR5G

NR

PDCP

RLC

MAC

PHY

PDCP

RLC

MAC

PHY

SDAPuser plane control plane

system interface

TTCN-3 code: RRC / NAS / IMS NW emulation (SW)

gNB emulator (HW)

Ut

Ut

© ETSI 2018 16

EN-DC (NSA Option3) – Component architecture

IP PTC

NAS EMU EUTRA

SystemAdaptor

EUTRA_PTC

IP_SOCKUt IPsec_CTRLIP_CTRL

IP_SOCKIPsec_CTRLIP_CTRL

IMS PTC

IMS_CTRL

IMS_CTRLIMS_Server IMS_Client

IMS_Server IMS_Client

EUTRA

IP stack

DRB MUX

MTC

IPC

AN

IPC

AN

E_SRB

SYS_SRB

NASCTRL

NASCTRL

SRB

SRB

SYSIND

E_SYSIND

SYS

E_SYS

Ut

EUTR

A_C

TRL

IP

UT

PTC_Ut

DRB

E_DRB

NR5G_PTC

NR

5G

_CTR

L

IP

EUTR

ANR

5G

e/nPDCPRLC

MACPHY NR

e/nPDCPRLC

MACPHY

nPDCPRLC

MACPHY

nPDCPRLC

MACPHY

user plane user plane control planecontrol plane

“XX-Interface”

system interface

© ETSI 2018 17

5G – TTCN-3 test case verificationTTCN executed on a System Simulator (SS) hardware platform, against a real physical device implementation (e.g. smartphone).

RAN5_SIG

TC prose specification

MCC TF160

TC TTCN implementation

e.g. TS 38.523-1,TS 38.523-2

Draft TTCN files(iWD)

3GPP core specse.g. TS 38.331

TC TTCN verification

MCC TF160+

RAN5_SIG

Formal TTCN filese.g. TS 38.523-3

Test EnvironmentTest System

Draft TTCN files(iWD)

TTCNexecutable

System Simulator

TTCN compilation

+

PA

SS TTCN Change Request

+SSPassLog

Prose Change Request

+

3GPP device under test3GPP device under test

FR1: RF cable,FR2: OTA chamber

© ETSI 2018 18

5G – TTCN-3 test cases status – implementation & verification

Implementation: latest delivery iwd-18wk49 on 7th Dec’18.

EN-DC: 69 test cases ;

NR/5GC: 22 test cases.

Verification: 1st successful PASS of a 5G TTCN-3 conformance test case submitted to 3GPP on Saturday

8th December 2018.

Under review period in 3GPP RAN5.

Test case (TS 38.523-1) EN-DC NAS test case 10.2.1.2 (Dedicated EPS Bearer addition on SCG)

UE under test Qualcomm SDM855+SDX50 5G NR EN-DC UE

Network Simulator Keysight 5G Protocol Conformance Toolset

TF160 TTCN-3 delivery iwd-18wk44 + critical changes

Technical details Full stack ; EN-DC band combination DC_5A_n261A

- E-UTRA: FDD freq. DL881.5MHz / UL836.5MHz, 5MHz BW- NR: TDD freq. 27.56GHz, SCS120KHz, 100MHz BW

© ETSI 2018

Interworking with OAI

© ETSI 2018 20

OAI – TTCN-3 Integration: Idea (food for thoughts)

MTC

SystemAdaptor

IP PTC

IP_SOCKIPsec_CTRLIP_CTRL

IP_SOCKIPsec_CTRLIP_CTRL

IMS PTC

IMS_CTRL

IMS_CTRLIMS_Server IMS_Client

IMS_Server IMS_Client

IP stack

DRB MUX

NR5G_PTCIPC

ANIP

CA

N

NR

5G

_CTR

L

IP

UT

PTC

_Ut

NAS EMU NR5G

OAI gNBPDCP

RLC

MAC

PHY

PDCP

RLC

MAC

PHY

SDAPuser plane control plane

systeminterface

TTCN-3 code: RRC / NAS / IMS NW emulation (SW)

Ut

Ut

OAI UEAT/MMI cmds

© ETSI 2018 21Agenda

THE END

olivier.Genoud@etsi.org

ETSI CTI (Centre for Testing and Interoperability)