presentation - exadata in turkcell

8/12/2019 Presentation - Exadata in Turkcell

1/31

TURKCELL DBAFerhat ENGNLhttp://ferhatsengonul.wordpress.com

http://twitter.com/ferhatsengonul

TURKCELLs EXADATAJourneyPart1 & Part 2

May 2011
http://ferhatsengonul.wordpress.com/http://twitter.com/ferhatsengonulhttp://twitter.com/ferhatsengonulhttp://ferhatsengonul.wordpress.com/


2/31

Who am I?

11 years in IT in finance sector.

Works with (nearly) all dbs from hierarchical to relation

Found peace in Exadata

Likes APEX (as an amateur) 1 year in Turkcell

http://ferhatsengonul.wordpress.com

http://ferhatsengonul.wordpress.com/http://twitter.com/ferhatsengonulhttp://twitter.com/ferhatsengonulhttp://ferhatsengonul.wordpress.com/


3/31

Headlines

Turkcell in numbers

BI domain in numbers

First project

Migration to V2 (8 nodes) ( Total uncompressed size 250 TB)

Second project

Migration to 2 x2-2s (16 nodes)

Consolidation of 4 databases ( Total uncompressed size 600 TB)

Geographical (continental) change of data center

Future plans


4/31

Turkcell in Numbers

Leading Telco in Turkey

34 million subscribers in Turkey as of Feb 28, 2011

Third biggest GSM operator in Europe in terms of subscribers

Turkcell started its operations in February 1994

Turkcell co-operates in 8 other countries and has over 60million subscribers total

First and only Turkish company listed on NYSE

Over 500 Oracle Databases, 150+ Production

DB Machine hosts our biggest Database from DWH Domain


5/31

TurkcellsBI Environment

Reporting

MSTR

ETL

AB Initio

Oracle ODISource

DBs

Exadata

OtherDWH

DBs

Amount Of Data 3 Billion CDR per Day

600 -1000 GB raw data extracted from 20+ source databases

5 TB Data on file system processed

2-3 TB loaded into databases, all into Exadata

Approximately 600 TB Customer data stored in multiple Databases

600 TB (60 TB compressed) on Exadata


6/31

TurkcellsBI Environment Application Footprint

ETL Environment

AB Initioruns on 8 Node Linux Cluster

Data loaded daily between 19:00 - 08:00 (SLA)

Sql*Loader used to load tables with 16 parallel threads

Works to implement external tables continue

Reporting Environment MSTR (Microstrategy) is used mostly.

4 nodes before migration. 3 nodes after migration.

300+ Users

3000 distinct reports with 50k run per month

Runs between 08:0020:00 (SLA)


7/31

First Project ( completed in July 2010)

Turkcellslargest 100 TB (~250 TBuncompressed) DB wasmigrated to DBM v2, now only 25 TB with the help of HCC on

Full SAS Rack

Over 50K reports run every month on this DB, Performance

improvement up-to 400x, average 10x

1 RACK instead of 11 RACKS


8/31


9/31


10/31


11/31

The Project Overview

Planned as simplemigration

No Application version or interface changes

Migrate to new Exadata V2 machine

Upgrade to new Oracle Version (from 10.2.0.4 to 11.2.0.1)

Move from Single Instance to RAC4 Months (Apr-July) testing of all the components

Crash Tests (working closely with support)

Network Transfer Speed Tests (10G vs IB)

Backup/Restore Tests Performance Tests (RAT, Report run times, data load times)


12/31


13/31

Migration Facts

Insert/append over DB Links

Platform and version change forced us to use insert over db-link None of the other methods like TTS, ASM Rebalance was applicable

Used in-house pl/sql utility to perform migration

Metadata (Tablespaces were re-organized)

Insert/Append with 128 parallel sessions partition-wise

40TB data was transferred during the migration window

Transfer rate 300mB/sec, around 1 TB per hour approximately

Completed in 36 hours.

High CPU load on comp nodes because of HCC (expected)

SQL*Net compressing the data 2-3x (this was a nice finding)

20 TB readonly data was transferred before, ~30TB after

Network Infrastructure

10Gb-to-IB (Voltaire 4036E) gateway used to connect old system


14/31

Migration Facts

After the test migration we ended-up staying on Exadata

End users were so happy, they did not let us go back

3 Weeks before the go-live date we were live

Parallel runs continued for few weeks till we completely feelcomfortable on Exadata

Stability of the system under real load was proved for various loadpatterns

Backup/Restore tests were completed


15/31

Compression in Action

Old System 10gR2 Compression ~2-3 times ~250TB raw data to 100TB

Exadata V2 with EHCC Raw Data 250TB to 25TB (Data)+ 5TB (Temp) = 30TB

EHCC - Compress ratio ~7-10x

Archive compression is efficient but high CPU consumption

http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/

SORT COMPRESS SIZE (GB) RATIO

NOSORT NOCOMP 137,59 1

NOSORT Q_HIGH 21,21 6,48

SORT_A Q_HIGH 12,18 11,29

SORT_B Q_HIGH 15,37 8,95

SORT_A_B Q_HIGH 11,64 11,80
http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/


16/31


17/31


18/31

I had a great ho l iday


19/31

Second Project

Monthly 1 TB increase in size.

Need a second RACK.

Management was satisfied and bought 2

RACKS in stead of one. Migration of Data Center from Europe to Asia

Consolidation on Exadata.


20/31

SMARTCUBE - MicroStrategy

Operat ionalSources

Extract

S

..

..

RDS

ODS CDRDM

Feed

DDS

BIS INFRASTRUCTURE ROADMAP

EXADATA x2-2


21/31

SINGLE DWH ENVIRONMENT

WITHOUT

DUPLICATION OF DATA

CDRDM 15TB

DDS 35 TB + 18 Ay

DEV DOMAIN 5 TBRDS 5 TB

SAS 60TB HOT

SAS 20TB COLD

100TB

COLD

Moving the data!

ODS 5 TB

TEST DOMAIN 5 TB

HIGH

AVAILABILTY

SOLUTION

FOR DWH 50TB

OTHER DBS

25TB

ZDDS 5TB

SINGLE DATABASE


22/31

Project Status (Feb 2011)

RDS was migrated and became XRDS

Size : 15 TB decreased to 3 TB

A single tables compression rate 70x (Full of numbers)

Performance increase 3x even the ETL Server and

the DB are on different continents And runs in only one database node. (server pool

which has only one node.)


23/31

Project Status (March 2011)

CDRDM was migrated and became XCDRDM

Size : 45 TB decreased to 15 TB

Our aim is to use this space for ETL server

migration.


24/31

Project Status (April 2011)

Existing XDDS has migrated in April.

ETL servers and reporting servers have migrated

simultaneously.


25/31

Project Status (End of May 2011)

ODS will be migrated in May

The existing v2 system will turn into a high

capacity disk system and will be the home of

XCDRDM/dev/test and high availability system.


26/31


27/31

GAINS and PROJECTION

DBNAME BEFORE AFTER END of 2011 END of 2012

XDDS 35TB 35TB 40TB 50TB

XCDRDM 60TB 13TB 15TB 20TB

XRDS 15TB 3TB 5TB 7TB

ZDDS 15TB 3TB 5TB 7TB

NODS 6TB 2TB 5TB 10TB

ARA

TOPLAM

96TB 21TB 30TB 44TB

TOTAL 131TB 56TB 70TB 94TB

120 TB (net space) of disk is given back with the first project.

100 TB (net space) of disk is given back with the second project.


28/31

GAINS on reporting

6,42 min 7,1 min 3,28 min

Avg Time

Even though were using only 8 nodes on X2-2

cluster, we had performance increase.


29/31


30/31


31/31

Thank YOU

Questions

www.turkcell.com.tr

Ferhat ENGNLhttp://ferhatsengonul.wordpress.com

http://ferhatsengonul.wordpress.com/http://twitter.com/ferhatsengonulhttp://twitter.com/ferhatsengonulhttp://twitter.com/ferhatsengonulhttp://ferhatsengonul.wordpress.com/http://ferhatsengonul.wordpress.com/

presentation - exadata in turkcell

Documents