exadata performance notes

Exadata Performans Notları

www.ozgurumutvurgun.com

Özgür Umut Vurgun

• ozgurumutvurgun.com • Senior Oracle DBA • 10g/11g OCP – OCE • Member of TROUG

Oracle SQL, Analitik SQL ve PL/SQL kitabı yazarlarından

Ajanda

www.ozgurumutvurgun.com 23 Aralık 2014

TROUG Day Ankara

•Exadata Nedir ? • Exadata Mimarisi • Storage Cell Server • Storage Indexes • Hybrid Columnar Compression • Smart Scan Queries • Smart Block Transfer • Smart Storage

EXADATA Nedir ?


TROUG Day Ankara

DB Server

DB Server

Oracle Linux 6

Oracle Database EE

Oracle VM (Opsiyonel)

Storage

Storage

Akıllı DiskServer

Flash Storage Server

Storage Server Software

NETWORK (Cisco switch)

40Gb/s InfinitiBand

Ajanda


TROUG Day Ankara

• Exadata Nedir ?

•Exadata Mimarisi • Storage Cell Server • Storage Indexes • Hybrid Columnar Compression • Smart Scan Queries • Smart Block Transfer • Smart Storage

I – Software Architecture


TROUG Day Ankara

CKPT RECO SMON

PMON

DBWR PROCs LGWR

ASM

CELLSRV SSSM MS

RS

Cellinit. ora

OS Watcher

Alert.log

Database Buffer Cache Shared Pool Others

Exadata Cell Exadata Cell

Exadata Storage Server

II - Exadata Storage Servers (CELL)


TROUG Day Ankara

II- Exadata Storage Servers (CELL)


TROUG Day Ankara

ORACLE Linux

CELLSRV MS RS

Exadata CELL

Default OS – Oracle Linux 6

CELLSRV – Core Exadata Component

MS: Management Server - Sistemsel Veri …. (İstatistik,alarm vb…)

RS: Restart Server - Start / Shutdown

iORM



TROUG Day Ankara

Physical Disk

LUN

CELL DiSK

GRiD DiSK

CellCLI > Create GRIDDISK

1

2

3

5

4

ASM Disk Grup Linux OS



TROUG Day Ankara

*** I/O Performance Rating Yavaş

Hızlı

CellCLI> CREATE GRIDDISK ALL HARDDISK PREFIX=DATA_DG, size=500G

Ajanda


TROUG Day Ankara

• Exadata Nedir ? • Exadata Mimarisi • Storage Cell Server

•Storage Indexes • Hybrid Columnar Compression • Smart Scan Queries • Smart Block Transfer • Smart Storage

Storage Index


TROUG Day Ankara

Cell Memory’de tutulur

Create / Drop / Tuning işlemleri olmaz

Query çalıştığında otomatik oluşur

Cell Reboot işleminde hepsi silinir Geçerli olduğu veri tipleri - Number - VarChar2 - Date

SQL İndeks Oluştur

Analiz SQL

Cell Disk

DB Server

Parametre Default Değer

_cell_storidx_mode EVA Kontrol Modu…

_kcfis_storageidx_disabled FALSE Açma / Kapama

_kcfis_storageidx_diag_mode 0 Monitor ve Trace işlemleri

Storage Index


TROUG Day Ankara

MIN / MAX Değerleri….

Name Col1

HR 1

Finance 3

IT 5

Mng 8

Col0 Col1 Col2 Col3

1

3

5

5

5

5

3

1

Bloom Filter

MIN/MAX

*** Storage Indeks tarafından memory’de tutulan alan

*** Storage Indeks tarafından dışarıda bırakılan alan

Dimension Fact

Ajanda


TROUG Day Ankara

• Exadata Nedir ? • Exadata Mimarisi • Storage Cell Server • Storage Indexes

•Hybrid Columnar Compression • Smart Scan Queries • Smart Block Transfer • Smart Storage

Hybrid Columnar Compression


TROUG Day Ankara

Tablo / TS / Partition seviyesinde işlem yapar

DML işlemi az olan tablolara önerilir

Disk performansı sağlar

Tablodaki kolonlar üzerinden işlem yapar

Compression Unit yapısını kullanır

COL 1 COL 2 COL 4 ROW 1

COL 1 COL 2 COL 3 ROW 2 COL 1 COL 2 COL 5 ROW 3




Compression Unit (CU)



TROUG Day Ankara

Query Low

• LZO algoritmasını kullanır

• CREATE TABLE ... COMPRESS FOR QUERY LOW;

Query High

• ZLIB (gzip) algoritmasını kullanır

• CREATE TABLE ... COMPRESS FOR QUERY

HIGH;

Archive Low

• ZLIB (gzip) algoritmasını kullanır. Query HIGH’tan dah üst seviyedir

• CREATE TABLE ... COMPRESS FOR ARCHIVE LOW;

Archive High

• ZLIB (gzip) algoritmasını kullanır

• CREATE TABLE ... COMPRESS FOR ARCHIVE HIGH;



TROUG Day Ankara

15 GB boyutunda bir tablo kopyalayalım….

No Compression

create table tst.comp01 nologging parallel 8 as select /*+ parallel (a 8) */ * from proddta.tst a;

create table tst.comp01 nologging parallel 8 compress as select /*+ parallel (a 8) */ * from

proddta.tst a;

Basic Compression

OLTP Compression

create table tst.comp01 nologging parallel 8 compress for oltp as select /*+ parallel (a 8) */ * from

proddta.tst a;



TROUG Day Ankara

HCC Methodu ile….

Query LOW Compression

create table tst.comp01 nologging parallel 8 compress for query lowas select /*+ parallel (a 8) */ * from proddta.tst a;

Query High Compression

create table tst.comp01 nologging parallel 8 compress for query high as select /*+ parallel (a 8) */ * from proddta.tst a;

Archive LOW Compression

create table tst.comp01 nologging parallel 8 compress for archive lowas select /*+ parallel (a 8) */ * from proddta.tst a;

Archive High Compression

create table tst.comp01 nologging parallel 8 compress for archive high as select /*+ parallel (a 8) */ * from proddta.tst a;



TROUG Day Ankara

Comp. Method

Boyut Yüzde Zip Arch

No compression

15.2 GB

-

- 42 sn

Basic 13,8 GB % 10,9 1dk 35 sn

OLTP 14.8 GB % 0,9 1dk 24 sn

Query Low 12.1 GB % 20,7 LZO 56 sn

Query High 7.7 GB % 47,3 ZLİP 1dk 56 sn

Archive Low 7.6 GB % 47,5 ZLİP 1dk 53 sn

Archive High 7.5 GB % 50,3 ZLİP 8 dk 23 sn

*** CPU Time *** Non Update Data blok

Ajanda


TROUG Day Ankara

• Exadata Nedir ? • Exadata Mimarisi • Storage Cell Server • Storage Indexes • Hybrid Columnar Compression

•Smart Scan Queries • Smart Block Transfer • Smart Storage

Smart Scan Queries


TROUG Day Ankara

Oracle Exadata Öncesi

Oracle Exadata

Smart Scan Queries


TROUG Day Ankara

Parametre Scope

cell_offload_process

SYSTEM / SESSION Alter system set ……

Opt_param_hint SQL Statement select /*+ opt_param('cell

offload processing','true' */ ...

alter diskgroup set attribute

ASM Disk Group alter diskgroup [DG] set attribute 'cell.smart_scan_ capable'='[TRUE|FALSE]';

System ASM

Smart Scan Queries


TROUG Day Ankara

SYS@TSTDB> alter session set cell_offload_processing = false;

SYS@TSTDB> select count(*) from tst.sts where col1 < 0; COUNT(*) ---------- 2 1 row selected. Elapsed: 00:00:51.09

SYS@TSTDB> alter session set cell_offload_processing = true;

SYS@TSTDB> select count(*) from tst.sts where col1 < 0; COUNT(*) ---------- 2 1 row selected. Elapsed: 00:00:01.15

Ajanda


TROUG Day Ankara

• Exadata Nedir ? • Exadata Mimarisi • Storage Cell Server • Storage Indexes • Hybrid Columnar Compression • Smart Flash Cache • Smart Scan Queries

•Smart Block Transfer • Smart Storage

Smart Block Transfer


TROUG Day Ankara

SQL * RGI (Right Growing Index)

*** Redo Log Buffer Wait

EXADATA Before EXADATA

SQL

*** I/O Wait

*** NO Redo Log Buffer Wait

*** NO I/O Wait

*** Throughput %40

*** Response Time %33

"_cache_fusion_pipelined_updates"=TRUE

Ajanda


TROUG Day Ankara

• Exadata Nedir ? • Exadata Mimarisi • Storage Cell Server • Storage Indexes • Hybrid Columnar Compression • Smart Flash Cache • Smart Scan Queries • Smart Block Transfer

•Smart Storage

CELL

Smart Storage


TROUG Day Ankara

x10

Predicate Filtering

SELECT * FROM v$sqlfn_metadata WHERE offloadable = 'YES'

• Sadece istenilen satırlar

• Storage katmanında SQL filtreleme operatörlerinii destekler

Columnd Filtering

• Sadece istenilen kolonlar

• LOB vb… kolonları işlemez.

• I/O ve Bandwith performansı sağlar

Join Prosesessing

• Bloom filtre kullanır **

• Klasik Nested ve Hash Join yapısına göre daha performanslı

CELL

Smart Storage


TROUG Day Ankara

x10

Scan on encripted Data

• Decrypt -> Encrypt

• Encrypt data üzerinde filtreleme

Scoring for data mining

• LOB vb… kolonları işlemez.

• CELL üzerinde Datamining Modelleme bilgilerini tutar

• CPU ve I/O performans

Extend Tablespace

• CELL üzerinde işlem yapılır

• DB server üzerinden bu işlem kalkar

• I/O - CPU - Memory ….. performansı

Teşekkürler

Özgür Umut Vurgun Bilgisayar Mühendisi

Oracle 10g OCA/OCP/OCE

[email protected]

www.ozgurumutvurgun.com www.turkceoracle.com

www.otechmag.com

http://www.turkceoracle.com/

exadata performance notes

Data & Analytics