copyright © 2017, oracle and/or its affiliates. all rights

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |Copyright © 2017 Oracle and/or its affiliates. All rights reserved. |

NAS and Data ProtectionOracle ZFS Storage Innovation

Sandip RanaPrincipal Solutions Consultant

Storage - North America

2

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

3


Engineered for data centers. Optimized for Oracle software.

Oracle’s Complete Storage Portfolio

Engineered Systems

Oracle Exadata

StorageTekSL8500 StoirageTek

SL3000 StorageTekVirtual Storage Manager

StorageTekSL150

StorageTekLTO drive StorageTek T10000

tape drive

Oracle SuperCluster

Oracle ZFS Storage ZS5 Series

Storage Cloud

SAN

Oracle FS1-2

Storage management: Oracle Intelligent Storage Protocol, Oracle Enterprise Manager, Oracle Automatic Storage Management,

Automated tiering: partitions, Oracle Hierarchal Storage Manager, Hybrid Storage Pool (a feature of Oracle ZFS Storage Appliance), StorageTek Virtual Storage Manager Data reduction: Oracle Advanced Compression, Oracle Automatic Data Optimization, Hybrid Columar Compression, Oracle Recovery Manager (Oracle RMAN), Oracle ZFS Storage Appliance deduplication/compressionData protection: Data Guard, Oracle RMAN, Oracle Secure Backup, Oracle ZFS Storage Appliance security/encryption: Oracle Advanced Security, Oracle Key Manager,

Storage Software

NAS and Data Protection

Oracle Exalogic

Oracle Big Data Appliance

Deployment options: private, public, hybrid

Services: IaaS, PaaS, SaaS

Consumption options: Build, manage, subscribe

Tape and Virtual Tape

4


Built on a Decade of Storage Innovation

2 0 0 6 2 0 1 62 0 1 0 2 0 1 2 2 0 1 42 0 0 8

ZettabyteFile System

Hybrid Storage Pool

Analytics

DatabaseOracle Intelligent Storage ProtocolDatabase

Hybrid Columnar Compression

InlineDeduplication

InlineCompressionUnified

StorageInfiniBand

Triple ParityRAID

AntivirusIntegration

FlexibleEncryption

ShadowMigration

Oracle Snap Management Utility for Oracle Database

Oracle Enterprise Manager

ProvisioningREST/OpenInterfaces

HybridCloud Pools

(HCPs)

AnalyticBundles

TripleMirroring External

L2ARC

Oracle 7*10series

Oracle 7*20series

Oracle ZS3series

Oracle ZS4series

OracleZS5series

256 GB DRAM1 TB Read Flash280 TB Capacity

2.5 GB/sec

FlashStorage

1 TB DRAM4 TB Read Flash3 PB Capacity

10 GB/sec

2 TB DRAM12 TB Read Flash

4 PB Capacity17 GB/sec





5


Oracle ZFS Storage Appliance

Oracle NAS and Data Protection

Oracle ZFS Storage ZS5-2 Oracle ZFS Storage ZS5-4

• Single or dual controllers

• 768 GB or 1.5 TB DRAM

• 4 PCIe expansion slots

• 3 PB capacity (Oracle Storage Drive Enclosure DE3)

• 102 TB read rlash

• 12 TB write flash

• Single or dual controllers

• 3 TB DRAM

• 7 PCIe expansion slots

• 9 PB capacity ((Oracle Storage Drive Enclosure DE3))

• 307 TB read flash

• 38 TB write flash

Oracle ZFS Storage Operating System• Most powerful storage software suite• Engineered integration with Oracle software

35% Faster and More Scalable Than the Previous Generation

NowShipping

6


• Oracle Intelligent Storage Protocol

• Fibre Channel

• iSCSI

• InfiniBand

- NFS/RDMA

- IPoIB

- iSER

- SRP

• Object API (OS8.7)

• NFS V3 and V4

• SMB/CIFS

• HTTP

• WebDAV

• FTP/SFTP/FTPS

• ZFS NDMP V4

Comprehensive Suite of Enterprise Software

• Hybrid Columnar Compression

• Hybrid Storage Pool

• Single, double, and triple-parity RAID

• Mirroring and triple mirroring

• End-to-end data integrity

• Local and remote replication

• Snapshots and clones

• Quota(s)

• Deduplication

• Compression

• Encryption

• Thin provisioning

• Antivirus via ICAP protocol

• Online data migration

• Clustering

• RESTful API, OpenStack/Cinder

• Browser and CLI interface

• Management dashboard

• Hardware/component view

• Role-based access control

• Phone home

• Event and thresholdbased alerting

• DTrace Analytics, a feature of Oracle ZFS Storage Appliance

• Scripting

• Workflow automation

• Advanced networking

• Snap Management Utility for Oracle Database

• Source-aware routing

Data Protocols Data Services Management

7


Oracle ZFS Storage Technical Innovations

Optimal Storage SecurityShare/LUN encryption, two-tier key management, end-to-end integrity checks

Oracle Cloud CoengineeringShadow Migration, a feature of Oracle ZFS Storage Appliance, and rolling upgrades, user-level analytics, workflows

Record-Setting Storage PerformanceDRAM/flash architecture (Hybrid Storage Pool), SMP RTOS, most scalable file system (ZFS)

Industry-Leading Storage EfficiencyReal-time analytics, clone/snap, compression, deduplication, Hybrid Storage Pool, data services

Oracle Database CoengineeringOISP, HCC, ADO, OEM Provisioning, SMU, pluggable database analytics

8


High Performance


Adaptive Throttle Algorithm

Determines Pipe Size

3 TBDRAM

144 CoresProcessingPower

307 TBRead Flash

38 TBWrite Flash

All Flash|Re-engineered for Extreme Performance

▪ Automated, real-time data migration from DRAM to multiclass flash, to multiclass disk storage

▪ Software specifically engineered for multilevel flash and disk storage

Most Horsepower Possible Hybrid Storage Pool

Adaptive

I/O Staging

3 T

B D

RA

M

SSDs

WRITE FLASH

LRU MRU

LFU MFU

High EnduranceLog Record

(Evicted)

Flas

h S

tora

ge (

SSD

s)

800GBFlashSSDs

3.2TBFlashSSDs

3.2TBFlashSSDs

3 TB DRAM

1 PB Flash

StoragePool

Wri

te F

lash

Wri

te F

lash

Flash Storage

Pool

10


OS 8.7 Oracle ZFS Storage ZS5 Series Flash Configuration Choices

FlashStorage Pool

Flash Storage Pool

DiskStorage Pool

DiskStorage Pool

Flash Storage Pool

DiskStorage Pool

zCloudStorage Pool

Flash Storage Configuration

Hybrid Storage Configuration

Hybrid CloudConfiguration

11


OS 8.7 ZS5 Series All Flash Array

ZS5-2 > 1.5 TB DRAM, 128 TB Flash

▪ 8 K (60% R/40% W): 322 K IOPS

▪ 8 K (100% read): 1.43 M IOPS

▪ 1 MB sequential: 20 GB/sec

Extreme Performance

ZS5-4 > 3 TB DRAM, 256 TB Flash

▪ 8 K (60% R/40% W): 483 K IOPS

▪ 8 K (100% read): 2.1 M IOPS

▪ 1 MB sequential: 34 GB/sec

▪ Best real-time analytics

▪ 20 second failover (1,600 LUNs)

▪ Rapid RAID rebuilds

▪ In-line dedupe and compression

Proven Service Uptime

▪ Fastest create/delete capability

▪ Dynamic database optimizations

▪ Most scalable snaps/clone capability

12


Data Protection


OS 8.7 What Is Oracle’s Dedupe Solution?✓ Strong dedupe designed by dedupe

experts

✓ Hybrid Storage Pool model reduces data ingest penalty

✓ Dedupe performance scales with meta devices (DDT SSDs)

✓ Dedupe per share or project provides flexibility

✓ Dedupe and LZ4 compression recommended for backup use cases

✓ NEW: LZ4 provides good compression ratios with reduced CPU overhead

WriteZILSSDDedup Table

Meta DeviceSSD

L2ARCSSD

ARC Memory

14


Actions Taken Prior to Full Backup

Dat

a R

edu

ctio

n R

atio

Deduplication Plus Compression Compression

0

1

2

3

4

5

6

7

8

9

Perform Snapshot Increase VMDK Size Change a File VM+34 Dataset Add 1GB File

average

Measured results in Veaam backup environment

OS 8.7 6x Improvement in Data Reduction

15


OS 8.7 Deduplicated Replication

Primary Business Values• Bandwidth cost savings• Dramatic benefits for Oracle RMAN backup use case • Increased DR protection by network-efficient

replication• Powerful tool when replicating VDI workloads

Features• Create hash table before each replication to send

only the deduplicated data to the target side• After replication update completes, replication

statistics show the original data set size and the size of the deduplicated data sent

• Performance highly data dependent

Supported Deployment Model• Replication feature in OS 8.7 release

16


0GB

500GB

1000GB

1500GB

2000GB

2500GB

3000GB

0hrs 00mins

1hrs 12mins

2hrs 24mins

3hrs 36mins

4hrs 48mins

6hrs 00mins

Week 1 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9

Nine-Week OLTP Database Backup Offsite Replication Characterization w/50 ms Latency (RT)

OS 8.7 Replication/Deduplication

No Deduplication With Deduplication Replication Lag (no dedup) Replication Lag (with dedup)

17


Database Coengineering


OISPOracle Direct

NFS, InfiniBand HCC

Oracle Coengineering

Dynamic and

automatic

database-to-

storage

tuning

Superior

database,

data

warehousing

compression

Superior

performance

and

efficiency

SMU

Faster and

simpler way to

manage clones

and copies of

Oracle Database

OEM

Centrally monitor and manage ZFS

Storage Appliance

ADO

Advanced

and dynamic

database

(data)

optimization

Technology Advantage| Database Coengineering

19


Optimized for Oracle and non-Oracle workloadsZFS Storage Appliance: High Value Backup, Restore and Beyond

OracleEngineeredSystems

Oracle Database

ZFS Storage Appliance for Backup

Non-OracleBackups

Fast Backup and Restore for Mixed

Workloads• High-throughput in-

memory architecture

• Database: maintains Oracle RMAN, compression and encryption best practices; optimizes storage configuration on the fly; provides detailed Oracle Database 12cbackup insights

• Non-database backups:includes Symantec, Commvault, Avamar

Extends ROI Beyond Backup

•Virtually unlimited snaps/clones for test, dev, QA, analytics, reporting•Maintaining of Hybrid

Columnar Compression • Ideal for heavily

virtualized environments

20


Oracle ZFS Storage ZS5, Oracle RMAN Test Results

• Oracle ZFS Storage OS 8.7 software

• InfiniBand connectivity

• Double-parity storage profile

• LZ4 compression enhancements

• Active/active cluster workload

• Synch write bias = throughput

• 1 MB record size

• Level 0 database backup/restore

• Deduplication not in use

Oracle Database and Oracle RMAN throughput characterization with Oracle ZFS Storage ZS5-4

21

Sustained backup rates up to 60 TB/hr.Sustained restore rates up to 62 TB/hr.


Use Case Purpose Competitive Advantage Best Practice

Database Backup Protect Exadata production DB’s Native InfiniBand connectivityRMAN integration: 2000 threads1MB block sizeHCC, OISP, CompressionZFS Backup Utility

Change threads to 2000Ensure MTU set to 65520Use Backup utility

Test & Dev Enable multiple DB copies for testing, development, reporting.

HCC, OISP, LZJB CompressiondNFS/PerformanceSnap Managment Utility (SMU)

Use SMU to easily provision unlimited DB copies

Storage expansion Free up Exadata space by moving old data/partitions to ZFS Storage

dNFS/Performance HCC, CompressionNative InfiniBand

Move tier-2 or low-use DBsMove cold-data partition (may impact workload)

DB Migration to Exadata

Migrate Oracle DB’s from any platform (i.e. HP) to Exadata

dNFS/Performance HCC, CompressionNative InfiniBand

Bridge FC (old server) to InfiniBand (Exadata)

Disaster Recovery Maintain stand-by remote database on ZFS Storage using DataGuard

SMU integration with DataGuardHigh Performance

Use SMU to automate Standby site creationSet expectation: performance < Exadata.

Oracle Confidential – Internal 22

Exadata plus ZFS Storage: Use Cases and Best Practices

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 23

RMANRMAN

Image

Dev / Test

ZFS clones

Prod

Database

Direct NFS

• Thin cloning of RMAN image files using ZFS snapshots and clones

• Mount thin clones via Direct NFS Client

• Native IB connection to Exadata

• No initial space consumption for Dev Test thin clones

• Increases ROI on your backup storage investment

Oracle Confidential – Internal

ZFS Backup ApplianceExadata

Oracle ZFS Backup Appliance ZS5 Dev/ Test and RMAN backup

https://mosemp.us.oracle.com/epmos/faces/DocContentDisplay?id=2087231.1

https://mosemp.us.oracle.com/epmos/faces/DocContentDisplay?id=2087231.1


Oracle Intelligent Storage Protocol

• Database and storage coengineering– Intelligence is in the code within both the database and

storage

– Available only with Oracle Database 12c and Oracle ZFS Storage Appliance OS 8 and above

• Storage awareness of database workload– Database sends cues about each I/O to the storage

– Over 70 database I/O types are recognized

– Cues grouped into five distinct categories by storage

– Information used by storage to adaptively and automatically adjust for optimal efficiency

OracleDatabase 12c

Oracle ZFS

Storage

Appliance

dynamically

tunes critical

storage

parameters

I/O cues

exchanged with

Oracle ZFS Storage Appliance

24


Without Oracle Intelligent Storage ProtocolStandard NFS server

I/O

All I/Os look the same {size, read versus write, file handle}

I/O

I/OI/O

I/O

I/O

I/O

25


With Oracle Intelligent Storage ProtocolDirect NFS Client, a feature of Oracle Database, + Oracle ZFS Storage Appliance

Oracle RMAN full

backup

Each I/O is tagged with:-- Who issued it-- What it’s for-- Its priority-- Other interesting metadata

LGWR redo write

Temp write from DB #1

DBWR writeto resolve

“free buffer wait”Buffer cache read for

OLTP transaction, PDB #2

Table scan read from DB #2

Buffer cache read for OLTP transaction, PDB

#3

DBWR write—no threat of

“free buffer wait”

Archive log write

Oracle Real Applications

Cluster voting disk I/O

Oracle RMAN apply

26


dNFS TCP IPOISP Network IP TCP dNFS OISP

Dynamic Actions• Dynamically record size, log bias

(shipping)

• Pluggable database analytics (shipping)

• Oracle Enterprise Manager provisioning (Shipping)

• Analytics AWR feed

• I/O fair share scheduling and DB priority

• I/O caching/prefetch

Oracle Intelligent Storage Protocol Technology: DB Coengineering

Oracle Database with Oracle Intelligent Storage Protocol• Extensions built on top of NFSv4 protocol• Each I/O is tagged with data context

– I/O reason– I/O priority– File type (redo log, data file, control file,

backup file)– Database block size for file– Database and/or pluggable database ID– Cache hints– Prefetch hints

27


Without Oracle Intelligent Storage Protocol Dynamic I/O Tuning With Oracle Intelligent Storage Protocol Dynamic I/O Tuning

Logfile share

Datafile shareMany shares, each with its own record size and log bias setting

Over 20 shares, each manually tunedmnt/dbname/redo* (block size, latency)mnt/dbname/control* (block size, throughput)mnt/dbname/pfile* (block, throughput)mnt/dbname/datafile* (block size, throughput)mnt/dbname/tempfile* (block size, throughput)mnt/dbname/chgtrack* (block size, throughput)mnt/dbname/backup* (block size, throughput)…

Two shares, dynamically tuned directly by the 12c Databasemnt/dbname/logfile(Oracle Intelligent Storage Protocol sets record size, logbias)

redomnt/dbname/datafile(Oracle Intelligent Storage Protocol sets record size, logbias)

controlpfiledatafiletempfilechgtrack, etc.

Dynamic I/O Database-Storage Tuning Oracle Intelligent Storage Protocol 1.0

28


Oracle Intelligent Storage Protocol 2.0: Efficient Cache Management

OLTP START Oracle RMAN START OLTP START Oracle RMAN START

ARC Evictions

• Simultaneous Oracle RMAN + OLTP workloads

• RPC fair share scheduler with DB I/O prioritization

• Negative cache hints for lower priority like Oracle RMAN and archivelog I/O

Before Extensions With Extensions

29


Before ExtensionsWith Extensions

86% reduction in LGWR latency

33% faster datafile backup

• Bounded latency for higher priority DB I/O

• RPC fair share scheduler with DB I/O prioritization

• Separate thread pools for READs, WRITEs, and Oracle Intelligent Storage Protocol high-priority I/O

Oracle Intelligent Storage Protocol 2.0: Optimized Database Storage

30


Database I/O Statistics by Function

Fair Share Scheduling Not Enabled Fair Share Scheduling Enabled

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

1.8

2

1 2 3 4 5 6 7 8 9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

seco

nd

s

minutes

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

1.8

2

1 2 3 4 5 6 7 8 9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

seco

nd

sminutes

PerformanceStabilization

Point

PerformanceStabilization

Point

7.6x faster time to peak performance

Database OLTP performance charted with no data in storage cache at start

Oracle Intelligent Storage Protocol 2.0: Fair Share Scheduling (FSS)

31


Control FilePerformance

Log FilePerformance

Transactions Per Minute(AWR output)

2.07 ms

27.95 ms

13.5xFaster

7.29 ms

28.95 ms

3.9xFaster

197,274

235,549TPM

19%Faster

Multiple (OLAP/OLTP) database workloads running concurrently

Oracle Intelligent Storage Protocol 2.0: Fair Share Scheduling (FSS)

32


Problem: Matching the DB I/O to what the DB administrator knows…

Database I/O Statistics by File Type

Database I/O Statistics by Function

• Datafile• Temp File• Archive Log• Data Pump/Dump

• Log Files• Backups• Control File• Flashback Log

• DBWR• Direct Writes• LGWR• Archive

• Oracle RMAN• Recovery• Streams/AQ• XDB

Oracle Intelligent Storage Protocol 2.0: Only Storage with Database (AWR) Analytics

33


Cloud Converged Storage


Hybrid Storage Pool serve 86% of I/O from L1 and L2 cache

OS 8.7 Oracle ZFS Cloud (Hybrid Cloud Pool)

0.01 ms latency

0.10 ms latency

10 ms latency

L2ARCSSD

WriteZILSSD

System Storage PoolHDD blocks

512/4 K Record Size

ARC/DRAM

WriteZILSSD

Cloud Storage PoolObjects

4 K-1 M Record Size

ARC/DRAM

L2ARCSSD

ZFS Cloud

Standard

Application

~100 ms latency

35


Hybrid Cloud Pool (HCP) Technology As a Bridge

Hybrid Cloud Pool

Object API

SMB/NFS

FC/iSCSI

FTP/WebDav

HCP

HSPs serve 85-90% of I/O

from L1 cache/ARC

Hybrid CloudPool (HCP)

Hybrid Storage Pool

0.01 ms latency

0.10 ms latency L2ARCSSD

WriteZILSSD

System Storage PoolHDD blocks

512/4K Record Size

ARC/DRAM

WriteZILSSD

Cloud Storage PoolObjects

4K-1M Record Size

ARC/DRAM

L2ARCSSD

Application

Advanced NAS and data protection storage systems will expand into public clouds natively to provide

virtually unlimited data protection scalability

36


Uses: Hybrid Data Management, Migration, and DR

• Basic Cloud Gateway: moves data from on-premises to OPC/object storage; can be used for data migration as well.

• Data Protection Using Replication: create a DR copy in the cloud.

• Data Protection/Backup: local/remote targets for NBU, Commvault, and Veeam.

WriteZILSSD

L2ARCSSD

ARC/DRAM

HCP

HCP

L2ARCSSD

ARC/DRAM

WriteZILSSD

HCP

L2ARCSSD

ARC/DRAM

WriteZILSSD

L2ARCSSD

ARC/DRAM

WriteZILSSD

37


ZFS Compression and Deduplication

ORACLE CLOUDSocial. Mobile. Complete.

Data Protection

Hybrid Cloud Pool

Oracle Intelligent Storage Protocol, Hybrid Columnar Compression, Advanced Compression/Advanced Data Optimization, Oracle RMAN, Encryption, Compression, etc.

Hybrid Cloud Pool

Up to 20:1 Data Reductionon Ingest

Up to 8:1 Data Reductionon Replication

Oracle ZFS Cloud Integrated with Proven Enterprise Storage Appliance

38


Oracle’s NAS and Data Protection System

Best performance. Best efficiency. Best security.

Trusted by a majority of the F100 and Oracle IT.

Foundation storage for Oracle Cloud.

Engineered for Oracle software.

Oracle Confidential – Highly Restricted 39

copyright © 2017, oracle and/or its affiliates. all rights

Documents