zfs appliance
DESCRIPTION
ZFS ApplianceTRANSCRIPT
1 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle’s ZS3 seriesEnterprise Storage Systems
Fran Navarro
Preventa Sistemas Oracle
Nov 2013
2 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.
The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Important Disclosure
3 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Hardware-defined StorageCustom hardware drives system
performance and efficiency
Software-defined StorageStorage software drives system
performance and efficiency
Application Engineered Storage
Enterprise software drives system performance and efficiency
Oracle is Driving the Storage System Evolution
4 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle ZS3 StorageApplication Engineered Storage
Integrated Analytics
Real-time visualizations cuts troubleshooting
times by 50%
Optimized for Oracle Software
OISP cuts database tuning times by 65%; HCC delivers
10-50X compression
World-record performance and leading
price performance
Extreme Performance
5 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ORACLE’S NEXT GENERATIONZFS STORAGE APPLIANCE:
ZS3 SERIES
BEST PERFORMANCE
MOST EFFICIENT
ENGINEERED FOR ORACLE SOFTWARE
6 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Strong and Steady Product Maturation
ZFS Filesystem
Analytics
• 2nd Gen. Platform• Software Release OS7
• Deduplication• Thin Provisioning• Enterprise RAS• Shadow Migration• Surpassed an Exabyte Stored
• ZS3 series release• Software Release OS8
• 200PBs in Oracle *IT• World-record Performance• Oracle Database (OISP)• IaaS Offering • SMU/Oracle DB• DE2 Disk Enclosures
2009 2010 2011 2012
2013
• First Platform Release- Compression, Replication, etc.
• Hybrid Storage Pool (with Flash)• Analytics• Development engaged in 2004
2008
• 3,000th Customer• 10,000th system sold• Hybrid Columnar Compression• ZFS Backup Appliance• 150PBs in Oracle *IT• Foundation for Oracle Cloud• Best-in-class SPC-1• Best-in-class SPC-2• Most efficient ($/IOP) SPECsfs
• 1,000th Customer• Unified Storage (block)• InfiniBand• Replication• Thin Provisioning• Best-in-class User Interface
Oracle’s ZFS Storage Appliance
7 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Snap Clone Replication
ApplicationI/O
Virtual Poolfile, volume, and
data services
ReadIntensive
I/OStorage Poolread flash, writeflash, and drives
Storage
Performance- Automates storage tiering (HSPs)- Eliminates distinct file and volume management- Concurrent block and file I/O, with shared data services- Multi-core, multi-threading RTOS
Data Integrity- Entire I/O path validated before data stored- Eliminates potential for bit rot, phantom writes, etc.
Analytics- Comprehensive and precise file-level view
Com-press Dedup Thin
Provision
WriteIntensive
I/O
• Auto Administration
• System Analytics• Virtual Storage
Pools• Dynamic Data
Tiering• Modular Scalability• Oracle SW
integration
Storage OS
CIFSNFS FCiSCSI
IB
Mirror,RAID-Zx
Engineered for Unified Storage
8 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle’s new ZS3 Series
ZS3-2 ZS3-4
• Single or Dual Controllers• 512GB DRAM• 8 PCIe Slots• 16 Disk Enclosures*• 12TB Read Flash• 4TB Write Flash*
• Single or Dual Controllers• 2TB DRAM• 14 PCIe Slots• 36 Disk Enclosures• 12TB Read Flash• 10TB Write Flash
2x Faster3x More ScalableOS8 Storage OS Support
* ZS3-2 will release with expansion to 8 disk enclosures. Scale to 16 expected within 6 months of release.
ZFS Storage Operating System• Most powerful storage software suite• Engineered Integration with Oracle software
9 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Software | Hybrid Storage Pools
80 CPU cores
2TB Memory
12TB Read Flash
10TB Write Flash
10 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Hybrid Storage Pool
Storage Media Latencies
DRAM0.03ms
FLASH0.10ms
DISK30.00ms
Introduced first by Oracle on ZFS Storage Appliances in 2008
Dynamically Serve 70-90% of I/O from DRAM Not to Scale
11 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
• Fibre channel• iSCSI• InfiniBand over IP/RDMA• iSER• SRP• NFS V3 and V4• CIFS• HTTP• WebDAV• FTP/SFTP/FTPS• ZFS NDMP V4
Comprehensive Suite of Enterprise Software
• OISP• Hybrid Columnar Compression• Hybrid Storage Pools• Single, double and triple-parity RAID
(RAIDZ, RAIDZ2,RAIDZ3)• Mirroring and triple mirroring• End-to-end data integrity• Local and remote replication• Snapshots and clones• Quota(s)• In-line deduplication• Compression• Thin provisioning• Antivirus via ICAP protocol• Online data migration• Clustering
• Browser and CLI interface
• Management dashboard
• Hardware/component view
• Role-based access control
• Phone home
• Event and thresholdbased alerting
• Storage analytics
• Scripting
• Workflow automation
• Advanced networking
• Snap Management Utility
• Source aware routing
Data protocols Data services Management
12 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Majority of the Fortune 100 Rely on Oracle ZFS Storage
13 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Majority of the Top 10 Global Banks Rely on Oracle ZFS Storage
14 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle’s ZFS Storage is the fastest growing major storage vendor
15 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Over 150 companies switch from NetApp and EMC to Oracle ZFS
Storage every quarter…
16 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
17 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Best Performance#12x Faster than NetApp in OLTP, 2x Faster than NetApp in File serving,4x Faster than NetApp in OLAP/DSS, 4x Faster than NetApp in VDI/VM4x Faster than NetApp in Backup, 5x Faster than NetApp in Restores.
Most Efficient#185% Smaller backup windows than NetApp, 44% Faster trouble-shooting than NetApp, 2x Better price/performance in OLTP than NetApp, 5x Better price/performance in File serving than NetApp, #1 in Analytics and HSPs.
Engineered for Oracle Software#1
Only NAS vendor with Hybrid Columnar Compression, Only NAS vendor with Oracle Intelligent Storage Protocol, Only NAS vendor engineered with ADG. , Only NAS vendor that enables the full-featured Oracle 12c ADO capability.
Storage for Oracle *IT and Cloud#1
Only NAS vendor with over 225PBs in enterprise environments that get updated before customers use the latest firmware releases. Only NAS with NFS cloud environment generated 3.2B database transactions per hour.
18 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 18
ZFS Storage Appliances
Increase database responsiveness.
Engineered for extreme performance.
Minimize backup windows.
Expedite large data queries.
19 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle’s ZS3 StorageThe Fastest Storage System Available
17.3 GB/s @ $23/MB/s
World-record performance, streaming and on-line application processing (SPC-2)
4-6X more efficient than every other storage product
has never exceeded 13GB/s @ $88/MB/s
has never exceeded 15GB/s @ $131/MB/s
has never exceeded 13GB/s @ $95/MS/s
BESTPERFORMANCE
20 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
450K IOPS / 700μs
Best-in-Class application responsiveness and performance (SPECsfs)
5-8X better $/IOP than everything in its class
Best is 1.2ms with FAS6240 and 100K IOPS / 1.7ms on FAS3250
BESTPERFORMANCE
Best is 3.2ms, 456K IOPS with a 56 node Isilon system
Oracle’s ZS3 StorageThe Fastest Storage System Available
21 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Best Performance is Not Enough
22 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
87% of Storage Costs Are the Result of Inefficient Systems or Software
Source: Oracle Customer Advisory Boards
23 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 23
ZFS Storage Appliances
Minimize the time it takes to trouble-shoot and resolve IT issues.
Industry-leading storage efficiency.Eliminate the time required to assess, tune, and deploy storage tiers.
Eliminate management of disparate files and volumes.
24 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
MOSTEFFICIENT
Management Efficiency | Analytics
• Industry’s most comprehensive real-time visualization of application- and storage-related workloads (on right picture of database and table index analytics)
• Visualize CPU, cache, protocol, disk, memory, networking, and system-related data, all at the same time.
• Drill down quickly on areas of concern
• Support multiple simultaneous application and workload analysis in real-time, to help compare various aspects of system stress
• Analysis can be saved, exported and replayed for further analysis
25 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ZFS Appliance Dashboard
• Starting point for appliance analysis– Ideal for single device
monitoring
• Real-time updates to graphical view of operations– Utilization and alerts
easy to identify
Monitoring at a glance
26 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ZFS Storage Appliance Analytics
• Simple yet sophisticated instrumentation
• Available on all ZFS Storage Appliance models
• Analysis can be saved, exported and replayed for further analysis
Automatic real-time visualization of application and storage workloads
27 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ZFS Storage Analytics
28 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Statistics
• Statistics are a collection of data displayed and graphed by ZFS Analytics
• Every layer of the stack has available statistics– CPU– Disk– Network– Protocols
29 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Drilling Down into Statistics
• Statistics can be drilled down to form ad-hoc queries– Which clients have the highest access rate on a certain day of the week?– Which NFS operations are taking at least 2 milliseconds during high
production load?– Which disks are seeing the most amount of activity over the past month?
30 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Navigate Through Time
‘Arrow’ buttons move back and forth between the past and present
‘Pause’ suspends the graph, but not data collection ‘Zoom’ buttons control the time scale of the graph
‘Clocks’ are pre-defined zooming to by-minute and by-hour
‘Calendars’ can display an entire day, entire week, or entire month
31 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Worksheets
• A worksheet is a user-defined collection of statistics
• They are persistently saved and can be shared by users
• Handy for crafting just the family of statistics that are relevant for your performance analysis
32 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
• A user running a performance test increases the load on the storage in an unexpected way and the storage administrator can drill into the issue in real time to understand where the load is coming from.
Phantom Workloads Exposed
File Level Visibility
33 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Phantom Workloads ExposedWhere is my IO load coming from?
34 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Phantom Workloads ExposedWhat is that client doing?
35 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Phantom Workloads ExposedWhat’s happening inside that file?
36 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ZFS Appliance Monitor iPhone application that monitors multiple ZFS Storage Appliances
Brings the power of DTrace Analytics at your fingertips
Easily view the health/status of any ZFS Appliance, anywhere
Ideal for Execs/Storage Admins with need for instant access to information
Graphical and intuitive display of:• System and component status (disks, CPU, RAM, fans, etc)• Service status (NFS, iSCSI, SMB, etc)• Resource & I/O status• DTrace Analytics (real time statistics via saved worksheets)• Logs for alert, system, fault, audit, phone home• Active systems problems (can be marked as repaired via app)• High level group status including storage use, problems, hardware status• Storage utilization• Remote activation of system and component locator LED
Availablenow on
App Store
37 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ZFSSA Monitoring and Managementmonitoring with Enterprise Manager for single pane of glass
Enterprise Grade Monitoring/Management Facility– Comprehensive Dashboard View
• Central Repository for Analytics Storage
• Database Configuration, Hardware and Network Configuration
• Operational and Availability Analytics
– For Storage Platforms
• Information is collected by installed Plug-Ins
• Stored in real-time on the Oracle Enterprise Manager Repository
For the Storage 7000– Data collected by Dtrace Analytics and FMA
• Data is corroborative between SS7000 and OEMGC
• Includes capacity Utilization
• Cache usage and performance metrics
• Detailed Alerts
– Enables collaboration between the DBA and Storage Administrator
38 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle EM Cloud Control Plug-in for ZFSSA
• Oracle Enterprise Manager Cloud Control (OCC) 12c communicates with the ZFSSA appliance through a plug-in deployed to an active OCC agent.
• The plug-in collects status and data from the ZFSSA and relays it to the OCC management server, which stores the data in the OMS repository database.
• The ZFSSA plug-in formats screens and reports in the OCC web interface.
39 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Integrating ZFS with Enterprise Manager
• ZFS appliance becomes an additional target to monitor
• Provides method for n-way monitoring of multiple ZFSSA systems through common EM interface
Monitor ZFS appliances as part of the enterprise
40 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Wide Range of Individual Measurements
• Ability to monitor statistics across all functions of the appliance– Appliance status– Cache activity– Disk throughput– Network devices– Protocol activity
• Graphical view of metrics
Complete set of metrics for system monitoring from EM
41 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ZFSSA – OEMCC MetricsHigh Level Metric Sub-Metrics
Logical Status
Share identifier, Available (GB), Total allocated (GB), Data (GB), Share percentage used, Quota (GB), Reserved (GB), Unused Reserved (GB), SCSI LUN
Project Status
Project identifier, Available (GB), Total allocated (GB), Project Data (GB), Project percentage used, Quota (GB), Reserved (GB), Unused Reserved (GB), Total Share Quota (GB), Project Over Allocated
Configuration Service Service name, Service Status
Appliance Capacity Totals
Storage pool, Pool owner, Pool status, Data profile, Available (GB), Total used (GB), Pool used percentage, Total Capacity (GB), Data disks, Spare disks, Cache Disks, Total project quota (GB), Quota Allocation(GB), Reservations (GB) Pool over allocated
Cache ARC Size (MB)Cache L2ARC Size (MB)CPU Utilization %Disk I/O Ops Operations per SecondDisk I/O Ops Latency Operations per SecondDisk I/O Bytes KB per SecondNetwork Device KB per SecondNFSv2 Ops Operations per SecondNFSv3 Ops Operations per SecondNFSv3 Ops Latency Operations per SecondNFSv4 Ops Operations per SecondSMB Ops Operations per SecondSMB Ops Latency Operations per SecondiSCSI Ops Operations per SecondiSCSI Ops Latency Operations per Second
Initiator and Target GroupsProtocol, Group name, Address, Initiator or target
High Level Metric Sub-MetricsARC Activity Activity, Accesses per secL2ARC Activity Activity, Accesses per secARC Activity by Share Share, Accesses per secL2ARC Activity by Share Share, Accesses per secNFSv3 Operations by Share NFSv3 Share, Operations per secNFSv4 Operations by Share NFSv4 Share, Operations per secNetwork IO Direction Direction, KB per secNetwork IO by Device Device, KB per secNetwork Interface Performance Interface, KB per sec
Physical Component StatusCluster state, Cluster state description, Cluster peer state, Cluster peer state description
Appliance Information
Reported node name, Product model, Appliance serial nbr, Chasis serial nbr, Appliance SW version, Install time, Last update time, Power on time, Up time, Clustered, Cluster peer
Appliance Logical informationShare identifier, Share type, Mount point, Data profile, Data compression, Cache usage, NFS, CIFS
IP Network InterfacesInterface, IP Address, CIDR, IP Version, Management enabled
IP Network Interface to Datalink relationship Interface, Datalink, Jumbo frames
IP Datalink to device relationship Datalink, Link, ClassIP Network Devices Network Device, Device speed, Device up
Alert Log ContentsProblem ID, Time stamp, Alert description, Alert log problem type
Fault Log ContentsProblem ID, Time stamp, Description, Fault log problem type
Problem Log ContentsUUID, Description, Problem severity, Problem log code
Replication ActivityProblem ID, Time stamp, Replication description. Replication log problem type
42 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Set Custom Thresholds
• Manage alerting based on specific limits– Alerting can be turned on
or off, send messages only on customer-defined key metrics
– Generate alert levels based on independent system use cases
Tune alerting to specific needs
43 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Expanded Reporting Features
• Expanding monitoring through the Oracle stack– Identify relationships between database and storage resources– Track network performance
Database relationship and Network performance monitoring
44 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Redirect to Appliance for Detailed Management
• For more granular analysis and control, link from the appliance summary page directly to the appliance dashboard– Will require ZFS appliance login
for security
Link directly from EM to launch ZFSSA GUI
45 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Available Resources
• Enterprise Manager Grid Control/Cloud Control– http://www.oracle.com/us/products/servers-storage/storage/nas/oracle-en
terprise-grid-manager-ds-431598.pdf– http://www.oracle.com/technetwork/oem/enterprise-manager/downloads/inde
x.html
• ZFSSA EM Plug-in– http://www.oracle.com/technetwork/oem/grid-control/downloads/zfs-stora
ge-plugin-487867.html– http://download.oracle.com/otn/java/oem/Oracle_GC_Plugin_InstallGuide
Links
46 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle Software Runs Fastest and Most Efficiently
on Oracle Storage
47 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Application Engineered Storage
OISP ADO HCC
Dynamic and automatic database-
storage tuning
Advanced and dynamic database (data) optimization
Superior database, data warehousing
compression
48 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
OracleIntelligentStorageProtocol
Eliminates hundreds of hours spent tuning (and re-tuning) storage and database for optimal performance
49 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
DB I/O metadata communicated to ZFS Storage
DB Control File Writes prioritized among other IO in ZFS Storage
Oracle Database
Que
ry D
ata
Res
pons
e
Databasedata
2TB DRAM
10TB FLASH (R / W)2PB DISK
0.03ms0.10ms
30.00ms
ZFS Storage
Oracle Intelligent Storage Protocol: Unique language that enables dynamic communication between an Oracle Database and Oracle’s ZFS Storage Appliances.
• Available only for Oracle Database 12c customers using Oracle Direct NFS (dNFS) with Oracle ZFS Storage Appliances that are running software version OS8
Oracle’s ZS3 systems dynamically assign system resources to optimize Oracle Database performance and efficiency
Oracle Intelligent Storage Protocol (OISP)Cut Database and Storage Tuning Time in Half
50 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Without OISP With OISP
Two shares: logfile and datafile
NFSServer
OISP Tunes
Logfile share
Datafile share
NFSServer
Multiple shares, each with its own Record Size and
LogBias setting
/mnt/dbname/redo (Record Size, LogBias)/mnt/dbname/control (Record Size, LogBias)/mnt/dbname/pfile (Record Size, LogBias)/mnt/dbname/datafile (Record Size, LogBias)/mnt/dbname/tempfile (Record Size, LogBias)/mnt/dbname/chgtrack (Record Size, LogBias)/mnt/dbname/backup (Record Size, LogBias)
/mnt/dbname/logfile (OISP sets Record Size, LogBias)redo
/mnt/dbname/datafile (OISP sets Record Xize, LogBias)controlpfiledatafiletempfilechgtrackbackup
OS8 | OISP: Auto Tuning of Record Size, LogBias
51 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
AutomaticDataOptimization
Increases database efficiency and performance, by dynamically moving data across storage tiers and compression algorithms
52 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ADO: Dynamically Assesses Data Usage PatternsDatabase ‘heat map’
10 0111 10 10 0111 101 1
00 0101 10 10 0101 10
0 010 0111 10 10 0111 100 010 0111 10 00 0111 001 1
01 0101 10 00 0101 101 110 0100 11 10 0111 100 0
10 0111 10 10 0111 100 010 0111 00 00 0111 100 110 0100 11 10 0111 100 0
10 0101 10 10 0101 001 1
00 0101 10 10 0101 101 110 0100 11 10 0111 100 0
10 0110 11 10 0111 100 0
10 0111 10 00 0111 001 1
01 0101 10 00 0101 101 110 0100 11 10 0111 100 0
10 0111 10 10 0111 100 010 0111 00 00 0111 100 1
00 0101 10 10 0101 101 110 0100 11 10 0111 100 0
00 0101 10 10 0101 101 110 0111 10 10 0111 100 010 0101 10 10 0101 001 110 0100 11 10 0111 100 0
10 0111 11 10 0111 100 010 0111 10 10 0111 101 110 0110 11 10 0111 100 0
10 0100 11 10 0111 100 0
10 0111 11 10 0111 100 010 0111 10 10 0111 101 110 0110 11 10 0111 100 0
10 0111 10 10 0111 100 01 1
1 1
10 0100 11 10 0111 100 0
10 0100 11 10 0111 1010 0111 10 10 0111 10
10 0100 11 10 0111 100 0
10 0100 11 10 0111 100 0
10 0111 10 10 0111 100 010 0111 10 00 0111 001 1
01 0101 10 00 0101 101 110 0100 11 10 0111 100 0
10 0111 10 10 0111 100 010 0111 00 00 0111 100 110 0100 11 10 0111 100 0
10 0101 10 10 0101 001 1
00 0101 10 10 0101 101 110 0100 11 10 0111 100 0
00 0101 10 10 0101 101 110 0111 10 10 0111 100 010 0101 10 10 0101 001 110 0100 11 10 0111 100 0
10 0111 10 10 0111 100 010 0111 10 00 0111 001 1
01 0101 10 00 0101 101 110 0100 11 10 0111 100 0
10 0111 10 10 0111 100 0
00 0101 10 10 0101 101 110 0111 10 10 0111 100 010 0101 10 10 0101 001 1
00 0101 10 10 0101 101 110 0100 11 10 0111 100 0
10 0111 10 10 0111 100 010 0111 10 00 0111 001 1
01 0101 10 00 0101 101 110 0100 11 10 0111 100 0
10 0111 10 10 0111 100 0
00 0101 10 10 0101 101 110 0111 10 10 0111 100 010 0101 10 10 0101 001 1
00 0101 10 10 0101 101 110 0100 11 10 0111 100 0
10 0111 10 00 0111 001 1
01 0101 10 00 0101 101 110 0100 11 10 0111 100 0
10 0111 10 10 0111 100 010 0111 00 00 0111 100 1
00 0101 10 10 0101 101 110 0100 11 10 0111 100 0
10 0111 11 10 0111 100 010 0111 10 10 0111 101 110 0110 11 10 0111 100 0
10 0111 10 10 0111 100 010 0111 10 10 0111 100 0
10 0110 11 10 0111 100 0
10 0100 11 10 0111 100 0
10 0111 11 10 0111 100 010 0111 10 10 0111 101 110 0110 11 10 0111 100 0
53 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Heat MapWhat it tracks
“Heat Map” tracking
– Database level Heat Map shows which tables and partitions are being used
– Block level Heat Map shows last modification at the block level
Comprehensive
– Segment level shows both reads and writes
– Distinguishes index lookups from full table scans
– Automatically excludes stats gathering, DDLs, table redefinitions, etc
High Performance– Object level at no cost– Block level < 5% cost
Active
Frequent Access
Occasional Access
Dormant
Actively updated
Infrequently updated, Frequently queried
Infrequent access for query and updates
Long term analytics & compliance
HOT
COLD
54 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
0101101110101010010100100100001000
1010101101001011010011100001010010
Archive Data
011100001010001011011
101010100101001001000
010001010101101001011
010101001010010010001
Automatic Data Optimization Usage Based Data Compression
Hot Data
3X Advanced Row Compression
Warm Data
10101010111010100110101110000101000
10110111010101001010010010000100010
10101101001011010011100001010010010
1000010010000100010101011010010
10X Columnar Query Compression
1000010100100101001010110111000010
1010101011101010011010111000010100010110111
010101001010010010000100010101011010010110
10011100001010010010100001001000010001010
101010101110101001101011100001010001011011
15X Columnar Archive Compression
011101010100101000010001010101011100001010
101010101110101001101011
10000101000101101110101
01001010010010000100010
101011010010110100111000
01010010010100001001000
01000101010111001101010100101001001000010001
1110010100100101001010110111011010
101010101110101001101011100001011101011001
55 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Heat MapEnterprise Manager
56 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
HybridColumnarCompression
Increases database efficiency and performance, by enacting columnar compression for data warehousing, analytics, and mining operations
57 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Store Less Data AND Run Faster
• Up to 50x space reduction
• Average 5x faster queries
• Only available on Oracle storage
• Increases performance for most data warehouse and data protection
Oracle Database Hybrid Columnar Compression
Hybrid Columnar Compression (HCC)
735GB 38GB
1
2
31
2
3
0
2 Hours, 22 Min, 44 Sec 16 Min, 50 Sec
8xFasterQuery
94%LessStorage
UncompressedWith Hybrid Columnar
Compression
Retail Data Warehouse Example
58 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
More Software | Data Reduction
• Thin Provisioning
• Deduplication
• Compression
59 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Data
Unused
Data
Unused
Data
UnusedVolume C80% of Reserved Space Consumed
Volume B50% of Reserved Space Consumed
Volume A20% of Reserved Space Consumed
Traditional Allocation58% consumed. 100% reserved.
No storage available.
Data
Data
Data
Volume C100% of Consumed
Volume B100% of Consumed
Volume A100% of Consumed
Thin Provisioned58% consumed. 42% storage available.
StorageAvailable
For AllVolumes
Software | Data Reduction: Thin Provisioning
60 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Software | Data Reduction: Deduplication
• Block level (in-line) deduplication
• Not recommended for database backup, active transactional workloads, or heavy throughput workloads
• Recommended for data reduction VM boot images Hash Function
Actual Data Blocks
Physically Stored Data Blocks
61 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Software | Data Reduction: Deduplication
• Reduce Costs– Leverage current backup software
– “Inexpensive” and high performance Sun servers
– Shrink backup window by up to 90% (client dedupe)
• Flexibility– Deduplication at the client, backup server, neither, or both
– Deduplicate by data type – eliminates “all or nothing” approach
• Reduce Risk– No hardware vendor lock-in
– Regular disk and tape storage – taking advantage of compression and encryption
– Possible tape deduplication
Deduplication is often completed in the application software layer
62 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ORACLE DATABASE COMPRESSION
ACO
• Algorithms calculated at the database compute tier
• Additional license cost
STORAGE COMPRESSION
• ZFS Storage Appliance
• 4 Levels of compression
• Algorithms executed at the storage tier
• Data type agnostic
• No additional cost
HCC
• Algorithms exeecuted at the database compute tier
• Available at no additional charge with Oracle storage only
Software | Data Reduction: Compression
63 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Software | Data Reduction: Compression Options
LZJB – low-overhead compression, aka “compression for free”
GZIP-2 – lightweight version of gzip algorithm
GZIP – higher compression, but at some compute overhead penalty
GZIP-9 – highest compression, but can consume significant compute resources
• No software license fees for compression
• Options: select compression to suit your workload
• Balance performance and data reduction
• LZJB is very lightweight – in fact it increases performance in some cases
• Higher compression options if more data reduction needed, more compute overhead tolerated
ZFS Storage Compression Considerations
Mo
re C
om
pressio
nM
ore
P
erfo
rman
ce
64 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Software | Data Reduction: Database Compression
Advanced Compression Option (ACO)• 2-4x reduction in storage• Faster queries in many cases,
due to improved I/O and memory efficiency
• Better network bandwidth utilization
Hybrid Columnar Compression (HCC)
Up to 50x reduction in data storedAverage 5x better performanceIncluded at no additional cost with
Oracle storage devices
65 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Snap Manager for Oracle DBManage snapshot copies in the ZFS Storage Appliance
• Allows for quick and efficient backup, restore, cloning and provisioning of application instances
• “Application Aware” Ensures no data loss and consistent backups
• Supports Oracle 10g, 11g, RAC– Currently supports NFS/dNFS and iSCSI protocols– CLI version for multiple client platforms (Solaris, Linux, Windows)
• Database host support includes Solaris, Linux, Windows
• Snapshot types– Hot: Online– Cold: Offline
• Snapshot maintenance– Automated scheduler– Retention policies– Custom Attributed (annotate snapshot with metadata)
• Rollback to a snapshot
Rollback
Snapshot
66 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 66
Oracle Storage Best Practices for Oracle VM
67 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle VirtualizationThe Full Stack, End-to-End
Application-Driven Virtualization
DATA CENTER
Servers Servers Servers
Oracle VM Servers
Oracle Enterprise Manager
12cVM
VM
VM
VM
VM
VM
Server Virtualization Desktop Virtualization
Oracle VMTemplates
&Assemblies
E-Business SuiteVMs
Software Delivery Cloud
US
ER
S
Contact Service Center
Oracle Sun Ray Clients
PCs, MACs,
MOBILE
DEVICES
THIN CLIENTS
Oracle Virtual Desktop Client
BROWSER
Oracle Secure Global DesktopApplication Stack
Oracle D
esktop V
irtualization
• Oracle VM Server for x86• Oracle VM Server for SPARC
(LDoms)• Oracle Solaris Zones• Dynamic Domains
• Oracle Secure Global Desktop• Oracle VM VirtualBox
Network
Storage
Storage
Network Virtualization
• Oracle Xsigo Data Center Fabric
68 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Virtualization Platform: Oracle VMServer Virtualization and Management
• Cost effective – no license fees
• High performance – virtualize apps with confidence
• Enterprise-quality support – global, 24x7 support
• Faster application deployment – Over 90+ templates
• Integrated stack- Interoperability, security across stack
• For both Oracle and non-Oracle applications
• The only server virtualization software supported and certified with Oracle products
69 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
• VM Observability w/ Storage Analytics– Optimized storage workload visibility– 44% faster in diagnostics/troubleshooting
• Higher performance with Hybrid Storage Pools– Accelerated read cache VM performance– Improved virtualization write performance
• Storage Efficient Provisioning– Accelerates Virtual Machine Deployment by 34%– Faster Oracle VDI Provisioning by 40%
• Lower TCO– 8x higher storage efficiencies with compression and de-dup– Optimized Power/Space/Cooling– No-charge for protocols
Higher Storage agility with virtualization and Oracle ZFS Storage appliance
Financing World GrowthFinancial Institute Relies on Sun ZFS Storage
70 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
+
+ +
Oracle VM Server + Templates
Sun Blade Modular System
Sun Unified StorageFlash Enabled
Ora
cle M
anag
emen
t
Oracle Solaris / Linux OS
Oracle and 3rd Party Applications
Oracle Network Fabric Architecture
=+
+
Oracle Optimized Solution for Enterprise Cloud Infrastructure
ZFS Storage Appliance
Sun Blade 6000 + Ethernet switched NEMs
71 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Network Configuration• NFS protocol over 10GigE network
– NFS integrates file access, file locking, and mount protocols into a single, unified protocol to improve security
– NFS offers the utmost simplicity in attaching storage in Oracle VM virtualization environments over Ethernet.
– NFS on Sun ZFS Storage Appliance scales well to many concurrent I/O threads. This high I/O throughput enables more VM stacks to perform I/O without sacrificing service levels.
– Two 10 GbE interfaces supply plenty of bandwidth to access virtual machine data.
• IB and FC are also available alternatives to this configuration
72 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle VM 3.0
• Storage Connect Framework– Support for Native Storage Services– Share/LUN creation, deletion, expansion– Access Group creation– Allows storage operations to be done via OVM Manager
• OCFS2 1.8 cluster file system– Instant clone support
What’s new for Storage?
73 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle VM Storage ConnectAdvanced Storage Operations
Storage Connect Plug-Ins for Management…• Oracle and 3rd party storage…from the Manager UI
More than just provisioning…
• Create LUNs or Volumes• Expand LUNs or Volumes• Associate, share with VMs
Create LUN
CLONE VM
3.0
Sun ZFS Storage
Storage Connect Plug-In Framework & API
Oracle ZFS Plug-In
Pillar Storage
Pillar Plug-In
vendor_specific_command_CREATE_LUN
OCFS2 Filesystem
JBOD
OCFS2 Plug-In
_INSTANT_CLONE
Storage Repositories
74 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Storage Connect for ZFSSA
• Current ZFSSA Storage Connect has support for iSCSI and FC LUNS– NFS support to come when OVM adds support in framework– NFS can still be added as a Generic File Server or Generic FC
array
75 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Configuration Best Practices
• Consider a Hybrid approach– Template/VM repositories on iSCSI block LUN
• Takes advantage of OCFS2 cloning for rapid template/OS deployment
– Application data (database, middleware) mounted direct from Guest VM via NFSv3. • Takes advantage of excellent NAS performance of ZFSSA
– EHCC & dNFS for the databases
– Analytics to pinpoint application issues down to the VM and even down to the file
– Snap&Clone on the ZFSSA for rapid Test/Dev rollout
– Avoids issues with Block Alignment on data intensive shares or LUNs
76 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Final ConsiderationsOracle ZFS Storage AppliancesNAS and Unified Storage
77 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle’s ZFS Storage Systems
Over 225PBs in Production at Oracle!
ORACLE CLOUDSocial. Mobile. Complete.
Storage foundation for Oracle’s Enterprise Cloud, IT, and Product Development Infrastructure
78 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Best Performance. Best Efficiency. Engineered for Oracle Software.
Trusted by a majority of the F100, ~4000 enterprise business, and Oracle IT
Foundation storage for Oracle Cloud (over 25 million users)
Fastest Growing Storage Vendor
Oracle Storage ZFS Storage Appliances
79 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
DEMOS
• Demo ZFS + Vmware– http://www.youtube.com/watch?v=i47XhPsAVTQ
• Demo ZFS Analitics– http://www.youtube.com/watch?v=JazDlzTe9vE
• Demo ZFS + OVM– Instalar ZFS Appliance Simulator + OVM
http://www.oracle.com/technetwork/systems/hands-on-labs/hol-deploy-cloud-ovm-sunzfs-1889199.html
80 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
81 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.