1
Storage Virtualisatie
Sjef van Ham
Storage Support Meerheide 101 5521 DZ Eersel [email protected]
26-maart-2009
2
Storage Opslag
DAS
Direct Attached Storage
NAS
Network Attached Storage
SAN
Storage Area Network
3
Wat is een SAN ?
1) Gecentraliseerde opslag op basis van een extern schijvencabinet voor verschillende typen servers
« alles in één doos »gecentraliseerd beheerhoge schaalbaarheid door veel schijfruimtehogere hardware redundantie en databeveiligingsfuncties : RAID,
spare disks
2) Speciaal storage netwerkFibre-Channel
grote afstand (optische kabels )hoge bandbreedte (4Gb)
iSCSI ethernetdirect toepasbaar en flexibellage TCO en infrastructuurkosten
4
Voordelen van gecentraliseerde opslag
• Flexibel en eenvoudig toewijzenvan capaciteit
• Gemiddelde benutting in een DAS-omgeving is < 50% (SAN = 85%)
• Schijf en tape in hetzelfde opslag netwerk (50-75% minder tape drives)
• Minder LAN-verkeer
• Gecentraliseerd beheer
• Beheer met minder mensen(efficiency stijgt met factor 10)
• Opslag, switches en tape toevoegen zonder applicaties stop te zetten
• Zo veel redundantie als gewenst
5
iSCSI Storage
• iSCSI staat voor Internet SCSI (Small Computer System Interface). Dit is een op het Internet Protocol (IP) gebaseerde standaard voor IP netwerken. Deze technologie is een versmelting van twee technieken die zich in de industrie bewezen hebben. Het gaat om de technologie die ontwikkeld is voor communicatie (ip netwerken) en de technologie bedoeld voor dataopslag , SCSI opslag. Door deze te combineren werd het mogelijk zowel de data als de dataopslagcommando's over ip-netwerken te versturen.
• Een netwerk protocol voor storage netwerken
• Gebruikt de standaard ethernet tcp/ip netwerktechnologie eb hardware
6
Fibre Channel SAN
• Fibre Channels work on a single popular storage networking protocol that offer compatibility to all common storage and database servers.
• Fibre Channels use the FCP protocol ( Fibre Channel Protocol) which is simply a serial bus SCSI protocol.
• This FCP (Fiber Channel protocol) works really well in networks with a high bandwidth requirement.
• Fibre Channel is een protocol dat voornamelijk wordt gebruik om data binnen storage netwerken te transporteren. Vaak wordt Fibre Channel geassocieerd met alleen glasverbindingen, maar het protocol kan zowel over glas als koperverbindingen worden gebruikt.
7
iSCSI voordelen door Eenvoud
Geen noodzaak meer om te investeren in FC technologie of FC
kennis
Ethernet is bekende technologie
Ethernet heeft een lagere TCO en infrastructuur
Geen noodzaak meer om te investeren in FC technolog
of FC kosten
Geen FC HBAs meer nodig, optionele iSCSI ethernet kaarten voor
hogere prestaties
8
IP based versus FC based
FC HBA’s Standaard Netwerk ip-kaarten
2-4-8 GB 1GBe-10GBe
• Fibre Kabels UTP kabels
• Fibre Switches Ethernet Switches
2-4-8 GB 1-10 GBe
9
De markt Fibre - iSCSI
Revenue Forecast by Installation EnvironmentRevenue Forecast by Installation Environment
$0B
$2B
$4B
$6B
$8B
$10B
$12B
$14B
2002
2003
2004
2005
2006
2007
2008
2009
$0
$5
$10
$15
$20
$25
$30
$35
$40
GB/$
DAS
FC SAN
NAS
Other SAN
iSCSI SAN
$/GB
10
Storage Requirements for the Traditional Data CenterPerformanceSupports current workloads. No performance degradation
ScalabilityScale capacity and performance without disruption
AvailabilityData stays online during a site failure, recover from disaster
ManageabilitySimple to admister
11
Typical Storage Array Architecture
• Monolithic Array
Not scalable• Controller head
becomes bottleneck• Scales capacity only
Single point of failure
Forklift upgrades
12
WHICH CAN BE COMBINED IN OUR FRAMELESS ARCHITECTURE
Scale when you need, as large as you need it, but view as a single SAN
Number of disks
Per
form
ance
13
Storage Pool
Pages
Disks
RAID
PS Series Array 1
RAID 10, 50 or 5
ArchiveSQL
11
22
NN
Exchange
Switched Gb Ethernet
ArchiveArchive
ExchangeExchange
SQLSQL
Typical iSCSI SAN
14
PS Series Array 2
RAID 10, 50 or 5
Storage Pool
Disks
RAID
PS Series Array 1
Pages
RAID 10, 50 or 5
ArchiveSQL
11
22
NN
Exchange
Switched Gb Ethernet
ArchiveArchive
ExchangeExchange
SQLSQL
33
44
22
44
Automatic and transparent load balancing across arrays
15
The LeftHand Difference
16
• Storage cluster
Aggregates all components for performance
Data is load balanced across all nodes
Predictable scalability
• Grow on your terms
Non-disruptive scalability
No forklift upgrades
Scale everything
Throttle bandwidth
• Create tiers of storage
Each optimized for type of data
Online volume migration
• Simple centralized managementProvisioningMonitoringSecurity
SAN/iQ Storage Clustering SAS
SATA
Centralized Management Console
17
SAN/iQ Network RAID
• Beyond component redundancy
Protects data from array failure
Synchronous replication
Configure on a per-volume basis
Configure on-the-fly, no down time
• High availability
Multiple disks, controllers, or arrays
Zero disruption of data access
Ensures “high availability” for data
SAN/iQ Cluster
A
B
C
D
A
B
C D
B
A
C
D
BA
C
D
18
SAN/iQ Multi-site SAN
• Protect Storage By:
Rack
Room
Floor
Building
Site
• Keep Data Online During:
Facility disruption
Natural disaster
Site maintenance
SAN/iQ ClusterSAN/iQ Multi-site SAN
A D A D
BA BA
C B BC
C D C D
Volumes Remain Online
SAN/iQ Thin Provisioning• Eliminate Initial Over-Purchasing
No Wasted and/or over-allocated capacity
Purchase what you need today
• Delay Future Storage Purchases
Grow capacity as warranted
• Simple to Manage
Enable/Disable with radio button on per-volume basis
Allocate only as data is written to the volume
No Reserve necessary
SAN/iQ Cluster
Full Provisioned Thin Provisioned
50 GB written50 GB written
50 GB written50 GB written
Allocated 200GB
Available 0GB
Used 0GB
Wasted 200GB
Allocated 0GB
Available 200GB
Used 0GB
Wasted 0GB
Allocated 200GB
Available 0GB
Used 50GB
Wasted 150GB
Allocated 200GB
Available 0GB
Used 100GB
Wasted 100GB
Allocated 50GB
Available 150GB
Used 50GB
Wasted 0GB
Allocated 100GB
Available 100GB
Used 100GB
Wasted 0GB
200 GB Volume 200 GB Volume
20
SAN/iQ Snapshots
• Simplified Backup and Recovery
Point-in-time volume copies
Scheduled, Ad Hoc or Scripted
• Functional
Volume rollback
Recover granular data
Backup Integration
• Microsoft VSS
• VMware VCB
• Space Efficient
Thin provisioned always
Delta changes only
No snap reservation
SAN/iQ Cluster
1:00
2:00
3:00
1:00
21
SAN/iQ Remote Copy
• Asynchronous Replication
Per volume basis
Scheduled or manual
Thin provisioned
No reserve space required
• Simple to Manage
Bandwidth management
Failover / Failback Wizard
SAN 1
SAN 2
2:00
1:00
3:003:00
2:00
1:00Baseline Copy
Incremental Copy
Incremental Copy
Recovery Server
22
Network Storage Server (NSS)Intelligent Storage Virtualization• True heterogeneous intelligent storage virtualization
• Application-aware data protection
• WAN optimized disaster recovery services protect operations and save on WAN costs
• Increased storage efficiency through Thin Provisioning of resources
• Your Storage, Your Infrastructure, Your Solution
23
TOTALLY Open Storage Virtualization Platform
DataPhysical
Existing SAN volumes via Storage
Service Enabler
Virtualized SAN volumes
Thin provisioned SAN volumes
Linux Solaris HP-UX AIX Netware
Exchange Oracle VMware
NotesSQL SAPDB2
Windows
Any application
Any operating system
Virtual
Any storage protocol
Any diskarray
24
Control storage management costand complexity
• Consolidate heterogeneous storage management through virtualization
• Minimize storage costs with thin provisioning
• Centralized management of client systems simplifies operations
25
The Solution Starts with Consolidation
• Enhanced storage utilization
• Consolidated storage management
• Opens the door for a host of solutions and innovations
Application ServersFile Servers
Backup SeversCritical Applications
SAN SAN
26
How storage virtualization works
• Quickly create virtual volumes from across or within any physical disk resources
- Simple wizard interface
- Physical LUN and virtual devices up to 16TB
- Expand volumes as needed
• Securely assign volumes to servers through NSS interface Virtual
disks
Physical disks
27
Storage abstraction layer
• Move the storage intelligence and security into the SAN fabric
NSS creates a storage abstraction layer
• Storage services no longer dependent on vendor-exclusive disk functionality
• Consolidates services and operations
Hosts
Fabric
Storage abstraction layer
Disk
28
Thin Provisioning:Better Storage Utilization
• Create a virtual volume to match size of data provisioning request
• Allocate a smaller amount of actual physical disk space
• Additional physical space allocated automatically as needed
• Reduces wasteful over provisioning of storage
• Saves disk space and power consumption
Data
Virtual
Thin provisioned SAN volume
Physical200GB
800GB
“800 GB”
29
Minimize downtime
• Highly available systems ensure continuous operation
•
• Cross-array mirroring for ultimate data protection
• Seamless, zero-downtime data migration
30
NSS high availability deployment model
• NSS appliances deployed in failover pairs
• Each NSS server supports its own set of client servers during normal operations
• If one devices fails, the second device takes over servicing clients
Shared Storage Failover
SAN
31
Data mirroring, zero downtime migration
• Any-to-any storage array synchronous data mirroring
• Ultimate data protection across arrays
• Seamless data migration across storage devices.
Create mirror
Switch primary/mirror status without any break in application processing
Remove mirror (old array)
Primary MirrorPrimaryMirror
Writes acknowledged
from both arrays to
ensure integrity
32
Ensure comprehensive data protection
• Application-aware snapshots provide rapid data recovery
• WAN optimized data replication for disaster recovery and failback
• Host-free, accelerated backup eliminates all backup windows
33
Application aware snapshots
• Up to 256 snapshots per volume
• Instant recovery to any captured
point in time
• Fully mountable as read/write
volumes
• Application agents and
consistency groups for 100%
transactional integrity
MS Exchange Oracle VMware DB2 Informix SAP MS SQL Sybase
Notes/Domino Progress Pervasive SQL
8:00 9:00 10:00 11:00
1:00 5:00 9:00
1:00 1:30 2:00 2:30
Each volume has its own
snapshot schedule
34
WAN Optimized Disaster Recovery
Full replicas
Copy to tape
DR Site
… …
Snapshots• WAN optimized out of the box• Includes WAN data encryption,
compression and QoS
• Easily configured any-to-any remote replication
• Continuous or periodic modes
35
WAN Optimized Data Replication
• Applications and file systems write far more data to disk than actual changes
• NSS scans the changes at a 512 byte level and replicates only the changed data
- Avoids constant re- sending of duplicate data
512 byte
= empty disk sector
= data written by application or file system
= sector with actual data change
A typical 8k write of data. Many systems send all 8k or more. CDP sends only the
truly changed sectors.
512 byte
Disk sectors
36
VMware Advanced Features
• Because continuous uptime is so critical, VMware has created several advanced features designed to help system uptime
- VMware High Availability
- VMotion
- VMware Distributed Resource Scheduler
37
VMware High Availability/Vmotion/Scheduler
• VMware High Availability automatically restarts virtual machines affected by physical server failure
XShared storage pool
38
The Power of the Virtual SAN
• The FalconStor Network Storage Server Virtual Appliance transforms internal disk storage into an iSCSI SAN
- No additional storage network investment needed
• Enables VMware advanced features
• Cost effective, highly available infrastructure for the SMB and ROBO
39
FalconStor NSS Virtual Appliance Architecture
Server Internal RAID
VirtualMachines
VirtualMachines
Virtual Switch
VMFSVolume
FalconStorNSS VA
VMFSVolume
IP Network
Physical Ethernet Adapter
Virtual LUN for VMDK files
40
High Availability via NSS VA Cross-Mirror
Cross-overGigabit connection
NSS-VA Cross-Mirror
Active Access Point
Passive Access Point
Standby NSS VA
Same sizevirtual LUN
Virtual Infrastructure HA supported without SAN storage
To client