storage challenges storage today = complex & expensive storage cost and infrastructure sprawl...
TRANSCRIPT
Hybrid Storage with Storsimple
Marin FrankovicDatacenter [email protected]
Storage challenges
Storage Today = Complex & Expensive
Storage cost and
infrastructure sprawl
Complex data protection &
recovery
Resource constraints
Rapid data growth - 40% YoY*
* Source: EMC Digital Universe with Research and Analysis by IDC, 2014
StorSimple 8000 series: Where they fit in
Applications in Physical or Virtual Servers
StorSimple Hybrid Storage Array
Customer Data Center
StorSimple 810015TB - 40TB local200TB with cloud
StorSimple 860040TB – 100TB local500TB with cloud
Consolidated storage and data
management
Access in Azure to enterprise data
StorSimple 8100, StorSimple 8600 with Microsoft Azure StorSimple Manager and Microsoft Azure StorSimple Virtual Appliance
Microsoft Azure StorSimple Manager
Microsoft AzureStorSimple Virtual Appliance
Applications in Virtual Servers
Azure Data Center
1 8000 series storage arrays are built and distributed by Seagate
Tiering to Azure versus other clouds, with StorSimple
4
Features Microsoft Azure AWS, OpenStack, HP
Cloud Storage √ √
StorSimple Manager Service (in Azure)
√ √
Disaster Recovery with StorSimple Virtual
Appliance (Failover)
√
Applications in Azure with StorSimple Virtual
Appliance (Clone)
√
Migration Tool Kit √
Microsoft Azure StorSimple Big PictureON-PREMISES DATA
CENTER
iSCSIInternet
connection
StorSimple Virtual Applianc
e
Administrator
CLOUD DATACENTER
Server
StorSimple Snapshot Manager Plug-in
Series 8000 Hybrid Storage
Array
StorSimple Manager
Cloud
StorSimple 8000 series: Hardware specs
summaryModel Number 81001 86001
Usable Capacity 15TB 40TB
Usable SSD Capacity 800GB 2TB
Effective Local Capacity2 15-75TB 40-200TB
Max Capacity (including cloud) 200TB 500TB
Network Interface Cards 2 x 10G and 4 x 1G
Enclosure Form Factor 1 X 2U 2 X 2U
1 Storage arrays built and distributed by Xyratex; Full specifications can be found at http://storsimple.seagate.com/specifications-80002 Based on deduplication and compression; may vary by workloads and data types
StorSimple 8000 series: StorSimple Virtual
ApplianceModel Number 1100
Maximum Capacity 30TB
Storage Azure BLOB
NetworkConnects to VMs via a virtual
network in Azure* No MPIO
Fault tolerance of enterprise class storage
Software Feature
Protects Against?
How is works?
Controller failover
Protection against the failure of a controller.
The dual controllers are active/passive. In the event the active controller fails the passive controller automatically takes over. NVRAM mirrored across controllers via NTB.
Storage Spaces
Protection in the event of one or more drive failures.
Disk insert into and removal from pools.
Nondisruptive software upgrades (NDU)
Allows updates to be made to the operating system without taking downtime.
The software is downloaded and updated on each controller. One controller is up at all times to continue processing and serving data.
Redundant Power
Supplies
Dual Controllers
Network Interfaces
Networking Physical,
Virtual Servers
VLAN1
VLAN2
Switch 1 Switch 2
Switch 3
Internet/WAN connection
CONTROLLER 1
CONTROLLER 2
NICD3
NICD3
NICMGMT
NICMGMT
NICD1
NICD2
NICD1
NICD2
NIC NIC
WAN (Corporat
e)
iSCSI should be on the storage network and it is not recommended to route the iSCSI traffic
To access azure, the firewall should allow HTTPS port (443)
If external DNS server is used, ports for DNS should be open
If external SMTP server is used for notification, port 25 should be open
Local, Zone, and Geo Redundant Storage Options
Primary Location
Secondary Location
Data protection for
data in the cloud
Asynchronous replication between
Azure data centers
Replicated data does not count against data limit for the account
Prevents against a partial or complete
data center failure
Makes 3 copies of data
across separate fault
domains
Failover to alternate location
determined by Azure
operations
Automatic tiering
Low Threshol
d
High Threshol
dTime
0
1
2
3
4
Oldest
DataData exceeds high watermark
Old data spills to next tier
Tier is empty in the beginning
New data is written at start of free space
Tier returns to low watermark level
DATA
DATA
DATA
DATA
DeduplicationSSD HD
D4MB
64KB ChunksDedupe Algorithm
0xaab123
0xccc123
0xabc123
0xaaa123
0xbbb123
0xccc123
0xaac123
0xbbc123
0xbcc123
0xabb123
Record of hash keys already generated0xaab12
3
0xccc123
0xabc123
Compression
HDD
0xaab123
0xccc123
Compress Data
Performed on data already deduplicated
Heuristics based compression to reduce CPU overhead when data is not compressible
Default algorithm is the standard DEFLATE (loss less compression)
Deduped Data
Encryption
0xabc12..
Data chunk before
encryption
Data chunk after
encryption
0xabc12..
Performed deduped and compressed data
Encryption key is generated based on the seed value provided
Encryption algorithm is AES-256 with CBC
Security keys maintained by the customer, stored securely on the appliance
Compress Data
Secure data throughout the solution
Account authentication with User ID, Password
StorSimple Customer defined encryption keys stored on device 2 x 512 bit keys
Account Access
Data In-flight
IT administrator
AES-256 bit encryption
Data At-restAES-256 bit encryption
StorSimple Virtual Appliance
Cloud
Consolidated management of appliances
Microsoft Confidential
(Service Data Encryption Key is generated, on device console, when first device is registered)
Physical Appliance
StorSimple Manager
Physical Appliance
Virtual Appliance
StorSimple Service in Azure Management Portal
Simple, integrated workflows with other Azure entities
Manages multiple devices from a single management interface
StorSimple Virtual Appliance
VM
Data
The Virtual Appliance is a software version of the physical array that runs on a VM in Azure and can be provisioned and turned-on as needed.
The StorSimple Virtual Appliance is an iSCSI target for the VMs in Azure.
A virtual network joins VMs and the StorSimple Virtual Appliance.
iSCSI Initiator
iSCSI Target
IT agility in Azure with StorSimple Virtual Appliance
The StorSimple Virtual Appliance facilitates data mobility of production datasets for the purpose of disaster recovery, on-demand development and test infrastructure, and Cloud applications.
The StorSimple Manager service provides workflows for failover of datasets for disaster recovery and clone workflows for replicating production datasets in Azure for Cloud applications and development and test scenarios
Clone/Failover
Microsoft Azure
iSCSI Internet
StorSimple Manager
iSCSI
iSCSI Vol D
Vol A Vol B Vol C Vol D
Local and Cloud snapshots
SSD
SAS
Local Snapshot
Cloud Snapshot
Example Group Of Data Protection Policies
Backup Type
Snapshot Type
Frequency Retention Period
Short-term backup
Local & Cloud
Daily ~1 week
Medium-term
backup
Cloud Weekly ~4 weeks
Long-term Backup
Cloud Monthly ~52 weeks
StorSimple Snapshot Manager
MMC UI snap-in that lives on
application host and
communicates with
appliance(s)
Orchestrates application consistent snapshots
Manages backup policies
Restores volumes and mounts them
as NTFS folders/drives
Disaster recovery
Cloud Snapshot
Secondary Datacenter
or Provisioned StorSimple
Virtual Appliance
• Thin restores provides fast recovery of data, downloading a small subset of data necessary data bring applications online. Not dependent on volume size.
• Recover data anyway: a secondary datacenter or a StorSimple Virtual Appliance in Azure
• A volume container is failed over to the destination appliance. Time to recover is the same for physical and virtual appliance
What is
needed?
DR to secondary datacenter or Virtual Appliance
Microsoft Azure
Production Data Production Data
Cloud Snapshots
Datacenter-1 Datacenter-2
Periodic VSS consistent cloud snapshots of production data
Location independent recovery from cloud snapshot
Thin Instant PredictableStorSimple Virtual
Appliance
File shares and archives
Before
Applications (Tier 2, & Tier
3 data)
FC/iSCSI
iSCSI
On-premise footprint
Capacity on-demand
Applications
Primary Storage
Disk-based Backup Storage
Tape Infrastructure
Archival Storage
After
Remote Blob Storage repository for SharePoint
Before
AfterSharePoint
Farm
FC/iSCSI
iSCSI
On-premise footprint
Capacity on-demand
SharePoint Farm
Primary Storage
Disk-based Backup Storage
Tape Infrastructure
Archival Storage
Offsite Facility
SharePoint metadata
BLOB data
SSABLOB data
SharePoint
metadata
(SQL)
Virtual machines and eliminating VM sprawl
Before
After
Primary Storage
Disk-based Backup Storage
Tape Infrastructure & Management
Archival Storage
FC/iSCSI
VMs forTier 2/Tier 3 workloads
iSCSI
Active VM data (VHDs, VMDKs)
Inactive VM data
Storage migration/
vMotion
Active VM data (VHDs, VMDKs)
Free space
InactiveSpin up
On-premise footprint
Capacity on-demand
SQL for Tier-2 and Tier-3 applications
Before
Applications (Tier 2, & Tier
3 data)
FC/iSCSI
iSCSI
On-premise footprint
StorSimple Virtual Appliance and Cloud backup and DR
Applications
Primary Storage
Disk-based Backup Storage
Tape Infrastructure
Archival Storage
After
Customer References
28
StorSimple: Well-proven enterprise storage solution
StorSimple Success in the EPG & SMS&P
Military and Aerospace
“We are saving $1M per month
with StorSimple”
-Les RowlandChief Architect of Architects, Textron (Microsoft Ignite, 2015)
British Fashion DesignerManufacturing
“Prior to StorSimple, Paul
Smith simply added more and more
storage to accommodate
growing data. Now they are using StorSimple to
create policies that archives data to
Azure storage if it hasn’t been
accessed in 12 months. “
-Richard Proud Director at Microsoft Partner, Risual, U.K.
Recent Wins!
“With StorSimple, data is copied to the
cloud in half the time, and files can be brought back
from Azure in minutes instead of
24 hours.”
-Kai SookwongseGroup Manager, Mazda North American Operations
Resources for Customer engagement• Microsoft Technology Center
• StorSimple is located in 30 MTC locations globally• http://www.Microsoft.com/mtc
• Microsoft Datacenter • Tour Microsoft Datacenter with customers• http://www.Microsoft.com/datacenters
• Total Datacenter Immersion • StorSimple customer experience through immersion• http://
www.microsoft.com/enterprise/en-bd/transform-the-datacentre-immersion/default.aspx#fbid=X6845JFjYCE
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.