windows 8 : storage provisioning and management€¦ · windows 8 : storage provisioning and...
TRANSCRIPT
![Page 1: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/1.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Windows 8 : Storage Provisioning and
Management
Shiv Rajpal
Principal Development Lead
Microsoft
![Page 2: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/2.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Provisioning And Management
Agenda
Storage Provisioning
Storage Pools
Storage Spaces
Storage Management
SMP Architecture
Tools – UI, Power Shell, WMI
Providers – SMP, SMI-S
2
![Page 3: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/3.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Cost-Effective Business Critical Storage
Powerful new platform abstractions
Storage Pools: are units of administration, capacity aggregation,
delegated administration and isolation in a multi-tenant
deployment.
Storage Spaces: Spaces are virtual disks delivering optimized (just-
in-time) allocation, resiliency to component failures, high-
performance, and scale.
Target design point
Industry standard interconnects: SATA or (Shared) SAS
Industry standard storage: JBODs
Storage Spaces enable partners to deliver a new category of highly capable storage
solutions to all Windows customer segments at dramatically lower price-points &
maximized operational simplicity
3
![Page 4: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/4.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Spaces
Optimized storage utilization
Thin (and Fixed) Provisioning Support
Storage optimizer assists in reclaiming slabs
Resiliency & application-driven error correction
Mirror and Parity Spaces
Storage optimizer driven error correction
High-availability & scale-out with Failover Clustering
& Cluster Shared Volumes
![Page 5: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/5.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Spaces
Operational simplicity
Delegated administration & isolation for multi-
tenant deployments
Management through new Windows 8
management architecture
Workload optimized performance via heterogeneous
media support
![Page 6: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/6.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Spaces
On-demand provisioning with trim support
For use by NTFS, Hyper-V, and other
applications e.g. SQL
Elastic capacity expansion
Simply add more physical drives
VM
Storage
Space Contoso Hosting Company
Company A Pool Company B Pool
20TB
Pool
20TB
Pool
40 TB physical storage
64TB
Space
64TB
Space
64TB
Space
64TB
Space
64TB
Space
64TB
Space
Thinly-
provisioned
Spaces
Physical
storage
![Page 7: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/7.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Spaces
Redundant storage
Mirrored Spaces and Parity Spaces with integrated
journaling
Rapid Recovery - per-pool hot-spare support
Application driven intelligent error correction
Industry standard
physical storage
Mirrored
Space
Parity
Space
Mirrored
Space
Mirrored
Space
Parity
Space
Mirrored
Space
Mirrored
Space
Parity
Space
Resilient Spaces
contained within
a Pool
![Page 8: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/8.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Spaces
• Managed via Windows Storage Management API
• Flexible & granular administrative control with self-
service agility & tenant isolation
Contoso Hosting Company
Company A Pool Company B Pool
Workloa
d Admin Space Space
Hoster
Admin
Space Space Workloa
d Admin Tenant
Admin Tenant
Admin
Granular
Access
Control
Multi-tenant
deployment
![Page 9: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/9.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Spaces
Effectively utilize hardware investment
Utilize both SSD and HDD media types
Control placement at Space granularity
Silver
File Server home
directories
Bronze
Archive
Gold
SQL workload
Thinly-provisioned
Spaces contained
within a Pool
Industry standard
physical storage
Space Space Space
Backup
Archive SQL
DB
Space
Solid-state drives 15K RPM HDDs Near-line HDDs
SQL
Logs
File
Data
![Page 10: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/10.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Spaces
SATA or SAS Shared SAS
![Page 11: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/11.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Operational Simplicity
Comprehencive Storage Management
11
Microsoft Applications ISV or Storage Vendor
Applications
One Storage Management Interface
Vendor array SMI-S compliant array
Storag
e
Space
s
Storage Spaces compatible
JBOD
![Page 12: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/12.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management Architecture
12
Storage Management Provider (SMP) Interface (+ pass-through for extensibility enabling all of SMI-S and vendor proprietary extensions)
– (Transport = WMI)
Proprietary Transport and/or Protocol
(Supports Windows SM-API + optional
extensions)
SMP: 3rd Party Providers
Storage Array /
RAID Controller
SMI-S Hardware
Provider
SMI-S Hardware
Provider
Windows Storage
Management Service
SMI-S Service (Proxy)
Storage Array /
RAID Controller
Storage Array /
RAID Controller
SMP: Storage Spaces (no
pass-through support)
![Page 13: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/13.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management
13
Physical Disk
Virtual Disk
Volume
c
![Page 14: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/14.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management
Discovery
Supporting different Levels of discovery
Discovering Sub System Capabilities in advance
Pooling Capability
Replication/Cloning
Offload Data Transfer (ODX)
Masking Sets
14
![Page 15: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/15.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management
Pool Management
Creation, Deletion
Setting properties on Pool (Example - Pool usage
type, Thin Provision thresholds)
Creating VirtualDisk
Multiple Resiliency Scheme
Multiple Provisioning Capability
Capacity utilization
15
![Page 16: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/16.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management
VirtualDisk Management
Creation, Deletion
Setting properties
Health and Operational Status
Space Management:
Attach/Detach
Automatic / Manual allocation selection
Clustered Spaces
16
![Page 17: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/17.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management
Target/Initiator Ports
Masking Sets
OS Disk Management
Partitioning
Formatting
Disk refresh/Bus Rescan
Repair Volume
17
![Page 18: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/18.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management
Indications
Thin Provisioning Threshold crossed
Pool/VirtualDisk health change notifications
Associations. (Examples)
VirtualDisk<->OS disk
Disks<->InitiatorPorts
VirtualDisk<->VirtualDisk
VirtualDisk<->PhysicalDisk
18
![Page 19: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/19.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management
Support for Pass Through
Contract between Application and Provider
Microsoft Applications will publish classes which
will be used through Pass through
19
![Page 20: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/20.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management - Tools
File Server role UI
Comprehensive set of Power Shell cmdlets
PowerShell provides a uniform, scriptable
management experience covering array
provisioning, deployment of storage, and host
management and provisioning
Comprehensive set of WMI interfaces
20
![Page 21: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/21.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management – File Server UI
21
![Page 22: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/22.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management – Power Shell
#Get All Physical Disks.
$DisksToUse = Get-PhysicalDisk | Where-Object {$_.IsPooled -eq $False}
#Locate the Storage Subsystem object for Windows Storage spaces to use as an input for Storage Pool creation.
$SubSystem = Get-StorageSubsystem | Where-Object {$_.Manufacturer -eq "Microsoft Corporation"}
22
![Page 23: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/23.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management – Power Shell
#Create the Storage Pool by utilizing the $DiskstoUse and $Subsystem variables created previously.
New-StoragePool -StorageSubSystemId $SubSystem.ID -FriendlyName DemoPool -PhysicalDisks $DisksToUse
$SpacesDemoPool = Get-StoragePool -FriendlyName DemoPool
23
![Page 24: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/24.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management – Power Shell
# Create Several Storage Spaces
New-VirtualDisk -FriendlyName "SQLLogs" -StoragePoolID $SpacesDemoPool.ID -StorageAttributesName Simple -ProvisioningScheme Sparse -Size 42TB
#Get the newly created Virtual Disk objects
$SQLLogsV = Get-VirtualDisk -FriendlyName "SQLLogs"
24
![Page 25: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/25.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management – Power Shell
#Get the Disk objects that correspond to the Virtual Disks and then Initialize them.
$SQLLogDisk = Get-VirtualDisk -FriendlyName $SQLLogsV.FriendlyName | Get-Disk -ErrorAction SilentlyContinue
Initialize-Disk -InputObject $SQLLogDisk
#Create Partitions
New-Partition -InputObject $SQLLogDisk
25
![Page 26: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/26.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management – Power Shell
#Format the volume
$SQLLogPartition = Get-Partition -DiskId $SQLLogDisk.Id | Where-Object {$_.Type -ne "Reserved"}($SQLLogPartition | Format-Volume -NewFileSystemLabel "SQLLogs" -Confirm:$False -Erroraction SilentlyContinue)
26
![Page 27: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/27.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
Storage Management Providers
You no longer need to develop two providers
There is NO functional difference between the two
options
SMP:
Lower development overhead
Easier learning curve
Microsoft platform only
SMI-S:
Industry standard
Works with many platforms
27
![Page 28: Windows 8 : Storage Provisioning and Management€¦ · Windows 8 : Storage Provisioning and Management Shiv Rajpal Principal Development Lead ... Rapid Recovery - per-pool hot-spare](https://reader030.vdocuments.mx/reader030/viewer/2022011900/5f0209b87e708231d4024499/html5/thumbnails/28.jpg)
2011 Storage Developer Conference. © Microsoft Corp. All Rights Reserved.
For More Information
28