sas technology making the bridgebtw capacity and performance · capacity and performance …...
TRANSCRIPT
![Page 1: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/1.jpg)
SAS technology making the bridge btwgy g gCapacity and Performance …
Technology inside…
Barnabas NAGY, Storage, SecurityFeb/04/2011 --- [email protected]
© Copyright 2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Confidentiality label goes here
![Page 2: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/2.jpg)
ATA P ATA SATA FATA FC SCSI iSCSI SSD é SAS
FibreChannel technology, but why ?ATA, P-ATA, SATA, FATA, FC, SCSI, iSCSI, SSD és SAS
Why do we need FibreChannel?y• Memory Channel and high performance parallelizm
2
![Page 3: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/3.jpg)
ATA P ATA SATA FATA FC SCSI iSCSI SSD d SASFibreChannel technology, but why ?
ATA, P-ATA, SATA, FATA, FC, SCSI, iSCSI, SSD and SAS
Why did we changed to SAS?y g
– SCSI fall short of new SCSI 1280: o Performance vs length – SCSI 640o Performance vs. length SCSI 640o Parallel cables strep \ overheating
– SAS – Serial Attached SCSI o Inicialisator, Target and Expander
3
![Page 4: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/4.jpg)
P f d t
FibreChannel technology, but why ?Performance data
4
![Page 5: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/5.jpg)
Serial Attached SCSI – SAS technológy levelsS i l
Any additional text can go here
Serial …
y gand can have multiple lines of content• Any additional text can go here
d h lti l li f t tand can have multiple lines of content
5
![Page 6: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/6.jpg)
Serial Attached SCSI – SAS technology capabilitiesMultiple disk connectionMultiple disk connection
![Page 7: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/7.jpg)
Multiple Disk connectionsSerial Attached SCSI – SAS technology capabilitiesMultiple Disk connections
7
![Page 8: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/8.jpg)
Zoning and the managementsSerial Attached SCSI – SAS technology capabilitiesZoning and the managements
![Page 9: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/9.jpg)
ZoningSerial Attached SCSI – SAS technology capabilitiesZoning
9
![Page 10: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/10.jpg)
Multi-node SAS cluster – FC local loop topology: NoSPoF ASICSerial Attached SCSI – SAS technology capabilities
Multi-node SAS cluster – FC local loop topology: NoSPoF, ASIC chipsets
10
![Page 11: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/11.jpg)
Architecture inside. Multy tenancy.
Traditional, Monolithic architecture
3PAR InSpire® Architektúra
pont‐pont or switch connections
Monolithic architecture
pont‐pont or switch connections
Tradicional Modular Architecture
autonomic loadbalanced Cluster
Host Connection
Adat Cache
Diszk Connection
balanced Cluster
![Page 12: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/12.jpg)
Hardware Based for PerformanceThin Built inZero Detect
Fast RAID 10, 50 & 60 Rapid RAID RebuildIntegrated XOR Engine
Tightly‐Coupled ClusterHigh Bandwidth, Low Latency
Interconnect
Mixed WorkloadIndependent Metadata and Data
Processing
![Page 13: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/13.jpg)
Mixed Workload: multy tenancy workload
Unified Processor
strong throughput MB\s
I/O : traditional data storagehosts
DiskHost Unified Processor and/or Memory disk
strong transaction I/Olow IOPs waits for more IOPs
Disk interface
Host interface
I/O : MultyTenancy Controller Nodehosts
= control information (metadata)= data
Control Processor & Memory
SAS ASIC & Memorystrong throughput MB\s
strong transaction I/O
Host interface disk
Disk interface
Control information and data different path
![Page 14: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/14.jpg)
IBRIX Fusion Solves Two Enterprise Storage Problemsp g• High Capacity
− Need extremely scalable storage to y gsupport high volume, unstructured data growth
• Infinite capacity scalabilityp y y
• Just-in-time scalability
• Better manageability
• High PerformanceN d f d l bl
14 4 February 2011
− Need fast and scalable access to data-intensive applications
• Remove I/O bottlenecks
![Page 15: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/15.jpg)
The Storage Stack of the 21st Century • The File System (a.k.a. namespace) has become the common abstraction• A Segmented File System aggregates a powerful but monolithic file system
allowing scalability and manageability and enabling new data managementallowing scalability and manageability and enabling new data management capabilities
EXT3 or ZFS
Sna
psho
ts
Bac
kup
Rep
licat
ion
HSM
SRM
Clu
ster
ing
Device Drivers
Volume ManagerEXT3 or ZFS
15 4 February 2011
Monolithic File System IBRIX: Parallelize Monolithic File System
![Page 16: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/16.jpg)
Challenges of Scaling Storage:Traditional Monolithic File Systems
Challenges:Many Small File Systems
Management/Administration Overhead Explodes
Data Layout Issues• Data Layout Issues (Hotspots & Duplication)
• Multiple File SystemsMount Point Management
OR
C O N S T R A I N E D
Issue: Management Complexity
• Mount Point Management
Faults will Happen, Statistically• Operational Faults
All or NothingFile Systems
C O N S T R A I N E D
16 4 February 2011
• Operational Faults• System FaultsIssue: Scalability Limited by
System/Box , Architecture/Capacity
![Page 17: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/17.jpg)
Challenges of Scaling Storage:What Customers Need: Best of BothWhat Customers Need: Best of Both
Scalable Single Name Space Fil S i h R ili d
Many Small File Systems
File System with Resiliency and Fault Containment
All or NothingFile Systems
Advantages:
• Independent Performance and Capacity Scaling
17 4 February 2011
Capacity Scaling• Manageability• Availability
![Page 18: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/18.jpg)
Previous Solutions Have Bottlenecks Centralized ArchitecturesMetadata ServerNamespace Server
Doesn’t Scale
pLock ManagerToken Manager
• Most enterprise application workloads are metadata intensive
− Small files, small I/Os, random t d t ti
Data
access, metadata operations Central component is a bottleneck
Distributed Lock ManagersAny server can modify any portion of the file systemData
18 4 February 2011
portion of the file system
![Page 19: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/19.jpg)
X9320 Network Storage System Hardware componentsS l tf− Server platform processor
• 2x HP X9300 file serving node, Intel® Xeon® Processor E5520 Quad Core 2.26 GHz; 1 standard
− Memory• 48GB (6 x 8GB)
− Internal Controller• Internal Smart Array Controller with internal SAS port for O/S drives
− Internal Storage• 2 x 146GB 3G SAS 15K 3.5" ENT hot-plug LFF HDDs (O/S mirror)
− Network Ports:• 8 x 1GbE (1GbE models) or• 4 x 1GbE + 2 x 10GbE (10GbE models)
− Management Ports• 1 Integrated Lights Out (iLO2) port
− Server expansion slots• 6 x PCIe HP X9320 12U (2 servers and 4x 2U disk enclosures)
− RAID Controllers• 2x MSA 2312sa SAS (48TB “capacity” models)• 4x MSA 2312sa SAS (21.6 TB “performance” models)
− Disk enclosures• 4 x 2U-12 drive enclosures (48 drive bays)
− Drives• 450GB 3G 15K 3.5 inch Dual-port SAS HDD• 1TB 7.2K rpm 3.5 inch SATA HDD
![Page 20: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/20.jpg)
Couplet VDisk & LUN LayoutPerformance Couplet Disk Assignments
vdisk 1SAS spare
vdisk 1
vdisk 1vdisk 1vdisk 1
vdisk 2vdisk 2vdisk 2
vdisk 2vdisk 2disk 2
Capacity Couplet Disk Assignments
vdisk 1SATA spare vdisk 1
vdisk 1vdisk 1vdisk 1
vdisk 1vdisk 2 00
0
vdisk 3vdisk 3
vdisk 5
vdisk 1vdisk 3
vdisk 5vdisk 5
vdisk 1
vdisk 3vdisk 3
vdisk 4vdisk 4
vdisk 6vdisk 6
vdisk 2
vdisk 4
vdisk 4
vdisk 6
vdisk 2
vdisk 4vdisk 4
vdisk 6
SATA sparevdisk 2vdisk 2
vdisk 3
vdisk 1vdisk 2
vdisk 3vdisk 3
vdisk 1
vdisk 2vdisk 2
vdisk 2vdisk 2
vdisk 4vdisk 4
vdisk 1
vdisk 3
vdisk 3
vdisk 4
vdisk 2
vdisk 3vdisk 3
vdisk 4SATA spare
MSA
2000 M
SA
2000
SAS spare
vdisk 3
vdisk 5vdisk 5
vdisk 7vdisk 7
vdisk 5
vdisk 7
vdisk 8
vdisk 6
vdisk 8
vdisk 6
vdisk 8
vdisk 8
vdisk 6vdisk 6
vdisk 8vdisk 8
vdisk 7vdisk 7
vdisk 7
vdisk 3vdisk 3
vdisk 3
vdisk 4vdisk 5
vdisk 3
vdisk 5
vdisk 5
vdisk 4
vdisk 5
vdisk 4
vdisk 5
vdisk 5
vdisk 4vdisk 4
vdisk 5vdisk 5
vdisk 4vdisk 4
SATA spare
M
MS
A20
• 4 global hot spares• 4X 7+2 and 1X 6+2 RAID6 VDisks• VDisk1, VDisk3 and VDisk5 assigned to Controller A• VDisk2 and VDisk4 assigned to Controller B
• 2 global hot spares• 6X 5+1 RAID5 and 2X 4+1 RAID5 VDisks• VDisks 1, 3, 5, 7 assigned to Controller A• VDisks 2, 4, 6, 8 assigned to Controller B
• 1 LUN per VDisk• 5 LUNs *(segments) per couplet
• 1 LUN per VDisk• 8 LUNs per couplet
![Page 21: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/21.jpg)
HP StorageWorks X9720 Extreme Data Storage System
1. Software – Proven in Content Rich EnvironmentsI t t d t t
Integrated hardware/software solution
– Integrated system management– Simplified performance and capacity scaling– Multiple access protocols
NFS CIFS X90002. Performance Blocks – Scale Performance
– Up to 12.8 cores/UStarting at 3 blades expand up to 16 blades
• NFS, CIFS, X9000
– Starting at 3 blades, expand up to 16 blades– Quad-core, half-height blades in c7000 Enclosure
3. Capacity Blocks – Industry Leading DensityU t 12TB/U– Up to 12TB/U
– Starting at 82TB, expand to 656TB– Scales in 82TB Capacity Blocks
![Page 22: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/22.jpg)
HP StorageWorks X9720System Specifications
System• Standard HP 42U Rack 12.8 cores/U and Power*Standard HP 42U Rack 12.8 cores/U and 12TB/U (increases with cores/capacities)• 3-16 Blade Servers• 1-8 Capacity Blocks
• 4 in base rack (328 drives)• 4 in expansion rack (328 drives)
• Min config: 13.8A, 3.23kW• Max config: 54A, 12.42kW• Performance block: .9A, 0.2kW• Capacity block: 9A, 2.07kW
• 4 in expansion rack (328 drives)• Complete Redundancy, NSPOF• NFS and CIFS Protocol Support
Weight• Base Min: 1,159lbs• Max Expansion: 1,697lbs• Per Performance Block: 14lbs• Per Capacity Block: 359lbsPer Capacity Block: 359lbs
Performance Capability• 16GB/s Blades to Ethernet Switch• 5 4GB/s Storage to Chassis (seq read)
Thermal• Base Min: 11,002 Btu/hr• Expansion Max: 28,252 Btu/hr• Performance Block: 682 Btu/hr• 5.4GB/s Storage to Chassis (seq read)
• 2.6GB/s Storage to Chassis (seq write)• Performance Block: 682 Btu/hr• Capacity Block: 7,063 Btu/hr
![Page 23: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/23.jpg)
HP StorageWorks X9720 Blade Server
Blade Server• Dual Quad Core Intel Xeon Processors 2.53 Ghz• Two Internal 2.5-inch 300 GB 10K SAS drives
D l 10Gb NIC (PCA)• Dual 10Gb NICs (PCA)• Dual 3 Gb/sec SAS Connections (Mezzanine Slot)• 16GB Memory
Chassis• 16 Blade Server Bays 10U• 16 Blade Server Bays, 10U• 8 Interconnect Bays• Bays 1&2, Network modules, two HP Virtual Connect Flex-10 10Gb
Ethernet Module (455880-B21), Note: Requires transceivers for networking connectivity
• Bays 3&4 Redundant 3Gbit SAS Switches 8 4x ports (32 SAS lanes)• Bays 3&4, Redundant 3Gbit SAS Switches, 8-4x ports (32 SAS lanes) each
• Bays 5,6,7&8, Reserved for future use
![Page 24: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/24.jpg)
HP StorageWorks X9720Performance Chassis
Flex-10 VC Modules 1-2
SAS SwitchesBay 1: VC Module 1 Bay 2: VC Module 2
Bay 3: SAS switch Bay 4: SAS switch
Reserved for Future Use
Bay 5: Reserved for Future Use Bay 6: Reserved for Future Use
Bay 7: Reserved for Future Use Bay 8: Reserved for Future Use
Redundant Onboard Administrator
![Page 25: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/25.jpg)
HP StorageWorks X9720 Capacity Blocks
Disk Drives• 1TB 7200 RPM Dual-Port SAS Midline• Standard Hot Swappable HP carriers
Capacity Block• 82 drives in 7U• Dual-Redundant Active-Active Controllers• Redundant 3Gbit SAS Connect• Eight 8+2 RAID6 groups, 2 hot spares, 78% storage
ffi iefficiency• 340lbs with drives loaded
![Page 26: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/26.jpg)
HP StorageWorks X9720X9720cx: cascaded dense storageg• Dual drawer
− Fully connected and operational when pulled outwhen pulled out
• 70x1TB SAS midline disks drives in 5U− All hot swappable
• 4 SAS expansion ports − 2 per drawer
• Dual redundant power supplies and fans per drawer
Power supplyFront Display
and fans per drawer− All hot swappable
• Front display showing drive status (green, orange, …)
Fan
(green, orange, …)
IO Module
![Page 27: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/27.jpg)
HP StorageWorks X9720SAS backend (simplified connection diagram)( p g )
Bla
de1
P700mha
ssi
3-16 blades (aka X9720 Blade Servers)
Bla
de N
P700m
SAS Switch 1 SAS Switch 2
Ch
RAID Controller 1
X9720c
apac
ity
RAID Controller 2
RAID Controller 1
X9720c
RAID Controller 2
X972
0 C
aB
lock
X972
0cx
5x7=35 disks per drawer
5x7=35 disks per drawer
1-8 X9720 capacity blocks
X972
0cx
5x7=35 disks per drawer
5x7=35 disks per drawer
![Page 28: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/28.jpg)
Standard (4x) Configuration #4 (Minimum)26 HDD Per Server
28
![Page 29: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/29.jpg)
BladeSystem Storage Unbound HP offers customer choice
iSCSI
Storage Host Interface
FCiSCSI
SASInfiniband
Zoned and Shared Storage choices
MSA & innovative
Virtualization choicesHP VSE, VMware, XenSource, MS Veridian
choicesJBOD expansion
Internal Direct Attach and Shared Storage choicesInternal DAS Internal shared Internal Shared
SSD and HDD Storage choices
External NAS or SAN:
SB40c AiO SB600c SB50c
File/Print and Block
Coming soon
External NAS or SAN: AiO, PSS, MSA, EVA, XP, Scalable File storage choices
Internal Tape
Internal and external Data Protection choices
External Tape LibraryDisk Backup
File/Print and BlockStorage choices
April 2009 – HP Restricted. For HP and channel partner internal use.LTO 4
MSL Tape LibraryVLS LibraryPSS/ AiO
![Page 30: SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis](https://reader034.vdocuments.mx/reader034/viewer/2022051802/5aef16767f8b9a8c308b7797/html5/thumbnails/30.jpg)
April 2009 – HP Restricted. For HP and channel partner internal use.30