storage virtualization citrix blr wide tech talk
TRANSCRIPT
![Page 1: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/1.jpg)
Storage VirtualizationStorage Virtualization
Sisimon Soman
![Page 2: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/2.jpg)
Study by IDC/EMC
• By 2010 nearly 1000 Exabytes (equal to 1000 billion Gigabytes) of digital information will created.
• If printed on paper, we can wrap earth 16 times using that paper.
• The total amount of digital information doubles in 18 months.
Numbers collected from EMC.com which is available for public
![Page 3: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/3.jpg)
Types of Storage
• Classify into three according to the access mechanism between server and storage.– Direct Attached Storage (DAS)– Network Attached Storage (NAS)– Storage Area Network (SAN)
![Page 4: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/4.jpg)
Direct Attached Storage (DAS)
• Disk(s) directly connected to the machine.• Most simple/common storage.• Example: Our Laptops, Desk tops etc
SCSI
![Page 5: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/5.jpg)
Network Attached Storage
• Uses CIFS/NFS protocol to access files.• Similar to a remote shared folder.• Client side redirector forward the file requests to
NAS box.• Example: EMC Celerra, NetApp FAS
LAN LAN
Servers
NAS box
![Page 6: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/6.jpg)
NAS - Module diagramApplication
File System Redirector
CIFS Protocol Layer
TCP/IP Stack
NIC Driver
User Space
Kernel Space
LAN LAN
CIFS Protocol Layer
TCP/IP Stack
NIC Driver
File System
Volume Manager
Disk Driver
NAS Box
Server
![Page 7: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/7.jpg)
What is a SAN
Picture taken from wikipedia
EMC Symmetrix DMX 2000 EMC Symmetrix DMX 1000
![Page 8: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/8.jpg)
SAN Continued..
• Example : EMC Symmetrix, CLARiiON
Fibre Channel Switch
Servers
SAN
![Page 9: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/9.jpg)
SAN Architecture
Fibre Channel Switch
Controllers/Storage Processors (It can be ACTIVE-ACTIVE or ACTIVE-PASSIVE)
Disks
GBs of memory in each controller
![Page 10: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/10.jpg)
Difference between SAN and NAS
• In NAS ‘file streams’ are transferred thru wire.
• In SAN ‘disk blocks’ are read from storage.• In SAN Fibre Channel is the common
communication mechanism. (SAN support SCSI over TCP/IP also, which is called iSCSI)
• In NAS file streams transfer over TCP/IP stack.
![Page 11: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/11.jpg)
Common features of SAN
• Backup
• Replication
• Snapshot
• Features specific to SAN like SRDF for Symmetrix
SAN Specific data collected from wikipedia
![Page 12: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/12.jpg)
Storage Virtualization - Advantages
• Hide the internal complexity of storage system.
• Better Disk block usage – Study shows only 30-40% of disk space is used effectively.
• Better Performance.
• Scalability.
![Page 13: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/13.jpg)
Taxonomy of Storage Virtualization
• Virtualization at Host Operating system storage stack.
• Switch/Appliance based Virtualization.
• Virtualization at external storage array (SAN).
![Page 14: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/14.jpg)
Storage Stack
File System
Volume Manager
Disk Class Driver
Hardware Driver
ApplicationUser Space
Kernel Space
Host Operating system Storage stack
Fibre channel adapter
Fibre channel Switch
SAN
Fibre Channel cable
![Page 15: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/15.jpg)
Virtualization at Operating Storage Stack
File System
Volume Manager
Disk Class Driver
Hardware Driver
• A typical Windows Storage stack (Not much difference in Linux flavor)
IO Request flow thru each layer
![Page 16: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/16.jpg)
Virtualization at File System Layer
File System
Volume Manager
Disk Class Driver
Hardware Driver
File1.doc
Disk blocks
Virtual Cluster Number (VCN)
Logical Cluster Number (LCN)
• NTFS expose IOCTL FSCTL_GET_RETRIEVAL_POINTERS, so that any app can query VCN-LCN mapping. Usually the disk defragment app uses this IOCTL.
![Page 17: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/17.jpg)
HSM File System (Tiered Storage)
RAM ($50/MB)
SAN ($.5/MB)
TAPE($.05/MB)
Only 20-30% of actively used data
• Ex: EMC DiskXtender
![Page 18: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/18.jpg)
Virtualization at Volume Manager- Spanned Volume
• Spanned Volume – Volume D is total 100MB which is spanned over Disk 1 and 2. Volume Manager adjust the physical address accordingly.
• NTFS support expanding the volume dynamically, its block allocation information (bitmap) is just another file and which can expand. FAT cannot expand volume without formatting the data.
![Page 19: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/19.jpg)
Virtualization at Volume Manager - Striped Volume (RAID 0)
• Less latency time – Multiple disk simultaneously read/write small block of data to complete one read/write request.
Striped Volume
![Page 20: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/20.jpg)
Virtualization at Volume Manager - RAID 5
• Also know as Striped Volume with parity.• Fault tolerance is achieved by reserving an equivalent of
one disk for keeping parity information.• Rotate the parity stripe to all disks - Avoid the possibility
of parity disk become busy all time.
RAID 5
![Page 21: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/21.jpg)
Virtualization at Disk Controller
• Disk Controller convert Logical Block Address to Cylinder Head Sector address.
• Disk controller take care of damaged sectors also.
LBA 1
LBA 2
LBA 3
LBA 4
LBA 5
LBA n
![Page 22: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/22.jpg)
Putting it all together
Windows Storage Stack
![Page 23: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/23.jpg)
Switch based Virtualization
• Combine LUNs from one or more Arrays to a single virtual LUN and pass to host OS.
• Take one big LUN from one Array, divide it and give to different host OS.
• Security – One host can see certain LUNs only.• Vendors are adding more intelligence in switch
level like advanced volume management, caching, QoS functions…
• EMC Invista, IBM SAN Volume Controller
![Page 24: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/24.jpg)
Switch level Virtualization
IBM EMC HP HDX
Intelligent switch – Virtualize LUNs from different array
![Page 25: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/25.jpg)
Virtualization at SAN
Virtual Disk
Disk in the storage array
![Page 26: Storage virtualization citrix blr wide tech talk](https://reader035.vdocuments.mx/reader035/viewer/2022062704/555c41dcd8b42a2c068b4dfe/html5/thumbnails/26.jpg)
Questions ?Questions ?