technology trends ip storage networking. agenda ip storage networking history protocols initiators...

Technology Trends

IP Storage Networking

Agenda

IP Storage Networking History Protocols Initiators IP Storage Networking Solutions

IP Storage Networking

Analyst Perspective"It's not a NAS versus SAN world—it's both. iSCSI is a way to utilize

existing, inexpensive infrastructure to carry block storage. There's no question that iSCSI enables networked storage for the masses.“

-Steve Duplessie, Founder, Enterprise Storage Group

Manufacturer Perspective"It’s important to understand that iSCSI is not about replacing Fibre

Channel. However, customers do want to extend the benefits of storage networking to parts of their infrastructure where SAN

technology has not been economically feasible. That’s where the majority of their data is. And that’s where iSCSI comes in.“

- Dave Hitz, Founder and EVP, NetApp

IP Storage Networking History

NAS was first File-oriented services providing cross-platform access Not appropriate for applications that require block-level

access Databases such as Oracle and MS Exchange

Fibre Channel developed to solve problems of traditional channel

protocols (SCSI, ESCON) Expensive and requires specialized expertise


IP-based Storage Networking developed to Leverage the ubiquity of Ethernet and IP Reduce the cost and complexity of FC

Foundation technologies Ethernet: IEEE 802.3 IP: IETF through RFCs SCSI: NCITS T10 Committee (T11 for FC)


False-start in 2000 IBM and Cisco pushed it

IBM had the i200 Why was it delayed?

Fibre Channel turned out to be very good A requirement for IPSec was added to the specification and

it took some time to finish Protocols developed by IP Storage Forum of IETF

FCIP, iFCP, iSCSI All 3 ratified in Jan/Feb 2003 All used to transport SCSI protocol commands

FCIP

Fibre Channel over IP First on the scene but interest declining

Allows SAN-to-SAN connectivity by providing a FC tunnel over an IP network (LAN/WAN) TCP Protocol is required LAN/WAN is invisible to SAN SAN is invisible to LAN/WAN

Problems in LAN/WAN may trigger FC error handling routines Time-Out is a problem and getting the TOV values right is difficult FCIP devices responsible for re-establishing broken links

Makes it easyto implement

IP WAN

FCIPtunneling between SANs

Server

FC Disk FC Tape

FC Switch

Server Server Server

FC Disk FC Tape

FC Switch

Server Server

Tunnel SessionFCIP

DeviceFCIP

Device

– CNT is a primary provider– Can be implemented as:

- Stand-alone system- IP Router Blade- FC Switch Port

Source: IP SANs by Tom Clark, Pg 127

iFCP Gateway to gateway protocol for providing FC Services to FC

devices over an IP network Can be used in place of FC fabrics

Why it was not embraced by FC Switch Vendors Devices plug into F-Ports in iFCP switches Uses TCP and Translates FC Address (24-bit) into IP Address IP network problems only affect the 2 devices communicating as

opposed to the entire fabric as with FCIP Nishan (McData) developed one of the few commercially

successful products based on iFCP Check out:

http://www.snia.org/tech_activities/ip_storage/iFCP_user_overview.pdf

iFCP – a fabric exampleFibre

ChannelDevice

N-Port

FibreChannelDevice

N-Port

FibreChannelDevice

N-Port

FibreChannelDevice

N-Port

F-Port F-Port

iFCP Layer

FCP Portal

F-Port F-Port

iFCP Layer

FCP Portal

IP Network

FibreChannelDeviceAddress

IPAddressMapping

FibreChannelDeviceDomain

IPFabric

FibreChannelTraffic

ControlData

iFCP Frames

iFCP Gateway Region iFCP Gateway Region


iFCPSwitch

iFCPSwitch

mFCP

UDP/IP variant of iFCP Does not use flow-controls of the TCP layer Equivalent to FC Class 3 Service

Increased performance over iFCP Possible to use mFCP within the Data Center

(where network is clean) and iFCP between Data Centers

Contributed as Open Source by Nishan Systems

iSCSI

Eliminates FC from the storage networking equation End-nodes implement SCSI for block data transfer over IP

networks Eliminates intelligent switches

End-nodes responsible for connection establishment and integrity

Many features built into protocol to accommodate IP networks Error handling, security

Very few extensions to the standard SCSI protocol

iSCSI – Protocol Stack

SCSI

iSCSI

Data Sync

TCP

Lower LevelFunction (IPSec)

IP

Link

IP Network

Initiator

SCSI

iSCSI

Data Sync

TCP

Lower LevelFunction (IPSec)

IP

Link

Target

SCSI ApplicationProtocol

iSCSI Protocol

TCP/IP Protocol


iSCSI Naming Conventions

Nodes on the network are known by its IP Address/TCP Port Combo “Network Portal”

Nodes also have a human-readable name – iSCSI Node Name fqn.com.ramjack.bigarray.research.30221 can have an alias

WWN convention accommodated by IEEE extended unique identifier (eiu) eiu.0300732A32590D26

iSNS

Internet Storage Name Server Used by iSCSI and iFCP Combination of FC and IP discovery techniques

FC: SNS in switches, zoning, state change notifications (SCN) IP: DNS, SLP LDAP

Discovery Domain Sets Similar to FC Zoning

Can also keep and exchange public and private keys used by nodes (X.509)

Implemented in Centralized iSNS servers, IP Storage Switches and Target Devices

Nishan supplied iSNS protocol as Open Source Currently in final stages of ratification by IETF

IP Storage Networking Security & Quality of Service Implementations

Security Discovery Domains

Equivalent to Soft Zoning in FC Access Control Lists LUN Masking VLAN Tagging IPSec, CHAP, SRP, Kerberos, SPKM

Quality of Service Traffic Prioritization Type of Service (TOS IP header field) Differentiated Service (DiffServ) Resource Reservation Protocol (RSVP) Multiprotocol Label Switching (MPLS)

iSCSI InitiatorsSoftware-based

Best for lightly loaded servers generating <40MBs

Supplied by OS W2K, WXP, W2K3, NetWare, Redhat Microsoft’s support in June 2003 accelerated

acceptance Supplied by Cisco for Solaris, AIX, HP-UX PYX Technologies supplies advanced iSCSI

software stack with Level 2 Error Recovery

iSCSI InitiatorsSoftware-based

Uses standard NIC Makes implementation practically free on the

Server Downside

iSCSI and TCP processing done by Host CPU Can be significant Requires workaround for Windows Dynamic Disks

iSCSI InitiatorsSoftware performance considerations

Cisco Tests 1) MS Exchange with 4000 users

Generated 20MBs server to storage thruput (no problem!) 2) OLTP/DW environment with 150 users

Performed the same as Fibre Channel Sizing

Network access: 1MBs thruput uses 8Mhz processor Storage access: 1MBs thruput uses 5Mhz processor Example: Backup server moving from network to tape drive at

30MBs each way Requires 390Mhz

Tape = 30 * 5 = 150Mhz Network = 30 * 8 = 240Mhz

To achieve full duplex Gig-E, consumes full 2Ghz processor

iSCSI InitiatorsHardware-based

Best for strained servers Offloads TCP/IP processing to Adapter

TCP Offload Engine (TOE) - TNIC General purpose – not necessarily optimized for Storage Microsoft does not yet approve

Offloads iSCSI and TCP/IP processing to Adapters Storage NIC (SNIC) Microsoft iSCSI-Ready Branding program

Most adapter vendors building TNICs and SNICs Capable of providing wire-speeds when other

bottlenecks are eliminated

iSCSI InitiatorsHardware Performance considerations

Adaptec Tests Generated 130MBs, full duplex using 64kb I/O Consumed only 5% CPU on 1Ghz processor

iReady Tests Used IOMeter test suite on Pentium II with 1500

byte I/O Hardware Initiator: 30000 IOPS @ 75% CPU Software Initiator: 12000 IOPS @ 90% CPU

iSCSI InitiatorsSummary

Host

SCSI

iSCSI

TCP/IP

Ethernet StandardNIC

TCP OffloadEngine (TOE)TNIC

StorageNIC (SNIC)

Operating System

Application

Software Initiators HardwareInitiators

IP Storage NetworkingSolutions

iSCSI Storage Router Bridge iSCSI to Fibre Channel

No virtualization of the storage Best in environments with an

existing FC SAN HP StorageWorks SR2122

2 iSCSI & 2 FC ports Cisco SN5420 & SN5428

2 iSCSI & 8 FC ports

iSCSIServer

W2K

FC Disk FC Tape

EthernetSwitch

iSCSIServer

Solaris

iSCSIServer

Linux

StorageRouter

iSCSI &Ethernet

FibreChannel


iSCSI Storage Bridge Bridge iSCSI to SCSI Good to get SCSI tape drives

into IP SAN Has to bridge SCSI-2 (tape) to

SCSI-3 (iSCSI) ATTO IPBridge 2500 C/R/D

Mix of iSCSI and SCSI ports

iSCSIServer

W2K

SCSI DiskSCSI Tape

EthernetSwitch

iSCSIServer

Solaris

NASServer

StorageBridge

iSCSI orNDMP &Ethernet

SCSI


iSCSI Storage Concentrator Bridge plus Storage

Provisioning appliance Serves volumes to iSCSI

servers from SCSI or FC Disk Arrays

Uses Allows stranded servers to

participate in SAN provides a way to reuse

older JBOD or other Disk Arrays

StoneFly’s i3000 Storage Concentrator Mix of iSCSI, SCSI and

FC ports

iSCSIServer

W2K

SCSI or FC Disk

EthernetSwitch

iSCSIServer

Solaris

iSCSIServer

Linux

StorageConcentrator

SCSI orFC

iSCSI &Ethernet

PhysicalDisk

LogicalDisk


iSCSI Storage Switch I’ve tried my hardest, but I just cannot figure out

what this thing is It’s a combo

Ethernet switch Fibre channel switch Bridge and/or Router Storage Virtualization engine

SANRAD V-Switch 3000


iSCSI Storage Array Just like today’s SCSI or FC

Arrays 14 SATA drives Dual iSCSI controllers (active-

passive) Software for

Provisioning, SnapShot, Replication, etc.

Good for ‘net new’ storage implementations

EqualLogic PeerStorage Array

iSCSIServer

W2K

iSCSI Disk

EthernetSwitch

iSCSIServer

Netware

iSCSIServer

Linux

iSCSI &Ethernet


iSCSI Tape Library Limited deployment

to date SpectraLogic first to

market SpectraLogic 2K

Tape Library

From:http://www.spectralogic.com/index.cfm?fuseaction=products.showContentAndChildren&CatID=153


iSCSI and NAS NetApp supports iSCSI

as a free download for their F800 and FAS900

Allows for block-level support Databases

Oracle and Exchange

iSCSIServer

W2K

SCSI or FC Disk

EthernetSwitch

iSCSIServer

Netware

StandardFile

Server

Ethernet

NAS Filer

SCSI orFC

iSCSI Block-Level traffic

IP File -Level traffic


IP on Fibre Channel Switches/Directors Cisco

IP Storage Services Module on MDS 9000 Series 8-port card supports both iSCSI and FCIP simultaneously on each

Gigabit Ethernet port McData

Acquired Nishan and is marketing their ‘edge’ devices for iFCP Did not find any plans to integrate into directors/switches

Brocade Developing Multiprotocol fabric routing services that will

allow for iSCSI to FC bridging and FCIP CNT

Using Edge Router for FCIP


iSCSI on Enterprise-class Arrays HDS has announced iSCSI blade for 9900V series arrays

Will provide for TrueCopy over IP Partnering with McData

EMC already provides iSCSI connectivity across their Symmetrix DMX line http://www.emc.com/news/press_releases/view.jsp?id=1744

IBM had the TotalStorage IP Storage 200i until it killed it in 2002 Teaming with Cisco


iSCSI for BladeServers Ideal solution for this type of environment

since often, each blade has only an ethernet port and a small, on-board hard drive.

Sun has blessed the EqualLogic PeerStorage Array for the B1600 Blade Platform

Allows for booting from IP SAN Without iSCSI, BladeServers relegated to using NAS

At least Sun’s was…..

iSCSI Best Practices

Start with non-mission critical application Put iSCSI at the edge and FC in the core

For an enterprise-class environment

Create a separate IP SAN from regular LAN For Small/Medium Businesses, can skip FC for

Storage Consolidation and use iSCSI Decide early who is responsible for IP SAN

iSCSI Resources

http://www.iscsistorage.com http://www.ietf.org/html.charters/ips-

charter.html http://www.snia.org/tech_activities/ip_storage http://www.iol.unh.edu/consortiums/iscsi

technology trends ip storage networking. agenda ip storage networking history protocols initiators...

Documents