Download - Hosted by Seven Step Plan for Building and Scaling Storage Networks Richard Scannell Bill Peldzus
Hosted by
Seven Step Plan for Building and Scaling Storage Networks Richard ScannellBill Peldzus
Hosted by
Building a Solid Foundation
Building and Scaling Storage NetworksBuilding and Scaling Storage Networks
• If you bypass just one pitfall at the end of this
session, then we’ve been successful!
Richard Scannell• VP of Strategy and Co-founder
Bill Peldzus• Sr. Storage Consultant
Hosted by
But First, Some Housekeeping…
Workbooks available for taking notes
• Outlines key questions and considerations for you and your
company going forward
Presentation flow
• Richard will address the high-level stuff
A.k.a. How to sell this to your boss
• Bill will address the techie stuff
What works, what to watch out for, design considerations
• We’ll both address the customer stuff
Hosted by
What’s the Agenda?
Topics include• What to plan for
• Budget/ROI/TCO
• Non-technical considerations
• Application effect
• Getting from here to there (a.k.a. migration)
• Up and running – what’s next?
• Planning for Q2, Q4, 2004
Hosted by
Audience Feedback Please
IT End User
•No privileged access•Victim of policy
IT Worker
•Has Privileged access•Enforcer of policy
IT Manager
•Grants Privileged access•Defines policy
Executive
•Privileged in general•There’s a policy?
Hosted by
What to Plan for When Building a Storage Network
Hosted by
Why is this Important? The intersection of Network, Storage and Database is
creating complex new technologies and three problems
for the CIO – Technology, Business, Organization.
Hosted by
DECNet, Appletalk, Token Ring, ATM, Frame Relay, TCP/IP, Gigabit Ethernet
Complex Today and Getting Worse
85% of those who have not yet implemented a SAN have heard “horror stories”about complexities/compatibilities.
Enterprise Storage Group
89% of organizations that have already implemented one major SAN would usean outside firm for their subsequent design and implementation.
Enterprise Storage Group
Fibre Channel, iSCSI, Infiniband, Virtualization, SRM, Virtual Tape
Hosted by
Balanced Business Approach
Hosted by
Storage Product Landscape
Disk Drives Tape Drives
Arrays Libraries
Storage Networking
Hardware
Virtualization Continuity Replication
Software
Storage System Management
Storage Resource Management
Storage Policy Management
Application ManagementServices
Application Integration Application Management
Hosted by
Interoperability – Why is it <still> an issue?
5+ Fibre Channel Switch/Director Vendors
Tape Library Tape Drive
Tape Drive
Tape Drive
Tape Drive
HBA
LAN
Disk Storage
HBA HBAHBA
SANSAN
5+ Server Vendors
4+ HBA Vendors
4+ Tape Library Vendors
3+ Bridge/Router Vendors
8+ Tape Formats
7+ Large and Small Disk Array Vendors
Bri
dg
e
AND: Multiple software options, multiple operating systems, multiple
firmware and microcode levels...
Tape Drive
Hosted by
Interoperability - more…
The last slide didn’t even touch on the multiple PRODUCTS from each of the noted vendors
Only counting vendors, there were over 67,000 possible product combinations for that “simple” storage area network
That’s going to the extreme, BUT, do you really think every configuration has been tested?
Hosted by
Your Vision May Not be Your Vendor’s Vision
Customer’s Overall Storage Vision
Disk Storage Vision
Tape Storage Vision
Fabric Storage Vision
Enterprise BackupStorage Vision
Storage ManagementVision
HA Storage Vision
DR Storage Vision
•Technology•Process•Policy•Measurability
•Technology•Process•Policy•Measurability
•Technology•Process•Policy•Measurability
•Technology•Process•Policy•Measurability
•Technology•Process•Policy•Measurability
•Technology•Process•Policy•Measurability
•Technology•Process•Policy•Measurability
Hosted by
Storage NetworksBudgets…ROI…TCO…
Hosted by
Justifying a Storage Network
In 2003 and beyond, the trend is
“Spend to SaveSpend to Save”
Can’t put in a SAN because it’s “cool”
• You put in a SAN because it saves money!
Justifications are difficult – let’s look at
some approaches…
Hosted by
Data Lifecycle
Data has a discrete value to the business and that value changes over time
Drivers that affect data value• Product/Service lifecycle
• Regulatory requirements
• Customer expectations
Hosted by
Align Value with Cost
Apply appropriate infrastructure to protect the data
and the business (from risk and waste)
One size doesn’t fit all
• JBOD, RAID, Clustering, Replication, Hot Site
Hosted by
Break Even Analysis
Value of Information
TCOLow Medium High
Hig
hM
ediu
mL
ow
Payroll
Order Processing
C.R.M.
Inventory Management
System
Break-even: TCO = Value
Best Practices Line
Hosted by
Governance: When does data qualify to
move up or down the value stream? (more on this coming up)
Architecture: Hardware/Software
requirements
Processes and Standards
Optimization of Assets
Occupancy: Appropriately congregate data
by value and rationalize storage requirements at each phase
Hosted by
Classes of Storage
Create Classes of
Storage based on
architecture attributes
Track TCO, utilization
(on the device) for each
class of storage and
occupancy of the
classes relative to each
other
Distribution by Class
0%
20%
40%
60%
80%
100%
Low Med High
Hosted by
Utilization and TCO
Understand yields of
useable storage based
on RAID configuration
Establish a goal line for
average utilization
Create plans to drive
utilization to the goal
Storage Utilization
0
50
100
150
200
250
300
TB
0%10%20%30%40%50%60%70%
% Utilization
Used Usable Raw Used/Usable
Hosted by
Utilization and TCO
TCO by Class
0
50
100
150
200
250
TCO
($/M
B)
High Med Low
Track TCO across each
class
Ensure there is sufficient
gap between the classes
to warrant separation
Focus efforts on reducing
TCO in ALL classes.
Diminishing returns is a
factor…
Hosted by
Asset Sharing
Storage Networks enable asset sharing• Share tape drives (more on this later)
Don’t have to buy a tape drive with every server
Use your tape drives twelve hours per night
instead of four or five
• Shared pool of “spare” storage
Don’t need to allocate spare storage to every
server or application
Distribute the spare storage where it’s needed
Hosted by
The Non-Technical (but very important!) Stuff…
Hosted by
Storage Governance
Governance: the continuous exercise of authority over and
the performance of functions (Webster)
To date almost all vendors are focused on the Physical and Logical levels – does not diminish the continuing needs for Business Level focus
Hosted by
Storage Governance
Needs to be
Predict
Occupancy
Operating Standards
Asset Optimization
Change Control
Utility Mindset
Strategic
Used to be
Guesstimate
Utilization
Benchmarks
Asset Management
Downtime
SLA
Tactical
Hosted by
Before I Buy…
Have you considered
• What your RFx is going to look like?
• More importantly, how are you going to rank the
responses?
• Will I consider startups with great technology?
• Do I understand my SLAs?
• Checking references?
Hosted by
The Effects on Applications
Hosted by
How Can Applications Benefit? Performance - more storage per channel and still faster than
old F/W SCSI
High availability - try a 3-node cluster with SCSI versus Fibre Channel SAN
Disaster Recovery - A DR architecture that doesn’t involve the server for data replication
Data protection - not buying another tape drive with every new server
Storage management - more managed GBs/support staff in a pooled environment
Let’s take one and explore it further__
Data protection
Hosted by
Multiple Approaches including
• Distributed backup
• Centralized backup
• LAN Free backup
• Serverless backup
Terminology – Backup Methodologies
Hosted by
Client Systems Application Servers
100 MbpsLAN
File Server Database Server Mail Server Database Server
Storage Storage Storage Storage
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Backup Methodologies: Distributed Backup
Hosted by
Application Servers
100 MbpsLAN
Tape Library
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Master Backup Server
Client Systems
Bottleneck
B
Gig E LAN
MediaServer
SCSl
File Server Database Server Mail Server Database Server
Storage Storage Storage Storage
Dedicated Gigabit Ethernet for backup LAN
Backup Methodologies:Centralized Backup over the LAN
Hosted by
Storage
Application Servers
100 MbpsLAN
Master Backup Server
Client Systems
Gig E LAN
Media ServerFile Server Database Server Mail Server Database Server
Storage Storage Storage Storage
Tape Library 1
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Library 2
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Dedicated BackupDedicated BackupSwitched FabricSwitched Fabric
Backup Methodologies:LAN Free Backup with Native FC Tape Drives
Hosted by
SCSl
Tape Library Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Fibre Channel SAN Fibre Channel SAN for Disk and Tapefor Disk and Tape
LAN1
Client Systems Application Servers
LAN2
Storage Storage Storage Storage
A¹ B¹
C¹ D¹
A B
C D
A B
C D
LAN2
MasterBackupServer
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
File Server
Database Server Mail ServerApplication Server
A B C D
Backup Methodologies:LAN Free Backup with SCSI Tape Drives
Hosted by
Fibre Channel SAN Fibre Channel SAN for Disk and Tapefor Disk and Tape
LAN1
Client Systems Application Servers
LAN2
Storage
Storage
Storage
Storage
A¹ B¹
C¹ D¹
A B
C D
A B
C D
LAN2
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Ro
ute
rR
ou
ter
File Server
Database Server
Mail Server
Application Server Master
BackupServer
A B C D
Backup Methodologies:LAN Free Backup with SCSI Tape Drives
Hosted by
Application Servers
Fibre Channel SAN Fibre Channel SAN for Disk and Tapefor Disk and Tape
LAN1
Client Systems
LAN2
Storage Storage Storage Storage
A¹ B¹
C¹ D¹
A B
C D
A B
C D
LAN2
Master
Backup
Server
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Ro
ute
rR
ou
ter
File Server
Database Server
Mail Server
Application Server Master
BackupServer
A B C D
XCOPY Server(SCSI Extended Copy Command)
XCOPY (SCSI Extended Copy Command)
Backup Methodologies:Serverless Backup with SCSI Tape Drives
Hosted by
Persistent binding• The mapping of a specific SCSI ID to a specific device
in a Fibre Channel environment
• Generally mapped by WWNN or WWPN
• Without persistent binding, the physical to logical
mapping of tape drives can be re-ordered every time
there is a re-boot
• This will confuse your backup software
Multiple Tape Drive Configuration – Issues
Hosted by
NT and W2K only
Not specific to SAN
If a tape drive fails in a library, there is danger of
re-ordering of the logical to physical mapping
This will happen upon re-boot
Lesson: replace drive before re-boot AND confirm mappings
before backups
Solutions are being integrated … help coming!
Physical Drives
1
2
3
4
5
Tape LibraryLogical
Mapping
1
2
3
4
5
Backup SoftwareMultiple Tape DriveConfiguration Hazards
Hosted by
How to Get There from Here(Data Migration)
Hosted by
Multiple Approaches
From the simple
• Backup tapes
To medium
• Mirrored copy, snap-shots, etc.
To complex
• Specialized data migration and
“virtualization” products
Hosted by
Migration Considerations
If you’re planning a migration over a
long weekend, know what time to “turn
back” if it’s not going as planned
Estimating the time it takes on paper is
fine, but…
• Don’t forget to factor in “import/export” times
into databases or applications
Hosted by
Client Systems Application Servers
LAN LAN
File Server Application Server Mail Server Database Server
Storage Storage Storage StorageSCSl
Tape Library
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
MasterBackupServer
NASNAS
Today’s Typical Architecture
Hosted by
SCSl
Shared Shared StorageStorage
Mail Server Database Server
Storage Storage
Client Systems Application Servers
LAN LAN
MasterBackupServer
Tape Library
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
HeartbeatHeartbeatProduction
Server
Storage
Production Server
Storage
Production Server
Storage
Production Server
Storage
Production Server
Storage
Production Server
Storage
Production Server
Storage
Production Server
Storage
Production Server
Storage
Production Server
Storage
NASNAS
Phase 1: Introducing Storage Networking (w/ H.A.)
Hosted by
Phase 2: Migrating from DAS to SAN
A B
C D
LAN
Client Systems Application Servers
LAN
File Server
Database Server Mail ServerApplication Server
Storage
Storage
Storage
Storage SCSl
Tape Library Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
MasterBackupServer
SAN Fabric
A B C DX X X X
Hosted by
Phase 3: Enterprise Ready SAN
SCSl
Tape Library Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
LAN1
Client Systems
A B
C D
MasterBackupServer
A B
C D
A¹ B¹
C¹ D¹
A¹ B¹
C¹ D¹
A B
C D
A B
C D
File Server
Database Server Mail ServerApplication Server
A B C D
Fabric 1Fabric 1 Fabric 2Fabric 2
Hosted by
Begin MigrationMethod Selection
Dual Direct-Attachment?
Host Mirroring?
Y
Host BlockCopy?
Host File Copy?
Host FileBackup?
N
N
N
Dual-HostNetwork
Attachment?
N
Array BlockCopy?
N
Host-to-HostNetwork
Mirroring?
Y
Host-to-HostBlock Copy?
Host-to-HostFile Copy?
N
N
N
Execute MigrationProcess
Y Y Y
SANAppliance?
N
Y
Y
N
Y Y
Y
Y
Abort MigrationProcess
N
Data Migration Decision Flow-Chart
Hosted by
Okay, it’s InstalledWhat’s Next?
Hosted by
Storage Management Lifecycle
Hosted by
Troubleshooting
Have you “Monitored for normal”
Is you staff trained?
• Can they do initial troubleshooting?
Do you know what to do if…
• you think it’s a switch problem? Or an HBA?
Are my maintenance contracts consistent?
• i.e. two hour response on storage array, but eight hour
response on FC switches
Hosted by
Planning for Next Quarter; Next Summer; Next Year; Next Millennium!
Hosted by
New Technologies to Consider
IP Storage
Disk versus tape for backup
InfiniBand
Storage Management products
Look before you leap!• Careful of baseline requirements
• Careful of what’s supported
• Careful of outrageous claims