www.isaaktech.com

BICSI 002 / TIA‐942 / UptimeWhich Data Center Standard

Should I Follow

Phil Isaak, PE, P.Eng., RCDD, DCDCPresident, Master Instructor

Isaak Technologies Inc.

www.isaaktech.com

Standards – Who are these People• Power Standards

– Distribution & Grounding• Network Standards

– Protocols– IT Hardware Manufacturers

• Media Standards• Cabling Manufacturers

• Design & Installation Standards• End Users, Contractors, Consultants, Manufacturers

www.isaaktech.com

Uptime ‐ TIA – BICSI

• Open Industry Standard• NOT Vendor Neutral

ANSI/TIA‐942‐A (2012)Telecommunications Infrastructure Standard 

for Data Centers118 pages

ANSI/BICSI 002‐2011Data Center Design and Implementation 

Best Practices392 pages

Uptime Institute (2010)Data Center Site Infrastructure 

Tier Standard: Topology12 pages

• Open Industry Standard• Vendor Neutral

• For‐Profit Privately Held• NOT a Standard

www.isaaktech.com

ANSI Certified Standard Requirements

Openness: Participation shall be open toall persons who are directly and materially affected by the activity in question.

Lack of Dominance: The standards development process shall not be dominated by any single interest category, individual or organization.

Balance: Participants from diverse interest categories shall be sought with the objective of achieving balance.

www.isaaktech.com

BICSI Subject Matter ExpertsMore than 150 subject matter experts from around the world participated in developing the standard.

Perspectives:• Data Center Managers• Data Center Operators• Consultants• Contractors• Risk Assessors• Manufacturers• Commissioning Agents

Expertise:• Facility Engineers/Architects• IT Engineers/Architects• System Administrators• Telecommunications• Security• Fire Protection• Project Managers

www.isaaktech.com

• ANSI/BICSI 002‐2011Provides a reference of common terminology and design practices … a framework for determining the recommended facility and technology redundancy to meet the operational requirements, achieve IT objectives 

and to develop optimum design & implementation solutions

• Uptime Tiers“Only data center benchmarking system developed by and for data center owners, not a checklist, design menu, or cookbook”

Source: Uptime Institute: Tier Classification System & Operational Sustainability presented by Dana Smith, Director of Development, Uptime Institute at BICSI Andino 2012

Design Guide vs Benchmarking

www.isaaktech.com

Uptime Benchmarks

Uptime Institute  Tier I  Tier II  Tier III Tier IV 

Scheduled Outages / Year  2 x 12hrs  1 x 12hrs  None  None 

Ave Failures / Year (4hrs / failure)  1.2  1.0  1.0  1.0 

Ave Annual Downtime Hours  28.8  22  1.6  0.8 

Availability  99.67%  99.75%  99.98%  99.99% 

** Basis is on top 10% of sites as determined by Uptime Institute Benchmarking **

www.isaaktech.com

Comparing the Standards• TIA‐942‐A chapters (normative)

– Data center design overview– Data center cabling system infrastructure– Data center telecommunications spaces & related topologies– Data center cabling systems– Data center cabling pathways– Data center redundancy

• TIA‐942‐A annexes (informative)– Cabling design considerations– Access provider information– Coordination of equipment plans with other engineers– Data center space considerations– Data center site selection and building design considerations– Data center infrastructure tiers– Data center design examples

www.isaaktech.com

– Space planning– Site selection– Architectural– Structural– Electrical systems– Mechanical– Fire protection

• BICSI‐002 annexes– Design process– Reliability and availability

– Security– Building automation systems– Telecommunications– Information technology– Commissioning– Data center maintenance

• BICSI‐002 sections

Comparing the Standards

www.isaaktech.com

ANSI/BICSI002‐2011

Comprehensive Data Center Standard

www.isaaktech.com

Methodology to Define Reliability

Define Operational Requirements

Annual Planned Downtime

Operational Level

> 400 hrs 0

100 – 400 hrs 1

50 – 99 hrs 2

0 – 49 hrs 3

0 hrs 4

www.isaaktech.com

Methodology to Define Reliability

Define Operational Requirements

Minutes Number of 9’s

> 5,000 > 99%

500 – 5,000 99% ‐ 99.9%

50 – 500 99.9% ‐ 99.99%

5 – 50 99.99% ‐ 99.999%

0.5 – 5 99.999% ‐ 99.9999%

Define Availability Requirements

www.isaaktech.com

Methodology to Define Reliability

Define Operational Requirements

Description ClassificationLocal in scope, affecting only a single function or operation, resulting in a minor disruption or delay in achieving non‐critical organizational objectives.

Isolated

Local in scope, affecting only a single site, or resulting in a minor disruption or delay in achieving key organizational objectives.

Minor

Regional in scope, affecting a portion of the enterprise or resulting in a moderate disruption or delay in achieving key organizational objectives.

Major

Multiregional in scope, affecting a major portion of the enterprise or resulting in a major disruption or delay in achieving key organizational objectives. 

Severe

Affecting the quality of service delivery across the entire enterprise, or resulting in a significant disruption or delay in achieving key organizational objectives. 

Catastrophic

Define Availability Requirements

Define Impact of Downtime

www.isaaktech.com

Methodology to Define Reliability

Define Operational Requirements

Define Availability Requirements

Define Impact of Downtime

Recommended Performance Identified

Class‐0Class‐1Class‐2Class‐3Class‐4

www.isaaktech.com

Class‐0/1 Single Path

“B” PSU“A” PSU

Power Circuit “A‐1”

“A” POU

RPP “A”

“N” CRAH Modules

“N” Chiller, Pumps& Condenser

Piping and valve redundancy not required.

LargeFrame

Processing

WANCarrier

DiskArray

Core

EdgeInternet

AccessSwitch

Server n

Aggregation

Server 1

EdgeWAN

NASDiskArray

Transfer Switchgear

Electrical Distribution

Alternate Power Source

UPS

PDU

CriticalLoads

Non-CriticalLoads

Mechanical Switchgear

MechanicalLoads

Static Bypass

Maint.Bypass

Utility

© 2013 Isaak Technologies Inc.

www.isaaktech.com

Class‐2 Redundant Components

“B” PSU“A” PSU

Power Circuit “A‐1”

“A” POU

“B” POU

Power Circuit “A‐2”

RPP “A”

“+1” CRAH Module

“N+1” Chillers, Pumps & Condensers

More than “N+1” redundancy is recommended as the number of modules to meet “N” increases

“N” CRAH Modules

Piping and valve redundancy not required outside computer room.

Refer to “Chiller Piping and Valve Redundancy” section for computer room recommendations

LargeFrame

Processing

WANCarrier

DiskArray

NASDiskArray

Core

AccessSwitch

Server n

Aggregation

Server 1

EdgeWAN

EdgeInternet

Transfer Switchgear

Electrical Distribution

Alternate Power Source

Alternate Power Source

UPS UPS

PDU

CriticalLoads

Non-CriticalLoads

Mechanical Switchgear

MechanicalLoads

Static Bypass

Maint.Bypass

Utility

© 2013 Isaak Technologies Inc.

www.isaaktech.com

Class‐3 Concurrent Maintainability

“B” PSU“A” PSU

“A” POU

“B” POU

STS “A”

STS “B”

Power Circuit 

RPP‐B1‐2

Power Circuit 

RPP‐B1‐1

RPP‐B1

PDU‐B1

Power Circuit 

RPP‐A1‐2

Power Circuit 

RPP‐A1‐1

RPP‐A1

PDU‐A1

“+1” CRAH Module

“N+1” Chillers, Pumps & Condensers

More than “N+1” redundancy is recommended as the number of modules to meet “N” increases

“N” CRAH Modules

Piping and valve redundancy not required, but recommended, outside computer room.

Refer to “Chiller Piping and Valve Redundancy” section for computer room recommendations

LargeFrame

Processing

WANCarrier “1”

DiskArray n

SANSwitch2

DiskArray1

SANSwitch1

Core2Core1

Edge2Internet

Edge1Internet

AccessSwitch 1

Server n

Aggregation1

AccessSwitch 2

Server 1

WANCarrier “2”

Aggregation2

Edge2WAN

Edge1WAN

Carrier “1” Carrier “2”

NASDiskArray

SwitchgearUtility

Electrical Distribution

Switchgear

Alternate Power Source

Electrical Distribution

Alternate Power Source

UPS UPS

Output Distribution Switchboard

PDU

Mechanical Switchboard

CriticalFans/Pumps

CriticalLoads

Non-CriticalLoads

Mechanical Switchgear

MechanicalLoads

Alternate Switchboard

PDU

Mechanical Switchboard

Non-CriticalLoads

Mechanical Switchgear

MechanicalLoads

Static Bypass

Maint.Bypass

© 2013 Isaak Technologies Inc.

www.isaaktech.com

Class‐4 Fault Tolerant

“B” PSU“A” PSU

“A” POU

“B” POU

STS “A”

STS “B”

Power Circuit 

RPP‐2B‐1

Power Circuit 

RPP‐2A‐1

Power Circuit 

RPP‐1B‐1

Power Circuit 

RPP‐1A‐1

PDU‐A1 PDU‐A2

Panel A Panel BRPP‐1

PDU‐B1 PDU‐B2

Panel A Panel BRPP‐2

“N” CRAH Modules

“+2” CRAH Module

“N+2” Chillers, Pumps & Condensers

More than “N+2” redundancy is recommended as the number of modules to meet “N” increases

Piping and valve redundancy required outside computer room.

Refer to “Chiller Piping and Valve Redundancy” section for computer room recommendations

LargeFrame

Processing

WANCarrier “1”

DiskArray n

SANSwitch2

DiskArray1

SANSwitch1

Core2Core1

Edge2Internet

Edge1Internet

AccessSwitch 1

Server n

Aggregation1

AccessSwitch 2

Server 1

WANCarrier “2”

Aggregation2

Edge2WAN

Edge1WAN

Carrier “1” Carrier “2”

NASDiskArray

SwitchgearUtility

Electrical Distribution

Switchgear

Alternate Power Source

Electrical Distribution

Alternate Power Source

UPS UPS

Output Distribution Switchboard

PDU

Mechanical Switchgear

CriticalFans/Pumps

CriticalLoads

Non-CriticalLoads

Mechanical Switchgear

MechanicalLoads

Output Distribution Switchboard

PDU

Mechanical Switchgear

Non-CriticalLoads

Mechanical Switchgear

Static Bypass Maint.

Bypass

UPS UPS

Static Bypass Maint.

Bypass

Utility

Alternate Power Source

Alternate Power Source

© 2013 Isaak Technologies Inc.

www.isaaktech.com

End‐to‐End Reliability

• Applications• Systems• Network• Cabling Infrastructure• Facility

Facility

Cabling Infrastructure

Network

Data Processing & Storage Systems

Applications

www.isaaktech.com

DC125 Data Center Design Course

• 4 Day Course• In‐Depth Review of Standard

• Prepare for DCDC Exam–Data Center Design Consultant

• Contact FiberOpto Asia Pte Ltd for course dates and locations available in South East Asia

www.isaaktech.com

BICSI Data Center Documents

ANSI/BICSI 002‐2011Data Center Design and Implementation Best Practices

Available from BICSIwww.bicsi.org/standards

BICSI International Standards Supplemental Information 001

Methodology for Selecting Data Center Design Class Utilizing Performance Criteria