michael mallia - eaton - future-proofing your data centre 2011

© 2011 Eaton Corporation. All rights reserved.

Evaluating power solutions for small to large enterprisesAssembling efficient data centres with flexible Power Infrastructure

Future-Proofing Your Data Centre

Conference 201114th February, Dockside, SydneyMichael Mallia, Eaton Corporation

2 2© 2011 Eaton Corporation. All rights reserved.

Technology changes and challenges

• High density blade servers and rack mounted storage arrays are being promoted as the saviors of the modern day space constrained data centre manager

• Virtualisation of IT applications can increase sever utilisation from an average of 15% to over 80%

• Social media and enhanced content requires increased attached storage capacity and faster more powerful networks, therefore higher power requirements

• Data centre consolidation can reduce operations costs, freeing up capital for additional IT technology

• Cloud computing increases the speed of application deployment while reducing the required IT resources


0 to10

30 to 40

60 to 70

12345

6-10

10-2020-50

0

1

2

3

4

5

6

Events Per Year

Voltage (% of Nominal)

Duration ( cycles)

Average of 50

Sags/Year

Interruptions

Typical PQ Problems

10%

7%

5% 5% 5%

10%

5% 7%

46% Sags

Swells

Spikes, switching Spikes, switching transients transients

Under voltage Under voltage

Over voltage Over voltage

Harmonics Harmonics

Line Noise Line Noise

Frequency Frequency variations variations 2002 EPRI study

of 985 customers in the US

Interruption

Understanding the type & frequency of power problems, plus the requirements of your IT systems may enable increase in uptime and significant savings in energy costs


Typical Blade Servers• Blade Servers:

• Chassis heights 4 to 19 RU• 7 to 16 Blades per chassis• Typically accept two (2) - quad core “x” class

processors per blade• Two (2) to six (6) power supplies per chassis

• Single and three phase power supplies• Fully redundant power configurations• Input voltage range 180 to 264Vac

• Each power supply rating 1000 to 2900 watts• Voltage ranges: Typically 200-240V• Cord types

• IEC 320 C20, or C14• Manufacturers online power sizing tools/guides

can be used to calculate power consumption per the actual configuration


The “Power Supply”

Common ThemeUniversal input

Power factor corrected (PFC)


Acc

epta

ble

Inpu

t Vol

tage

to U

PS

On Line or Line Interactive UPS?

• Line Interactive UPS ideal for SMB applications

• On Line UPS provide constant voltage regulation, but may unnecessarily waste energy

• On Line UPS with Energy Saver or “ECO” modes work in bypass mode when mains is suitable, and in Double Conversion mode when line voltage is close to the limits of ITIC Curve

• Transition time between Normal and Double Conversion mode should be ~2-4 ms under all line/load conditions – up to 2x faster than any Mission Critical STS


High efficiency UPS with Energy Saver Systemcompared to legacy UPS systems

• Energy Saver System 99% or higher efficiency for 20% to 100% load range• 6% to 15% efficiency improvement across full load range vs traditional UPS• Continuous power tracking and proprietary DSP algorithms combined with

transformerless topology ensures critical loads are always protected

Regular

92Efficient

95Premium

99

η

ESS

99%Standard

95%Legacy

85%

You select the desired efficiency


Where does that bring us?• No matter what size the data centre they “may” already be, or

“will” be deploying in the future, more advanced IT technology

• Need to protect against the variety of power quality problems that are seen today, although the key need may just be power availability

• How do you prepare for those challenges?• Top 5 considerations for any size critical power application

• Reliability• Efficiency

• Flexibility• Manageability• Serviceability


Importance of more reliable hardwarePre-virtualisation applications: Post virtualisation applications:

Payroll

PayrollCRM

Accounts PayableShipping

Receiving

Human resources

Financial analysis

Business intelligence


Increasing reliability

• Hardware additions to increase reliability• Multi – corded (power supply)

servers• Redundant UPS Systems• Dual power path power

distribution (A & B design)• Dual UPS systems (2N)• Source Transfer Switches• Surge Protection Devices (SPD)• Maintenance Bypass Switches

N + 1 Redundant UPS

SPM

LoadLoad

N + 1 Redundant UPS

SPM

LoadLoad


Increasing reliability: N+1 Systems

30 kVA 30 kVA 30 kVA 30 kVA

Load 90 kVA total

Any single UPS can be taken off line for maintenance or repair


Increasing power infrastructure reliability

UPS 1

Power panel

1

UPS 2

Power panel

2

“A” side power

“B” side power

2N deployment, - one power

source can be off-line for

service or repair

Dual corded server

Single corded server

STS

Redundant UPS


UPS Deployment - Centralised

Centralised• Scalable for buildouts• Ongoing maintenance is simplified

Centralised UPSComputer Room

UPS

Computer Room

UPS UPS

Centralised A + B• Scalable for buildouts• Total Redundancy (UPS, Switchgear, Cabling)


Past designs

900 kW

Modular design allows:Increased redundancyConcurrent ServiceModule cycling for highest efficiency loading

State of the art design

900 kW

Flexible Centralised UPS designs


Maximising Efficiency and Reliability!

• Energy Saver System mode on Source A• On Line mode with Variable Module Management System on Source B• > 3% efficiency improvement over existing double conversion only approach

• ESS 99% efficiency for 50% of the system load• VMMS >93% efficiency for 50% of the system load

• Double Conversion backup for 100% of system load

VMMS on “B”

Single or Dual Source

Data Centre with Dual Corded ServersESS 99%

Efficiency ESS on “A”

“A”

“B”

50% of Load

50% of Load

VMMS > 93% Efficiency X


UPS Deployment - Zone

Zone UPSComputer Room

UPS

UPS

UPSZone

• Scales with computer room growth• Maintenance more intensive than centralised

• End of Row or Rack Based

Redundant Zone UPSComputer Room

UPS

UPS

UPS

UPS

UPS

UPSRedundant Zone• End of Row Redundant systems• Simplified Power Distribution


120 kW 2(N+1) building block

Bla

deU

PS

60

kW

Bla

deU

PS

60

kW

Bla

deU

PS

60

kW

Bla

deU

PS

60

kW


Landscape


Connection Diagram

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42


Scalable Efficient Data Centres• Modular building block approach

• 200-1000 Sq ft computing “nodes”• Include power and cooling systems• Central power and compartmentalised cooling• Redundancy of nodes is a function of software

AC Unit 3

3URPM

3URPM

3URPM

3URPM

3URPM

3URPM

AC Unit 3

3URPM

3URPM

3URPM

3URPM

3URPM

3URPM

AC Unit 3

3URPM

3URPM

3URPM

3URPM

3URPM

3URPM

AC Unit 3

3URPM

3URPM

3URPM

3URPM

3URPM

3URPM

Module 1 Module 2 Module 3


UPS Deployment - Rack

Rack MountedComputer Room

UPSUP

SUPSUP

SUPS

UPSUP

SUPSUP

SUPS

Rack Mounted• Each UPS powers a rack• 3Ph or 1Ph, Single or Redundant• High power with small footprint• IT friendly features• Limits impact of UPS failure to a enclosure(s)

Rack MountedComputer Room

UPSUPS

UPSUPS

UPS

UPSUPS

UPSUPS

UPS

UPSUPS

UPSUPS

UPSUPS

UPSUPS

UPSUPS

UPS

UPSUPS

UPS

Rack Mounted A + B• Add redundant feeds for dual corded loads


UPS Deployment - Variations

Centralised• Scalable for buildouts• Ongoing maintenance is simplified

Centralised & End Of Row Zone UPSComputer Room

UPSUPS

UPS

UPS

Centralised & Rack UPSComputer Room

UPS

UPSUPS

UPSUPS

UPSUPS

UPSUPS

UPSUPS

UPS

UPSUPS

UPS

Zone• Scales with computer room growth• Maintenance more intensive than centralised

• Rack Based


Adjusting existing facilities to handle - cloud

Cloud environment is contained

in special area

Util

ity F

eed

AU

tility

Fee

d B

Bat

tery

Public and Private cloud

area High density

N+1 Redundant

modular UPS systems

Corporate data centre

Standard density (5kW per rack)

Corporate data centre

High density (15 kW per rack)

Power systems supporting

corporate data centre


Centralised with Rack UPS for redundancy“Existing Central UPS” and “In the Rack” for redundancy• Add redundancy in highly critical computing areas “zones”.• Individual 12kW UPS module provides redundant UPS source.

Existing UPS(A Source)

6kW power requirement per rack

12kW UPS where redundancy needed (B Source)

No redundancy needed


Monitoring your power Home office and SMBs

UPS monitoring may be all that is needed.

Business critical computer roomsMonitor the UPS and output power to the rack level.

Large data centresMonitor from the utility input to the server in the rack.

Mission critical facilitiesMonitor from utility input to the server level with in-depth power quality and analysis.

Monitoring increases reliability, as well as helping you to become more efficient


Monitoring at the utility service entrance


Monitoring at the utility service entranceTypically installed in low- or medium-voltage switchgear

Advanced power quality monitoring

Basic power monitoring


Monitoring at the facilities level


Monitoring at the facilities levelTypically installed in low-voltage switchgear


Monitoring at the data centre level


Monitoring at the data centre level

A central UPS displays monitoring information:• Locally via a display or• Remotely over the network


Monitoring at the power distribution level


PDU / RPP contain monitored data locallyand with communication cards can connect to networks

Monitoring at the power distribution level


Monitoring UPS in the rack

UPSs distributed throughout the data centre deliver information about themselves, such as:

• UPS energy use• Battery runtime• Battery health and status• UPS status• Input and output voltage, output kWh


Monitoring at the enclosure level


Monitoring at the enclosure levelRack-mounted PDU’s display local information

can be configured for network connectivity as well.


What do you do with all that information?

H2OPumps

Chiller

Precision

Cooling

Utility

Central UPS

Power Distribution Units

Facility Network

DC Power

Low Voltage600VAC Eqpt

Generators

Parallel or Transfer Eqpt

Utility,Rates, Incentives SubstationCommunicating Revenue Meter

Power

Cooling

Monitoring and Control

CoolingTower

Medium Voltage>600VAC Eqpt

$

Utility

AlternativePower

Utilities

Compute• Main Frames• Volume Servers• Blade Servers

Storage• SATA Disk• Tape• Blended

Network• Corporate Networks• VoIP

IT and Networks

Security…UPSBattery

Service Level Agreements

MonitoringSoftware

IT

• Open architecture• Reporting warehouse• Vendor neutral drivers• Various energy meters

and Gateways


Built in User View Templates- Geographical Layout Example

Data Centre LIVE Webcam video stream

embedded into PXS

Data Centre LIVE Webcam video stream

embedded into PXS

Events bubble up and change City-label colors

accordingly

Events bubble up and change City-label colors

accordingly

Local Weather LIVE webpage embeddedLocal Weather LIVE webpage embedded

http://10.222.50.187/powerxpertsoftware


DCiE, PUE, THD, kWh, $$$, key indicators for

the plant

DCiE, PUE, THD, kWh, $$$, key indicators for

the plant

Shop Floor components: UPS’s, Meters, Gateways w/

status indicators

Shop Floor components: UPS’s, Meters, Gateways w/

status indicators

Built in User View Templates- Plant (industrial) Layout Example


Integrated PXM Meters with live

metering data & LED’s

Integrated PXM Meters with live

metering data & LED’s

ePDU and UPS live status LED indicatorsePDU and UPS live

status LED indicators

Built in User View Templates- Device Overview (Data Centre) Layout Example


Data Centre Efficiency Report- Power Usage Effectiveness (PUE), Data Centre Infrastructure Efficiency (DCiE)

Energy Consumption: - IT vs. non-IT consumption delineation- Day-by-Day Line and Bar Charts

Energy Consumption: - IT vs. non-IT consumption delineation- Day-by-Day Line and Bar Charts

DCiE & PUE: - industry standard efficiency metrics-Understand and track how efficiently your Data Centre is running, and how effective your improvement efforts have been

DCiE & PUE: - industry standard efficiency metrics-Understand and track how efficiently your Data Centre is running, and how effective your improvement efforts have been

Temperature & Humidity: - Low, Average, High metrics- Day-by-Day Bar Charts

Temperature & Humidity: - Low, Average, High metrics- Day-by-Day Bar Charts

$$$ $$ $


Greenhouse Gas Report

Report Key: - Carbon Dioxide- Sulfur Dioxide- Nitrogen Oxide- Mercury- Methane- Nitrous Oxide

Report Key: - Carbon Dioxide- Sulfur Dioxide- Nitrogen Oxide- Mercury- Methane- Nitrous Oxide

Report period totals for all gas’Report period totals for all gas’

Consumption breakdown by selected locations

Consumption breakdown by selected locations


Utilities Report

Utilities usage per day Bar GraphsUtilities usage per day Bar Graphs

Utilities totals:-Understand and track your utilities consumption, and how effective your improvement efforts have been

- Water- Air- Gas- Electricity- Steam

Utilities totals:-Understand and track your utilities consumption, and how effective your improvement efforts have been

- Water- Air- Gas- Electricity- Steam

Utilities usage Day-by-Day Line GraphsUtilities usage Day-by-Day Line Graphs


Conclusion• Today’s data centre requirements are more

complex than ever: Help is available, as more weight is placed on IT groups to provide solutions

• Begin small by thinking of modular solutions • Monitor your power

• information gained can help make decisions to maximisereliability and efficiency

• Integrate Power Monitoring into your IT monitoring environment

• Move toward being Green in the Data Centre


Eaton can help you!

GenerationUtility Substations

Software & Monitoring

MV Switchgear

Low Voltage EquipmentTransformers, SwitchgearPanelboards, SPDs

DC Power

Engineering Services• Project Management• Service• Monitoring• Business Continuity• Disaster Recovery

In the “white” spaceModular 1 and 3 phase UPSLarge floor power distributionRack power distributionEnvironmental monitoring IT Racks & Air Flow Management Systems

Central UPS SystemsStatic Auto-Tie

Static Transfer Switches

Wiring Closets

Roll-upGenerators

Paralleling Switchgear

michael mallia - eaton - future-proofing your data centre 2011

Education

user view

double conversion

data centre

day line

utility input

redundancy

ups deployment

rights reserved