my ton – ecos consulting brian fortenbery – epri solutions bill tschudi – lawrence berkeley...

My Ton – Ecos ConsultingBrian Fortenbery – EPRI Solutions

Bill Tschudi – Lawrence Berkeley National Laboratory

Sponsored by: California Energy Commission (CEC)─Public Interest Energy Research (PIER),California Institute for Energy Efficiency (CIEE).

Open House PresentationSummer 2006

Sun Microsystems Newark, CA

DC Power for Data Centers – a demonstration

2High Performance Buildings for High-Tech Industries

Open House: Agenda

Project background Project objectives Demonstration configurations Technical & safety details Project results

Guided Tour of Equipment

Questions/Answers/Discussion

Welcome & Overview


Thomas Edison:

“My personal desire would be to prohibit entirely the use of alternating currents. They are as unnecessary as they are dangerous. I can therefore see no justification for the introduction of a system which has no element of permanency and every element of danger to life and property.”


• Research, develop, and demonstrate, innovative energy efficient technologies

• 10-year initiative focusing on high-tech industries – e.g. data centers

• Help move the market to more efficient technologies

• Research and demonstration projects include technology transfer

California Energy Commission Public Interest Energy Research

High-tech Buildings Project Objectives


DC Demonstration – Timeline

• Stakeholders first met – Fall 2005

• Kick-off meeting – April 2006

• Equipment assembly – May 2006

• Initial “Team Open House” June 7, 2006

• Public Open House events: June 21,

July 12, 26; Aug 9, 16

• End date – August 16, 2006


Industry Partners Made it Happen

Alindeska Electrical Contractors APC Baldwin Technologies Cisco Systems Cupertino Electric Dranetz-BMI Emerson Network Power Industrial Network Manufacturing

(IEM)

Intel Nextek Power Systems Pentadyne Rosendin Electric SatCon Power Systems Square D/Schneider Electric Sun Microsystems UNIVERSAL Electric Corp.

Equipment and Services Contributors:


Other Partners Collaborated

380voltsdc.com CCG Facility Integration Cingular Wireless Dupont Fabros EDG2, Inc. EYP Mission Critical Gannett Hewlett Packard

Morrison Hershfield Corporation

NTT Facilities RTKL SBC Global TDI Power Verizon Wireless

Stakeholders:


Data Center Power Use

Data center power use nationally is large and growing.

Two studies estimated data center energy use:

• 2004 EPRI/Ecos estimated 14.8 TWh

• 2000 Arthur D. Little estimated 10.1 TWh

0ne terawatthour = 1,000,000,000 kilowatthours or one million megawatthours

Saving a fraction of this energy is substantial

9High Performance Buildings for High-Tech Industries 9

Typical Data Center Power Use

Source: Intel Corp.

~50% Power Efficiency

0%

5%

10%

15%

20%

25%

30%

35%

40%

45%

50%

Load PSU Chiller UPS VRs Serverfans

CRAC fan PDU CW pump Totalbaseline

Po

we

r p

er

co

mp

on

en

t

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Cu

mu

lati

ve

po

we

r

Loads Power delivery Cooling

Cumulative Power

10High Performance Buildings for High-Tech Industries 10

Power Consumption: 100 W System Load

Source: Intel Corp.

Server fans 15W

UPS +PDU 20W

PSU 50W

Load 100W

VR 20W

Room cooling

system 70W

Total 275W

source: Intel Corporation


This demonstration focuses on reducing power delivery and conversion losses observed in our prior work:

45%

50%

55%

60%

65%

70%

75%

80%

85%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

% of Nameplate Power Output

% E

ffic

ien

cy

Average of All Servers

Uninterruptible Power Supplies (UPS)

Power Supplies in IT equipment

Factory Measurements of UPS Efficiency

70%

75%

80%

85%

90%

95%

100%

0% 20% 40% 60% 80% 100%

Percent of Rated Active Power Load

Eff

icie

nc

y

Flywheel UPS

Double-Conversion UPS

Delta-Conversion UPS

(tested using linear loads)


UPS and Power Supply efficiency

• We observed a wide range of performance from the worst to the best

• Our original goal was to move the market to the higher performing systems

• Incentive programs, labeling, education programs were all options – and still are


Data Center Power Delivery System

Power Dist98 - 99%

UPS88 - 92%

Power Supply68 - 72%

DC/DC78 - 85%

The heat generated from the losses at each step of power conversion requires additional cooling power

HVAC: Power for cooling can equal or exceed the direct losses


Then we asked the question:

Inverter

In Out

Bypass

Battery/ChargerRectifier

Inverter

In Out

Bypass

Battery/ChargerRectifier

Internal Drive

External Drive

I/O

Memory Controller

Processor

SDRAM

Graphics Controller

DC/DCAC/DC

DC/DC

AC/DC Multi output PS

Voltage Regulator Modules

5V

12V

3.3V

12V 1.5/2.5V

1.1V-1.85V

3.3V

3.3V

12V

PWM/PFCSwitcher

Unregulated DCTo Multi Output Regulated DC

Voltages

Internal Drive

External Drive

I/O

Memory Controller

Processor

SDRAM

Graphics Controller

DC/DCAC/DC

DC/DC

AC/DC Multi output PS

Voltage Regulator Modules

5V

12V

3.3V

12V 1.5/2.5V

1.1V-1.85V

3.3V

3.3V

12V

PWM/PFCSwitcher

Unregulated DCTo Multi Output Regulated DC

Voltages

Could some of the conversion steps be eliminated to improve efficiency? Could a demonstration be devised to measure actual savings?


DC Demonstration - Objectives

1. DC powered server equipment exists in the same form factor or can readily be built from existing components

2. DC powered server equipment can provide the same level of functionality and computing performance when compared to similarly configured and operating AC server equipment

3. Efficiency gains from the elimination of multiple conversion steps can be measured by comparing traditional AC delivery to a DC architecture

4. DC system reliability is as good or better than AC system reliability

The demonstration’s original objectives were to show a rack level solution:


The project team rapidly defined additional objectives:

1. Demonstration of 380 V. DC distribution at the facility level compared to conventional AC systems

2. Demonstration of other DC solutions (48 volt systems)

3. Evaluation of safety considerations

4. Demonstrate ability to connect alternative energy solutions (PV, fuel cells, etc.)


What the demonstration included • Side-by-side comparison

of traditional AC system with new DC system

– Facility level distribution

– Rack level distribution

• Power measurements at conversion points

• Servers modified to accept 380 V. DC

• Artificial loads to more fully simulate data center


Additional items included

• Racks distributing 48 volts to illustrate that other DC solutions are available, however no energy monitoring was provided for this configuration

• DC lighting was included!


Typical AC Distribution Today

DC/ACAC/DC480 VACBulk Power

Supply

UPS PDU

AC/DC DC/DC VRM

VRM

VRM

VRM

VRM

VRM

12 V

Loadsusing

LegacyVoltages

Loadsusing

SiliconVoltages

12 V

5 V

3.3 V

1.2 V

1.8 V

0.8 VServer

PSU


Facility-Level DC Distribution

AC/DC480 VACBulk Power

SupplyDC UPS

orRectifier

DC/DC VRM

VRM

VRM

VRM

VRM

VRM

12 V

Loadsusing

LegacyVoltages

Loadsusing

SiliconVoltages

12 V

5 V

3.3 V

1.2 V

1.8 V

0.8 VServer

PSU

380 VDC380V.DC


Rack-Level DC Distribution

DC/ACAC/DC480 VACBulk Power

Supply

UPS PDU

AC/DC DC/DC VRM

VRM

VRM

VRM

VRM

VRM

12 V

Loadsusing

LegacyVoltages

Loadsusing

SiliconVoltages

12 V

5 V

3.3 V

1.2 V

1.8 V

0.8 V

Server

380 VDC

Rack

PSU


The layout you will see


Details

• Safety was reviewed by a committee of the partners. No significant issues were identified. Only concern was whether fault currents would be large enough to trip protective devices.

• All distribution equipment is UL rated for DC applications

• No commercially available DC connector exists in a size convenient for use with servers

• Reliability should be improved – fewer potential points of failure. Eliminating heat sources should help.

• Final report will address safety and applicable codes and standards


Measured Results

• Facility level overall efficiency improvement: 10 to 20%

• Smaller rack level overall efficiency improvement but other benefits include:

– Thermal benefits

– Smaller power supply in server

– Transition strategy for existing centers


AC system loss compared to DCDC/ACAC/DC480 VAC

Bulk PowerSupply

UPS PDU

AC/DC DC/DC VRM

VRM

VRM

VRM

VRM

VRM

12 V

Loadsusing

LegacyVoltages

Loadsusing

SiliconVoltages

12 V

5 V

3.3 V

1.2 V

1.8 V

0.8 VServer

PSU

AC/DC480 VACBulk Power

SupplyDC UPS

orRectifier

DC/DC VRM

VRM

VRM

VRM

VRM

VRM

12 V

Loadsusing

LegacyVoltages

Loadsusing

SiliconVoltages

12 V

5 V

3.3 V

1.2 V

1.8 V

0.8 VServer

PSU

380 VDC

9% measured improvement 2-5% measured

improvement


Implications could be even better for a typical data center

• Redundant UPS and server power supplies operate at reduced efficiency

• Cooling loads would be reduced.

• The UPS system used in the AC base case system performed better than benchmarked systems – efficiency gains could be higher.

• Further optimization of conversion devices/voltages is possible



XFMR98% - NA

UPS87 - 92%


UPS XFMR PS Total EfficiencySystem Efficiency 87.00% 98.00% 90.00% 76.73%High Efficiency (DC Option) 92.00% 100.00% 92.00% 84.64%

Compute Load (W) Input Load (W) DifferenceSystem Load 10,000 13032.03

High Efficiency (DC Option) 10,000 11814.74 9.34%



Power Dist98% - NA

UPS85 - 92%


UPS XFMR PS Total Efficiency Typical System Efficiency 85.00% 98.00% 73.00% 60.81%

High Efficiency (DC Option) 92.00% 100.00% 82.00% 75.44%Optimized DC Option 92.00% 100.00% 92.00% 84.64%

Compute Load (W) Input Load (W) DifferenceTypical Load 10,000 16444.93

High Efficiency (DC Option) 10,000 13255.57 19.39%Optimized DC Option 10,000 11814.74 28.16%


Results

What does 15% increase in efficiency mean to the bottom line?

Data Center Example

Today FutureArea (Sqft) 30000 100000Racks (#) 1000Power Need (MW) 10 50Operating Energy ($) 8,760,000$ 43,800,000$ Cooling (MW) 10 50Cooling Cost ($) 8,760,000$ 43,800,000$ Annual Energy Budget($) 17,520,000$ 87,600,000$

15% Improvement ($) 2,628,000$ 13,140,000$

Actual mileage will vary


Results

What does 15% increase in efficiency mean to the electrical power grid?


See the results on-line

• Actual results

• Lawrence Berkeley National Laboratory

websites for more information

– http://hightech.lbl.gov/

– http://hightech.lbl.gov/dc-powering/


Additional InformationProject Coordination & Contacts:

• My Ton, Ecos Consulting [email protected]• Brian Fortenbery, EPRI Solutions [email protected]

Lawrence Berkeley National Laboratory• Bill Tschudi, Principal Investigator

[email protected]• Dr. Evan Mills, Press and publicity contact

[email protected]

THANK YOU FOR YOUR INTEREST!THANK YOU FOR YOUR INTEREST!

my ton – ecos consulting brian fortenbery – epri solutions bill tschudi – lawrence berkeley...

Documents

hightech industriesups

hightech industriesresearch

cadc power

power consumption

power delivery

hightech industriesopen

data center energy use

power supply efficiency