green it technical survey - events.static.linuxfound.orggreen it technical survey miracle linux...

43
Green IT Technical Survey MIRACLE LINUX CORPORATION Naohiro Ooiwa / Ichiro Suzuki 2009/04/08

Upload: others

Post on 03-Feb-2021

2 views

Category:

Documents


0 download

TRANSCRIPT

  • Green IT Technical Survey

    MIRACLE LINUX CORPORATIONNaohiro Ooiwa / Ichiro Suzuki

    2009/04/08

  • • Introduction• Green IT standards / organizations• Functionalities on Linux• Real-world measurement• Future ideas• Summary

    Contents

    2009/04/08 2Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

  • • An IPA project: Green IT on Linux• Japanese government sponsored project• Miracle Linux + LF-jp

    • Information-technology Promotion Agency• Providing technology and resources for IT in Japan• IT Security / Software engineering / Open source etc.

    • Miracle Linux Corp.• Linux distributor (Asianux)

    • Linux Foundation Japan• you know...

    Who are we? What do we do?

    2009/04/08 3Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

  • • Finding problems in Green-IT on Linux/OSS– The report will be used as a base-line for IPA’s

    planning.• Sharing the findings within the community

    – Encourage developers– Make users aware of Green IT

    Project Goals

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved2009/04/08 4

  • • Survey of Green-IT standards and organizations

    • Survey of Linux functionalities to reduce power consumption

    • Evaluation of these functionalities• Improvement ideas

    – Driver improvements to reduce power consumption of the e1000 NIC

    Four Steps

    2009/04/08 5Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

  • • We want to ...– Tell you our findings– Get your feed-backs– Discuss solutions / ideas

    In this session...

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved2009/04/08 6

  • • Standards– ENERGY STAR– EPEAT

    • Organizations– The Green Grid– The Climate Savers Computing Initiative

    Standards and Organizations

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved2009/04/08 7

  • • A program to reduce power consumption for personal desktops/laptops, not for servers.

    • Required power saving modes– Off (ACPI S5)– Sleep (ACPI S3)– Idle

    • Power management is also required– WOL

    ENERGY STAR

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    Linux has already satisfied the requirements

    2009/04/08 8

  • • Environmental standard in U.S. to evaluate desktops, laptops, and monitors

    • It has 51 evaluation items.• material / energy saving / packaging etc.

    • The result is categorized into Gold, Silver, and Bronze.

    • Requiring ENEGY STAR on software part.

    EPEAT

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    Linux has also satisfied this standard

    2009/04/08 9

  • • Global consortium for data center and information center

    • Provides wide range of white papers– Analysis of power distribution, power efficiency

    metrics, chassis configuration, recommend ways to save power ...

    The Green Grid

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    PUE is good, but hard to compare without detailed conditionsMicroscopic indicator is useful for software developers

    2009/04/08 10

  • • NPO that consists of companies and consumers who have high environmental consciousness.

    • Detailed instructions to reduce power consumption for Windows and Mac.– How to power off display / stand-by / hibernate

    when a computer is idle

    The Climate Savers

    2009/04/08 11Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    Comparable documents for Linux would be nice

  • Linux Functionalities

    2009/04/08 12Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    mc/smt power saving policyVirtualizationPower QoSDevice Bus Power ManagementDisplay and Graphics Power SavingWake On LanWiFi

    Many of these found in LessWatts

    Battery Life ToolkitLm_sensorsIPMI toolsPowertopHibernation

    (swsusp, uswsusp, TuxOnIce)Tickless idlePower Policy Manager

  • • Major functions have been implementedon Linux

    Our impressions (1/2)

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    Functions / OSS Linux Windows

    Hibernation ○ ○

    Suspend ○ ○

    Power Management ○ ○

    Monitoring by IPMI ○ ○

    Monitoring by dedicated controllers ○ ○

    Virtualization ○ ○

    2009/04/08 13

  • • But,– There is no de-facto standard benchmark tools in OSS.– Interface to enable functions are not always easily

    accessible for users. Can’t control uniformly.– Open source management software to govern entire

    functions to reduce power?

    Our impressions (2/2)

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved2009/04/08 14

  • • De-facto bench mark software is important for H/W vendor, S/W developer, and Users.

    • Indicator is necessary to improve power consumption.

    • Commercial software: SPECpower.• The OSS like SPECpower is needed?

    – Or other kind of bench mark is needed?

    Bench Mark Tool

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved2009/04/08 15

  • • Some functions to reduce power are implemented, but the interface is mainly CUI-base such as /proc/xxx, /sys/xxx

    • This is not easy for users• We think it is better if GUI tools are provided.

    – And it’s available from Desktop Environment(gnome, KDE, …)

    Uniform Control

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved2009/04/08 16

  • • For administrators, set and monitor configuration and status of a lot of nodes are important.• JP1 can check status of these functionalities.

    • Integrated with OSS cluster monitoring software such as nagios, Zabbix, Hinemos etc.?

    Power Consumption Management

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved2009/04/08 17

  • • Measured the effects of the functions to reduce power consumption• to see the effects quantitatively• not to get the precise reduction value that depends on

    the machines and H/W configurations.

    Measurements

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved2009/04/08 18

  • • We measured total current by a shunt resister.– Not exactly the same as power consumption,

    but a good indicator. (cosθ ignored)– Easy to measure

    Setup

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved2009/04/08 19

    Digital Multi MeterAgilent 34401A

    AC100V Computer

    Shunt resister1mΩ or 10mΩ

  • Setup (cont’d)

    2009/04/08 20Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

  • • Server– DELL PowerEdge1950

    • Intel Xeon 5460 (3.16GHz) x 2• Memory 2GB• HDD(SAS) 73GB (Seagate ST973402SS) x 2

    • Laptop– Panasonic CF-W4

    • Intel Pentium-M 1.2GHz x 1• Memory 768MB• HDD(ATA) 40GB (TOSHIBA MK4025GASL) x 1

    • Focusing on idle state

    Target Computers

    2009/04/08 21Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

  • Tickless Idle

    2009/04/08 22Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    PowerEdge 1950 / Cent5.2 / Kernel-2.6.27.1

    2% of200W

    Long-term idle

    Boot

  • Processor Power Management (cpufreq)

    2009/04/08 23Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    3%

    governer:ondemand

    governer:ondemand

    governer:performance

    PowerEdge 1950 / Cent5.2 / Kernel-2.6.27.1

  • HDD spin down (sdparm/hdparm)

    Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    ~1%

    HDD:Spinning

    HDD:Spinning

    HDD:Stopped

    2009/04/08 24

    PowerEdge 1950 / Cent5.2 / Kernel-2.6.27.1

  • Bus Power Management (USB)

    2009/04/08 25Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    ~1%

    Root Hub & USB-Mouse:Suspended

    Root Hub &USB-Mouse:Active

    PowerEdge 1950 / Cent5.2 / Kernel-2.6.27.1

  • Bus Power Management (PCIe)

    2009/04/08 26Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    ~0.5%

    PCI-e:Suspended

    PCI-e:Active

    PowerEdge 1950 / Cent5.2 / Kernel-2.6.27.1

  • Hibernation(swsusp)

    2009/04/08 27Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    Computer:Working

    Computer:Working

    Computer:Hibernated

    ~95%

    PowerEdge 1950 / Cent5.2 / Kernel-2.6.27.1

  • rf_kill

    2009/04/08 28Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    RF:Active

    RF:Suspended

    RF:Active

    4%

    Panasonic CF-W4 / Ubuntu 8.10 / Kernel-2.6.24

  • xbacklight

    2009/04/08 29Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    13%26%

    Backlight:100% Backlight:

    50% Backlight:0% = Invisible(Completely Dark)

    Panasonic CF-W4 / Ubuntu 8.10 / Kernel-2.6.24

  • • Hibernation– Very effective as expected

    • Other functions that reduces power when idle– 0.5 - 4% of the current is reduced– Total sum: ~10%– Cutting out peripheral devices is effective– About 10% (times system idle fraction)

    of power should be reduced by present Linux/OSS.

    Summary of the Measurements

    2009/04/08 30Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

  • • Disabling peripheral devices is very effective• Some PCs has network devices even not used

    • unplug the network cable• run ifdown command

    2009/04/08 31Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    Peripheral Driver – e1000 NIC

  • • Machine/OS• DELL PowerEdge SC440• Linux 2.6.18 kernel (runlevel 1)

    • e100/e1000/e1000e driver• e100: 3.5.10-k2-NAPI• e1000: 7.3.20-k2-NAPI• e1000e: 0.2.9.5-NAPI

    • e100/e1000/e1000e NIC• e100: Intel 82557/8/9/0/1 Ethernet Pro 100• e1000: Intel 82541PI Gigabit Ethernet Controller• e1000e: Intel 82572EI Gigabit Ethernet Controller

    Environment

    2009/04/08 32Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

  • unplug the cable

    2009/04/08 33Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    • The e100 device doesn’t reduce the power.

    reduced

    stay constant

    reduced

    4min0min

    Link Down of e100/e1000/e1000e

  • [problem] • doesn’t let the power

    down when unplugging a LAN cable

    [solution]• set power state of a

    PCI device to D3hot at the check point of watchdog

    2009/04/08 34Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    10 seconds

    e100_watchdog

    if (Link is Down) pci_set_power_state(D3hot)

    pci_set_power_state(D0)and thencheck the state of Link

    2 seconds

    Modification of e100 Driver

  • unplug the cable

    2009/04/08 35Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    D0 state

    D3hot state

    Average power

    4min0min

    • In transitions to D0, there were big spikes.

    Modified e100 Driver

  • • Only e1000e device is smart.

    Changes by ifdown Command

    2009/04/08 36Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    ifdown

    stay constant

    stay constant

    reduced

    4min0min

  • [problem]• doesn’t let the power

    down when running ifdown command.

    [solution]• set to the D3hot state

    at the end of e1000_close().

    Modification of e1000 Driver

    2009/04/08 37Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    e1000_closepci_set_power_state(D3hot)

    pci_set_power_state(D0)

    ifdown command

    ifup command

    e1000_open

  • • Modified driver worked expectedly.

    Modified e1000 Driver

    2009/04/08 38Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

    ifdown

    reduced

    4min0min

  • • Link-down/ifdown behaviors are different among drivers

    • e100/e1000 hacks• e100(link-down): depending on polling period• e1000(ifdown): effective

    • Same approach can be also applied to embedded area

    • Future plan• Other enhancements• Other drivers

    NIC Driver Modification

    2009/04/08 39Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

  • • Total control tools for users / admins• Benchmark software• Integrated cluster monitoring / management tool• Aggressive device shut-down• In-direct indicators other than powertop

    Proposal

    2009/04/08 40Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

  • • Surveyed about standards / organizations• Linux implementation status• Measured actual power reduction effects• Proposed development ideas• Started Linux improvements (e1000)

    Summary

    2009/04/08 41Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

  • • What is standard / good way to measurepower consumption?

    • How do you think about,• Benchmark suite• GUI configurator• Integration in cluster management

    • Any other idea?

    Questions

    2009/04/08 42Copyright © 2000-2009 MIRACLE LINUX CORPORATION All rights reserved

  • Green IT Technical SurveyContentsWho are we? What do we do?Project GoalsFour StepsIn this session...Standards and OrganizationsENERGY STAREPEATThe Green GridThe Climate SaversLinux FunctionalitiesOur impressions (1/2)Our impressions (2/2)Bench Mark ToolUniform ControlPower Consumption ManagementMeasurementsSetupSetup (cont’d)Target ComputersTickless IdleProcessor Power Management (cpufreq)HDD spin down (sdparm/hdparm)Bus Power Management (USB)Bus Power Management (PCIe)Hibernation(swsusp)rf_killxbacklightSummary of the Measurements スライド番号 31Environmentスライド番号 33スライド番号 34スライド番号 35Changes by ifdown CommandModification of e1000 DriverModified e1000 DriverNIC Driver ModificationProposalSummaryQuestionsスライド番号 43