![Page 1: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/1.jpg)
Cees de Laat
GreenClouds
University of Amsterdam
![Page 2: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/2.jpg)
Towards Hybrid Networking! • Costs of photonic equipment 10% of switching 10 % of full routing
– for same throughput! – Photonic vs Optical (optical used for SONET, etc, 10-50 k$/port) – DWDM lasers for long reach expensive, 10-50 k$
• Bottom line: look for a hybrid architecture which serves all classes in a cost effective way – map A -> L3 , B -> L2 , C -> L1 and L2
• Give each packet in the network the service it needs, but no more ! • Lower == greener
L1 ≈ 2-3 k$/port L2 ≈ 5-8 k$/port L3 ≈ 75+ k$/port
![Page 3: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/3.jpg)
How low can you go?
Router Ethernet SONET DWDM
Fiber
Application Endpoint A
Application Endpoint B Regional
dark fiber
MEMS
POS
15454 6500 HDXc
GLIF
Trans-Oceanic
Local Ethernet
![Page 4: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/4.jpg)
Hybrid computing Routers ç è Supercomputers Ethernet switches ç è Grid & Cloud Photonic transport ç è GPU’s What matters: Energy consumption/multiplication Energy consumption/bit transported
![Page 5: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/5.jpg)
M Y R I N E T
85 (40+45) compute nodes
Fast interconnect
Local interconnect
10 Gb/s Ethernet lanphy
1 Gb/s Ethernet
head node (2)
To local University
DAS-3 Cluster Architecture
N O R T E L
10 Gb/s Ethernet lanphy
UvA-node
To SURFnet
8 * 10 Gb/s from bridgenodes
2006!!!
![Page 6: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/6.jpg)
Power is a big issue
• UvA cluster uses (max) 30 kWh • 1 kWh ~ 0.1 € • per year -> 26 k€/y • add cooling 50% -> 39 k€/y • Emergency power system -> 60 k€/y • per rack 10 kWh is now normal • YOU BURN HALF THE CLUSTER OVER ITS
LIFETIME!
2006!!!
![Page 7: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/7.jpg)
VM opportunity
Head node
Mem
ory rich VM
holder
CPU nodes
network
switchable power strip
![Page 8: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/8.jpg)
VM opportunity - B
Head node
CPU nodes
network
switchable power strip
![Page 9: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/9.jpg)
• 9
Dutch Science Foundation (NWO)
Smart Energy Systems call • Spring 2010 • Awards in september 2010 • Start in 2011 • UvA & VU teamed up to submit
GreenClouds • http://www.nwo.nl/SES
![Page 10: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/10.jpg)
• 10
Four focus areas
1. Smart ICT methods for energy saving, storage and generation in building environments
2. Smart control systems for flexible electricity networks (smart grids)
3. Energy reduction in processing and storing of information
4. Energy reduction in communication
![Page 11: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/11.jpg)
• 11
Focus area 1: Energy management in buildings • Ultimate goal is to create
– a zero energy building (ZEB) (no energy import or export)
– or energy neutral buildings (ENB) (net energy import and export over a year is zero)
… without reduction in Quality of Living (QoL) and with acceptable costs
• Why interesting – 40 % of all energy is consumed in houses
• Consensus – ZEB and ENB with equal QoL is only possible with
ICT technology
![Page 12: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/12.jpg)
• 12
Smart House
Plug-in (hybrid) electric cars
Added green power sources
Smart thermostats, appliances and in-home control devices
Real-time and green pricing signals
High-speed, networked connections
Customer interaction with utility
![Page 13: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/13.jpg)
• 13
ICT challenges
• Reduce stand-by power (10% of all power) • Prediction of energy profile • When to store electricity locally, when to export when to
import • Sensor networks to sense / predict / control energy
consumption and production • Efficient in-building communication infrastructures to
control white-good & brown-good appliances & lighting and micro-generators
• Create energy-awareness of house owners • Trade-off between energy-efficiency and Quality of Living • ….
![Page 14: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/14.jpg)
• 14
Focus area 2: Flexible electricity networks
• Goal – Create ICT technology for smart grids
![Page 15: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/15.jpg)
• 15
Today's electricity grids and efficiency
Transmission & distribution
G production
consumption
CHP
35-60%
90%
-7%
![Page 16: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/16.jpg)
• 16
The future: smart grids
![Page 17: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/17.jpg)
• 17
Some ICT challenges ahead
• Using ICT for efficiency implies efficient ICT • Dependability of ICT
– Smart grids are the life lines of our society – Should continue even when some parts fail
• Load balancing in the home / neighborhood • Compensate for dynamics of generation (e.g. windmills) • Scalability
– Grid with thousands / millions of generators/consumers – Real-time control of thousands / millions of appliances
• Online optimization problems – Do I store energy locally or give it back to the grid? – Do I get energy from the battery or from the grid?
![Page 18: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/18.jpg)
• 18
Focus area 3: Energy reduction in processing
• Goal – Reduce energy consumption of ICT
![Page 19: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/19.jpg)
• 19
Microprocessor Trends
• Single Thread performance power limited
• Multi-core throughput performance extended
• Heterogeneous extends performance and efficiency
Per
form
ance
Power
Heterogeneous
Multi-Core
Single Thread
Slide from Peter Hofstee IBM
![Page 20: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/20.jpg)
• 20
Future is in heterogeneous MPSoC Platforms
DSRH A/D DSP FPGA
DSP
ASIC
A/D MEM
GPP
DSRH
DSP
GPP
GPP
DSRH
D/A
FPGA MEM
R
R
R
R
R
R
R
R
R
R
R
R
R
R
R
R
R
R
R
R
interface
interface interface
analog interface
analog analog
~ 2 mm2
- Heterogeneous - Simple tiles - NoC - Distributed Memory DSRH
DSRH
DSRH
![Page 21: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/21.jpg)
• 21
ICT challenges
• Efficient processing platforms • Efficient memory hierarchy • Efficient software / compilers • How to program multi-core systems • Make applications, compilers and operating
systems energy aware • System can adapt (at run-time) to the
environment • Promote energy awareness of PC users
![Page 22: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/22.jpg)
• 22
Focus area 4 Energy reduction in communication
• Goal – Energy reduction in communication by using
• Optical communication techniques • Wireless communication techniques • Intelligent networking techniques
![Page 23: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/23.jpg)
• 23
ICT challenges
• Optical fiber access networks – optical access by GPON consumes about 18x less
energy per user than VDSL2 – all-optical packet switching by avoiding power-hungry
EO conversions • Optimum combination of radio technologies with
optical fiber technologies • Low power cognitive radio transceivers • Wideband transceivers and wake-up radios for
small and adaptive cell sizes • Low-power transceivers with strong spatial
selectivity, MIMO and adaptive beamforming
![Page 24: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/24.jpg)
Partners in GreenClouds
• Free University of Amsterdam – Henri Bal
• (really free) University of Amsterdam – Paola Grosso, Cees de Laat
• SARA – Axel Berg
• In context of: – ASCI – DAS4
![Page 25: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/25.jpg)
GreenClouds @ VU & UvA • The GreenClouds project studies how to reduce the energy
footprint of modern High Performance Computing systems (like Clouds) that are distributed, elastically scalable, and contain a variety of hardware (accelerators and hybrid networks). The project takes a system-level approach and studies the problem of how to map high-performance applications onto such distributed systems, taking both performance and energy consumption into account.
• We will explore three ideas to reduce energy: 1. Exploit the diversity of computing architectures (e.g. GPUs, multicores) to run
computations on those architectures that perform them in the most energy-efficient way; 2. Dynamically adapt the number of resources to the application needs accounting for
computational and energy efficiency; 3. Use optical and photonic networks to transport data and computations in a more energy-
efficient way.
![Page 26: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/26.jpg)
GreenClouds @ VU & UvA • The project will create the GreenClouds Knowledge Base System (GKBS)
based on semantic web technology, which will provide detailed information on the energy characteristics of various applications (e.g., obtained from previous execution runs) and the different parts of the distributed system, including the network. Also, the project will study a broad range of applications and determine which classes of applications can reduce their energy consumption using accelerators. Finally, it will study energy reductions through dynamic adaptation of computing and networking resources. The project will make extensive use of the DAS-4 infrastructure, which is a wide-area testbed for computer scientists, to be equipped with many types of accelerators, a photonic network, and energy sensors.
• The results of the project will be utilized by the SARA national HPC center that operates a supercomputer, clusters, accelerator systems, and an HPC cloud. Today, the costs of energy over the lifetime of these systems are already larger than their acquisition costs, so reducing energy is vitally important for centers like SARA. Moreover, the results will be utilized in DAS-4 itself.
![Page 27: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/27.jpg)
Photonic Network SURFnet
Head node
quad core
dual proc
4 U nodes
local network exp. equipment
40 Gb/s
... Phase 1: SURFnet to other DAS sites
I N F I N I B A N D
40 Gb/s
10/40/100 Gb/s = phase 2
WAN link switch
...
ORACLE/SUN Niagara
ORACLE/SUN 50 Tbyte Thumper
ORACLE/SUN 50 Tbyte Thumper
dual-proc quad-core Twin nodes
DELL R815 48 core server
DELL R815 48 core server
DAS-4 @ UvA
![Page 28: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/28.jpg)
CPU freq
Within this benchmark, measured the power consumption & performance of the twin-node with various fixed frequencies by disabling the CPU-frequency-scaling feature and fixing the CPU frequency to one of available frequencies.
![Page 29: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/29.jpg)
Efficiency (Multiplications/Watt)
Figure 1(a) and Figure 1(b) are the performance and energy efficiency graphs for the CPU-Frequency-Scaling experiments, from where we may conclude that: • Idle power consumption remains a constant in regardless of its CPU frequency; • Higher CPU frequency results in better energy efficiency • CPU consumes the most significant power within a system.
![Page 30: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/30.jpg)
# of threads 1-16
![Page 31: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/31.jpg)
VM or host
Each benchmark is run with the same amount of memory. The degradation in energy efficiency of VMs is around 30% compared with the host.
![Page 32: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/32.jpg)
Memory dependence
![Page 33: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/33.jpg)
Semantic web approach in GreenClouds
• Distributed info system describing current and historical load on infrastructure including parameters of jobs running
• Describe contextual parameters (energy sources, etc.)
• Dynamically optimize and migrate if context changes
![Page 34: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/34.jpg)
The VM Turntable Demonstrator
The VMs that are live-migrated run an iterative search-refine-search workflow against data stored in different databases at the various locations. A user in San
Diego gets hitless rendering of search progress as VMs spin around
Seattle
Netherlight
Amsterdam
NYC
Toronto
iGrid05 UvA
Starlight Chicago
VMs
Dynamic Lightpaths
hitless remote rendering
iGrid2005 SC2005
![Page 35: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/35.jpg)
Network Description Language
Object Subject Predicate
• From semantic Web / Resource Description Framework. • The RDF uses XML as an interchange syntax. • Data is described by triplets:
Location Device Interface Link name description locatedAt hasInterface
connectedTo capacity encodingType encodingLabel
Object Subject
Subject Object Subject
Object Subject
Object Subject
![Page 36: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/36.jpg)
NDL + PROLOG
• Reason about graphs
• Find sub-graphs that comply with rules
Research Questions: • order of requests • complex requests • usable leftovers
![Page 37: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/37.jpg)
Applications and Networks become aware of each other!
![Page 38: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/38.jpg)
RDF describing Infrastructure
content content
RDF/CG!RDF/CG!
RDF/ST!
RDF/NDL!RDF/NDL!
RDF/VIZ!
RDF/CPU!
Application: find video containing x, then trans-code to it view on Tiled Display
PG&CdL
![Page 39: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/39.jpg)
NDL
NDLCPU/RDF
NDL
CPU/RDF
CPU/RDF NDL
NDLCPU/RDF
NDL
CPU/RDF
CPU/RDF
EDL
EDL
EDL
EDL
EDLEDL
![Page 40: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/40.jpg)
EU-NOVI
![Page 41: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/41.jpg)
GEYSERS EU
![Page 42: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/42.jpg)
ECO-Scheduling
![Page 43: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/43.jpg)
Future research
• Parametrize energy usage • Describe energy properties of infrastructure • (automatically) determine footprint of
applications • Dynamically optimize and migrate • First order:
E =a*CPU + b*GPU + c*mem + d*trans + e*rw
![Page 44: GreenClouds - CiscoUse optical and photonic networks to transport data and computations in a more energy efficient way. • The project will create the GreenClouds Knowledge Base System](https://reader034.vdocuments.mx/reader034/viewer/2022052105/60405d105e72e561d61fe307/html5/thumbnails/44.jpg)
Q&A
http://ext.delaat.net/smartgreen/index.html