peak efficiency aware scheduling for highly energy...
TRANSCRIPT
![Page 1: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/1.jpg)
Peak Efficiency Aware Scheduling for Highly Energy Proportional Servers
Daniel Wong University of California, Riverside
[email protected] Department of Electrical and Computer Engineering
![Page 2: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/2.jpg)
Main Observations
› Servers are nearly energy proportional
› Peak energy efficiency does not occur at peak utilization
› Current data center scheduling techniques are unaware
› Peak Efficiency Aware Scheduling› Achieves better-than-ideal cluster-wide energy proportionality
2
![Page 3: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/3.jpg)
Measuring Energy Proportionality
› Dynamic Range
› Energy Proportionality
› EP range: (0,2), 1 = Ideal EP, 0 = Energy disproportional
› More metrics in [1]
3
0%
20%
40%
60%
80%
100%
0% 20% 40% 60% 80% 100%
Pe
ak p
ow
er
Utilization
Actual
Linear
Ideal
DR =Powerpeak -Poweridle
Powerpeak
EP =1-Areaactual - Areaideal
Areaideal
[1] D. Wong and M. Annavaram. "Knightshift: Scaling the
energy proportionality wall through server-level heterogeneity.“
MICRO 2012.
![Page 4: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/4.jpg)
Servers are nearly energy proportional
• Published SPECpower results• 426 servers
• 12/2007 – 9/2015
• Most servers today are nearly energy proportional
4
![Page 5: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/5.jpg)
What is the limit of EP?
• Identified Pareto frontier between DR and EP
• With ideal dynamic range, best possible EP = 1.35
• Hypothetical server where non-processor components are as proportional as processor• Pareto frontier still holds true
for this extreme case
• Practical EP limit = 1.2
5
![Page 6: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/6.jpg)
Peak Energy Efficiency ≠ Peak Utilization6
• EP = 1.0 servers achieve peak efficiency @ 60% utilization
• Future super EP servers (EP = 1.2) can achieve peak efficiency @ 50% utilization
• Peak Efficiency point shifts as EP improves0
0.2
0.4
0.6
0.8
1
1.2
1.4
1.6
0% 50% 100%
Energ
y E
ffic
iency N
orm
. to
E
nerg
y E
ffic
iency @
100%
Utilization
EP = 0.2EP = 0.7
EP = 1.2
EP = 1.0
![Page 7: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/7.jpg)
Schedulers are not peak efficiency aware[2]
Uniform scheduling
• Cluster-wide EP reflects underlying server’s EP
• If server’s EP is poor, then cluster’s EP is poor
Packing Scheduling
• Have exact number of servers for load
• Cluster’s EP is ideal
7
[2] D. Wong and M. Annavaram. "Implications of high energy
proportional servers on cluster-wide energy proportionality“
HPCA 2014.
![Page 8: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/8.jpg)
One-size does not fit all
› Prior work[2] identified that Packing is better for low EP servers,while Uniform is better for high EP servers
› We also identified that different utilization favors different scheduling policies
8
[2] D. Wong and M. Annavaram. "Implications of high energy
proportional servers on cluster-wide energy proportionality“
HPCA 2014.
![Page 9: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/9.jpg)
Peak Efficiency Scheduling (PEAS)
› Goal:› Capture behavior of both Packing and Uniform scheduling
› 1. Pack servers up to peak efficiency point
› 2. Then issue requests uniformly
› Intuition:› Quickly get servers to peak efficiency point
› Move away from peak efficiency point as slowly as possible
9
![Page 10: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/10.jpg)
PEAS Design
› Per server local energy efficiency profiler (LEEP)› Identify peak energy efficiency point
› Global peak efficiency aware scheduler (PEAS)› Schedule workloads to server with highest energy efficiency
10
Global Peak Efficiency Aware Scheduler (PEAS)
LEEP LEEPLEEP
![Page 11: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/11.jpg)
Local energy efficiency profiler (LEEP)
• Daemon periodically samples utilization and power consumption
• Dynamically captures energy efficiency curve of individual server configuration and workload
• Generates energy efficiency curve to identify peak efficiency point
11
Energy efficiency
curves
Peak efficiency
point
![Page 12: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/12.jpg)
Global peak efficiency aware scheduler (PEAS)
› Scheduler maintain sorted list of servers based on peak energy efficiency
› Receives utilization update from servers
› Pack servers up to peak efficiency point, then issue requests uniformly
12
Global Peak Efficiency Aware Scheduler (PEAS)
LEEP LEEPLEEP
![Page 13: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/13.jpg)
PEAS provide better-than-ideal EP and efficiency!
Energy proportionality
• Always outperform ideal EP
Energy efficiency
• Sustain peak energy efficiency
13
![Page 14: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/14.jpg)
Evaluation Methodology
› BigHouse data center simulator
› 100 servers› Dual-socket 18-core processors
(similar to recently reported SPECpower results)
› Four levels of EP: Low=0.24, Med=0.73, High=1.0, Super=1.2
› Evaluated 5 workloads› DNS (csedns), Mail (newman) , Apache (www), Search and Shell
14
![Page 15: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/15.jpg)
Power Consumption
› Packing-based scheduling is most effective at low-med EP
› PEAS matches performance of Packing at low-med EP
15
0.60.70.80.9
11.11.21.31.41.51.6
No
rma
lize
d P
ow
er
0.60.70.80.9
11.11.21.31.41.51.6
No
rma
lize
d P
ow
er
pack uniform PEAS
Low EP Med EP
![Page 16: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/16.jpg)
Power Consumption
› Uniform outperforms packing at high EP
› PEAS outperforms both uniform and packing!
16
High EP Super EP
0.6
0.7
0.8
0.9
1
1.1
No
rma
lize
d P
ow
er
pack uniform PEAS
0.6
0.7
0.8
0.9
1
No
rma
lize
d P
ow
er
![Page 17: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/17.jpg)
Heterogeneous Cluster
Mix of 25% Low, Med, High, and Super EP servers
• Uniform performs worst due to inability to mask low-med EP servers
Mix of 50% High and Super EP servers
• PEAS consistently outperform other schedulers across various mixes of servers
17
0.6
0.8
1
1.2
1.4
No
rma
lize
d P
ow
er
pack uniform PEAS
0.6
0.7
0.8
0.9
1
No
rma
lize
d P
ow
er
![Page 18: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/18.jpg)
Latency
› Observed tail latency similar to Uniform scheduling› Holds true across various sleep transition times
18
0
0.2
0.4
0.6
0.8
1
No
rma
lize
d 9
5th
%tile
pack uniform PEAS0
0.2
0.4
0.6
0.8
1
1.2
No
rma
lize
d 9
5th
%tile
pack uniform PEAS
20s transition time 0s transition time
![Page 19: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/19.jpg)
More in the paper
› Analytical Best-case Cluster-wide EP analysis
› TCO impact
› Effect on power capping
19
![Page 20: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/20.jpg)
Conclusion
› Servers are nearly energy proportional
› Peak energy efficiency no longer occurs at peak utilization
› Peak Efficiency Scheduling (PEAS) can achieve better-than-ideal cluster-wide energy proportionality
› Consistently outperforms Uniform and Packing scheduling
20
![Page 21: Peak Efficiency Aware Scheduling for Highly Energy ...isca2016.eecs.umich.edu/wp-content/uploads/2016/07/7B-3.pdf · 07-07-2016 · •12/2007 –9/2015 •Most servers today are](https://reader033.vdocuments.mx/reader033/viewer/2022051912/600285bfb0458246b37ede3e/html5/thumbnails/21.jpg)
Peak Efficiency Aware Scheduling for Highly Energy Proportional Servers
Daniel Wong University of California, Riverside
[email protected] Department of Electrical and Computer Engineering
Thank you! Questions?