follow the sun through the clouds: application migration...
TRANSCRIPT
![Page 1: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/1.jpg)
Follow the Sun through the Clouds:Application Migration for
Geographically Shifting Workloads
Zhiming Shen
Cornell University
Joint work with Qin Jia, Gur-Eyal Sela, Ben Rainero, Weijia Song, Robbert van Renesse, Hakim Weatherspoon
1
![Page 2: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/2.jpg)
Supercloud Demo
2
Nested VM
VM
VM
![Page 3: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/3.jpg)
Supercloud Demo
2
Nested VM
HTTP
VM
VM
![Page 4: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/4.jpg)
Supercloud Demo
2
Nested VM
HTTP VM
VM
![Page 5: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/5.jpg)
Highlights
• Automatic VM placement and migration
• Migrated VMs are LIVE
• IP addresses are not changed
• TCP connections are not broken
3
![Page 6: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/6.jpg)
Demo
4
(Full video available at http://supercloud.cs.cornell.edu)
![Page 7: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/7.jpg)
Full Demo (http://supercloud.cs.cornell.edu)
5
![Page 8: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/8.jpg)
Highlights
• Automatic VM placement and migration
• Migrated VMs are LIVE
• IP addresses are not changed
• TCP connections are not broken
• Appears as a unified private cloud that spans all clouds
• Controlled by the user!
6
![Page 9: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/9.jpg)
Research Challenges
• How to migrate across incompatible virtualization platforms?
• How to keep IP addresses unchanged and TCP connections unbroken?
• How to decide when and where to migrate?
• How to make the system efficient?
7
![Page 10: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/10.jpg)
Supercloud is the first system that supportsautomatic, efficient, and live VM migration
across heterogeneous cloud providerswithout changing IP addresses or breaking TCP connections.
8
![Page 11: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/11.jpg)
Supercloud Architecture
9
• Computation• Nested hypervisor: Xen-Blanket
• Support all major platforms
• Network• SDN overlay
• Support migration with public IP
• Storage:• Geo-replicated storage
• Optimized for serving VM images
• Resource management• OpenStack platform
• Automatic scheduling framework
First Layer
KVM/virtio
Dom0
KVM/virtio
Dom0
Availability Zone 1 Availability Zone 2
Cloud Provider 1 Cloud Provider 2
Xen-Blanket Xen-Blanket Xen-Blanket
OpenStack OpenStack OpenStack
User VMsSecond
Layer
User VMs
User VMs
User VMs
User VMs
User VMs
First-layer VM
Geo-replicated Image Storage
Second-layer VM
Second-layer hypervisor
Xen/PV-on-HVM
First-layer hypervisor
Software-Defined Network (SDN)
![Page 12: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/12.jpg)
Supercloud Networking
• Challenges:• Optimal routing without extra forwarding
• Migration without changing IP addresses
• Solution:• VPN overlay with full-mesh tunnels
• Frenetic SDN controller
10
vSwitch
vSwitch vSwitch
vSwitch
VM
vSwitch
VM
Cloud 1
Cloud 2
![Page 13: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/13.jpg)
Supercloud Networking
• Challenges:• Optimal routing without extra forwarding
• Migration without changing IP addresses
• Solution:• VPN overlay with full-mesh tunnels
• Frenetic SDN controller
10
vSwitch
vSwitch vSwitch
vSwitch VM
vSwitch
VM
Cloud 1
Cloud 2
![Page 14: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/14.jpg)
VM Migration with Public IP Address
11
VM
Pub IP front-end
54.172.26.213
54.172.26.213
![Page 15: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/15.jpg)
VM Migration with Public IP Address
11
VMPub IP front-end
54.172.26.213
54.172.26.213
![Page 16: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/16.jpg)
VM Migration with Public IP Address
11
VMPub IP front-end
54.172.26.213
54.172.26.213
Dynamic DNS?• Can be delayed due to cache• Can cause connection interrupts• Some applications might not work
![Page 17: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/17.jpg)
VM Migration with Public IP Address
12
VM
Pub IP front-end
54.172.26.213Pub IP
front-end
52.69.94.195
![Page 18: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/18.jpg)
VM Migration with Public IP Address
12
VMPub IP front-end
54.172.26.213Pub IP
front-end
52.69.94.195
![Page 19: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/19.jpg)
Centralized VM Image Storage
13
VM
Image
Long latency; Low throughput
![Page 20: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/20.jpg)
Geo-Replicated VM Image Storage
14
VM
Image Image
![Page 21: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/21.jpg)
Geo-Replicated VM Image Storage
14
VM
Image Image
![Page 22: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/22.jpg)
Geo-Replicated VM Image Storage
14
VM
Image Image
Challenges:• Strong consistency requirement• Long latency and low throughput in WAN
Supercloud VM image storage:• Decoupling consistency from data propagation.• Propagating data according to disk access patterns.
![Page 23: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/23.jpg)
In the Paper
• Comparison with application-level migration
• Placement policies for different types of applications
• Detail design of the image storage
• Hierarchical network topology
• Evaluations
15
![Page 24: Follow the Sun through the Clouds: Application Migration ...supercloud.cs.cornell.edu/slides/socc16-public.pdfFollow the Sun through the Clouds: Application Migration for Geographically](https://reader034.vdocuments.mx/reader034/viewer/2022042315/5f03d8927e708231d40b0d3a/html5/thumbnails/24.jpg)
Conclusion
• Supercloud: application migration for geographically shifting workloads• Crossing heterogeneous cloud providers
• Automatic placement and migration
• Geo-replicated image storage
• Wide-area SDN
• A unified private cloud that spans all clouds
• Controlled by the user!
• More at http://supercloud.cs.cornell.edu
16
Thank You. Questions?