bolt-on global consistency for the cloud - github pageschallenges for data replication in cloud...
TRANSCRIPT
![Page 1: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/1.jpg)
Bolt-On Global Consistency for the Cloud
Zhe Wu, Edward Wijaya, Muhammed Uluyol,
Harsha V. Madhyastha
University of Michigan
1
![Page 2: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/2.jpg)
Geo-distribution for Low Latency
2
![Page 3: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/3.jpg)
Geo-distribution Requires Data Replication
3
![Page 4: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/4.jpg)
Geo-distribution Requires Data Replication
4
![Page 5: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/5.jpg)
Cloud Simplifies App Deployment
5
![Page 6: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/6.jpg)
Cloud Simplifies App Deployment
6
?
?
![Page 7: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/7.jpg)
Application Needs to Manage Replication
Isolated storage services
7
![Page 8: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/8.jpg)
Application Needs to Manage Replication
Isolated storage services
8
![Page 9: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/9.jpg)
Application Needs to Manage Replication
Isolated storage services
No replication across cloud providers
9
![Page 10: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/10.jpg)
Challenges for Data Replication in Cloud
Conflict?
10
![Page 11: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/11.jpg)
Challenges for Data Replication in Cloud
Megastore(CIDR’11) Spanner(OSDI’12) MDCC(Eurosys’13) Tapir(SOSP’15) …..
Paxos
11
![Page 12: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/12.jpg)
Challenges for Data Replication in Cloud
Paxos logic Paxos logic Paxos logicPropose writes
Paxos
12
![Page 13: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/13.jpg)
Challenges for Data Replication in Cloud
Paxos logic Paxos logic Paxos logicPropose writes
Paxos
13
![Page 14: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/14.jpg)
Challenges for Data Replication in Cloud
Paxos logic Paxos logic Paxos logicPropose writes
Paxos
14
![Page 15: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/15.jpg)
Challenges for Data Replication in Cloud
Paxos logic Paxos logic Paxos logic
PUT/GET
Propose writes
Paxos
15
![Page 16: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/16.jpg)
Challenges for Data Replication in Cloud
Paxos
VMs managedby application
PUT/GET
16
Paxos logic Paxos logic Paxos logic
![Page 17: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/17.jpg)
Challenges for Data Replication in Cloud
Paxos1. High cost
VMs managedby application
PUT/GET
17
Paxos logic Paxos logic Paxos logic
![Page 18: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/18.jpg)
Challenges for Data Replication in Cloud
Paxos1. High cost2. Bottleneck
VMs managedby application
PUT/GET
18
Paxos logic Paxos logic Paxos logic
![Page 19: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/19.jpg)
Challenges for Data Replication in Cloud
Conflict?
Paxos1. High cost2. Bottleneck
19
![Page 20: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/20.jpg)
Challenges for Data Replication in Cloud
Conflict?
Paxos1. High cost2. Bottleneck
Paxos withlimited interface
Disk Paxos(Distributed Computing’03)
pPaxos (ATC’15)
20
![Page 21: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/21.jpg)
Challenges for Data Replication in Cloud
Paxos1. High cost2. Bottleneck
Paxos withlimited interface
DiskPaxos, pPaxos
21
![Page 22: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/22.jpg)
Challenges for Data Replication in Cloud
Paxos1. High cost2. Bottleneck
Paxos withlimited interface
DiskPaxos, pPaxos
1. Conflict-free writePaxos ops
22
![Page 23: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/23.jpg)
Challenges for Data Replication in Cloud
Paxos1. High cost2. Bottleneck
Paxos withlimited interface
DiskPaxos, pPaxos
1. Conflict-free writePaxos ops
2. Read from the logto replay Paxos logic
23
![Page 24: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/24.jpg)
Challenges for Data Replication in Cloud
Paxos1. High cost2. Bottleneck
Paxos withlimited interface
DiskPaxos, pPaxos
1. Conflict-free writePaxos ops
2. Read from the logto replay Paxos logic
1. High latency
24
![Page 25: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/25.jpg)
Challenges for Data Replication in Cloud
Paxos1. High cost2. Bottleneck
Paxos withlimited interface
DiskPaxos, pPaxos
1. Conflict-free writePaxos ops
2. Read from the logto replay Paxos logic
1. High latency2. High cost
25
![Page 26: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/26.jpg)
Problems with Existing Solutions
26
Low latency Compatible with limited interface Low cost
Traditional Paxos
Disk Paxos,pPaxos
![Page 27: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/27.jpg)
Our Solution: Consistent Replication In the Cloud
27
Low latency Compatible with limited interface Low cost
Traditional Paxos
Disk Paxos,pPaxos
CRIC
![Page 28: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/28.jpg)
CRIC Overview
Cloud Storage
Cloud Storage
App VM App VMCRIC Library CRIC Library
Key-value store(reads/writes)
28
![Page 29: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/29.jpg)
CRIC Overview
Cloud Storage
Cloud Storage
App VM App VMCRIC Library CRIC Library
CPaxos
Key-value store(reads/writes)
29
![Page 30: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/30.jpg)
CRIC Overview
Cloud Storage
Cloud Storage
App VM App VMCRIC Library CRIC Library
CPaxos
Key-value store(reads/writes)
30
ü Apps directly read/write data from/to cloud storage
![Page 31: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/31.jpg)
CRIC Overview
Cloud Storage
Cloud Storage
App VM App VMCRIC Library CRIC Library
CPaxos
Key-value store(reads/writes)
31
ü Apps directly read/write data from/to cloud storage
ü Low latency (1 RTT)
![Page 32: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/32.jpg)
CPaxos In Action
Proposer(App) Acceptor Storage
Prepare
Accept
Executing a write in traditional Paxos
32
![Page 33: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/33.jpg)
CPaxos In Action
Proposer(App) Acceptor Storage
Proposer(App)
Storage
Prepare
Accept
Executing a write in traditional PaxosExecuting a write in CPaxos
33
![Page 34: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/34.jpg)
CPaxos In Action
Proposer(App) Acceptor Storage
Proposer(App)
Storage(Passive
acceptor)
Prepare
Accept
Executing a write in traditional PaxosExecuting a write in CPaxos
34
![Page 35: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/35.jpg)
CPaxos In Action
Proposer(App) Acceptor Storage
Proposer(App)
Storage(Passive
acceptor)
Prepare
Read Paxos state
Run Paxos prepare logic
Update Paxos state
Accept
Executing a write in traditional PaxosExecuting a write in CPaxos
35
![Page 36: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/36.jpg)
CPaxos In Action
Proposer(App) Acceptor Storage
Proposer(App)
Storage(Passive
acceptor)
Prepare
Read Paxos state
Run Paxos prepare logic
Update Paxos state
Accept
Executing a write in traditional Paxos
Run Paxos accept logic
Update Paxos state and data
Executing a write in CPaxos
36
![Page 37: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/37.jpg)
CPaxos In Action
Proposer(App)
Storage(Passive
acceptor)
Read Paxos state
Run Paxos prepare logic
Update Paxos state
Run Paxos accept logic
Update Paxos state and data
Executing a write in CPaxos
37
Proposer
![Page 38: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/38.jpg)
CPaxos In Action
Proposer(App)
Storage(Passive
acceptor)
Read Paxos state
Run Paxos prepare logic
Update Paxos state
Run Paxos accept logic
Update Paxos state and data
Executing a write in CPaxos
38
Proposer
Leverage cloud supported conditional-PUT(available in all cloud storage services)
![Page 39: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/39.jpg)
CPaxos In Action
Proposer(App) Acceptor Storage
Proposer(App)
Storage(Passive
acceptor)
Prepare
Read Paxos state
Update Paxos state
Accept
Executing a write in traditional Paxos
Update Paxos state and data
Executing a write in CPaxos
39
2 RTTs 3 RTTs
Preparelogic
Acceptlogic
![Page 40: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/40.jpg)
CPaxos In Action
Proposer(App) Acceptor Storage
Proposer(App)
Storage(Passive
acceptor)
Prepare
Read Paxos state
Update Paxos state
Accept
Executing a write in traditional Paxos
Update Paxos state and data
Executing a write in CPaxos
40
2 RTTs 3 RTTs
Preparelogic
Acceptlogic
Can be omitted when:1. Write follows a read2. Object creation
![Page 41: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/41.jpg)
CPaxos In Action
Proposer(App) Acceptor Storage
Proposer(App)
Storage(Passive
acceptor)
Prepare
Read Paxos state
Update Paxos state
Accept
Executing a write in traditional Paxos
Update Paxos state and data
Executing a write in CPaxos
41
2 RTTs 3 RTTs
Preparelogic
Acceptlogic
Can be omitted when:1. Write follows a read2. Object creation
Leverage Fast Paxos to execute reads and writes in one round
![Page 42: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/42.jpg)
Tradeoff: High Latency under Conflict
Propose 0Propose 1Time
42
![Page 43: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/43.jpg)
Tradeoff: High Latency under Conflict
Propose 0Propose 1Time
43
![Page 44: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/44.jpg)
Tradeoff: High Latency under Conflict
Propose 0Propose 1Time
Retry Retry
44
![Page 45: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/45.jpg)
Tradeoff: High Latency under Conflict
Propose 0Propose 1Time
Higher proposal will succeed in traditional Paxos
Retry Retry
45
![Page 46: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/46.jpg)
Tradeoff: High Latency under Conflict
Propose 0Propose 1Time
Retry Retry
Reason for conflict: variance inlatency to different data centers
46
![Page 47: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/47.jpg)
Optimization: Staggered Requests
Propose 0Propose 1Time
47
![Page 48: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/48.jpg)
Optimization: Staggered Requests
Propose 0Propose 1Time
48
![Page 49: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/49.jpg)
Optimization: Staggered Requests
Propose 0Propose 1Time
49
![Page 50: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/50.jpg)
Optimization: Staggered Requests
Propose 0Propose 1Time
50
![Page 51: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/51.jpg)
Optimization: Staggered Requests
Propose 0Propose 1Time
Detect conflict faster
51
![Page 52: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/52.jpg)
Optimization: Staggered Requests
Propose 0Propose 1Time
Detect conflict faster
52
Observation: low network latency variance between cloud DCs
![Page 53: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/53.jpg)
CRIC Optimizations
¤Reduce latency under conflict¤Staggered Requests
¤Reduce reader-write-back¤Asynchronous commit notification
¤Reduce storage and data transfer cost¤ Separates data and Paxos log¤ Aggressive garbage collection in Accept phase¤ Store data digest in Paxos log
53
![Page 54: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/54.jpg)
CRIC Optimizations
¤Reduce latency under conflict¤Staggered Requests
¤Reduce reader-write-back¤Asynchronous commit notification
¤Reduce storage and data transfer cost¤ Separates data and Paxos log¤ Aggressive garbage collection in Accept phase¤ Store data digest in Paxos log
54
Cost-effectiveOnly one version of the data is stored in each replica data center
![Page 55: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/55.jpg)
Evaluation
¤ Deploy CRIC in 5 Azure data centers and run YCSB workload
¤ Comparison systems:¤ active acceptor Fast Paxos¤ passive acceptor pPaxos
55
![Page 56: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/56.jpg)
Evaluation
¤ Deploy CRIC in 5 Azure data centers and run YCSB workload
¤ Comparison systems:¤ active acceptor Fast Paxos¤ passive acceptor pPaxos
¤How does CRIC compare with respect to cost and performance?
56
![Page 57: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/57.jpg)
Evaluation
¤ Deploy CRIC in 5 Azure data centers and run YCSB workload
¤ Comparison systems:¤ active acceptor Fast Paxos¤ passive acceptor pPaxos
¤How does CRIC compare with respect to cost and performance?
¤How effective are staggered requests?
57
![Page 58: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/58.jpg)
CRIC Enables Low Cost
58
![Page 59: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/59.jpg)
CRIC Enables Low Cost
59
CRICFast Paxos
pPaxos
![Page 60: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/60.jpg)
CRIC Enables Low Cost
60
CRICFast Paxos
pPaxos
Eliminate need for relay VMs
![Page 61: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/61.jpg)
CRIC Enables Low Cost
61
CRICFast Paxos
pPaxos
Reduce I/O and data transfers
![Page 62: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/62.jpg)
CRIC Enables Low Cost
62
CRICFast Paxos
pPaxos
CRIC can reduce cost by 20% ~ 50%
![Page 63: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/63.jpg)
… without Sacrificing Performance
0
50
100
150
200
250
300
350
400
Read Write
Med
ian
late
ncy
(ms)
Und
er lo
w c
onfli
ct
FastPaxospPaxosCRIC
63
![Page 64: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/64.jpg)
… without Sacrificing Performance
0
50
100
150
200
250
300
350
400
Read Write
Med
ian
late
ncy
(ms)
Und
er lo
w c
onfli
ct
FastPaxospPaxosCRIC
Same performance as FastPaxos
64
![Page 65: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/65.jpg)
… without Sacrificing Performance
0
50
100
150
200
250
300
350
400
Read Write
Med
ian
late
ncy
(ms)
Und
er lo
w c
onfli
ct
FastPaxospPaxosCRIC
Better write performance than pPaxos
65
![Page 66: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/66.jpg)
Staggered Requests Lower Latency Under Conflict
100
1000
0 1 2 3 4 5 6 7 8
Med
ian
late
ncy
for
succ
essf
ul w
rites
(ms)
# of client servers per DC
100
1000
0 1 2 3 4 5 6 7 8
Med
ian
late
ncy
for
succ
essf
ul w
rites
(ms)
# of client servers per DC
Without staggeredWith staggered
Increasing conflict rate
66
![Page 67: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/67.jpg)
Staggered Requests Lower Latency Under Conflict
100
1000
0 1 2 3 4 5 6 7 8
Med
ian
late
ncy
for
succ
essf
ul w
rites
(ms)
# of client servers per DC
100
1000
0 1 2 3 4 5 6 7 8
Med
ian
late
ncy
for
succ
essf
ul w
rites
(ms)
# of client servers per DC
Without staggeredWith staggered
Increasing conflict rate
Lower latency for same conflict rate
67
![Page 68: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/68.jpg)
Conclusions
¤Consistent Replication In the Cloud¤Compatible with cloud storage interface ¤One round read/write in common case¤Low cost
Thank [email protected]
68
![Page 69: Bolt-On Global Consistency for the Cloud - GitHub PagesChallenges for Data Replication in Cloud Paxos 1. High cost 2. Bottleneck Paxos with limited interface DiskPaxos, pPaxos 1. Conflict-free](https://reader034.vdocuments.mx/reader034/viewer/2022050511/5f9b6d7904056c5f79412596/html5/thumbnails/69.jpg)
69