decentralized storage systems in volunteer computing systems
DESCRIPTION
Course: Decentralized Systems Final Project: Make a survey on Large-Scale Decentralized Storage Systems to be used by Volunteer Computing Systems and present it in class (15-20min)TRANSCRIPT
A Survey on Large-Scale Decentralized Storage Systems
to be used by Volunteer Computing Systems
Umit Cavus Buyuksahin [email protected] Stylianou [email protected] Demetriou [email protected] Adnan Khan [email protected]
DS – Decentralized Systems
2
Outline
● Introduction● Large-Scale Decentralized Storage Systems● Volunteer Computing Systems
● Main Common Characteristics
● Most Suitable System
● Summary
3
Introduction
Storage Systems
→ Store data from computations of Distributed Systems
→ Need for more storage!
Volunteer Computing Systems
→ Volunteers offer unused storage & resources
Researchers from SS turn to:
→ Unused storage
→ Volunteer Computing SystemsDS – Decentralized Systems
4
Main Common Characteristics
● Symmetry
● Scalability
● Anonymity
● Availability
● Robustness
DS – Decentralized Systems
peers at the same level
regarding # of nodes
keep identity secret
data reachable
recovery after failures
5
Examined Decentralized Systems
● FreeHaven● FreeNet● Ivy● Frangipani● Ceph● OceanStore● Antiquity● TFS
DS – Decentralized Systems
● Riak● Dynamo● MongoDB● BigTable● Pastis● Storage@home ● Farsite● TotalRecall
Umit
Nicos
Adnan
Maria
6
Symmetry
Frangipani
Antiquity
BigTable
Farsite
OceanStore
MongoDB
TotalRecall
Not Symmetric Systems
DS – Decentralized Systems
Have an administrator
Have different roles
7
Scalability
FreeHaven
Ivy
Farsite
Best System: Ceph
Systems with Limited Scalability
DS – Decentralized Systems
Limited Scalability
by design
8
Anonymity
FreeHaven
FreeNet
Storage@Home
Systems with Anonymity
DS – Decentralized Systems
Addressed as a main issue
9
Availability
FreeHaven
FreeNet
Best System: TotalRecall
Systems with Medium Level Availability
DS – Decentralized Systems
No replication mechanism
10
Robustness
FreeHaven → Buddy System
Antiquity → Quorum Repair
Pastis → Based on its Storage Layer
FarSite → Handle Byzantine Faults
The rest:
→ Fault Tolerance Service, Repair Mechanisms
All Systems are Robust
DS – Decentralized Systems
11
Most Suitable System: Storage@home
● Typical volunteer computing model● Participants
● Act as volunteers● Install an agent on their machine● Compete & Gain points based on
contribution in storage & recruitment process
● DSS characteristics → Satisfied!● VCS requirements → Satisfied!
DS – Decentralized Systems
12
Summary
● DSS & VCS have common characteristics
– Symmetry – Scalability – Anonymity – Availability – Robustness
● Storage@home has everything!
DS – Decentralized Systems
A Survey on Large-Scale Decentralized Storage Systems
to be used by Volunteer Computing Systems
Umit Cavus Buyuksahin [email protected] Stylianou [email protected] Demetriou [email protected] Adnan Khan [email protected]
DS – Decentralized Systems