cloud- and peer-to-peer storage · •wuala •tahoe •crashplan •cucku •powerfolder. amazon...
TRANSCRIPT
![Page 1: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/1.jpg)
Cloud- and Peer-to-Peer Storage
End-user considerations and product overview
4/3/2010
Arjan Peddemors
![Page 2: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/2.jpg)
Objectives
• Get overview of existing cloud storage and P2P
storage concepts and products*
• outline of basic principles underlying cloud- and P2P
storage technologies
• product scan
• scenario description
• Focus on end-users (researchers, staff, students)
2 * Report available soon on SURFnet website
![Page 3: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/3.jpg)
Overview
Cloud Storage
3
cloud storage
process
local data
storage
cloud storage service
![Page 4: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/4.jpg)
Overview
Peer-to-Peer (P2P) Storage
4
p2p storage process
local data
storage
peer data
storage
![Page 5: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/5.jpg)
Overview
Application Domain
• Cloud storage / P2P storage domain is currently
highly dynamic
• many new products
• quickly increasing number of (end-)users
• new technologies being applied
• Future developments driven by
• fast internet connections for (end-)users
• cheap storage hardware
• uptake of cloud computing in general
5
![Page 6: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/6.jpg)
Basic principles
• Redundancy
• Erasure coding
• Security
• Asymmetric read / write
• Peer selection
• Fairness and quota
• Versioning
• Efficient transmission
6
![Page 7: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/7.jpg)
Erasure Coding
7
Original file
Redundant fragments (n = 6)
Fragments stored at peers
Loss of fragments due to peer
churn or temporal unavailability
Remaining fragments
stored at peers
Retrieved fragments ( ≥ k)
Original file
Encode
Upload to peers
Download from peers
Decode and join
Split
Fragments (k = 3)
![Page 8: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/8.jpg)
Erasure Coding
• Compared to replication, erasure codes deliver a higher
probability of successful data restore
• Example calculation
• peer network consisting of 10000 peers
• 10% of peers is offline on average
• replication factor of 2 (file consumes twice the original size at
peers)
• 2 replicas: probability of availability of at least one replica is
0.99 (2 nines)
• 16 fragments at peers: probability of availability of at least 8
fragments is 0.99994 (four nines)
8
![Page 9: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/9.jpg)
Product scan
• Research projects / products
• Simple Tools
9
• Cloud Storage products
• Amazon S3
• Dropbox
• Microsoft Live Mesh /
Live Skydrive
• Adrive
• Mozy
• P2P Storage products
• Wuala
• Tahoe
• CrashPlan
• Cucku
• PowerFolder
![Page 10: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/10.jpg)
Amazon S3 / Dropbox (cloud)
10
![Page 11: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/11.jpg)
Amazon S3 / Dropbox (cloud)
11
![Page 12: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/12.jpg)
Wuala (P2P)
12
![Page 13: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/13.jpg)
Scenario
• Doctoral student working on research data / thesis at
multiple locations
13
universityhome
laptopfixed PC
cloud storage / P2P storage
fixed PC
![Page 14: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/14.jpg)
Scenario
• Comparing
• Simple tool (Unison)
• Cloud storage service (Dropbox)
• P2P storage service (Wuala)
• Aspects
• Preparation / installation
• Regular activities and maintenance
• Recovery
14
![Page 15: Cloud- and Peer-to-Peer Storage · •Wuala •Tahoe •CrashPlan •Cucku •PowerFolder. Amazon S3 / Dropbox (cloud) 10. Amazon S3 / Dropbox (cloud) 11. Wuala (P2P) 12. Scenario](https://reader033.vdocuments.mx/reader033/viewer/2022050418/5f8dafb63dd945065a28c238/html5/thumbnails/15.jpg)
Conclusions
• Cloud / P2P storage products interesting for SURFnet
end users
• Domain is new and developing quickly
• Many product variants (targeting different usage)
• Subscription versus bringing in own resources
• Two types of P2P storage products
• ‘full’ P2P system scaling to many peers
• ‘social’ P2P systems
• Cloud storage services more mature than P2P
• Many products have both Cloud and P2P features
15