amazon simple storage service (s3) - s3 introduction...storage service (amazon s3) in the form of...

43

Upload: others

Post on 21-May-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 2: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 3: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 4: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

multiple specialized methods

Page 5: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

To support the above and many more use cases, Amazon S3 offers a range of storage classes designed : General purpose Infrequent access Archive

Page 6: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 7: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 8: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 9: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 10: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

https://s3-eu-west-1.amazonaws.com/nuageacademy/index.html

Page 11: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 12: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

Amazon guarantee 99.99% availability Encryption

Amazon guarantees 99.999999999% durability for S3 information

Secure your data using ACL and Bucket Policies

Amazon guarantees 99.999999999% durability for S3 information

MFA Delete

Tiered Storage available Pre-Signed URLs

Lifecycle Management Multipart Upload

Versioning Cross-Region Replication

Logging Event Notifications

Page 13: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

http://www.hjsplit.org/

http://www.manpagez.com/man/1/split/

http://www.bucketexplorer.com/

http://s3browser.com/

http://www.cloudberrylab.com/free-amazon-s3-explorer-cloudfront-IAM.aspx

Page 14: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

Features Functionality

Using Amazon DevPay with Amazon S3Learn how you can use Amazon DevPay to charge customers that access the data you store on Amazon S3.

Requester Pays BucketsLearn how to configure a bucket so that a customer pays for the downloads they make.

Using BitTorrent With Amazon S3Use BitTorrent, which is an open, peer-to-peer protocol for distributing files.

Versioning Learn about Amazon S3's Versioning capabilities.

Hosting Static Websites Learn how to host a static website on Amazon S3.

Object Lifecycle Management

Learn how to manage the lifecycle of objects in your bucket. Lifecycle management includes expiring objects and archiving objects (transitioning objects to the GLACIER storage class).

Page 15: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 16: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 17: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

https://s3-eu-west-1.amazonaws.com/nuageacademy

Page 18: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 19: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

Read the S3 FAQ before taking the exam.

Page 20: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 21: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 22: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 23: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

• By default, all newly created buckets are private• We can set up Access Control to the bucket using:

• Bucket Policy• Access Control Lists

• S3 buckets can be configured to create access logs, which log all requests made to the S3 bucket.

• Encryption:• In Transit

• SSL• At Rest

• Server Side Encryption• S3 Managed Keys – SSE-S3 (AES 256)• AWS Key Management Service, Managed Keys – SSE-KMS• Server Side Encryption with customer provided keys – SSE-C

• Client Side Encryption

Page 24: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 25: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 26: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 27: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

Glacier is an extremely low cost storage service for data archival. Amazon Glacier stores data for as little as $0.01 per GB per month, and is optimized for data that is infrequently accessed and for which data retrieval times of 3 – 5 hours are suitable.

Page 28: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 29: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 30: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 31: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 32: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 33: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

AWS Import/Export disk accelerates moving large amount of data in and out of the AWS cloud using portable storage devices for transport. AWS Import/Export disk transfers your data directly onto and off of storage devices using Amazon’s high-speed internal network and bypassing the internet

Page 34: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

• Snowball• Snowball Edge• SnowMobile

Snowball available in all regions. Snowball uses multiple layers of security designed to protect your data including tamper-resistant enclosures, 256-bit encryption, and an industry standard Trusted Platform Module (TPM) designed to ensure both security and full chain of custody of the data. Once the data transfer job has been processed and verified, AWS performs software erasure of the Snowball appliance

Page 35: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1
Page 37: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

File Gateway– File gateway is a type of AWS Storage Gateway that supports a file interface into

Amazon S3. File gateway combines a service and virtual software appliance, enabling you to store

and retrieve objects in Amazon S3 using industry-standard file protocols such as Network File System (NFS).

The software appliance, or gateway, is deployed into your on-premises environment as a virtual machine (VM)

running on Vmware ESXi. The gateway provides access to objects in S3 as files on a NFS mount point.

With file gateway, you can do the following:

• You can now store and retrieve files directly using NFS 3 or 4.1 protocol.

• You can access your data directly in S3 from any cloud application or service.

• You can manage your data directly in Amazon S3 using lifecycle policies, cross-region replication,

and versioning.

Page 38: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

Cached Volumes Architecture -Cached volumes let you use Amazon Simple Storage Service (Amazon S3) as your primary data storage whileretaining frequently accessed data locally in your storage gateway. Cached volumes minimize the need to scale youron-premises storage infrastructure, while still providing your applications with low latency access to their frequentlyaccessed data. You can create storage volumes up to 32 TiB in size and attach to them as iSCSI devices from your on-premises application servers. Your gateway stores data that you write to these volumes in Amazon S3 and retainsrecently read data in your on-premises storage gateway's cache and upload buffer storage.

Cached volumes can range from 1 GiB to 32 TiB in size. Each gateway configured for cached volumes can support upto 32 volumes for a total maximum storage volume of 1,024 TiB(1 PiB).

In the cached volumes solution, AWS Storage Gateway stores all your on-premises application data in a storagevolume in Amazon S3.

Page 39: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

The following diagram provides an overview of the cached volumes deployment

After you've installed the AWS Storage Gateway software appliance—the virtual machine (VM)—on a host in your data center and activated it, you can use the AWS Management Console to provision storage volumes backed by Amazon S3.You also allocate disks on-premises for the VM. These on-premises disks serve the following purposes:• Disks for use by the gateway as cache storage• Disks for use by the gateway as the upload buffer

Page 40: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

Stored Volumes ArchitectureStored volumes let you store your primary data locally, while asynchronously backing up that data toAWS. Stored volumes provide your on-premises applications with low-latency access to their entiredatasets, while providing durable, off-site backups. You can create storage volumes and mount themas iSCSI devices from your on-premises application servers. Data written to your stored volumes isstored on your on-premises storage hardware. This data is asynchronously backed up to Amazon SimpleStorage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots.

Stored volumes can range from 1 GiB to 16 TiB in size and must be rounded to the nearest GiB. Eachgateway configured for stored volumes can support up to 32 volumes and a total volume storage of 512TiB (0.5 PiB).

With stored volumes, you maintain your volume storage on-premises in your data center. That is, youstore all your application data on your on-premises storage hardware. Then, using features that helpmaintain data security, the gateway uploads data to the AWS Cloud for cost-effective backup and rapiddisaster recovery. This solution is ideal if you want to keep data locally on-premises, because you need tohave low-latency access to all your data, and also to maintain backups in AWS.

Page 41: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

The following diagram provides an overview of the stored volumes deployment

Page 42: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

Tape GatewayTape Gateway offers a durable, cost-effective solution to archive your data in the AWS Cloud. The VTLinterface it provides lets you leverage your existing tape-based backup application infrastructure to storedata on virtual tape cartridges that you create on your tape gateway. Each tape gateway is preconfiguredwith a media changer and tape drives, which are available to your existing client backup applications asiSCSI devices.You add tape cartridges as you need to archive your data.The following diagram provides an overview of the tape gateway deployment.

Page 43: Amazon Simple Storage Service (S3) - S3 Introduction...Storage Service (Amazon S3) in the form of Amazon Elastic Block Store (Amazon EBS) snapshots. Stored volumes can range from 1

• File Gateway – For flat files, stored directly on S3.

• Volume Gateway

• Stored Volumes – Entire Dataset is stored on site and is asynchronously backed up to S3.

• Cached Volumes – Entire Dataset is stored on S3 and the most frequently accessed data

is cached on site.

• Gateway Virtual Tape Library (VTL)

• Used for backup and uses popular backup applications like NetBackup, Backup Exec,

Veam etc.,