amazon aurora new features - september 2016 webinar series
TRANSCRIPT
![Page 1: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/1.jpg)
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Steve Abraham – Solutions Architect
September 28, 2016
Amazon AuroraNew Features
![Page 2: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/2.jpg)
Options for hosting databases
Self-managed EC2 instances Fully managed
Corporate data center
Database DB on EC2 instance RDS
![Page 3: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/3.jpg)
If You Host Your Databases On-Premises
Power, HVAC, net
Rack & stack
Server maintenance
OS patches
DB s/w patchesDatabase backups
High availability
DB s/w installs
OS installation
you
ScalingApp optimization
![Page 4: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/4.jpg)
If You Host Your Databases in EC2
Power, HVAC, net
Rack & stack
Server maintenance
OS patches
DB s/w patchesDatabase backups
ScalingHigh availability
DB s/w installs
OS installation
you
App optimization
![Page 5: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/5.jpg)
If You Choose a Managed Database Service
Power, HVAC, net
Rack & stack
Server maintenance
OS patches
DB s/w patchesDatabase backups
App optimization
High availability
DB s/w installs
OS installation
you
Scaling
Database Tuning Design Consultation
App optimization
Best Practices
![Page 6: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/6.jpg)
Relational databases
Fully managed and secure
Fast, predictable performance
Simple and fast to scale
Low cost, pay for what you useAmazon
RDS
Amazon Aurora
![Page 7: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/7.jpg)
MySQL-compatible relational database
Performance and availability of commercial databases
Simplicity and cost-effectiveness of open-source databases
What is Amazon Aurora?
![Page 8: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/8.jpg)
Database architectures in last 30 years
Even when you scale it out, you’re still replicating the same stack
SQL
Transactions
Caching
Logging
SQL
Transactions
Caching
Logging
ShardingCoupled at the application layer
Application
SQL
Transactions
Caching
Logging
SQL
Transactions
Caching
Logging
Shared nothingCoupled at the SQL layer
Application
SQL
Transactions
Caching
Logging
SQL
Transactions
Caching
Logging
Shared diskCoupled at the caching and
storage layer
Storage
Application
![Page 9: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/9.jpg)
A service-oriented architecture applied to the database
Moved the logging and storage layer into a multi-tenant, scale-out database-optimized storage service
Integrated with other AWS services like Amazon EC2, Amazon VPC, Amazon DynamoDB, Amazon SWF, and Amazon Route 53 for control plane operations
Integrated with Amazon S3 for continuous backup with 99.999999999% durability
Control planeData plane
Amazon DynamoDB
Amazon SWF
Amazon Route 53
Logging + Storage
SQL
Transactions
Caching
Amazon S3
1
2
3
![Page 10: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/10.jpg)
Fastest growing
service in AWS
history
Business applications
Web and mobile
Content management
E-commerce, retail
Internet of Things
Search, advertising
BI, analytics
Games, media
Aurora customer adoption
![Page 11: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/11.jpg)
Expedia: On-line travel marketplace Real-time business intelligence and analytics on
a growing corpus of on-line travel marketplace data.
Current Microsoft SQL Server–based architecture is too expensive. Performance degrades as data volume grows.
Cassandra with Solr index requires large memory footprint and hundreds of nodes, adding cost.
Aurora benefits: Aurora meets scale and performance
requirements with much lower cost. 25,000 inserts/sec with peak up to 70,000. 30 ms
average response time for write and 17 ms for read, with 1 month of data.
World’s leading online travel company, with a portfolio that includes 150+ travel sites in 70 countries.
![Page 12: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/12.jpg)
New Regions
![Page 13: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/13.jpg)
13 Regions
35 Availability Zones
63 Edge Locations
AWS Global Infrastructure
![Page 14: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/14.jpg)
July 2015• Virginia• Oregon• Ireland
Amazon Aurora Regions
![Page 15: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/15.jpg)
October 2015• Tokyo
Amazon Aurora Regions
![Page 16: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/16.jpg)
February 2016• Sydney
Amazon Aurora Regions
![Page 17: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/17.jpg)
March 2016• Seoul
Amazon Aurora Regions
![Page 18: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/18.jpg)
June 2016• Mumbai
Amazon Aurora Regions
![Page 19: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/19.jpg)
Cross Region Read Replicas
![Page 20: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/20.jpg)
Cross Region Read Replicas
• Launched 6/1/2016• Features
• Additional 15 Read Replicas in New Region
• Very Low RPO & RTO• Unencrypted Clusters
• Use Cases• Cross Region Disaster
Recovery• Cross Region Migration• Regional Availability
![Page 21: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/21.jpg)
Cross Region Read Replicas
![Page 22: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/22.jpg)
Cross Region Read Replicas
![Page 23: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/23.jpg)
Cross Region Read Replicas
![Page 24: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/24.jpg)
Cross Region Read Replicas
![Page 25: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/25.jpg)
Cross Region Read Replicas
![Page 26: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/26.jpg)
Cross Region Read Replicas
![Page 27: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/27.jpg)
Local Time Zone Support
![Page 28: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/28.jpg)
Local Time Zone support for Amazon Aurora
• Launched 3/1/2016• Features
• Default Time Zone is UTC• Set as Cluster Parameter• Time Zone Applied for New Connections• Cross Region Uses Different Parameter Groups• Restore from Cluster Snapshot – Defaults to UTC
• Use Cases• Application Compatibility• Reporting
![Page 29: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/29.jpg)
Local Time Zone support for Amazon Aurora
![Page 30: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/30.jpg)
Local Time Zone support for Amazon Aurora
![Page 31: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/31.jpg)
Local Time Zone support for Amazon Aurora
![Page 32: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/32.jpg)
Cross Account Snapshot Sharing
![Page 33: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/33.jpg)
Cross Account Snapshot Sharing
• Launched 5/18/2016• Features
• Share with Specific Accounts• Create Public Snapshots• Manually Generated, Unencrypted Snapshots
• Use Cases• Separation of Environments (dev, test, prod)• Partnering (vendors, customers)• Data Dissemination (research, public datasets)
![Page 34: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/34.jpg)
Cross Account Snapshot Sharing
![Page 35: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/35.jpg)
Cross Account Snapshot Sharing
![Page 36: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/36.jpg)
Cross Account Snapshot Sharing
![Page 37: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/37.jpg)
Enhanced Monitoring
![Page 38: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/38.jpg)
Enhanced Monitoring
• Launched 12/18/2015• Features
• 53 Metrics (CPU, Memory, Disk, Swap, Processes, File System)
• Configure Granularity (1-60 seconds)• Use Cases
• Diagnose Bottlenecks via Console• Metrics Extraction Filter• CloudWatch Alerts (Add Read Replica)
![Page 39: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/39.jpg)
Enhanced MonitoringAmazon CloudWatch metrics for RDS
CPU utilization Storage Memory 50+ system/OS metrics 1–60 second granularity DB connections Selects per second Latency (read and write) Cache hit ratio Replica lag
CloudWatch alarms Similar to on-premises custom
monitoring tools
![Page 40: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/40.jpg)
Enhanced Monitoring
![Page 41: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/41.jpg)
Enhanced Monitoring
![Page 42: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/42.jpg)
Enhanced Monitoring
![Page 43: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/43.jpg)
Additional Failover Control
![Page 44: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/44.jpg)
Additional Failover Control for Amazon Aurora
• Launched 3/14/2016• Features
• Up to 15 Read Replicas• Specify Failover Order• Specify High Failover Order for Application Instances
• Use Cases• Isolate Application Instances from Failover• More Control Over Failover Precedence
![Page 45: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/45.jpg)
Additional Failover Control for Amazon Aurora
![Page 46: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/46.jpg)
Encryption at Rest
![Page 47: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/47.jpg)
Encryption at Rest
• Launched 12/7/2015• Features
• AWS Managed or Customer Managed Key (KMS)• AES-256 (In-Transit & at Rest)• Database, Logs, Backups, Snapshots, Read Replicas• Specify at Creation• Annual Key Rotation• CloudTrail Audit• Can Create from Unencrypted Backup
• Use Cases• Protect Data at Rest• Compliance (PCI, SOC 1/2/3, ISO 27001/9001, ISO 27017/27018)
![Page 48: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/48.jpg)
Encryption at Rest
![Page 49: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/49.jpg)
Binary Snapshot Ingestion from S3
![Page 50: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/50.jpg)
Binary Snapshot ingestion from S3
• Launched 7/20/2016• Features
• Replaces mysqldump• Percona XtraBackup• Simplifies Import of Complex Databases• No Performance Impact on Source Database• Migrate MySQL on EC2 or on-premises
![Page 51: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/51.jpg)
Binary Snapshot ingestion from S3
• Manual Options• User Accounts• Functions• Stored Procedures• Time Zone Information
• Does Not Support Partial Backups• --include• --tables-file• --databases
![Page 52: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/52.jpg)
Binary Snapshot ingestion from S3
• Best Practices• Large Files – Use Multi-Part Upload / Split Option• Long Distances – Use S3 Transfer Acceleration• Backup Format Must Match File Extension
• Gzip• tar• Percona xbstream
• Use Cases• InnoDB or MyISAM table spaces
![Page 53: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/53.jpg)
Binary Snapshot ingestion from S3
![Page 54: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/54.jpg)
Reader Endpoint for Amazon Aurora
![Page 55: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/55.jpg)
Reader Endpoint for Amazon Aurora
• Launched 9/8/2016• Features
• Single Reader Endpoint• May Replace MariaDB
Connector Load Balancing• During Failover, read-only
connections dropped• Use Cases
• Load Balancing• High Availability
![Page 56: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/56.jpg)
Reader Endpoint for Amazon Aurora
• Load Balancing• Point all Readers to Reader Endpoint• New Read Replicas are put into rotation• Retired Read Replicas are taken out of rotation• Load Balances Connections Not Queries• Check DNS Cache Settings if Connections are Lopsided
![Page 57: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/57.jpg)
Reader Endpoint for Amazon Aurora
• Failover• Point all Writers to Cluster Endpoint• Ensure Read Replicas are in Different Availability Zones• DNS Change Points to Read Replica in Priority Order• Read Only Connections to Replica are Dropped• May see temporary traffic to new master while DNS changes• Make sure to use Failover Priorities
![Page 58: Amazon Aurora New Features - September 2016 Webinar Series](https://reader035.vdocuments.mx/reader035/viewer/2022070601/5886a1081a28ab0c1d8b612f/html5/thumbnails/58.jpg)
Demo