aws re:invent 2016: busting the myth of vendor lock-in: how d2l embraced the lock and opened the...
TRANSCRIPT
![Page 1: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/1.jpg)
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
November 30, 2016
Busting the Myth of Vendor Lock-In
How D2L Embraced the Lock and Opened the Cage
ARC318
Ben Snively (AWS)
Stephen S. Skrzydlo and Stan Przychodzki
![Page 2: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/2.jpg)
What to Expect from the Session
AWS cloud
![Page 3: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/3.jpg)
The Basics Amazon
EC2
Who’s afraid of
Amazon EC2?
![Page 4: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/4.jpg)
Usage Curve
![Page 5: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/5.jpg)
Usage Curve – Self-Hosting Provisioning
![Page 6: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/6.jpg)
Usage Curve – Reserved InstancesAmazon
EC2
![Page 7: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/7.jpg)
Why is no one afraid of EC2?
Virtualization already
paved that road
We’re not afraid of
what we’re used to
Amazon
EC2
![Page 8: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/8.jpg)
D2L shops at the Content Store
Don’t forget the tax
![Page 9: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/9.jpg)
Round 1: DFSR
• At least 2 windows
• Each with 12 TB of
• Cost curve looks familiar
• High minimum
• Step function
Amazon EBS
instances
$-
$5,000
$10,000
$15,000
$20,000
$25,000
$30,000
$35,000
$40,000
$45,000
$50,000
0
10
20
30
40
50
60
70
80
90
100
110
120
130
140
150
160
170
180
190
200
Month
ly C
ost
TB Storage
![Page 10: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/10.jpg)
Round 2: NetApp ONTAP
• At least 2 ONTAP
• Each with 50 TB of
• Cost curve is better but…
• Still a step function!
Amazon EBS
instances
$-
$5,000
$10,000
$15,000
$20,000
$25,000
$30,000
$35,000
$40,000
$45,000
$50,000
0
10
20
30
40
50
60
70
80
90
100
110
120
130
140
150
160
170
180
190
200
Month
ly C
ost
TB Storage
![Page 11: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/11.jpg)
Round 3: S3
• Standard storage
• Bye-bye step function
• But… that’s not a CIFS
share, we’d need to change
our product!
Amazon
S3
bucket
$-
$5,000
$10,000
$15,000
$20,000
$25,000
$30,000
$35,000
$40,000
$45,000
$50,000
0
10
20
30
40
50
60
70
80
90
100
110
120
130
140
150
160
170
180
190
Month
ly C
ost
TB Storage
![Page 12: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/12.jpg)
The dreaded Vendor Lock-in
And here we see it, changing the code to handle S3
instead of CIFS shares. Think of the poor developers!
Yes, let’s think of them… Math time!
ROI = <Estimated Cost of Dev Effort>---------------------------------------------------------------------
(<OpExold> - <OpExnew>)
(Watch your units)
![Page 13: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/13.jpg)
$-
$5,000
$10,000
$15,000
$20,000
$25,000
$30,000
$35,000
$40,000
$45,000
$50,000
0
10
20
30
40
50
60
70
80
90
100
110
120
130
140
150
160
170
180
190
Month
ly C
ost
TB Storage
Why not EFS?
Doesn’t meet our needs
Costs more
Amazon EFS
![Page 14: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/14.jpg)
Don’t compete outside
your core competency
Amazon
Route 53
DNS and CachingAmazon
ElastiCache
![Page 15: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/15.jpg)
DNS
“Transforming the way the
world learns”
Not: “implementing DNS”
Amazon
Route 53
$
Number of domains
![Page 16: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/16.jpg)
DNS
“Transforming the way the
world learns”
Not: “implementing DNS”
Amazon
Route 53
$
Number of domains
![Page 17: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/17.jpg)
Caching
“Transforming the way the
world learns”
Not: “re-implementing
Memcached”
Amazon
ElastiCache
$-
$1,000
$2,000
$3,000
$4,000
$5,000
$6,000
$7,000
$8,000
$9,000
Number of instances
![Page 18: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/18.jpg)
Scaling and Opportunity Cost
If D2L were to have 1 DNS
specialist that would be like
Amazon having
Classic Build vs. Buy pattern
Better integration into the rest
of the ecosystem
Just superior feature sets
![Page 19: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/19.jpg)
The Cloud is NOT a
Hosting Facility in the Sky
Logging ErrorsAmazon Kinesis
FirehoseAmazon
KinesisAmazon
Elasticsearch Service
![Page 20: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/20.jpg)
SQL as a Logging Database – Legacy Design
• Unpleasant to search
• Only 30 days retained
• Hardcoded sharding
• Costly
50
100
150
200
250
300
350
400
450
500
550
600
650
700
750
800
850
900
950
100
0
$
TB
![Page 21: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/21.jpg)
Kinesis Firehose -> Elasticsearch
(with S3)
• Designed for search
• 12 months retained
• Could retain more
• Sharding by choice
• Cheaper (~1/4th the cost) 50
100
150
200
250
300
350
400
450
500
550
600
650
700
750
800
850
900
950
100
0
$
TB
Amazon Kinesis
Firehose
Amazon
Elasticsearch Service
Amazon
S3
![Page 22: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/22.jpg)
PaaS GOOD
IaaS BAD
Big Data LessonsAmazon
Redshift
Amazon
EMR
![Page 23: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/23.jpg)
Original “Hosted” Design
• Pure self-roll
• Self-hosted
• Very high floor costs
• Concerns over multiregion
requirements
• IaaS$
Time
![Page 24: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/24.jpg)
AWS “Lifted” Design – In Theory
• Pure self-roll
• AWS hosted
• Much better floor costs
• Concern over crossover
point
• IaaS$
Time
![Page 25: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/25.jpg)
AWS “Lifted” Design – In Practice
• Self-roll
• AWS hosted
• Much better floor costs
• Concern over crossover
point
• IaaS$
Time
![Page 26: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/26.jpg)
AWS Native Design
• AWS native
• AWS hosted
• Jump in with both feet
• Crossover point becomes
hilarious
• PaaS$
Time
Amazon
EMR
Amazon
Redshift
![Page 27: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/27.jpg)
People
OPPORTUNITY
COST
![Page 28: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/28.jpg)
“Understand motivations”
3rd Party Pushback
![Page 29: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/29.jpg)
People
![Page 30: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/30.jpg)
Recap
• Who’s afraid of EC2?
• Don’t forget to account for all costs
• Don’t compete outside your core competency
• The cloud is not a Hosting Facility in the Sky
• PaaS > IaaS
• This AWS thing might stick around for a bit
![Page 31: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/31.jpg)
Integrating AWS with existing On-Prem Solutions
![Page 32: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/32.jpg)
Integrated
networking
Integrated
access control
Integrated
storage and
backups
Integrated
Management
# 10.0.100.0
# 10.0.200.0
Microsoft Active
Directory,
OTKA,
Shib,
Etc..
App 1
AWS Storage Gateway
Integrating AWS with existing On-Prem Infrastructure
…
![Page 33: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/33.jpg)
Amazon EFS
File
Amazon EBSAmazon EC2
Instance Store
Block
Amazon S3 Amazon Glacier
Object
Data Transfer
AWS Direct
Connect
AWS
Snowball
ISV Connectors Amazon
Kinesis
Firehose
S3 Transfer
Acceleration
AWS Storage
Gateway
Storage is a platform: AWS Storage Maturity
![Page 34: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/34.jpg)
AWS Database
Migration Service
Start your first migration in 10 minutes or less
Keep your apps running during the migration
Replicate within, to, or from Amazon EC2 or Amazon RDS
Move data to the same or different database engineAWS Schema
Conversion Tool
![Page 35: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/35.jpg)
AWS Application Discovery Service
Identify application
Inventory
Map application
dependencies
Baseline system and
process performance
Automate data center application discovery
![Page 36: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/36.jpg)
AWS Server Migration Service
• Support VMWare VMs migration
• Agentless VM Migration
• Capture incremental changes
• Migrate a group of VMs
• Management Console/API Access
• Launch EC2 instances from AMIs
![Page 38: AWS re:Invent 2016: Busting the Myth of Vendor Lock-In: How D2L Embraced the Lock and Opened the Cage (ARC318)](https://reader033.vdocuments.mx/reader033/viewer/2022042723/587543341a28abb8208b56c1/html5/thumbnails/38.jpg)
Remember to complete
your evaluations!