puppetconf 2017: adobe advertising cloud: lean puppet workflow to support multi-cloud &...

© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.

A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting InfrastructureNicolas Brousse | Director of Engineering, Operations


Increased Complexity and Faster Changes


Immutable or Mutable?

3


Tesla remotely extends range of vehicles for free in Florida to help owners escape Hurricane Irma

4

Source: Electrek.co


Tesla Over-The-Air Software Update

5


Any connected device need to handle updates

6


Connected Home gets more sophisticated

7


Likewise Enterprises Infrastructure Complexity increase

8

• IaaS / PaaS (AWS, Azure, GCP, IBM, Oracle…)

• Cloud Productivity Apps (G Suite, Office 365, AWS...)

• CRM

• Private Cloud (OpenStack, VMware...)

• Containers Orchestration (K8s, Mesos, Swarm, Nomad...)

• Bare-metal servers, mainframes (IBM Z 2017)

• Edge Computing

• Quantum Annealer (D-Wave)

Next Quantum Computers?


Patching (very) quickly matters

10


The Adobe Advertising Cloud


Technical Challenges

12

Latency Requirement<50ms @ 95th percentile

High Volume Traffic+100 billions request a day

Huge Datasetsbillions of object to store


> 6,000 servers

> 10,000 Puppet code deployments a year

> 40,000 Application deployments a year

1 Puppet Master

13


Bare-metal Infrastructure Automation

Fully automated deployment

Rack-And-Roll Infrastructure

Puppet Hiera and eYAML

15


Bare-metal Infrastructure Automation – Rack…

16

Buy Build

BurnTest

ShipRack, Bolt, Powered onConnect to Network


And Roll…

17

Jenkins API TFTP PXE boot API puppet

Log centralization Monitoring and Metrics IdM & IDS


Containers Environments

18

git jenkins

docker

terraform puppet K8s


Cloud Bursting

19

git

jenkins

terraform

puppet

puppet

jenkins

Application DeploymentInfrastructure Deployment

git


Final word


Configuration Management is not deadIt’s complicated and diverse

21


Key Take Aways

§ Acknowledge the reality of complex infrastructure in the enterprise world

§ Understand your Infrastructures models§ Strongly Immutable§ Weakly Immutable§ Mutable

§ Prevent and detect configuration drift + allow patching

§ Holistic understanding of your product lifecycle§ Infrastructure As Code (multiple tools involved)§ Feature Toggles§ Beta Percentage Rollout§ Blue / Green Deployments§ Mean Time to Release Changes at scale

22

@AdobeAdCloud @orieg

puppetconf 2017: adobe advertising cloud: lean puppet workflow to support multi-cloud &...

Technology