test-driven infrastructure with cloudformation and cucumber

COPYRIGHT © 2012 Stelligent Systems LLC Unauthorized duplication is not permitted.

Test-Driven Infrastructure w/ CloudFormation and Cucumber

Paul Duvall, Stelligent CTO Author of Continuous Integration and DevOps in the Cloud Tuesday, July 24, 2012

Stelligent Monthly Cloud Delivery Webinar Series


Introduction

Stelligent

Linkedin

Next Webinar

August 28th: Scripted Deployment with Capistrano http://stelligent.com/cap with Brian Jakovich

Continuous Delivery in the Cloud: http://linkd.in/Pfbf1h

Cloud Delivery: Migration, Training and Operations

Materials Powerpoint and other resources will be emailed to attendees and available in Linkedin group

June Webinar

Recording of last month’s webinar: http://www.stelligent.com/aws-webinar/


About Me


Continuous Delivery

http://bit.ly/cdwebinar1


Continuous Delivery


5 Steps to Continuous Delivery

Continuous

Document

Test

Version

Script

Document to automate

Write an automated test to verify behavior

Automate to a single command

Version all scripts

Run headless with every change


Business Value of Test-Driven Infrastructure

•  Learn of problems earlier by integrating CI with infrastructure - Infrastructure changes integrated with rest of software system

•  Scripted Infrastructure becomes Documentation •  Remove Gatekeepers •  Isolate Destructive Changes •  Canonical System •  Quickly get back to earlier version of Infrastructure •  Infrastructure as Code: Apply rigorous practices

similar to writing application code


Test-Driven Infrastructure within Delivery Pipeline

•  Manually Configure and Document Environment

•  Write Acceptance Test •  Script the Environment

provisioning •  Version the infrastructure

automation (Checkin the Script(s))

•  Run as part of a Continuous Process

•  Make “pre-baked” environments available to team members and CD system


CI Server

Target Environment

Instances Version-Control

Repository

Sidebar: Continuous Integration Process

Developer

Tester

Operations

DBA

Polling

Create Environments

Deploy Build

Tests


Test-Driven Infrastructure: Success

Jenkins Environment Job

Environment Email SSH

Working App Deployment Email


Test-Driven Infrastructure: Failure •  Notified soon after

infrastructure script is committed to version-control repository

•  Since all infrastructure scripts and config are versioned, can simply revert to previous known-good version

•  Failure is identified, scripts are changed and committed back to version-control system

•  Infrastructure changes are integrated with rest of software system


Non-Automated Test Scenario •  Environment is manually created by

running through a series of steps to install/configure OS, networking, servers, etc.

•  In some cases, these steps are documented. Often, the documentation is not regularly updated

•  New environments – based on the “initial environment” – are created by going through similar manual steps

•  No canonical state of environments – each environment is unique

•  Software is deployed to environments (Dev, QA, Stage, etc.). Deployments fail. Root cause is unclear.

•  Troubleshooting and patch work ensue. State remains dubious. Team members apply superstition to root cause.


Sidebar: Test-Driven Development with JUnit


Scripted Infrastructure (Code) •  Walkthrough of production.template CloudFormation template


Cucumber BDD Basics

•  Philosophy •  Executable Specifications •  Continuous Traceability

•  Cucumber Components (1)

•  Business Facing •  Features •  Scenarios •  Steps

•  Technology Facing •  Step Definitions •  Support Code •  Automation Library •  Syntax Rules: Gherkin

From “The Cucumber Book” (Wynne and Hellesoy; Pragmatic Bookshelf, 2012)


TDI BDD Components

Jenkins

Cucumber

CloudFormation

Step Definitions


TDI Cucumber Examples

•  Walkthrough of production.feature Cucumber feature


Other TDI Tools

•  Cucumber Nagios: http://auxesis.github.com/cucumber-nagios/ •  Cucumber Chef: http://www.cucumber-chef.org/


Question and Answer

August Webinar

Blog

Social

Solutions

CD Video

http://www.stelligent.com/blog/

@stelligent @paulduvall facebook.com/Stelligent

http://bit.ly/cdwebinar1

http://www.stelligent.com/solutions/

http://www.stelligent.com/cap/

Training http://www.stelligent.com/cd-training/


Infrastructure Components CloudFormation Template

Amazon Simple Notification Service

(SNS)

Elastic IP

Security Group IAM Route 53 EC2 SimpleDB

Config

Tomcat Apache HTTPD

Jenkins

Linux OS S3

Version-Control Repo Cucumber