A Taste of What’s Cooking at US Foods

Step 1 in our quest for DevOpsNovember 13th, 2015David Kent - Senior Director, Enterprise ArchitectureDavid.kent@usfoods.com

Where we’ve come from

2

Step 1 in our Quest (Complete)

● Business● In 2012 we made a commitment to rethink our ECOM strategy● Adopted Agile Methodology - Agile Coaches Hired

● Dev● New tools adopted (Jira, SVN, Archiva)● Starting Build Automation (CI with Bamboo, SVN, Archiva)

● Ops● Leverage Virtualization – Linux virtual machine is standard● Starting automating server builds (Ansible, Python scripting)● Implemented APM solution (New Relic)

● QA● Implemented Testing Automation (HP QC, Perfecto Mobile)

3

ECOM Reference Architecture

● Oracle Database● Oracle WebLogic Server● Oracle WebCenter Portal● Oracle Coherence● Oracle API Gateway● Oracle Endeca Search● Tibco EMS● Tibco BW● Kony Mobile Platform

4

ECOM Roll Out

● 166K Customers (107K Customers Order through ECOM)● ECOM “Release 3” Customer Rollout 85% complete

ECOM Historical Adoption (% of Revenue) ECOM R3 Roll Out (Customers versus Order Volume)

5

New Relic Configuration

APM LicensesSince 1 month ago

250Licenses 

Agents deployedSince 1 month ago

223Agents 

Active UsersSince 1 month ago

121Users 

Applications MonitoredSince 1 month ago

40Applications

Server AgentsSince 1 month ago

116Agents 

DashboardsSince 1 month ago

6Dashboards 

Plugins ConfiguredSince 1 month ago

5Plugins 

MobileSince 1 month ago

PilotStatus 

BrowserSince 1 month ago

PilotStatus 

F5 LTMApache HTTPdEndecaRedisElastic SearchOracle DB

6

Challenges

Geographic Financial

Tools GapsCultural, Technical

7

Dev Ops Tools Status

Source Code Management

Containers

Monitoring

Logging

Continuous Integration

Configuration Management

Security

Build

Testing

Deployment

Collaboration

Cloud / IaaS / PaaS

Release Management Repo Management Code Quality / Peer Review

???

Complete POC Gap

8

Agile Development Tools

Conceptual Physical

9

Step 2 in our quest (To Do)Focus on culture and collaboration

● Educate IT on the benefits of DevOps cultureOperations Improvements

● Build a private cloud (Vrealize Automation)● Embrace Infrastructure Automation (Chef)● More automation between teams

QA Improvements● ECOM has 80% automated test coverage● Improve test environments

Dev Improvements● Config file tokenization/templating strategy ● Artifact versioning standardization● Unit test/code coverage improvements across

dev teamsMonitoring Improvements

● Leverage more New Relic tools (Browser, Insights, Synthetics, Ducksboard)

Planning Improvements● Move from project teams to product teams

1

1

2

2

3

3

4

4

5

5

6

6

10

64 WebSphere JVMs / 15 WebLogic JVMs

Release 2

Release 3

11

New Relic APM - ECOM Portal Farm

12

Web Services Farm with EJB Transaction graphs

13

New Relic DashboardsServer Agent: CPU Usage/Load of ECOM Servers

14

New Relic SyntheticsBasic Ping of ECOM Portal Farm

15

New Relic Browser

16

New Relic Plugins F5 Load Balancing Throughput

17

New Relic Insights

18

New Relic Tools (Custom Dashboards)

19

New Relic Servers

20

New Relic APM: All Transactions Table

21

New Relic APM: Errors

22