Transcript
Page 1: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

OPENNEBULACONF – 25TH OCTOBER 2013

OPENNEBULA IN A MULTI- CUSTOMER ENVIRONMENT

BERND ERK | NETWAYS GMBH

Page 2: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

AGENDA

■  Introduction ■  Use case & Requirements ■  History ■  Today‘s Architecture ■  Configuration Management ■  Monitoring & Reporting ■  Coming up ■  Questions & Answers

Page 3: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

INTRODUCTION NETWAYS

•  Founded 1995 •  Open Source since 1997

•  40 Employees

•  Specialized in Open Source Systems Management and Open Source Datacenter Infrastructure

Searching for awesome people!

Page 4: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

NETWAYS COMPETENCIES

•  Monitoring & Reporting

•  Configuration Management

•  Service Management

•  Knowledge Management

•  Backup & Recovery

•  High Availability & Clustering

•  Cloud Computing

•  Load Balancing

•  Virtualization

•  Database Management

OPEN SOURCE SYSTEMS MANAGEMENT

OPEN SOURCE DATA CENTER

MANAGED SERVICES MONITORING HARDWARE CONFERENCES

Page 5: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

PuppetCamp 2013/2014 •  28th November Munich •  11th April Berlin •  CfP is still open

Open Source Datacenter Conference •  8th – 10th April 2014 •  125 Attendees (2012) •  Datacenter | Automation | DevOps •  CfP open until 31th December 2013

OpenNebulaConf 2014 •  opennebulaconf.com •  2nd – 4th December 2014 •  Berlin

NETWAYS CONFERENCES

Page 6: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

INTRODUCTION OPENNEBULA

Page 7: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

INTRODUCTION OPENNEBULA

Page 8: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

USE CASE & REQUIREMENTS

Page 9: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

USE CASE

Page 10: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

REQUIREMENTS

■  High Availability •  Automatic Failover

■  Flexible Resources •  Resource allocation and accounting •  Isolation of noisy neighbours

■  Independent Storage Architecture •  Persistent Images on existing technologies

■  Client isolation •  Networking •  Monitoring

Page 11: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

HISTORY

Page 12: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

ARCHITECTURE - 2007

100% BareMetal

Page 13: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

ARCHITECTURE - 2010

XEN

XEN

XEN

XEN

XEN

XEN

XEN

XEN

XEN

NFS on NetApp Filer

Page 14: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

ARCHITECTURE – 2010 - PROBLEMS

■  Missing overview •  Monitoring driven reboot •  Missing priorities •  No logic grouping on servers

■  XEN-Problems •  Kernel in Debian •  Sometimes compatibility issues with Dell-HW

■  No API •  Missing accounting •  Clear path for Puppet integration

XEN

XEN

XEN

XEN

XEN

XEN

XEN

XEN

XEN

NFS on NetApp Filer

Page 15: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

WHAT NOW?

OpenStack

OpenNebula

Nigel Beighton (Rackspace)

Page 16: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

DEPENDS ON THE PERSPECTIVE

■  Technical Guy •  There is a tool for every customer

■  Sales Guy •  There is a customer for every tool

Page 17: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

WHAT WE DID?

Page 18: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

TODAY’S ARCHITECTURE

Page 19: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

ARCHITECTURE - 2012

Page 20: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

ARCHITECTURE - 2012

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

NFS on NetApp Filer

Page 21: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

ARCHITECTURE – 2012- CHALLENGES

■  Failover •  Split-Brain situation

■  NetApp •  We want to get rid of it •  No financial scaling

■  Choosing the right filesystem •  OCFS2 sucks (sometimes) •  Ceph is nearly stable •  GlusterFS implementation is not (yet) ready

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

NFS on NetApp Filer

Page 22: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

ARCHITECTURE – 2012- SOLUTIONS

■  Pacemaker is controlling the stack •  Checking libvirt is important!

■  Stonith – if something looks creepy ■  Still working on NetAPP-NFS ■  GlusterFS seems to be good for now •  Working on better integration in ONE •  First tests are promising

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

NFS on NetApp Filer

Page 23: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

REPORTING & MONITORING

Page 24: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

MONITORING - ICINGA

Page 25: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

MONITORING - GRAPHING

Page 26: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

REPORTING & ACCOUNTING

Page 27: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

REPORTING & ACCOUNTING

Page 28: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

REPORTING & ACCOUNTING

Page 29: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

CONFIGURATION MANAGEMENT

Page 30: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

PUPPET

■  Puppet •  Configuration Management based on Ruby •  Life-Cylce-Management and Provisioning •  Live Management using MCollective

■  How it works •  Puppet DSL (Domain Specific Language) •  Abstracted through Resource Abstraction Layer •  Define -> Simulate -> Enforce - > Report

Page 31: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

PUPPET ENTERPRISE / FOREMAN

■  Puppet Enterprise •  Graphical Interface •  Great Live Management

■  Foreman •  Open Source interface for Puppet •  http://theforeman.org •  Great interface and additional features like •  Unattended Installation •  Integration of cloud frameworks

Page 32: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

FOREMAN – VIRT-HOSTS

Page 33: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

FOREMAN – PUPPET-CLASSES

Page 34: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

FOREMAN – PUPPET - LIFECYLE

Configuration (Hiera, PuppetDB)

Dry Run using MCollective

Continuous Testing

Merge Environm

ents

Final Test

Rollout

Page 35: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

FOREMAN – PUPPET - LOADBALANCER

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

NFS on NetApp Filer

LB 1 LB 2

Page 36: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

COMING UP

Page 37: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

WHAT’S NEXT?

■  Update OpenNebula to 4.2 ■  Using GlusterFS •  Did some first tests with new qemu-versions •  GlusterFS-Support since version 1.3

■  Fully automated provisioning of all systems including networking, backup and monitoring -> Software Defined Infrastructure

■  Kicking out NetApp-Filer ■  Adding new Nodes :-)

Page 38: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

QUESTIONS & ANSWERS

Page 39: OpenNebulaConf 2013 - OpenNebula in a Multi-Customer-Environment by Bernd Erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

NETWAYS GmbH Deutschherrnstrasse 15-19 90429 Nuremberg

Tel: +49 911 92885-0

Fax: +49 911 92885-77 Email: [email protected]

Website: www.netways.de Twitter: twitter.com/netways Facebook: facebook.com/netways

Blog: blog.netways.de

QUESTIONS & ANSWERS

THANK YOU

SEE YOU NEXT YEAR 2ND – 4TH

DECEMBER 2014


Top Related