www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
OPENNEBULACONF – 25TH OCTOBER 2013
OPENNEBULA IN A MULTI- CUSTOMER ENVIRONMENT
BERND ERK | NETWAYS GMBH
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
AGENDA
■ Introduction ■ Use case & Requirements ■ History ■ Today‘s Architecture ■ Configuration Management ■ Monitoring & Reporting ■ Coming up ■ Questions & Answers
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
INTRODUCTION NETWAYS
• Founded 1995 • Open Source since 1997
• 40 Employees
• Specialized in Open Source Systems Management and Open Source Datacenter Infrastructure
Searching for awesome people!
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
NETWAYS COMPETENCIES
• Monitoring & Reporting
• Configuration Management
• Service Management
• Knowledge Management
• Backup & Recovery
• High Availability & Clustering
• Cloud Computing
• Load Balancing
• Virtualization
• Database Management
OPEN SOURCE SYSTEMS MANAGEMENT
OPEN SOURCE DATA CENTER
MANAGED SERVICES MONITORING HARDWARE CONFERENCES
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
PuppetCamp 2013/2014 • 28th November Munich • 11th April Berlin • CfP is still open
Open Source Datacenter Conference • 8th – 10th April 2014 • 125 Attendees (2012) • Datacenter | Automation | DevOps • CfP open until 31th December 2013
OpenNebulaConf 2014 • opennebulaconf.com • 2nd – 4th December 2014 • Berlin
NETWAYS CONFERENCES
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
INTRODUCTION OPENNEBULA
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
INTRODUCTION OPENNEBULA
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
USE CASE & REQUIREMENTS
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
USE CASE
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
REQUIREMENTS
■ High Availability • Automatic Failover
■ Flexible Resources • Resource allocation and accounting • Isolation of noisy neighbours
■ Independent Storage Architecture • Persistent Images on existing technologies
■ Client isolation • Networking • Monitoring
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
HISTORY
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
ARCHITECTURE - 2007
100% BareMetal
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
ARCHITECTURE - 2010
XEN
XEN
XEN
XEN
XEN
XEN
XEN
XEN
XEN
NFS on NetApp Filer
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
ARCHITECTURE – 2010 - PROBLEMS
■ Missing overview • Monitoring driven reboot • Missing priorities • No logic grouping on servers
■ XEN-Problems • Kernel in Debian • Sometimes compatibility issues with Dell-HW
■ No API • Missing accounting • Clear path for Puppet integration
XEN
XEN
XEN
XEN
XEN
XEN
XEN
XEN
XEN
NFS on NetApp Filer
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
WHAT NOW?
OpenStack
OpenNebula
Nigel Beighton (Rackspace)
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
DEPENDS ON THE PERSPECTIVE
■ Technical Guy • There is a tool for every customer
■ Sales Guy • There is a customer for every tool
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
WHAT WE DID?
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
TODAY’S ARCHITECTURE
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
ARCHITECTURE - 2012
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
ARCHITECTURE - 2012
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
NFS on NetApp Filer
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
ARCHITECTURE – 2012- CHALLENGES
■ Failover • Split-Brain situation
■ NetApp • We want to get rid of it • No financial scaling
■ Choosing the right filesystem • OCFS2 sucks (sometimes) • Ceph is nearly stable • GlusterFS implementation is not (yet) ready
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
NFS on NetApp Filer
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
ARCHITECTURE – 2012- SOLUTIONS
■ Pacemaker is controlling the stack • Checking libvirt is important!
■ Stonith – if something looks creepy ■ Still working on NetAPP-NFS ■ GlusterFS seems to be good for now • Working on better integration in ONE • First tests are promising
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
NFS on NetApp Filer
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
REPORTING & MONITORING
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
MONITORING - ICINGA
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
MONITORING - GRAPHING
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
REPORTING & ACCOUNTING
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
REPORTING & ACCOUNTING
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
REPORTING & ACCOUNTING
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
CONFIGURATION MANAGEMENT
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
PUPPET
■ Puppet • Configuration Management based on Ruby • Life-Cylce-Management and Provisioning • Live Management using MCollective
■ How it works • Puppet DSL (Domain Specific Language) • Abstracted through Resource Abstraction Layer • Define -> Simulate -> Enforce - > Report
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
PUPPET ENTERPRISE / FOREMAN
■ Puppet Enterprise • Graphical Interface • Great Live Management
■ Foreman • Open Source interface for Puppet • http://theforeman.org • Great interface and additional features like • Unattended Installation • Integration of cloud frameworks
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
FOREMAN – VIRT-HOSTS
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
FOREMAN – PUPPET-CLASSES
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
FOREMAN – PUPPET - LIFECYLE
Configuration (Hiera, PuppetDB)
Dry Run using MCollective
Continuous Testing
Merge Environm
ents
Final Test
Rollout
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
FOREMAN – PUPPET - LOADBALANCER
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
NFS on NetApp Filer
LB 1 LB 2
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
COMING UP
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
WHAT’S NEXT?
■ Update OpenNebula to 4.2 ■ Using GlusterFS • Did some first tests with new qemu-versions • GlusterFS-Support since version 1.3
■ Fully automated provisioning of all systems including networking, backup and monitoring -> Software Defined Infrastructure
■ Kicking out NetApp-Filer ■ Adding new Nodes :-)
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
QUESTIONS & ANSWERS
www.netways.de // blog.netways.de // @netways
We love Open Source #opennebulaconf
NETWAYS GmbH Deutschherrnstrasse 15-19 90429 Nuremberg
Tel: +49 911 92885-0
Fax: +49 911 92885-77 Email: [email protected]
Website: www.netways.de Twitter: twitter.com/netways Facebook: facebook.com/netways
Blog: blog.netways.de
QUESTIONS & ANSWERS
THANK YOU
SEE YOU NEXT YEAR 2ND – 4TH
DECEMBER 2014