webinar: management and automation of mariadb galera clusters
DESCRIPTION
This webinar was presented at 30. September 2014 by MariaDB and Severalnines. Speakers: Ralf Gebhardt, Jean-Jérôme Schmidt and Vinay JooseryTRANSCRIPT
© MariaDB Corpora,on Ab
Management & Automa,on of MariaDB Galera Clusters
Vinay Joosery, CEO -‐ [email protected]
Jean-‐Jérôme Schmidt, VP Marke,ng -‐ [email protected] Ralf Gebhardt, Sales Engineer -‐ [email protected]
* * 02.10.14 1
© MariaDB Corpora,on Ab
Agenda
• Introduc,on • MariaDB Galera Cluster Essen,als • Partner presenta,on: Severalnines • MariaDB Enterprise and MariaDB Enterprise Cluster
02.10.14 2
© MariaDB Corpora,on Ab
About MariaDB Corpora,on
● Home for the founders and original developers of the core of MySQL
● Home for the commercial offering of MariaDB
● Provides support and services for MySQL and derived databases like MariaDB
● Flagship product is MariaDB Enterprise: It includes support, tools and services for MariaDB
02.10.14 3
mariadb.com
© MariaDB Corpora,on Ab
Data Redundancy with MariaDB
• MariaDB Internal Replica,on • Asynchronous • Semi-‐Synchronous • Storage based redundancy (Ac,ve/Passive) • DRBD (Distributed Replicated Block Device) • SAN (Storage Area Network) • VMWare replica,on • MariaDB Galera Cluster
02.10.14 4
© MariaDB Corpora,on Ab
HA using MariaDB Replica,on
• This is in many cases a good enough solu,on, but it has some issues
• The cluster is very loosely coupled, not all nodes are aware of all the other nodes for example
• Replica,on is asynchronous, so failing over is more difficult than usually
• Adding a slave is difficult
02.10.14 5
© MariaDB Corpora,on Ab
MariaDB Galera Cluster Architecture
• MariaDB Galera Cluster is a so_ware-‐only solu,on with many advantages
• No failover requirements -‐ the nodes are all ac,ve and are all masters
• “Proper” Cluster with built-‐in failover, locking and split-‐brain protec,on
• Synchronous replica,on with low overhead due to op,mis,c locking
• Automated online add node • No applica,on change scale out
02.10.14 6
© MariaDB Corpora,on Ab
HA using MariaDB Replica,on
02.10.14 7
MariaDB Galera Cluster
MariaDB Server MariaDB Server MariaDB Server
Galera wsrep Library Galera wsrep Library Galera wsrep Library
Synchronous Replication
Load Balancer / Failover
Application / Application Server
© MariaDB Corpora,on Ab
Secng up MariaDB Galera Cluster
• MariaDB Galera Cluster consists of the MariaDB binary that in turns talks to the Galera wsrep library
• Once set up, Galera is configured using the usual my.cnf file, and is monitored / managed per node using SHOW GLOBAL STATUS and SHOW GLOBAL VARIABLES commands
02.10.14 8
Confidential
Automation and Management of Database Clusters
September 30, 2014
Vinay Joosery & Jean-Jérôme Schmidt
Severalnines
Confidential
Agenda
¤ Database Infrastructure Lifecycle ¤ Deploy, Monitor, Manage, Scale
¤ ClusterControl Overview
¤ Introducing ClusterControl 1.2.8
¤ Live Demo
10
Copyright Severalnines AB
Confidential
Database Infrastructure Lifecycle
11
Copyright 2013 Severalnines AB
Confidential
Database TCO
12
Copyright Severalnines AB
Source: IDC, Maximizing the Business Value of Enterprise Database Applications
Confidential
Infrastructure Lifecycle
13
Copyright 2012 Severalnines AB
Manage Scale
Monitor Deploy
Confidential
Deployment - Beyond Puppet or Chef
¤ Puppet/Chef are appropriate for a group of single-node components ¤ E.g. web servers can be clones of each other..
¤ Distributed databases are complex ¤ Different node types & roles
¤ Orchestration of procedures in a specific order
¤ Using e.g. Chef for deploying a distributed database ¤ Yes, it is possible
¤ Not much Chef functionality is leveraged
¤ Prepare to write code
14
Copyright Severalnines AB
Confidential
Monitoring - Beyond Nagios
¤ What do you do when the application is slow?
¤ Is it Disk? CPU? RAM? Badly written queries?
¤ What are the symptoms? (Replication queues, Page Faults, locks, # connections, …)
¤ How do you avoid problems?
¤ How do you plan for capacity?
15
Copyright Severalnines AB
Confidential
Management - Beyond Monitoring
16
Copyright Severalnines AB
Confidential
Scaling - Beyond Manual Operations
17
Copyright 2012 Severalnines AB
Confidential
ClusterControl Overview
18
Copyright 2013 Severalnines AB
Confidential
ClusterControl In a nutshell
19
Copyright 2012 Severalnines AB
Manage Scale
Monitor Deploy
Confidential
Supported Databases
SQL
¤ MariaDB Cluster
¤ MySQL Galera Cluster (Codership)
¤ Percona XtraDB Cluster
¤ MySQL Cluster (NDB)
¤ MySQL Replication – with GTID
¤ Standalone MySQL/MariaDB
NoSQL
¤ MongoDB Sharded Cluster
¤ MongoDB Replica Set
¤ TokuMX Cluster
Copyright Severalnines AB
20
Confidential
ClusterControl Automation & Management
¤ Provisioning ¤ Deploy a cluster in minutes
¤ On-premises or in the cloud (AWS & OpenStack)
¤ Monitoring ¤ Systems view
¤ 1sec resolution
¤ DB / OS stats & performance advisors
¤ Configurable dashboards
¤ Query Analyzer
¤ Real-time / historical
21
Copyright Severalnines AB
Confidential
ClusterControl Automation & Management
¤ Management ¤ Multi cluster/data-center
¤ Automate repair/recovery
¤ Database upgrades
¤ Backups
¤ Configuration management
¤ Cloning
¤ One-click scaling
22
Copyright Severalnines AB
Confidential
Getting Started
¤ Dedicated VM for the controller
¤ Specs ¤ 2 CPU cores ¤ 2-4GB RAM ¤ 20GB diskspace
¤ No agents ¤ Host stats gathered via SSH
¤ Installation ¤ YUM/APT ¤ Setup SSH access to DB nodes
23
Copyright Severalnines AB
Confidential
Example Architecture
24
Copyright Severalnines AB
Confidential 25
Copyright 2013 Severalnines AB
Confidential
Introducing ClusterControl 1.2.8
26
Copyright 2013 Severalnines AB
Confidential
ClusterControl 1.2.8 - Highlights ¤ YUM/APT repositories for ClusterControl
¤ Deployment and scaling of single-node MySQL, MariaDB and MongoDB
¤ Alerts and incident tracking with PagerDuty
¤ Unified Event Viewer
¤ New flexible alarms/email notification system
¤ Audit logging - Administrator activity tracking
¤ Global MySQL User Management
¤ New default dashboards for MySQL/MariaDB
¤ Puppet Module for ClusterControl
¤ Improved LDAP support for Active Directory and FreeIPA
27
Copyright Severalnines AB
Confidential
Deployment of single-node MariaDB, MySQL & MongoDB
¤ Deploy single DB nodes
¤ Scale into clusters with a single click
28
Copyright Severalnines AB
Confidential
Alert & Incident Tracking: PagerDuty Integration
¤ Integrate ClusterControl alerting with PagerDuty
¤ Add phone and SMS alerting to ClusterControl
29
Copyright Severalnines AB
Confidential
Cluster-Wide MariaDB / MySQL User Management
¤ Easily create MySQL users across multiple clusters,
¤ Manage all privileges
30
Copyright Severalnines AB
Confidential
New Default Dashboards for MariaDB & MySQL ¤ InnoDB IO - shows IO read/write stats for InnoDB
¤ Query Performance - for queries such as table scans and joins without indexes
¤ Galera Flow Control - shows the replication performance
31
Copyright Severalnines AB
Confidential
Demo
32
Copyright 2013 Severalnines AB
Confidential
Customers
33
Copyright Severalnines AB
Confidential
Thank You!
¤ Cluster Configurator ¤ www.severalnines.com/config
¤ ClusterControl ¤ www.severalnines.com/clustercontrol
¤ Severalnines Blog ¤ www.severalnines.com/blog
¤ Contact: jj@severalnines
34
© MariaDB Corpora,on Ab
Full product and service offering for MariaDB and MySQL available today
• MariaDB & MySQL Server
• MySQL compa,ble
• Fully open source
• Feature enhanced
• Galera Cluster
• NoSQL compa,ble (Cassandra, LevelDB)
• Tools for MariaDB & MySQL
• Monitor, manage, backup
• High availability
• Cloud deployment
• Clients for Java and C
• Services for MariaDB & MySQL
• Opera,ons support
• Developer support
• Consul,ng, training, remote DBA
02.10.14 35
Enterprise Subscrip,ons Annually renewed bundle of DB tools and services
MariaDB/MySQL Server
Services Tools
© MariaDB Corpora,on Ab
MariaDB Enterprise Subscrip,on Offers
02.10.14 36
MariaDB Enterprise MariaDB Enterprise Cluster
Summary Powerful enterprise data management. Highly available database cluster for the most demanding use cases.
Supported Database Pla?orms
● MariaDB (Included) ● MySQL ● Percona XtraDB
● MariaDB Galera Cluster (Included) ● MySQL + Galera ● Percona XtraDB Cluster
Comprehensive Benefits: ● 30 min. support response ● Unlimited incidents ● Updates and bug fixes ● Security patches ● Advice, hot-‐fixes ● InstallaMon, configuraMon help ● Email, web, remote login ● Exclusive content ● Roadmaps ● OpMonal enterprise products ● OpMonal services including
Remote DBA, ConsulMng, Training, NRE
✔ ✔
Included Third-‐party Products
● Monitoring: MONyog ● Query Editor: SQLyog ● Backup: XtraBackup, Zmanda Backup
● Cluster Deployment, Management & Monitoring : SeveralNines ClusterControl
● Monitoring: MONyog ● Query Editor: SQLyog ● Backup: XtraBackup, Zmanda Backup
© MariaDB Corpora,on Ab
Ques,ons?
www.mariadb.com www.facebook.com/mariadb.dbms
www.twiker.com/mariadb