percona + grafana + prometheus = lovewhy prometheus data model •any number of key-value pairs...

26
© 2016 Percona 1 Peter Zaitsev Percona + Grafana + Prometheus = Love How We Integrate Grafana with Prometheus for Easy MySQL and MongoDB Monitoring CEO, Percona GrafanaCon 30 November 2016, NYC

Upload: others

Post on 25-May-2020

16 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona1

Peter Zaitsev

Percona + Grafana + Prometheus = LoveHow We Integrate Grafana with Prometheus for Easy MySQL and MongoDB Monitoring

CEO, PerconaGrafanaCon30 November 2016, NYC

Page 2: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona2

About Percona

We Exist to help you to succeed with MySQL and MongoDB

Page 3: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona3

Support Broad Ecosystem

Percona Server for

MySQLMySQL MariaDB

AWS for MySQL and

Aurora

MongoDBPercona

Server for MongoDB

Google CloudSQL

Page 4: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona4

Percona Software – 100% Open Source

Percona Server for MySQL

Percona Server for MongoDB

Percona XtraDBCluster

Percona Xtrabackup

Percona Toolkit Percona

Monitoring and Management

Page 5: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona5

Services

• Support

• More than Support (Percona Care)

• Managed Services (Percona Care Ultimate)

• Consulting

Page 6: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona6

We resolve complex Data Layer problems

We need deep insights into Database Operation

Page 7: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona7

Existing Solutions are

Commercial

•MySQL Enterprise Monitor

•MongoDB Ops Manager

•MonYog

Cloud Only

•VividCortex

•DataDog

•NewRelic

Page 8: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona8

Open Source Solutions

Great Components exist

Need to put together for complete solution

Typically Lacks Depth in Database Insights

Page 9: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona9

Our Requirements

Free and Open Source Solution

In The Cloud and on Premises

Easy to Install

Monitor Development and Production

Page 10: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona10

Modern Systems: Well Defined Roles

Data Capture

Storage and Processing

Visualization

Page 11: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona11

Data Capture “Telemetry”

Requirements

• High Level of Details

• Low Overhead

• Support for your technology

Solutions

• Statsd

• Collectd

• Prometheus Exporters

• InfluxDB Telegraf

• Intel Snap

Page 12: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona12

Storage and Processing

Requirements

• High Performance (ingest and queries)

• Efficient Storage

• Powerful Query Language

Solutions

• OpenTSB

• InfluxDB

• Prometheus

• ElasticSearch

• Graphite (Whisper)

• Riak TS

Page 13: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona13

Visualization/Dashboards

Requirements

•Visualization/Usability

•Support Multiple Sources

•Extensibility

Technologies

•Chronograf

•Kibana

•Graphite

•Grafana

Page 14: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona14

What Makes Grafana Special

Grafana does not focus on data capture or storage

Focus on Visualization only

Supports Plugins

Supports Multiple Data Sources

Integrates with Other visualization tools (Graphite, OpenNMS, Zabbix)

Greatest momentum in the Community

Page 15: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona15

Why Prometheus

Data Model

• Any number of Key-Value Pairs

• Great for complex relationships in Database World

Query Language

• Very Expressive

• Custom designed for problem space

• Operates on the whole “data universe”

Efficiency

• High Ingestion Speeds

• High Compression

• Excellent compression

Page 16: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona16

Grafana+Prometheus+Custom=PMM

Note: Name is futureproof, currently doing Monitoring not Management

Page 17: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona17

PMM at Glance

Easy to use Monitoring Solution for MySQL and MongoDB

100% Free and Open Source

Using Best in Class components as Grafana and Prometheus

Custom Percona Development for Query Insights

Page 18: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona18

Inside PMM

Page 19: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona19

For the User ?

Get Docker Container for “Server Part”

Install the “Agent” on MySQL or MongoDB Servers

Point the agent to the right server location

Page 20: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona20

Insights on Operating Systems layer

Page 21: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona21

Insights on MySQL Layer

Page 22: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona22

Find What queries are causing load

Page 23: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona23

Why are they causing this load

Page 24: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona24

… And How to Fix Them

Page 25: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

© 2016 Percona25

Find out More

• Talk to us at the Booth

• Check out our live demo http://pmmdemo.percona.com

Page 26: Percona + Grafana + Prometheus = LoveWhy Prometheus Data Model •Any number of Key-Value Pairs •Great for complex relationships in Database World Query Language •Very Expressive

DATABASE PERFORMANCE

MATTERSDatabase Performance MattersDatabase Performance MattersDatabase Performance MattersDatabase Performance MattersDatabase Performance Matters