what is openstack trove? trove day 2014

August 19, 2014

OpenStack Trove Day

Nikhil Manchanda, Trove Project Technical Lead, HPDoug Shelley, VP of Product Development, Tesora

What is Trove?

Mission StatementTo provide scalable and reliable Cloud

Database as a Service provisioning functionality for both relational and non-

relational database engines, and to continue to improve its fully-featured and extensible open

source framework.

8/19/14 tesora.com 2

What is Trove?

• Service to provision and manage Databases in an OpenStack Cloud

• Integrated OpenStack Project

• Exposes APIs to• Provision Instances• Scale instance sizes (memory / cpu)• Scale storage size• Take backups of data• Manage databases/schemas• Manage db users and permissions


Cinder VolumeCinder VolumeCinder VolumeCinder Volume CinderCinderCinder VolumeCinder Volume

trove-apitrove-api

trove-conductortrove-conductor

trove-taskmanager

trove-taskmanager

Message Bus

Message Bus

NovaNovaCompute InstanceCompute InstanceGuest AgentGuest Agent

SwiftSwift

SQL/NoSQLSQL/NoSQL

BackupBackup

DataData

BackupBackupDB BackupDB Backup

DBDB

GlanceGlanceBackupBackupBackupBackupGuest ImageGuest Image

KeystoneKeystone

Nova-N

etworking/N

eutronN

ova-Netw

orking/Neutron

DataDataDataData

Trove Architecture

TroveTrove


Managing a Trove Database

• Create Database / Schema

• Create users

• Grant permissions to a User to a Schema

• Enable Root User

• Resize flavor

• Resize volume


Trove Backups

• Fully Managed

• Triggered and Tracked via API

• Streamed to Swift (OpenStack Object Storage)

• Incremental as well as Full backups

• Formats:• XtraBackup (Percona)• mysqldump


Trove is Tuned

• Automatically tune my.cnf by Flavor• Buffer Pool Size• Log file size• max_connections

• Sane defaults• InnoDB only• Disable load data infile• Disable select into outfile

• New API to programmatically set configuration groups


Trove is Secure

• Security Groups to manage Access

• Turn off SSH

• Remove anonymous user

• Remove non-localhost users

• Remove local file access

• Mangle root user password

• Apply security patches automatically


Features in Icehouse

Non Relational DB Types• Support for datastore type, and version

• Support for • Cassandra• MongoDB• Redis• Couchbase

• Currently only supports single instances


DNS Support

• Integration with Designate

• Provision Trove instances with DNS name


Configuration Groups

• Support for user defined configuration settings

• Supports defining certain mysql (my.cnf) settings

• Allow grouping settings, and targeting groups to instances


Heat Integration

• Support for configuration based “heat” mode

• Default heat templates for each datastore provided

• Supports user-defined custom heat templates per datastore


Incremental Backup / Restore

• No longer necessary to perform full backups every time

• Specify a “parent” backup in API call

• Leverages xtrabackup to perform incremental backup


Trove Conductor

• New component added to Trove Control Plane

• Guest no longer needs direct connection to the Trove DB

• Uses RPC messages to communicate with guest

• Supports heartbeat messages, and backup / restore checks


Miscellaneous

• Goodbye XML API

• Support for Tempest API tests

• Trove Deployment Guide


New in Juno

Replication

• Asynchronous mysql master-slave replication

• Support for new, and existing instances

• Ability to Promote / Detach Slave


Neutron Support

• Add Neutron NICs on instance create

• Support default Neutron Networks

• Horizon (Trove dashboard) enhancements


Configuration Groups Enhancements

• Configuration Groups per datastore and version

• Configuration Groups for MongoDB

• Configuration Groups Enhancements• Allow users to add descriptions to groups• Better schema-based validation for values


Datastore Improvements

• Associate flavors with datastores

• Initial Support for other datastores• PostgreSQL • Vertica


Enhancements to Backups

• Cross-region availability of backups

• Backup/restore for non-mysql datastores• Cassandra• Couchbase


Testing Enhancements

• More Tempest tests• Guest level API tests• Client tests• Scenario tests

• Support for Upgrade testing through Grenade


Miscellaneous

• Support for Capabilities

• Migrate to oslo.messaging

• Heat enhancements

• Improved Logging and Documentation


Replication in Trove


• Community decided on a versioned approach• First version is in Juno• Goal is to provide read replicas for MySQL• Subsequent releases will add more

capabilities:• Master-master• Failover• Multi-zone disaster recovery• Choice of replication strategies

Replication - Overview


• Launch slave from existing master• Slave bootstrapped with snapshot of master• Uses MySQL native asynch replication• Started from snapshot provided binlog position• Master can support many slaves• Replication is monitored; instance status

changes for delay or disconnect• Slaves can be promoted (i.e. detached from

Master)

Replication – Juno Capabilities

Replication DemoSneak preview of Tesora DBaaS Platform Enterprise Edition

Your Idea Here!

• Growing community of contributors

• Open to new ideas, and code

• Lots of room for improvement

• Find us at #openstack-trove on FreeNode.


Questions?

Thank You


what is openstack trove? trove day 2014

Software