introduction to software defined storage ceph and gluster: fudcon2015

20
Vikhyat Umrao [email protected] SME – Ceph and Gluster

Upload: vikhyat-umrao

Post on 19-Aug-2015

25 views

Category:

Technology


3 download

TRANSCRIPT

Page 1: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

Vikhyat Umrao [email protected]

SME – Ceph and Gluster

Page 2: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

Software Defined Storage - SDS

SDS is an approach to data storage in which the programming that controls storage releated tasks is decoupled from the pysical storage hardware.

Page 3: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

Software Defined Storage - SDS

Managed and automated by intelligent software as opposed to by the storage hardware itself.

SDS abstracts typically store functions such as raid, volume management, replication and snapshots from storage hardware and move these functions to software.

Page 4: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015
Page 5: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015
Page 6: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015
Page 7: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015
Page 8: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015
Page 9: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015
Page 10: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015
Page 11: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

What is GlusterFS?

A general purpose scale-out distributed file system.Aggregates storage exports over network interconnect to provide a single unified namespace.Filesystem is stackable and completely in userspace.Layered on disk file systems that support extended attributes.

Page 12: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

Typical GlusterFS Deployment

Global namespace

Scale-out storage building blocks

Supports thousands of clients

Access using GlusterFS native, NFS, SMB and HTTP protocols

Linear performance scaling

Page 13: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

GlusterFS Architecture – Foundations

Software only, runs on commodity hardware

No external metadata servers

Scale-out with Elasticity

Extensible and modular

Unified access

Largely POSIX compliant

Page 14: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

GlusterFS – Trusted Storage Pool

Trusted Storage Pool (cluster) is a collection of storage servers.Trusted Storage Pool is formed by invitation – “probe” a new member from the cluster and not vice versa.Membership information used for determining quorum.Members can be dynamically added and removed from the pool.

Page 15: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

GlusterFS – Trusted Storage Pool

Node1 Node2

Probe

Probe accepted

Node1 Node2

Node 1 and Node 2 are peers in a trusted storage pool

Page 16: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

GlusterFS – Bricks

A brick is the combination of a node and an export directory – for e.g. hostname:/dir

Each brick inherits limits of the underlying filesystem

No limit on the number bricks per node

Ideally, each brick in a cluster should be of the same size

Page 17: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

GlusterFS – Bricks

/export3

/export3

/export3

Storage Node

/export1

Storage Node

/export2

/export1

/export2

/export4

/export5

Storage Node

/export1

/export2

3 bricks 5 bricks 3 bricks

Page 18: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

GlusterFS - Volumes

Node2Node1 Node3

/export/brick1

/export/brick2

/export/brick1

/export/brick2

/export/brick1

/export/brick2

music

Videos

Page 19: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

GlusterFS - Volumes

Type of a volume is specified at the time of volume creation

Volume type determines how and where data is placed

Following volume types are supported in glusterfs:a) Distributeb) Stripec) Replicationd) Distributed Replicatee) Striped Replicatef) Distributed Striped Replicate

Page 20: Introduction to Software Defined Storage Ceph and Gluster: Fudcon2015

Q & A

Thank You