alcestor moosefs brochure

4
MooseFS Enterprise High Performance & Fault Tolerant Parallel File System MooseFS Enterprise is a fault-tolerant distributed parallel file system designed from the ground up for extremely demanding data workloads, offering exceptional perfor- mance, high availability and scalability. MooseFS Enterprise features a SPOF-less configuration, metadata redundancy, and distributed user data. Plus, it scales linearly with your data all the way up to 16 exabytes on a single cluster.

Upload: others

Post on 18-Apr-2022

7 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Alcestor MooseFS Brochure

MooseFS EnterpriseHigh Performance & Fault Tolerant Parallel File System

MooseFS Enterprise is a fault-tolerant distributed parallel file system designed from the ground up for extremely demanding data workloads, offering exceptional perfor-mance, high availability and scalability. MooseFS Enterprise features a SPOF-less configuration, metadata redundancy, and distributed user data. Plus, it scales linearly with your data all the way up to 16 exabytes on a single cluster.

Page 2: Alcestor MooseFS Brochure

Why MooseFS EnterpriseBig Data presents a myriad of potential opportunities for every organization to gain insights, find new opportunities, reduce costs and generate more profit and revenue. Of course, Big Data also presents a big challenge: storage for the billions of files that are being gener-ated, stored, and retrieved all the time. In many cases, cloud is the answer, but sometimes you just want to use your own hardware solution.

Do you store a lot of mission critical data? Does your data need to be stored more securely? Do you need an on-site storage solution?

MooseFS Enterprise by GIGABYTE and Alcestor, an enterprise version of the open source distributed file system MooseFS could be the perfect solution.

MooseFS Enterprise intelligently assigns data to numerous servers, thereby creating one virtually unlimited storage space, available like an ordinary hard drive with a POSIX compliant file system. MooseFS Enterprise keeps data redundant and safe for decades, with uninterrupted access, featuring data protection using redundant copies or 8+N erasure coding algorithms (RAID 5 extension), and saves your time with minimal maintenance and parallel data access. MooseFS Enterprise also saves you money with less hard disks required thanks to erasure coding, and different storage tiers possible using different disk types.

How It WorksMooseFS Enterprise distributes data in parallel over a virtually unlimited number of servers that act as one disk to the client devices accessing it. A MooseFS Enterprise storage cluster is comprised of Master and Chunk Servers. The Master servers hold file metadata, while the Chunk Servers redundantly store chunks of data. The Leader Master manages the Chunk Servers, ensuring data is always available or recovered should any Chunk Servers fail. In the event a Leader server fails, the Chunk Servers will “elect” a new Leader from the remaining Follower Master servers. This is how the system self-heals and maintains data integrity.

Page 3: Alcestor MooseFS Brochure

MooseFS Enterprise FeaturesHigh Performance• Store up to 16 exabytes and more than 2 billion files on a single cluster• High throughput across multiple storage nodes• Parallelism—performs all I/O operations in parallel threads of executions to deliver high readwrite operations perfor-

mance• Compute on nodes efficiently uses idle CPU, GPU and memory resources for low-latency data processing and storage

on same machine• Direct drive mounts means a significant performance boot over traditional RAID arrays— each chunk server creates a

mount-point for each drive, allowing MooseFS to intelligently decide how data is written to individual drives• Native clients and MooseFS (MFS) protocol - dedicated client component for Linux, FreeBSD, and Mac OS X systems

for max performance• Pre-fetch and read-ahead algorithms enhance HDD disk cluster performance—improves stream-like cluster access

patterns including storing and serving video files, logging, etc.

High Availability and Reliability• Runs as single file system volume, no matter the cluster size• SPOF-less configuration (no single point of failure)• Metadata redundancy with two or more raw copies on physically redundant master servers for rapid recovery• Distributed user data - data divided into “chunks” and redundantly spread across storage servers• Transparent automatic failover - the system instantly initiates parallel data replication from redundant copies to other

resources• Fast disk recovery - as little as 15 minutes for a 1 TB drive• Cyclic redundancy checks - each chunk of data in a cluster is followed by CRC to assure 100% consistency

Competitive TCO• Completely hardware- and OS-agnostic - mix existing and new hardware for a cost effective solution• Erasure coding using error correction code algorithms (with up to 9 parity sums) ensures redundancy on less raw

space• POSIX compliance - meets IEEE-specified standards that define uniform APIs for Unix-like operating systems, mean-

ing no need to replace existing architecture

Easy Deployment• Software-defined storage solution that you can set up in less than 30 minutes• Use turnkey appliances available from GIGABYTE • On-the-fly upgrades - one node at a time - means zero downtime

Security and Management• Granular quota limits and storage policies enable full control over how data is stored• Access control based on a standard Unix access control lists (ACLs) model• Global trash makes it easy to recover accidentally deleted data• Rich set of admin tools: command-line, web-based, and SNMP-based interfaces• Advanced storage policies and tiering:

- Tier between unlimited number of storage pools like HPC and archive- Files automatically moved between storage tiers based on triggers set by admin

Advanced Features• Atomic snapshots provide instantaneous, uninterrupted provisioning of the file system at any point in time - ideal for

online backup solutions• Access storage with any major industry-standard protocol for file access including SMB, NFS, FTP, and HTTP• Ethernet-based network (1, 10, 40, 100, or 200 GB/s) used for all the communication with support for LACP configura-

tions

Page 4: Alcestor MooseFS Brochure

2019/10 V1.0

www.gigabyte.com @GIGABYTESERVER GIGABYTEgigabyteserver

MooseFS Turnkey Appliance SpecificationsMASTER SERVER (Meta-Data Server)2 Master Servers are standard in any cluster

CPU

Memory

Data / OS + Application Disks

Networking

Master Server: R181-2A0 1 x Intel Xeon 5222

6 x 32GB DDR4

6 x 2.5" 256GB SSD with software RAID 10

2 x 40Gb/s port LAN

MooseFS Turnkey Appliance Example Configuration

CHUNK SERVER (Storage Server)There is a minimum of 3 Chunk Servers of any combination in a cluster and no maximum

Raw Capacity

Usable Capacity

CPU

Memory

Data Disks

OS + Application Disks

Networking

Raw Capacity

Usable Capacity

CPU

Memory

Data Disks

OS + Application Disks

Networking

Small Chunk Server: R281-3C1

Large Chunk Server: S451-3R0

144TB

72TB*

1 x Intel Xeon 4216

6 x 8GB DDR4 RAM

12 x 3.5" 12TB SAS HDD for data storage

2 x 2.5" 256GB SSD with software RAID 1

2 x 10Gb/s port LAN

432TB

216TB*

1 x Intel Xeon 4216

6 x 16GB DDR4 RAM

36 x 3.5"12TB SAS HDD for data storage

2 x 2.5" 512GB SSD with software RAID 1

2 x 40Gb/s port LAN

Raw Capacity

Usable Capacity*

Required Rack Space

Hardware Configuration

432TB

216TB

8U

2 x R181-2A03 x R281-3C1

720TB

360TB

10U

2 x R181-2A01 x S451-3R02 x R281-3C1

1PB

500TB

12U

2 x R181-2A02 x S451-3R01 x R281-3C1

1.295PB

648TB

14U

2 x R181-2A03 x S451-3R0

2.592PB

1.296PB

26U

2 x R181-2A06 x S451-3R0

3.456PB

1.728PB

34U

2 x R181-2A08 x S451-3R0

All intellectual property rights, including without limitation to copyright and trademark of this work and its derivative works are the property of, or are licensed to, GIGA-BYTE TECHNOLOGY CO., LTD. Any unauthorized use is strictly prohibited.The entire materials provided herein are for reference only. GIGABYTE reserves the right to modify or revise the content at anytime without prior notice.All other brands, logos and names are property of their respective owners.

GIGABYTE TECHNOLOGY CO., LTD.

* Default; usable capacity can be adjusted by the user according to data replication configuration

* Default; usable capacity can be adjusted by the user according to data replication configuration