GlusterFS is a distributed file-system capable of scaling to several peta-bytes. It aggregates various storage bricks over Infiniband RDMA or TCP/IP into one large parallel network file system. Storage bricks can be made of any commodity hardware such as x86-64 server with SATA RAID, and can use Infiniband HBAs'.
Ceph is a distributed network file system designed to provide excellent performance, reliability, and scalability. Ceph fills two significant gaps in the array of currently available file systems:
1. Robust, open-source distributed storage — Ceph is released under the terms of the LGPL, which
... [More] means it is free software (as in speech and beer). Ceph will provide a variety of key features that are generally lacking from existing open-source file systems, including seamless scalability (the ability to simply add disks to expand volumes), intelligent load balancing, and efficient, easy to use snapshot functionality.
2. Scalability — Ceph is built from the ground up to seamlessly and gracefully scale from gigabytes to petabytes and beyond. Scalability is considered in terms of ... [Less]
DRBD is a block device which is designed to build high availability clusters. This is done by mirroring a whole block device via (a dedicated) network. You could see it as a network raid-1.
Lustre is a scalable, secure, robust, highly-available cluster file system. Lustre is consistently used by 60% or more of the Top100 largest HPC systems in the world, and has been for over 15 years. It is also used by NVIDIA and many other organizations for their largest AI training and inference
... [More] workloads. It is developed by a variety of contributors around the world, from organizations like Ddn/Whamcloud, HPE, Amazon, NVIDIA, Google, Microsoft, and many others. [Less]
LizardFS – Software Defined Storage is a distributed, scalable, fault-tolerant and highly available file system. It allows users to combine disk space located on several servers into a single name space which is visible on Unix-like and Windows systems in the same way as other file systems. LizardFS
... [More] makes files secure by keeping all the data in many replicas spread over all available servers. It can be used also to build an affordable storage, because it runs without any problems on commodity hardware. [Less]
Gfarm file system is a network shared file system that supports scalable I/O performance in distributed environment. It can federate local disks of network-connected PCs and compute nodes in several clusters.
EOS is a software solution that aims to provide fast and reliable multi-PB disk-only storage technology for both LHC and non-LHC use-cases at CERN. The core of the implementation is the XRootD framework which provides feature-rich remote access protocol. The storage system is running on commodity
... [More] hardware with disks in JBOD configuration. It is written mostly in C/C++, with some of the extra modules in Python. Files can be accessed via native XRootD protocol, a POSIX-like FUSE client or HTTP(S) & WebDav protocols. [Less]
This site uses cookies to give you the best possible experience.
By using the site, you consent to our use of cookies.
For more information, please see our
Privacy Policy