MooseFS

MooseFS

This GFS (Google FS, not the RedHat thingy) like storage implementation is my current way of tackling the problem of distributing all the data that I will need to store, without having to devise my own solution – but why would I want to?! It is awesome!

It is well worth a look if you need to distribute data across many machines for performance, scalability or both!

A snippet from the MooseFS site:

MooseFS is a fault tolerant, network distributed file system. It spreads data over several physical servers which are visible to the user as one resource. For standard file operations MooseFS acts as other Unix-alike file systems:

  • A hierarchical structure (directory tree)
  • Stores POSIX file attributes (permissions, last access and modification times)
  • Supports special files (block and character devices, pipes and sockets)
  • Symbolic links (file names pointing to target files, not necessarily on MooseFS) and hard links (different names of files which refer to the same data on MooseFS)
  • Access to the file system can be limited based on IP address and/or password

Distinctive features of MooseFS are:

  • High reliability (several copies of the data can be stored across separate computers)
  • Capacity is dynamically expandable by attaching new computers/disks
  • Deleted files are retained for a configurable period of time (a file system level “trash bin”)
  • Coherent snapshots of files, even while the file is being written/accessed
  • Leave a Reply