MogileFS - The Diigo Meta page

• 13 Aug 11
  

  Martin Menzel
• 27 Apr 11
  

  quartzo

  cluster distributed filesystem Linux OpenSource perl Software storage Imported from del.icio.us

• 05 Mar 11
  

  Błażej Gruszka

  linux filesystem

• 12 Jan 11
  

  Joost den Boer

  distributed filesystem

• 04 Dec 10
  

  Alex Yakovlev

  "MogileFS is our open source distributed filesystem. Its properties and features include:
  
  * Application level -- no special kernel modules required.
  * No single point of failure -- all three components of a MogileFS setup (storage nodes, trackers, and the tracker's database(s)) can be run on multiple machines, so there's no single point of failure. (you can run trackers on the same machines as storage nodes, too, so you don't need 4 machines...) A minimum of 2 machines is recommended.
  * Automatic file replication -- files, based on their "class", are automatically replicated between enough different storage nodes as to satisfy the minimum replica count as requested by their class. For instance, for a photo hosting site you can make original JPEGs have a minimum replica count of 3, but thumbnails and scaled versions only have a replica count of 1 or 2. If you lose the only copy of a thumbnail, the application can just rebuild it. In this way, MogileFS (without RAID) can save money on disks that would otherwise be storing multiple copies of data unnecessarily.
  * "Better than RAID" -- in a non-SAN RAID setup, the disks are redundant, but the host isn't. If you lose the entire machine, the files are inaccessible. MogileFS replicates the files between devices which are on different hosts, so files are always available.
  * Flat Namespace -- Files are identified by named keys in a flat, global namespace. You can create as many namespaces as you'd like, so multiple applications with potentially conflicting keys can run on the same MogileFS installation.
  * Shared-Nothing -- MogileFS doesn't depend on a pricey SAN with shared disks. Every machine maintains its own local disks.
  * No RAID required -- Local disks on MogileFS storage nodes can be in a RAID, or not. It's cheaper not to, as RAID doesn't buy you any safety that MogileFS doesn't already provide.
  * Local filesystem agnostic -- Local disks on MogileFS storage nodes can be formatted with your filesystem of choice (ext3, XFS, etc..). Mo

  opensource linux file system distributed cluster software storage

• 03 Dec 10
  

  Graham Perrin

  2010 2010-12 2010-12-03 distributed file system

  • MogileFS
  • open source
  • distributed filesystem

  • MogileFS is not:

      
     
    • POSIX Compliant

  2 more annotations...

• 22 Jun 10
  

  Pedro Ângelo

  MogileFS is an open source distributed filesystem

• 17 May 10
  

  memcached 만든 사람이 만들었다.

  filesystem opensource delicious

• 19 Apr 10
  

  ahenobarbi

  filesystem distributed storage Linux foss software tools

• 03 Mar 10
  

  Raphael Rousseau

  filesystem distributed linux opensource software cluster mogilefs storage

• 29 Jan 10
  

  Alexandre Verri

  opensource scalability clustering distributed mogilefs filesystems filesystem fs

• 28 Jan 10
  

  Bez Thomas

  MogileFS is our open source distributed filesystem.

  filesystem distributed storage linux opensource cluster software

• 25 Jan 10
  

  arjenvrielink

  filesystem distributed storage linux mogilefs scalability cluster

• 23 Jan 10
  

  thattommyhall

  filesystem backblaze for:john@johnleach.co.uk

• 18 Jan 10
  

  Zoltan Szasz

  userspace fs mogilefs distributed filesystem

• 04 Jan 10
  

  dave parker
• 02 Jan 10
  

  Gabriel Gasparolo

  imported Barra_de_marcadores Tools OpenSource_&_Freeware Development filesystem distributed storage linux opensource cluster software

• 22 Dec 09
  

  Pablo Nussembaum

  filesystem distributed storage opensource cluster mogilefs scalability

• 15 Dec 09
  

  Jordi Varela

  opensource linux software filesystem storage network distributed ops

• 

  karim guirguis

  storage opensource filesystem

• 

  Mark Leyden

  filesystem distributed storage linux opensource

• 07 Dec 09
  

  Tassos Pavlakos

  opensource distributed filesystem cluster storage linux software

• 02 Dec 09
  

  Marcin Kasperski

  mogilefs cluster filesystem distributed storage performance scalability

• 01 Dec 09
  

  T B

  MogileFS used by Last.fm for their streaming servers. It is an open-source distributed file system, which is a little bit like a software RAID system.
  
  MogileFS is our open source distributed filesystem. Its properties and features include:
  
  * Application level -- no special kernel modules required.
  * No single point of failure -- all three components of a MogileFS setup (storage nodes, trackers, and the tracker's database(s)) can be run on multiple machines, so there's no single point of failure. (you can run trackers on the same machines as storage nodes, too, so you don't need 4 machines...) A minimum of 2 machines is recommended.
  * Automatic file replication -- files, based on their "class", are automatically replicated between enough different storage nodes as to satisfy the minimum replica count as requested by their class. For instance, for a photo hosting site you can make original JPEGs have a minimum replica count of 3, but thumbnails and scaled versions only have a replica count of 1 or 2. If you lose the only copy of a thumbnail, the application can just rebuild it. In this way, MogileFS (without RAID) can save money on disks that would otherwise be storing multiple copies of data unnecessarily.
  * "Better than RAID" -- in a non-SAN RAID setup, the disks are redundant, but the host isn't. If you lose the entire machine, the files are inaccessible. MogileFS replicates the files between devices which are on different hosts, so files are always available.
  * Flat Namespace -- Files are identified by named keys in a flat, global namespace. You can create as many namespaces as you'd like, so multiple applications with potentially conflicting keys can run on the same MogileFS installation.
  * Shared-Nothing -- MogileFS doesn't depend on a pricey SAN with shared disks. Every machine maintains its own local disks.
  * No RAID required -- Local disks on MogileFS storage nodes can be in a RAID, or not. It's cheaper not to, as RAID doesn't buy you any safety that MogileFS doesn't already p

  filesystem distributed linux storage mogilefs software cluster last.fm

• 20 Nov 09
  

  rieman bren

  distributed storage linux opensource cluster software sysadmin mogilefs filesystem scalability delicious

• 30 Oct 09
  

  Damon Snyder

  filesystem distributed opensource mogilefs

• 28 Oct 09
  

  scmoral

  MogileFS is our open source distributed filesystem. Its properties and features include:

  filesystem distributed storage linux cluster scalability hadoop

• 21 Oct 09
  

  Christian Winkler

  filesystem replication

• 13 Oct 09
  

  Radoslaw Tomaszewski

  filesystem distributed storage linux cluster mogilefs replication raid san architecture last.fm_company

• 03 Oct 09
  

  erikhogan
  • all three components of a MogileFS setup
  • Automatic file replication
  • their class. For instance, for a photo hosting site you can make original JPEGs have a minimum replica count of 3, but thumbnails and scaled versions only have a replica count of 1 or 2. If you lose the only copy of a thumbnail, the application can just rebuild it. In this way, MogileFS (without RAID) can save money on disks that would otherwise be storing multiple copies of data unnecessarily.

  1 more annotation...

• 01 Oct 09
  

  simon pasquier

  distributed linux opensource cluster software Perl scalability

• 24 Sep 09
  

  Robert Boyd

  storage filesystem mogilefs perl distributed cluster software linux sysadmin opensource

• 11 Sep 09
  

  mel pullen

  distributed storage opensource cluster software server mogilefs filesystem

• 04 Sep 09
  

  enachb

  distributed storage linux opensource cluster scalability digg

• 18 Aug 09
  

  joe phantom

  tools programming software linux development opensource unix web scalability sysadmin network networking server backup system filesystems file perl storage cluster distributed database filesystem performance mogilefs architecture fs clustering scaling rai

• 02 Aug 09
  

  alex madon

  mogilefs distributed filesystem

• 09 Jul 09
  

  mccraig mccraig

  distrib

  distributed filesystem computer programming reliable

• 20 Jun 09
  

  John Chen

  MogileFS FS

• 03 Jun 09
  

  Simon Gianoutsos

  Opensource distributed filesystem

  opensource storage distributed filesystem

• 23 May 09
  

  rawwell

  ""Better than RAID" -- in a non-SAN RAID setup, the disks are redundant, but the host isn't. If you lose the entire machine, the files are inaccessible. MogileFS replicates the files between devices which are on different hosts, so files are always availa

  scalability checkitout

• 22 May 09
  

  wuduoyi

  storage distributed

• 18 May 09
  

  Germán Moltó

  filesystem cloud

• 07 May 09
  

  wei deng

  distributed file storage mogilefs perl

• 22 Apr 09
  

  Pierre L

  according to @otisg , better than Hadoop for a distributed filesystem.

  web database server cluster storage linux architecture file system distributed scalability filesystem

• 20 Apr 09
  

  jean-christophe zulian

  linux fs filesystem storage redundant

• 02 Apr 09
  

  Van Tran

  filesystem distributed storage mogilefs cluster sysadmin distributedfilesystem

• 18 Mar 09
  

  cezarm

  MogileFS is our open source distributed filesystem.

  opensource software sysadmin linux storage distributed cluster perl mogilefs filesystem viaDelicious

• 12 Mar 09
  

  alfred westerveld
• 04 Mar 09
  

  thesuffixed

  scalability

• 03 Mar 09
  

  Andrew T
• 23 Feb 09
  

  Di Ci

  MogileFS is our open source distributed filesystem.

  filesystem distributed storage linux software opensource cluster lang_en

• 15 Feb 09
  

  Daniel CAUNE

  distributed filesystem linux

• 12 Jan 09
  

  feng bo

  mogilefs distributed

• 22 Dec 08
  

  李 华顺

  MogileFS 一个开源的分布式文件系统。

  distributed performance opensource

• 16 Dec 08
  

  benpjohnson

  web unix system tools

• 13 Dec 08
  

  Kenzo Okamura

  software network server linux storage filesystems mogilefs raid fs filesystem distributed scalability clustering cluster

• 03 Dec 08
  

  cchaulk

  filesystem storage

• 23 Nov 08
  

  nealrichter

  scaling tools memcached filesystem

• 18 Nov 08
  

  Alexandre Mclean

  scalability storage filesystem distributed opensource

• 18 Oct 08
  

  Charleno Pires

  sysadmin scaling server storage system tools

• 07 Oct 08
  

  Hamada Kazunori

  web unix sysadmin storage software server system tools filesystem perl

• 05 Oct 08
  

  Vivus Ignis

  distributed fs (raid-over-net)

  fs

• 30 Sep 08
  

  Mike Chelen

  open source distribute file system

• 16 Sep 08
  

  pierreaubert

  storage distributed filesystem

• 10 Sep 08
  

  virkang fds

  storage cluster distributed opensource delicious

• 02 Sep 08
  

  qexing
• 25 Jul 08
  

  matthieu bozec

  filesystem distributed storage cluster

• 16 Jul 08
  

  Cui Yingjie

  filesystem distributed storage cluster linux opensource software mogilefs

• 14 Jul 08
  

  filesystem distributed storage cluster linux opensource software mogilefs

• 09 Jul 08
  

  Guang Chen

  opensource

• 06 Jul 08
  

  Sergey Anufrienko

  filesystem distributed storage cluster mogilefs

• 22 Jun 08
  

  Matt Vance
• 05 May 08
  

  alex perl

  filesystem

• 01 May 08
  

  dvainsencher

  cluster loadbalance distributed filesystem for:ramalho for:rbp

• 15 Apr 08
  

  Bin Li

  opensource software distributed programming filesystem

  • MogileFS is our open source distributed filesystem
• 21 Mar 08
  

  M R

  Filesystem GoogleFS Skalowalność Software

• 18 Mar 08
  

  mishzu

  distributed storage filesystem mogilefs

• 23 Feb 08
  

  frankalcantara

  cluster database filesystem sysadmin

• 18 Feb 08
  

  Alejandro Sánchez

  filesystems

• 14 Feb 08
  

  Eamonn O'Brien-Strain

  The distributed file system originally developed for LiveJournal.

  architecture deployment library

• 04 Feb 08
  

  numard

  filesystem distributed storage linux clustering opensource software perl architecture application

• 

  Daniel D

  GFS like OS

  distributedOS

• 14 Dec 07
  

  Pedro Trindade

  filesystem distributed storage linux opensource cluster software perl

• 29 Nov 07
  

  Stanton Teters

  An open source distributed filesystem.

  open-source backup software-architecture hosting development filesystem performance delicious-import

• 28 Nov 07
  

  zeroeth

  linux filesystem

• 13 Nov 07
  

  Craig Andrew

  emc

• 01 Nov 07
  

  Andrew Gilmartin

  MogileFS is our open source distributed filesystem

  distributed filesystem todo

• 31 Oct 07
  

  linekin

  distributed file system

• 02 Oct 07
  

  Boris Smus

  architecture database development linux storage cluster

• 20 Sep 07
  

  Hendy Irawan

  MogileFS is our open source distributed filesystem. Its properties and features include:
  
  * Application level -- no special kernel modules required.
  * No single point of failure -- all three components of a MogileFS setup (storage nodes, trackers,

  admin application architecture archive article code backup computer software perl cluster storage distributed filesystem opensource linux

• 04 Sep 07
  

  Mark Gibbons

  distributed file nfs

• 18 Aug 07
  

  ajmonteiro

  filesystem distributed storage opensource development

• 30 Jun 07
  

  W.W. Webster

  server-side computing perl webdev linux swtools sysAdmin

  • MogileFS is our open source distributed filesystem.
• 29 May 07
  

  Alejandro Moreno

  GFS Linux gpl

• 25 May 07
  

  filesystem linux opensource software

• 15 May 07
  

  Bosse Klykken

  filesystem architecture cluster linux opensource storage tools sysadmin highavailablitity readme cloud

• 30 Apr 07
  

  Chris Grant

  filesystem distributed storage linux opensource software perl cluster

• 24 Apr 07
  

  Chu Yeow Cheah

  remote filesystem linux

• 21 Apr 07
  

  Gerardo Lisboa

  filesystem distributed storage Linux opensource software cluster server

• 16 Apr 07
  

  ellecer

  cluster filesystem storage distributed

Page Comments

• 
  sciphex on 2006-06-25
  MogileFS is a distributed filesystem that enables the easy creation and maintenance of a network of computers that maintain one congruous self-replicating filesystem.
• 
  Zhe sto on 2006-07-25
  open source distributed filesystem
• 
  Pistos Christou on 2006-11-03
  MogileFS is a distributed filesystem that enables the easy creation and maintenance of a network of computers that maintain one congruous self-replicating filesystem.
• 
  Graham Perrin on 2010-12-03
  MogileFS mentioned at http://blog.crowdflower.com/2008/07/amazons-s3-web-service-our-1-cause-of-failure/#comment-364

Would you like to comment?

Join Diigo for a free account, or sign in if you are already a member.