Re: [Kosmosfs-users] KosmosFS vs HDFS

[Sriram R. <sri...@gm...>]

While both are functionally equivalent, there are some differences
between KFS and HDFS (HDFS as of today):
 - in HDFS, files are visible only on close; in KFS this isn't the case
   -- impact: for DB commit logs, HDFS makes it hard.  you write a
commit log record and then close the file; this has the downside of
creating lots of small files in the system.
 - HDFS doesn't have a sync() call; KFS does
 - Performance differences: I am currently trying do some
benchmarking; will get back to you in a week or so.

Aside...just as HDFS works with Hadoop for map-reduce, so too does
KFS; we have integrated KFS as a layer in the Hadoop filesystem
interfaces.

Sriram

On Mon, Feb 25, 2008 at 1:43 PM, David Carter <da...@ca...> wrote:
> Can someone provide some guidelines on when someone would choose to
>  use KosmosFS vs Hadoop's HDFS?
>
>  Are there significant functional differences that would cause someone
>  to choose one over the other for a specific application?
>
>  Are there significant performance differences? My gut reaction is that
>  C++ is better suited than Java for developing a distributed file
>  system, but I'm wondering if there are any performance measurements to
>  back this up, preferably benchmarks run on the same cluster?
>
>  --
>  David Carter
>  da...@ca...
>
>  -------------------------------------------------------------------------
>  This SF.net email is sponsored by: Microsoft
>  Defy all challenges. Microsoft(R) Visual Studio 2008.
>  http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
>  _______________________________________________
>  Kosmosfs-users mailing list
>  Kos...@li...
>  https://lists.sourceforge.net/lists/listinfo/kosmosfs-users
>