Siram,

Can you send this tests for me?

thanks.

On Wed, Oct 22, 2008 at 8:18 AM, <kosmosfs-devel-request@lists.sourceforge.net> wrote:
Send Kosmosfs-devel mailing list submissions to
       kosmosfs-devel@lists.sourceforge.net

To subscribe or unsubscribe via the World Wide Web, visit
       https://lists.sourceforge.net/lists/listinfo/kosmosfs-devel
or, via email, send a message with subject or body 'help' to
       kosmosfs-devel-request@lists.sourceforge.net

You can reach the person managing the list at
       kosmosfs-devel-owner@lists.sourceforge.net

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Kosmosfs-devel digest..."


Today's Topics:

  1. Re: KFS-0.2.2 patch for FreeBSD (Sriram Rao)
  2. Re: KFS-0.2.2 patch for FreeBSD (Sriram Rao)
  3. tech talk video (Sriram Rao)
  4. Metaserver performance (Moreframe)
  5. Re: Metaserver performance (Sriram Rao)
  6. Is there a roadmap of kfs development? (xiaozhu)
  7. Re: Is there a roadmap of kfs development? (Sriram Rao)
  8. About KFS_FUSE (Tong-Hong Kuo)


----------------------------------------------------------------------

Message: 1
Date: Mon, 6 Oct 2008 10:35:29 -0700
From: "Sriram Rao" <sriramsrao@gmail.com>
Subject: Re: [Kosmosfs-devel] KFS-0.2.2 patch for FreeBSD
To: " ??? " <yghan88@gmail.com>
Cc: kosmosfs-devel@lists.sourceforge.net,       kosmosfs-users
       <kosmosfs-users@lists.sourceforge.net>
Message-ID:
       <c9690f720810061035g385389canb1dae452aa92a99@mail.gmail.com>
Content-Type: text/plain; charset=GB2312

Hello,

Thanks for the patch. This is great.  I'll test this out on a FreeBSD
box and get it checked in.

Sriram

2008/10/6 ??? <yghan88@gmail.com>:
> I have compiled the KFS-0.2.2 on the FreeBSD6.1 and FreeBSD7.0, gcc version is >= 4.2.1
> The patch file is kfs-freebsd.patch, you can find it in the attachment!
>
> patch -s -p1 -d kfs-0.2.2 < kfs-freebsd.patch
>
>
> I mainly modify one bug(src/cc/libkfsIO/TcpSocket.cc:134): When we do a non-blocking connect,
> then call connect and it wil return EAGAIN on FreeBSD platform.
>
> Now, I have added "FreeBSD" preprocessor definitions in the cmake and source files
>
>
> yghan88@gmail.com
> 2008-10-06
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Kosmosfs-devel mailing list
> Kosmosfs-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/kosmosfs-devel
>
>

------------------------------

Message: 2
Date: Mon, 6 Oct 2008 10:35:29 -0700
From: "Sriram Rao" <sriramsrao@gmail.com>
Subject: Re: [Kosmosfs-devel] KFS-0.2.2 patch for FreeBSD
To: " ??? " <yghan88@gmail.com>
Cc: kosmosfs-devel@lists.sourceforge.net,       kosmosfs-users
       <kosmosfs-users@lists.sourceforge.net>
Message-ID:
       <c9690f720810061035g385389canb1dae452aa92a99@mail.gmail.com>
Content-Type: text/plain; charset=GB2312

Hello,

Thanks for the patch. This is great.  I'll test this out on a FreeBSD
box and get it checked in.

Sriram

2008/10/6 ??? <yghan88@gmail.com>:
> I have compiled the KFS-0.2.2 on the FreeBSD6.1 and FreeBSD7.0, gcc version is >= 4.2.1
> The patch file is kfs-freebsd.patch, you can find it in the attachment!
>
> patch -s -p1 -d kfs-0.2.2 < kfs-freebsd.patch
>
>
> I mainly modify one bug(src/cc/libkfsIO/TcpSocket.cc:134): When we do a non-blocking connect,
> then call connect and it wil return EAGAIN on FreeBSD platform.
>
> Now, I have added "FreeBSD" preprocessor definitions in the cmake and source files
>
>
> yghan88@gmail.com
> 2008-10-06
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Kosmosfs-devel mailing list
> Kosmosfs-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/kosmosfs-devel
>
>

------------------------------

Message: 3
Date: Fri, 17 Oct 2008 21:21:06 -0700
From: "Sriram Rao" <sriramsrao@gmail.com>
Subject: [Kosmosfs-devel] tech talk video
To: kosmosfs-users <kosmosfs-users@lists.sourceforge.net>,
       kosmosfs-devel@lists.sourceforge.net
Message-ID:
       <c9690f720810172121w64a4b6e0j1d3839b0c39fc936@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1

Hi,

I was at Hadoop User Group y'day.  I presented about a recent move our
big cluster. I also talked a bit how we use KFS in our cluster.

http://developer.yahoo.net/blogs/hadoop/2008/10/hadoop_user_group_meeting.html

Sriram



------------------------------

Message: 4
Date: Sun, 19 Oct 2008 20:09:57 +0800
From: Moreframe <moreframe@gmail.com>
Subject: [Kosmosfs-devel] Metaserver performance
To: kosmosfs-users@lists.sourceforge.net,
       kosmosfs-devel@lists.sourceforge.net,   moreframe@gmail.com
Message-ID:
       <36e843290810190509i6747fea4m4e9a63f97361a543@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi, Sriram,

Do you have any performance data about Metaserver, like number of concurrent
requests. The reason raise the issue is this can be a performance factor to
say what capacity the KFS can provide, such as how many chunkserver can
support and how many concurrent user access can handle.

Specificially, following is the items:
1. maximum number of concurrent access requests
2. maximum number of chunkserver supported


Thanks
-Simon
-------------- next part --------------
An HTML attachment was scrubbed...

------------------------------

Message: 5
Date: Sun, 19 Oct 2008 10:00:38 -0700
From: "Sriram Rao" <sriramsrao@gmail.com>
Subject: Re: [Kosmosfs-devel] Metaserver performance
To: Moreframe <moreframe@gmail.com>
Cc: kosmosfs-devel@lists.sourceforge.net,
       kosmosfs-users@lists.sourceforge.net
Message-ID:
       <c9690f720810191000u2067f1belc984bd7a96505370@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1

Hi,

I don't have specific #'s..but our deployment:
 - metaserver handles ~600 chunkservers
 - metaserver handles ~3000 clients
The CPU use on the metaserver is very low...( < 8%).

Sriram

On Sun, Oct 19, 2008 at 5:09 AM, Moreframe <moreframe@gmail.com> wrote:
> Hi, Sriram,
>
> Do you have any performance data about Metaserver, like number of concurrent
> requests. The reason raise the issue is this can be a performance factor to
> say what capacity the KFS can provide, such as how many chunkserver can
> support and how many concurrent user access can handle.
>
> Specificially, following is the items:
> 1. maximum number of concurrent access requests
> 2. maximum number of chunkserver supported
>
>
> Thanks
> -Simon
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great
> prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Kosmosfs-devel mailing list
> Kosmosfs-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/kosmosfs-devel
>
>



------------------------------

Message: 6
Date: Mon, 20 Oct 2008 20:54:01 +0900
From: xiaozhu <xiaozhu@gmail.com>
Subject: [Kosmosfs-devel] Is there a roadmap of kfs development?
To: kosmosfs-devel@lists.sourceforge.net
Message-ID: <48FC7159.6030509@gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed

Hi,

 I want to know is there a roadmap of the development?

xzer



------------------------------

Message: 7
Date: Tue, 21 Oct 2008 09:47:10 -0700
From: "Sriram Rao" <sriramsrao@gmail.com>
Subject: Re: [Kosmosfs-devel] Is there a roadmap of kfs development?
To: xiaozhu <xiaozhu@gmail.com>
Cc: kosmosfs-devel@lists.sourceforge.net
Message-ID:
       <c9690f720810210947m77e19505l7a33fae998c7d54@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1

Hi,

The current roadmap for at least the next 3 months:

 - add a "warm" standby for the metaserver.  This is to provide HA for
the metaserver
 - telemetry service for working around slow nodes. When the KFS
client sees a slow read/write, it notifies a telemetry server; this
server then propogates this info to all the clients in the system.
WHen reading from a node, the client tries to avoid nodes determined
to be slow. We have started some work in this direction.  We'll
continue to expand this.
 - shift some of the non-critical operations to the backup metaserver.
 For example, block rebalancing can be initiated by the backup server.
 - performance and stability improvements in general.

If there are other things you'd like to see added, let us know.

Sriram

On Mon, Oct 20, 2008 at 4:54 AM, xiaozhu <xiaozhu@gmail.com> wrote:
> Hi,
>
>  I want to know is there a roadmap of the development?
>
> xzer
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Kosmosfs-devel mailing list
> Kosmosfs-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/kosmosfs-devel
>



------------------------------

Message: 8
Date: Wed, 22 Oct 2008 17:30:24 +0800
From: Tong-Hong Kuo <kth@ftp.isu.edu.tw>
Subject: [Kosmosfs-devel] About KFS_FUSE
To: kosmosfs-devel@lists.sourceforge.net
Message-ID: <48FEF2B0.10408@ftp.isu.edu.tw>
Content-Type: text/plain; charset="utf-8"

Dear Sir,

I have patched kfs_fuse for my works and test it in many cases.
1. OK      create large files(4G+) with dd
2. OK      edit files with vim
3. OK      read large files with dd (only works with -o direct_io option)
4. FAILED  open more than 500 file descriptors

Case 4 will cause kfs_fuse to leak memory. I know kfs_fuse isn't a good way
to do large amounts of I/O. But it can help me serve static files by web
servers
directly. Do anyone have good ideas for this? Thanks.

make options for compiler:
make -j3 -e "_FILE_OFFSET_BITS=64"
-------------- next part --------------
A non-text attachment was scrubbed...
Name: kfs_fuse.diff
Type: text/x-diff
Size: 2423 bytes
Desc: not available

------------------------------

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/

------------------------------

_______________________________________________
Kosmosfs-devel mailing list
Kosmosfs-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/kosmosfs-devel


End of Kosmosfs-devel Digest, Vol 5, Issue 3
********************************************



--
Vinicius Tinti -> vtintipo@gmail.com

"Here Goes Nothing"
"Beware of bugs in the above code; I have only proved it correct, not tried it."
"Only those who attempt the absurd can achieve the impossible."