Thread: [Moosefs-users] help

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 422-6466

Hi :

         I am programmer used c language. I want to add c interface in
moosefs , which used like lidhdfs of hadoop.

Could you give me some advice?

         thanks

Hi!

Please share with us where you would see the usage of such an interface? We
already have a mini-library for this but it is not very efficient. It would
need some additional mechanisms as read-ahead, etc. On the other hand FUSE
works nicely and smoothly, we are not sure there is really need for the
additional c library. 

If you would like to contribute to the project probably there would some
other issues you could take care of :)

Kind regards

Michał Borychowski 

MooseFS Support Manager

_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

Gemius S.A.

ul. Wołoska 7, 02-672 Warszawa

Budynek MARS, klatka D

Tel.: +4822 874-41-00

Fax : +4822 874-41-01

From: 夏亮 [mailto:xia...@zh...] 
Sent: Friday, August 06, 2010 4:41 AM
To: moo...@li...
Subject: [Moosefs-users] help

Hi :

         I am programmer used c language. I want to add c interface in
moosefs , which used like lidhdfs of hadoop.

Could you give me some advice?

         thanks

The whole communication with the master is on the level of i-nodes not paths. So the system has to have possibility to remap path on the i-node number. Generally most regular file systems under unix work this way.

CUTOMA_FUSE_LOOKUP finds i-node number which is a descendant of i-node number N and name Y (N, Y)->M.

For example to find i-node number of object “foo/has/bar” you need to make three LOOKUP operations:

1.       LOOKUP(1, “foo”)->X

2.       LOOKUP(X, “has”)->Y

3.       LOOKUP(Y, “bar”)->Z

And we know that object “foo/has/bar” has i-node number Z. 

Kind regards

Michał Borychowski 

MooseFS Support Manager

_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

Gemius S.A.

ul. Wołoska 7, 02-672 Warszawa

Budynek MARS, klatka D

Tel.: +4822 874-41-00

Fax : +4822 874-41-01

From: 夏亮 [mailto:xia...@zh...] 
Sent: Thursday, August 12, 2010 5:33 AM
To: 'Michał Borychowski'
Subject: 答复: [Moosefs-users] help

Hi!

I want to know when client CUTOMA_FUSE_LOOKUP data to master, what should be inode seted.

thanks

  _____  

发件人: Michał Borychowski [mailto:mic...@ge...] 
发送时间: 2010年8月10日 15:47
收件人: '夏亮'
抄送: moo...@li...
主题: RE: [Moosefs-users] help

Hi!

Please share with us where you would see the usage of such an interface? We already have a mini-library for this but it is not very efficient. It would need some additional mechanisms as read-ahead, etc. On the other hand FUSE works nicely and smoothly, we are not sure there is really need for the additional c library. 

If you would like to contribute to the project probably there would some other issues you could take care of :)

Kind regards

Michał Borychowski 

MooseFS Support Manager

_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

Gemius S.A.

ul. Wołoska 7, 02-672 Warszawa

Budynek MARS, klatka D

Tel.: +4822 874-41-00

Fax : +4822 874-41-01

From: 夏亮 [mailto:xia...@zh...] 
Sent: Friday, August 06, 2010 4:41 AM
To: moo...@li...
Subject: [Moosefs-users] help

Hi :

         I am programmer used c language. I want to add c interface in moosefs , which used like lidhdfs of hadoop.

Could you give me some advice?

         thanks

My mfs, the following error：
Appear in the client：
Dec 10 12:46:51 www mfsmount[2627]: file: 941671, index: 0, chunk: 3075082,
version: 1, cs: DEDE2069:9422 - readblock error (try counter: 1)
Dec 10 12:50:35 www mfsmount[2627]: file: 1657763, index: 0, chunk: 5236293,
version: 1 - writeworker: connection with (DEDE2069:9422) was timed out
(unfinished writes: 2; try counter: 1)
Dec 10 12:50:36 www mfsmount[2627]: file: 1657762, index: 0, chunk: 5236292,
version: 1 - writeworker: connection with (DEDE2069:9422) was timed out
(unfinished writes: 2; try counter: 1)
Dec 10 12:50:36 www mfsmount[2627]: file: 1657761, index: 0, chunk: 5236291,
version: 1 - writeworker: connection with (DEDE206A:9422) was timed out
(unfinished writes: 2; try counter: 1)
Dec 10 13:04:27 www mfsmount[2627]: readblock; tcpread error: Connection
timed out
Dec 10 13:04:27 www mfsmount[2627]: file: 447712, index: 0, chunk: 443587,
version: 1, cs: DEDE2069:9422 - readblock error (try counter: 1)
Dec 10 13:04:27 www mfsmount[2627]: readblock; tcpread error: Connection
timed out
Dec 10 13:04:27 www mfsmount[2627]: file: 447735, index: 0, chunk: 443610,
version: 1, cs: DEDE2069:9422 - readblock error (try counter: 1)
Dec 10 13:04:27 www mfsmount[2627]: readblock; tcpread error: Connection
timed out
Dec 10 13:04:27 www mfsmount[2627]: file: 447905, index: 0, chunk: 443780,
version: 1, cs: DEDE2069:9422 - readblock error (try counter: 1)
Dec 10 13:04:27 www mfsmount[2627]: readblock; tcpread error: Connection
timed out
Dec 10 13:04:27 www mfsmount[2627]: file: 447808, index: 0, chunk: 443683,
version: 1, cs: DEDE2069:9422 - readblock error (try counter: 1)

Who can help me？
Thanks

On messages have some wrong.Please tell me why? Thank you

Feb 28 13:05:22 hadoop-grid3-node33 mfsmount[5190]: file: 8, index: 0 - fs_writechunk returns status 11
Feb 28 13:05:22 hadoop-grid3-node33 mfsmount[5190]: file: 5, index: 0 - fs_writechunk returns status 11
Feb 28 13:05:22 hadoop-grid3-node33 mfsmount[5190]: file: 8, index: 0 - fs_writechunk returns status 11
Feb 28 13:05:23 hadoop-grid3-node33 mfsmount[5190]: file: 5, index: 0 - fs_writechunk returns status 11

With typing lessons ? 

-------Original Message------- 

From: Scoleri, Steven 

Date: 01/07/2010 12:20:50 

To: moo...@li... 

Subject: [Moosefs-users] help 

Thread: [Moosefs-users] help

Fault tolerant, POSIX-compliant, Net Distributed Storage / File System

moosefs-users