Re: [Moosefs-users] ??: I want use MFS , need help, thanks(tony cheng)

[yishi c. <hol...@gm...>]

the MFS can hold billions of file,and for each chunk ,in spite of it is
64MB ，*It contains more than one files*.until the total file size of one
single chunk reached 64MB.

however the MFS stored file information with *hash bucket*，the size of hash
table is 2^22.if you stored too many files, *the list of each hash unit
will be too long*，saying the list size will be more than 300，that will
cause some *lost on performance of mfs.*

for small files ,the TFS will be a good choice,*but you need to do some
coding work with TFS's client*

2012/5/21 <moo...@li...>

> Send moosefs-users mailing list submissions to
>        moo...@li...
>
> To subscribe or unsubscribe via the World Wide Web, visit
>        https://lists.sourceforge.net/lists/listinfo/moosefs-users
> or, via email, send a message with subject or body 'help' to
>        moo...@li...
>
> You can reach the person managing the list at
>        moo...@li...
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of moosefs-users digest..."
>
>
> Today's Topics:
>
>   1. Re: ??: I want use MFS ,need help,thanks (Ken)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Mon, 21 May 2012 11:57:34 +0800
> From: Ken <ken...@gm...>
> Subject: Re: [Moosefs-users] ??: I want use MFS ,need help,thanks
> To: gaoyafang <ga...@co...>
> Cc: moo...@li...
> Message-ID:
>        <CAJ...@ma...
> >
> Content-Type: text/plain; charset="utf-8"
>
> >> MFS support store many small files in one chunk (for example 64MB ) in
> the future?
> I do not think it should. (not officially)
>
> Did your read 'Solution of small file store' (
> http://sourceforge.net/mailarchive/message.php?msg_id=29244311).
>
>
> Sincerely
> -Ken
>
>
>
> On Mon, May 21, 2012 at 10:55 AM, gaoyafang <ga...@co...> wrote:
>
> > ****
> >
> > I want use MFS to store over billion small email files,average email file
> > size is 5K?****
> >
> > 64K block size seem too big,so want to test 4k block size.It is very
> > important for our project****
> >
> > MFS support store many small files in one chunk (for example 64MB ) in
> the
> > future?****
> >
> > ** **
> >
> > ****
> >
> > ** **
> >
> > *???:* Micha? Borychowski [mailto:mic...@co...]
> > *????:* 2012?4?17? 14:02
> > *???:* 'gaoyf'
> > *??:* moo...@li...
> > *??:* RE: [Moosefs-users] I want use MFS ,need help,thanks****
> >
> > ** **
> >
> > Hi!****
> >
> > 1. MySQL will run on MooseFS but probably not with the performance you
> > would expect. Or maybe you build SSD-based chunkservers.****
> >
> > 2. Chunk size as well as block size are hardcoded (
> > http://www.moosefs.org/moosefs-faq.html#modify_chunk) and really you
> > should not change its value in the code as it?s not that simple as just
> > changing one value.****
> >
> > Probably you are worried by losing space on the storage with bigger block
> > size. But have a look here:
> > http://www.moosefs.org/moosefs-faq.html#source_code - space lost is not
> > that big: ?project with 100,000 small files would consume at most 13GiB
> of
> > extra space due to this internal chunk fragmentation.?****
> >
> > Kind regards****
> >
> > Micha? Borychowski ****
> >
> > MooseFS Support Manager****
> >
> > ** **
> >
> > *From:* gaoyf [mailto:ga...@co...]
> > *Sent:* Monday, April 16, 2012 10:45 AM
> > *To:* moo...@li...
> > *Subject:* [Moosefs-users] I want use MFS ,need help,thanks****
> >
> > ** **
> >
> > Hello****
> >
> > I test  MFS in a project.I have two questions:****
> >
> > 1  Can run Mysql database on MFS?****
> >
> > 2  Can change MFS block size from 64KB to 4KB? I want use MFS to storage
> > many small files; I find *MFSBLOCKSIZE in *file ?MFSCommunication.h?,Can
> > change it?****
> >
> > ** **
> >
> > ** **
> >
> > ** **
> >
> > ** **
> >
> > <http://www.21cn.com/>
> >
> > ???
> > 21CN.COM  ????
> > ???????????????211?????????
> > ???510630
> > ???86-020-85115238
> > ???86-020-85115111
> > ???18926128676****
> >
> > ???ga...@co... ****
> >
> > ** **
> >
> >
> >
> ------------------------------------------------------------------------------
> > Live Security Virtual Conference
> > Exclusive live event will cover all the ways today's security and
> > threat landscape has changed and how IT managers can respond. Discussions
> > will include endpoint security, mobile security and the latest in malware
> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> > _______________________________________________
> > moosefs-users mailing list
> > moo...@li...
> > https://lists.sourceforge.net/lists/listinfo/moosefs-users
> >
> >
> -------------- next part --------------
> An HTML attachment was scrubbed...
> -------------- next part --------------
> A non-text attachment was scrubbed...
> Name: not available
> Type: image/gif
> Size: 3831 bytes
> Desc: not available
> -------------- next part --------------
> A non-text attachment was scrubbed...
> Name: not available
> Type: image/jpeg
> Size: 5675 bytes
> Desc: not available
>
> ------------------------------
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
>
> ------------------------------
>
> _______________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users
>
>
> End of moosefs-users Digest, Vol 29, Issue 23
> *********************************************
>