From: <ha...@si...> - 2011-04-21 12:03:42
|
i have some doubts,now ,please answer me : problem one: About MooseFS,i had asked the question : what size does it support the single file? and what size about the total numbers of file?? and your answer is: "Limit of 2TiB is for a single file. There is no limit for the total size of all files in the system. " and today,your reply is "if it supports 3000 million files? We would need about 3 000 * 300 MB = 878 GB of RAM which would be rather impossible."and today's answer conflict with that statement(e.g."no limit for the total size of all files in the system"). please tell me ,for 300 million files, what size is the RAM that we need in the system???, as you say,it needs 87 GB of RAM,or "no limit"????? That's all ,thanks a lot! Sincerely look forward to your reply! Best regards! Hanyw |
From: Michal B. <mic...@ge...> - 2011-04-21 12:09:40
|
Hi! There is (theoretically) no limit for the number of files in the system. For 300 million files you’ll need: 300 * 300 MB = 87.8 GB of RAM Best regards Michal Borychowski From: ha...@si... [mailto:ha...@si...] Sent: Thursday, April 21, 2011 2:03 PM To: moo...@li... Subject: [Moosefs-users] i have some doubts,now ,please answer me i have some doubts,now ,please answer me : problem one: About MooseFS,i had asked the question : what size does it support the single file? and what size about the total numbers of file?? and your answer is: "Limit of 2TiB is for a single file. There is no limit for the total size of all files in the system. " and today,your reply is "if it supports 3000 million files? We would need about 3 000 * 300 MB = 878 GB of RAM which would be rather impossible."and today's answer conflict with that statement(e.g."no limit for the total size of all files in the system"). please tell me ,for 300 million files, what size is the RAM that we need in the system???, as you say,it needs 87 GB of RAM,or "no limit"????? That's all ,thanks a lot! Sincerely look forward to your reply! Best regards! Hanyw |
From: Fyodor U. <uf...@uf...> - 2011-04-21 12:14:26
|
On 04/21/2011 03:09 PM, Michal Borychowski wrote: > > Hi! > > There is (theoretically) no limit for the number of files in the system. > > For 300 million files you’ll need: 300 * 300 MB = 87.8 GB of RAM > Michal, whether or not reasonable to use the swap in such cases? All the files are not simultaneously used, and some information about them can be moved to swap? > Best regards > > Michal Borychowski > > *From:*ha...@si... [mailto:ha...@si...] > *Sent:* Thursday, April 21, 2011 2:03 PM > *To:* moo...@li... > *Subject:* [Moosefs-users] i have some doubts,now ,please answer me > > > i have some doubts,now ,please answer me : > > problem one: About MooseFS,i had asked the question : what size does > it support the single file? and what size about the total numbers of > file?? > and your answer is: > "Limit of 2TiB is for a single file. There is no limit for the total > size of all files in the system. " > > and today,your reply is "if it supports 3000 million files? We would > need about 3 > 000 * 300 MB = 878 GB of RAM which would be rather impossible."and > today's answer conflict with that statement(e.g."no limit for the > total size of all files in the system"). > please tell me ,for 300 million files, what size is the RAM that we > need in the system???, as you say,it needs 87 GB of RAM,or "no > limit"????? > > > > > > That's all ,thanks a lot! > > Sincerely look forward to your reply! > > > > Best regards! > > Hanyw > > > ------------------------------------------------------------------------------ > Benefiting from Server Virtualization: Beyond Initial Workload > Consolidation -- Increasing the use of server virtualization is a top > priority.Virtualization can reduce costs, simplify management, and improve > application availability and disaster protection. Learn more about boosting > the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev > > > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users |
From: Michal B. <mic...@ge...> - 2011-04-21 12:25:49
|
Hi! We let the system to manage swap usage. There are some plans to further optimize metadata, but for the moment we do not interfere with the swap on the level of MooseFS. Regards Michal From: Fyodor Ustinov [mailto:uf...@uf...] Sent: Thursday, April 21, 2011 2:14 PM To: Michal Borychowski Cc: moo...@li... Subject: Re: [Moosefs-users] i have some doubts,now ,please answer me On 04/21/2011 03:09 PM, Michal Borychowski wrote: Hi! There is (theoretically) no limit for the number of files in the system. For 300 million files you’ll need: 300 * 300 MB = 87.8 GB of RAM Michal, whether or not reasonable to use the swap in such cases? All the files are not simultaneously used, and some information about them can be moved to swap? Best regards Michal Borychowski From: ha...@si... [mailto:ha...@si...] Sent: Thursday, April 21, 2011 2:03 PM To: moo...@li... Subject: [Moosefs-users] i have some doubts,now ,please answer me i have some doubts,now ,please answer me : problem one: About MooseFS,i had asked the question : what size does it support the single file? and what size about the total numbers of file?? and your answer is: "Limit of 2TiB is for a single file. There is no limit for the total size of all files in the system. " and today,your reply is "if it supports 3000 million files? We would need about 3 000 * 300 MB = 878 GB of RAM which would be rather impossible."and today's answer conflict with that statement(e.g."no limit for the total size of all files in the system"). please tell me ,for 300 million files, what size is the RAM that we need in the system???, as you say,it needs 87 GB of RAM,or "no limit"????? That's all ,thanks a lot! Sincerely look forward to your reply! Best regards! Hanyw ---------------------------------------------------------------------------- -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
From: Steve <st...@bo...> - 2011-04-21 12:40:28
|
or part ram part swap ? -------Original Message------- From: Michal Borychowski Date: 21/04/2011 13:10:05 To: ha...@si... Cc: moo...@li... Subject: Re: [Moosefs-users] I have some doubts,now ,please answer me Hi! There is (theoretically) no limit for the number of files in the system. For 300 million files you’ll need: 300 * 300 MB = 87.8 GB of RAM Best regards Michal Borychowski From: ha...@si... [mailto:ha...@si...] Sent: Thursday, April 21, 2011 2:03 PM To: moo...@li... Subject: [Moosefs-users] I have some doubts,now ,please answer me I have some doubts,now ,please answer me : problem one: About MooseFS,I had asked the question : what size does it support the single file? and what size about the total numbers of file?? and your answer is: "Limit of 2TiB is for a single file. There is no limit for the total size of all files in the system. " and today,your reply is "if it supports 3000 million files? We would need about 3 000 * 300 MB = 878 GB of RAM which would be rather impossible."and today's answer conflict with that statement(e.G."no limit for the total size of all files in the system"). please tell me ,for 300 million files, what size is the RAM that we need in the system???, as you say,it needs 87 GB of RAM,or "no limit"????? That's all ,thanks a lot! Sincerely look forward to your reply! Best regards! Hanyw |
From: Michal B. <mic...@ge...> - 2011-04-21 12:45:23
|
Yes, yes :) And best quick swap on SSD :) Regards Michal -----Original Message----- From: Steve [mailto:st...@bo...] Sent: Thursday, April 21, 2011 2:40 PM To: ha...@si...; Michał Borychowski Cc: moo...@li... Subject: Re: [Moosefs-users] i have some doubts,now ,please answer me or part ram part swap ? -------Original Message------- From: Michal Borychowski Date: 21/04/2011 13:10:05 To: ha...@si... Cc: moo...@li... Subject: Re: [Moosefs-users] I have some doubts,now ,please answer me Hi! There is (theoretically) no limit for the number of files in the system. For 300 million files you’ll need: 300 * 300 MB = 87.8 GB of RAM Best regards Michal Borychowski From: ha...@si... [mailto:ha...@si...] Sent: Thursday, April 21, 2011 2:03 PM To: moo...@li... Subject: [Moosefs-users] I have some doubts,now ,please answer me I have some doubts,now ,please answer me : problem one: About MooseFS,I had asked the question : what size does it support the single file? and what size about the total numbers of file?? and your answer is: "Limit of 2TiB is for a single file. There is no limit for the total size of all files in the system. " and today,your reply is "if it supports 3000 million files? We would need about 3 000 * 300 MB = 878 GB of RAM which would be rather impossible."and today's answer conflict with that statement(e.G."no limit for the total size of all files in the system"). please tell me ,for 300 million files, what size is the RAM that we need in the system???, as you say,it needs 87 GB of RAM,or "no limit"????? That's all ,thanks a lot! Sincerely look forward to your reply! Best regards! Hanyw |
From: Davies L. <dav...@gm...> - 2011-04-21 16:50:34
|
MooseFS was designed for large file storage, if you have so many small files, you should choose another solutions, just like beansdb[1] or Riak [2]. [1] http://code.google.com/p/beansdb/ [2] http://wiki.basho.com/ 在 2011-4-21,下午8:03, ha...@si... 写道: > > i have some doubts,now ,please answer me : > > problem one: About MooseFS,i had asked the question : what size does it support the single file? and what size about the total numbers of file?? > and your answer is: > "Limit of 2TiB is for a single file. There is no limit for the total size of all files in the system. " > > and today,your reply is "if it supports 3000 million files? We would need about 3 > 000 * 300 MB = 878 GB of RAM which would be rather impossible."and today's answer conflict with that statement(e.g."no limit for the total size of all files in the system"). > please tell me ,for 300 million files, what size is the RAM that we need in the system???, as you say,it needs 87 GB of RAM,or "no limit"????? > > > > > > That's all ,thanks a lot! > > Sincerely look forward to your reply! > > > > Best regards! > > Hanyw ------------------------------------------------------------------------------ > Benefiting from Server Virtualization: Beyond Initial Workload > Consolidation -- Increasing the use of server virtualization is a top > priority.Virtualization can reduce costs, simplify management, and improve > application availability and disaster protection. Learn more about boosting > the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev_______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users |
From: Davies L. <dav...@gm...> - 2011-04-22 00:34:47
|
MooseFS was designed for large file storage, if you have so many small files, you should choose another solutions, just like beansdb[1] or Riak [2]. http://code.google.com/p/beansdb/ http://wiki.basho.com/ 在 2011-4-21,下午8:03, ha...@si... 写道: > > i have some doubts,now ,please answer me : > > problem one: About MooseFS,i had asked the question : what size does it support the single file? and what size about the total numbers of file?? > and your answer is: > "Limit of 2TiB is for a single file. There is no limit for the total size of all files in the system. " > > and today,your reply is "if it supports 3000 million files? We would need about 3 > 000 * 300 MB = 878 GB of RAM which would be rather impossible."and today's answer conflict with that statement(e.g."no limit for the total size of all files in the system"). > please tell me ,for 300 million files, what size is the RAM that we need in the system???, as you say,it needs 87 GB of RAM,or "no limit"????? > > > > > > That's all ,thanks a lot! > > Sincerely look forward to your reply! > > > > Best regards! > > Hanyw ------------------------------------------------------------------------------ > Benefiting from Server Virtualization: Beyond Initial Workload > Consolidation -- Increasing the use of server virtualization is a top > priority.Virtualization can reduce costs, simplify management, and improve > application availability and disaster protection. Learn more about boosting > the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev_______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users |