[Moosefs-users] Data deduplication

[Florent B. <fl...@co...>]

Hi all,

I would like to know if MooseFS will (in which future ?) take care about
data deduplication.

I know that MooseFS makes a checksum of every chunk, so would it be
possible to have data deduplication at that level ?
If two (or more) files with goal=3 each, have chunk(s) in common, only
store 3 copies of that (those) chunk(s) and not 6 (or more) like today...

For files having different goals, use the more important goal.

I think it does not change the architecture of MooseFS... maybe the
problem is that MFS Master do not know about checksums, it is made on
CS... but we could find a way to go through

Is it difficult to add that feature ? What do you think about it ?

Thank you guys!
-- 


Florent Bautista

------------------------------------------------------------------------

Ce message et ses éventuelles pièces jointes sont personnels,
confidentiels et à l'usage exclusif de leur destinataire.
Si vous n'êtes pas la personne à laquelle ce message est destiné,
veuillez noter que vous avez reçu ce courriel par erreur et qu'il vous
est strictement interdit d'utiliser, de diffuser, de transférer,
d'imprimer ou de copier ce message.

This e-mail and any attachments hereto are strictly personal,
confidential and intended solely for the addressee.
If you are not the intended recipient, be advised that you have received
this email in error and that any use, dissemination, forwarding,
printing, or copying of this message is strictly prohibited.

------------------------------------------------------------------------