lessfs-users Mailing List for lessfs - data deduplication for less (Page 2)
Brought to you by:
mruijter
Menu
▾
▴
lessfs-users — Users mailinglist
You can subscribe to this list here.
| 2009 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(2) |
Jul
(5) |
Aug
|
Sep
(2) |
Oct
(2) |
Nov
|
Dec
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2010 |
Jan
|
Feb
|
Mar
|
Apr
(1) |
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
(2) |
Nov
|
Dec
|
| 2011 |
Jan
|
Feb
(3) |
Mar
|
Apr
|
May
(7) |
Jun
(2) |
Jul
|
Aug
|
Sep
(1) |
Oct
(1) |
Nov
|
Dec
(2) |
| 2012 |
Jan
|
Feb
|
Mar
(1) |
Apr
|
May
|
Jun
|
Jul
(1) |
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2013 |
Jan
|
Feb
|
Mar
|
Apr
(5) |
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2017 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
(1) |
Dec
|
|
From: Emmanuel F. <ef...@in...> - 2010-10-01 11:12:58
|
Hello everyone,
It looks like there could be a couple of enhancements, namely :
* some more documentation (man pages for the various binaries, etc)
* an example default configuration file
* mklessfs doesn't report any error message upon failure, that would
be nice to know what does its various error statuses mean.
If I make these corrections, should I send patches to the mailing list,
or else?
--
------------------------------------------------------------------------
Emmanuel Florac | Direction technique
| Intellique
| <ef...@in...>
| +33 1 78 94 84 02
------------------------------------------------------------------------
|
|
From: Mr J. L. <pro...@ya...> - 2010-04-20 03:21:55
|
I had two questions.
1) Is it possible to help with documentation? There were so many problems with the docs. They are spread out all over the tar.gz, the INSTALL file was a bad symlink to some other directory, and nothing really said, "Step 1 do this, step 2....." from start to finish. I could only have guessed at what the different variables mean in the /etc/lessfs.conf file. It would really great if there were some real packages for various Linuxes.
2) Once I got it working, I noticed that if I copied the same file (no matter how big) on the lessfs filesystem, that the size the data on the filesystem did not grow. But, figuring that this was block level deduplication, it should be able to work at the block level. So I cat'd one fil into another. Everytime I did this, the new file created always added more to the filesystem as if there was no dedup going on. Is this the expected behavior?
I know that seems like some big complaints, but I really liked what i saw and the performance was pretty impressive. Keep up the good work.
|
|
From: Bo R. R. <bor...@gm...> - 2009-10-31 13:25:05
|
Hi, Indeed a nice project you have running, I have been checking up with the latest updates, and it really seems to work great in my small test lab! One thing that would be nice to know, about your implementation, would be which kind of method you are using to check the blocks, when you do the inline de-dup? Is it linear, variable (like DataDomain) or perhaps like Dilligent, using a kind of diff/delta check on the blocks? I don't seem to find it documented anywhere. Keep up the good work! Kind regards, Bo |
|
From: <Pek...@so...> - 2009-10-26 07:12:38
|
Hi Is there any instructions howto get latest lessfs working for CentOS 5.4. I would like to test this nice de-duplication system with our systems, but as you know CentOS 5.4 doesn't have those requirements that it needs, eg fuse 2.8, etc. I would like to know if someone has already made some progress to test it and made some notes how to compile it and configure it. I am also using Bacula backup system and thats where i want to test it, i got currently about 6 TB disk system but without some serious de-duplication thats gets me only about 1 week backups. Terveisin/Regards, Pekka Panula |
|
From: Dimitri B. <dim...@gm...> - 2009-09-22 07:52:30
|
Hi Mark many thanks for your great and very usefull work on Dedup!! I'm glade to test your software because i work on storage department of big company and i have test LessFs with NetApp NearStore R200 and must say works great!! I have made a lot of test concerning of how Dedup works on usually backup file, i have notice some strange behavior with tar backup file but is common with netapp dedup. For example if put a tar file A in dedup file system with some variant i have found this: - Tar file A 1000MB = Dedup OK as i aspect - rename file A in B = near 0MB as i aspect - cat file A in file B = 1000MB is not as i aspect because is the same file only concat to the same file but renamed!!! I repeat this is not a problem with LessFS but from my test i have found the same result on NetApp. But i go on in my test and i made a conjuct work with linuxvtl.googlepages.com this is very good software for Tape Library Emulation and works great with LessFS, i mount the Dedup file system as based for emulated media type file. Also using Bacula i have create a very cool Backup solution!!! Also i have test everything with iscsi using scst software...and works great!! I can able to export the Virtual Tape drive to Windows server without problem i also can export the autochanger. As i can do i want make a guide to create this all in one solution!! Because is not simple to export via iscsi using scst... The only minor/big feature for LessFS i think is needed are: - Dedup filesystem tool (test DB and check it) - Direct IO drive (no file based) If you want i can make other test please ask me!! Many thanks Sincerely Dimitri Bellini |
|
From: <de...@we...> - 2009-09-21 17:56:49
|
Hello, lessfs looks great! so far i`m very impressed. i wonder, how can i switch between lzo or quicklz compression ? i found no docs for this, so iŽm asking here. thanks roland ______________________________________________________ GRATIS für alle WEB.DE-Nutzer: Die maxdome Movie-FLAT! Jetzt freischalten unter http://movieflat.web.de |
|
From: Gila <ing...@gm...> - 2009-07-11 17:32:14
|
Hi all, How can I determine what the dedup factor is of all of the files? Kind regards |
|
From: Gila <ing...@gm...> - 2009-07-09 16:42:58
|
Nope that was not it. Any other ideas I can try? output remains the same: # mklessfs /etc/lessfs.cfg lessfs /etc/lessfs.cfg /lessfs -f -o negative_timeout=0,entry_timeout=0,attr_timeout=0,use_ino,readdir_ino,default_permissions,allow_other,max_read=4096,max_write=4096 ls: cannot access /lessfs: Transport endpoint is not connected fusermount --v fusermount version: 2.8.0-pre3 Regards On Thu,root@KingGila:/# mklessfs /etc/lessfs.cfg Jul 9, 2009 at 4:08 PM, Gila <ing...@gm...> wrote: > I did not forget that part I did however placed the databases in /tmp, > should that also be /lessfs then? > > I'll try that when I get back from work, thanks in advance > > > > > On Wed, Jul 8, 2009 at 11:26 PM, Andreas Lund <fl...@at...> wrote: > >> Wed, 8 Jul 2009 23:14:45 +0200, Gila <ing...@gm...> wrote: >> > List, >> > >> > I'm trying out lessfs but I have a problem getting it to run in the >> first >> > place: >> > >> > lessfs /etc/lessfs.cfg /lessfs -d -f -o >> >> -d implies -f, with either one the process should keep running in the >> foreground. If it doesn't, it means the process crashed and you will get >> the >> following error when trying to access the mounted filesystem: >> >> > ls: cannot access /lessfs: Transport endpoint is not connected >> >> Did you perhaps forget to run "mklessfs /etc/lessfs.cfg" to initialize the >> database? >> > >> -- >> Andreas Lund (fl...@at...) >> Tel: +47 90077162 >> #include <disclaimer.h> >> "Look at you hacker, panting and sweating as you run through my corridors. >> How can you challenge a perfect immortal machine?" -- SHODAN, System Shock >> >> >> ------------------------------------------------------------------------------ >> Enter the BlackBerry Developer Challenge >> This is your chance to win up to $100,000 in prizes! For a limited time, >> vendors submitting new applications to BlackBerry App World(TM) will have >> the opportunity to enter the BlackBerry Developer Challenge. See full >> prize >> details at: http://p.sf.net/sfu/Challenge >> _______________________________________________ >> Lessfs-users mailing list >> Les...@li... >> https://lists.sourceforge.net/lists/listinfo/lessfs-users >> > > |
|
From: Gila <ing...@gm...> - 2009-07-09 14:08:52
|
I did not forget that part I did however placed the databases in /tmp, should that also be /lessfs then? I'll try that when I get back from work, thanks in advance On Wed, Jul 8, 2009 at 11:26 PM, Andreas Lund <fl...@at...> wrote: > Wed, 8 Jul 2009 23:14:45 +0200, Gila <ing...@gm...> wrote: > > List, > > > > I'm trying out lessfs but I have a problem getting it to run in the first > > place: > > > > lessfs /etc/lessfs.cfg /lessfs -d -f -o > > -d implies -f, with either one the process should keep running in the > foreground. If it doesn't, it means the process crashed and you will get > the > following error when trying to access the mounted filesystem: > > > ls: cannot access /lessfs: Transport endpoint is not connected > > Did you perhaps forget to run "mklessfs /etc/lessfs.cfg" to initialize the > database? > > -- > Andreas Lund (fl...@at...) > Tel: +47 90077162 > #include <disclaimer.h> > "Look at you hacker, panting and sweating as you run through my corridors. > How can you challenge a perfect immortal machine?" -- SHODAN, System Shock > > > ------------------------------------------------------------------------------ > Enter the BlackBerry Developer Challenge > This is your chance to win up to $100,000 in prizes! For a limited time, > vendors submitting new applications to BlackBerry App World(TM) will have > the opportunity to enter the BlackBerry Developer Challenge. See full prize > details at: http://p.sf.net/sfu/Challenge > _______________________________________________ > Lessfs-users mailing list > Les...@li... > https://lists.sourceforge.net/lists/listinfo/lessfs-users > |
|
From: Andreas L. <fl...@at...> - 2009-07-08 21:41:49
|
Wed, 8 Jul 2009 23:14:45 +0200, Gila <ing...@gm...> wrote: > List, > > I'm trying out lessfs but I have a problem getting it to run in the first > place: > > lessfs /etc/lessfs.cfg /lessfs -d -f -o -d implies -f, with either one the process should keep running in the foreground. If it doesn't, it means the process crashed and you will get the following error when trying to access the mounted filesystem: > ls: cannot access /lessfs: Transport endpoint is not connected Did you perhaps forget to run "mklessfs /etc/lessfs.cfg" to initialize the database? -- Andreas Lund (fl...@at...) Tel: +47 90077162 #include <disclaimer.h> "Look at you hacker, panting and sweating as you run through my corridors. How can you challenge a perfect immortal machine?" -- SHODAN, System Shock |
|
From: Gila <ing...@gm...> - 2009-07-08 21:14:53
|
List, I'm trying out lessfs but I have a problem getting it to run in the first place: lessfs /etc/lessfs.cfg /lessfs -d -f -o negative_timeout=0,entry_timeout=0,attr_timeout=0,use_ino,readdir_ino,default_permissions,allow_other,max_read=4096,max_write=4096 yields: FUSE library version: 2.8.0-pre3 nullpath_ok: 0 unique: 1, opcode: INIT (26), nodeid: 0, insize: 56 INIT: 7.10 flags=0x0000003b max_readahead=0x00020000 then when I do a ls /lessfs i get: ls: cannot access /lessfs: Transport endpoint is not connected I assume this is a fuse related problem not sure though, any pointers? Kind regards |
|
From: Mark R. <mru...@gm...> - 2009-06-24 17:38:08
|
Hi Roy, As far as I can tell there are no known collisions for the full hash. Lessfs uses the full hash so there seems to be no reason to switch to a slower sha2 algorithm. Mark. -- Tiger is a cryptographic hash function with a 192-bit hash value. It was proposed by Anderson and Biham in 1996. Recently, weaknesses have been shown in round-reduced variants of the Tiger hash function. First, at FSE 2006, Kelsey and Lucks presented a collision attack on Tiger reduced to 16 and 17 (out of 24) rounds with a complexity of about 2^44 and a pseudo-near-collision for Tiger reduced to 20 rounds. Later, Mendel /et al./ extended this attack to a collision attack on Tiger reduced to 19 rounds with a complexity of about 2^62 . Furthermore, they show a pseudo-near-collision for Tiger reduced to 22 rounds with a complexity of about 2^44 . No attack is known for the full Tiger hash function. In this article, we show a pseudo-near-collision for the full Tiger hash function with a complexity of about 2^47 hash computations and a pseudo-collision (free-start-collision) for Tiger reduced to 23 rounds with the same complexity. |
|
From: Roy S. K. <ro...@ka...> - 2009-06-01 14:36:15
|
Hi According to Wikipedia http://en.wikipedia.org/wiki/Tiger_hash, collisions may be possible in the tiger hash function. Would it perhaps be better to use SHA2? roy -- Roy Sigurd Karlsbakk (+47) 97542685 / 98013356 ro...@ka... http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. |
