[Archive-access-discuss] test nutchwax + nedlibToArc2.0

[<st...@ar...>]

>From: Lukas Matejka <mat...@ce...>
>...
>
>I've just tested Nutchwax on single machine.
>there are some parametres..
>documents: 2 222 660
>dups:477 234
>begin:13:37:13 CEST 13.10.2005
>end:03:25:12 CEST 16.10.2005
>  
>
Whats that Lukas -- Almost 3 days to do 2 and a quarter million 
documents?  That looks way slow.  You're using default nutchwax config 
(With indexer.maxMergeDocs set to indexer.maxMergeDocs?).  Are you doing 
NedlibToArc convertion at same time?

What kinda machine is it?

>
>i fixed new version of NedlibToArc2.0 based on arc-1.5.1-200508191341.jar with 
>little changes.
>
>http://cvs.sourceforge.net/viewcvs.py/arcwayback/NedlibToArc2.0/
>  
>
Good stuff.  Did you take the original dk stuff and modify it?  Do you 
want to move your nedlibtoarc here onto archive-access?  Seems like good 
place for it.  I can make you a subproject and make you admin.

St.Ack