archive-access-cvs

[Archive-access-cvs] SF.net SVN: archive-access:[2656] trunk/archive-access/projects/nutchwax/ archive/bin/nutchwax

[<bi...@us...>]

Revision: 2656
          http://archive-access.svn.sourceforge.net/archive-access/?rev=2656&view=rev
Author:   binzino
Date:     2008-12-10 04:59:10 +0000 (Wed, 10 Dec 2008)

Log Message:
-----------
Fixed but to pass back return code of invoked command.

Modified Paths:
--------------
    trunk/archive-access/projects/nutchwax/archive/bin/nutchwax

Modified: trunk/archive-access/projects/nutchwax/archive/bin/nutchwax
===================================================================
--- trunk/archive-access/projects/nutchwax/archive/bin/nutchwax	2008-12-10 04:58:24 UTC (rev 2655)
+++ trunk/archive-access/projects/nutchwax/archive/bin/nutchwax	2008-12-10 04:59:10 UTC (rev 2656)
@@ -62,4 +62,5 @@
     ;;
 esac
 
-exit 0
+# Return the exit code of the command invoked.
+exit $?


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.

[Archive-access-cvs] SF.net SVN: archive-access:[2670] trunk/archive-access/projects/nutchwax/ archive/bin/nutchwax

[<bi...@us...>]

Revision: 2670
          http://archive-access.svn.sourceforge.net/archive-access/?rev=2670&view=rev
Author:   binzino
Date:     2008-12-16 02:59:10 +0000 (Tue, 16 Dec 2008)

Log Message:
-----------
Added a command for running the PageRanker tool.

Modified Paths:
--------------
    trunk/archive-access/projects/nutchwax/archive/bin/nutchwax

Modified: trunk/archive-access/projects/nutchwax/archive/bin/nutchwax
===================================================================
--- trunk/archive-access/projects/nutchwax/archive/bin/nutchwax	2008-12-16 02:43:25 UTC (rev 2669)
+++ trunk/archive-access/projects/nutchwax/archive/bin/nutchwax	2008-12-16 02:59:10 UTC (rev 2670)
@@ -50,6 +50,10 @@
     shift
     ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.DumpParallelIndex $@
     ;;
+  pagerank)
+    shift
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.PageRanker $@
+    ;;
   *)
     echo ""
     echo "Usage: nutchwax COMMAND"
@@ -57,6 +61,7 @@
     echo "  import       Import ARCs into a new Nutch segment"
     echo "  add-dates    Add dates to a parallel index"
     echo "  dumpindex    Dump an index or set of parallel indices to stdout"
+    echo "  pagerank     Generate pagerank file for URLs in a 'linkdb'."
     echo ""
     exit 1
     ;;


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.

[Archive-access-cvs] SF.net SVN: archive-access:[2694] trunk/archive-access/projects/nutchwax/ archive/bin/nutchwax

[<bi...@us...>]

Revision: 2694
          http://archive-access.svn.sourceforge.net/archive-access/?rev=2694&view=rev
Author:   binzino
Date:     2009-03-08 22:59:46 +0000 (Sun, 08 Mar 2009)

Log Message:
-----------
Added commands to drive recently added tools.

Modified Paths:
--------------
    trunk/archive-access/projects/nutchwax/archive/bin/nutchwax

Modified: trunk/archive-access/projects/nutchwax/archive/bin/nutchwax
===================================================================
--- trunk/archive-access/projects/nutchwax/archive/bin/nutchwax	2009-03-08 21:43:33 UTC (rev 2693)
+++ trunk/archive-access/projects/nutchwax/archive/bin/nutchwax	2009-03-08 22:59:46 UTC (rev 2694)
@@ -42,6 +42,14 @@
     shift
     ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.Importer $@
     ;;
+  pagerankdb)
+    shift
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.PageRankDb $@
+    ;;
+  pagerankdbmerger)
+    shift
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.PageRankDbMerger $@
+    ;;
   add-dates)
     shift
     ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.DateAdder $@
@@ -50,18 +58,25 @@
     shift
     ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.DumpParallelIndex $@
     ;;
-  pagerank)
+  pageranker)
     shift
     ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.PageRanker $@
     ;;
+  parsetextmerger)
+    shift
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.ParseTextCombiner $@
+    ;;
   *)
     echo ""
     echo "Usage: nutchwax COMMAND"
     echo "where COMMAND is one of:"
-    echo "  import       Import ARCs into a new Nutch segment"
-    echo "  add-dates    Add dates to a parallel index"
-    echo "  dumpindex    Dump an index or set of parallel indices to stdout"
-    echo "  pagerank     Generate pagerank file for URLs in a 'linkdb'."
+    echo "  import            Import ARCs into a new Nutch segment"
+    echo "  pagerankdb        Generate pagerankdb for a segment"
+    echo "  pagerankdbmerger  Merge multiple pagerankdbs"
+    echo "  pageranker        Generate pagerank.txt file from 'pagerankdb's or 'linkdb's"
+    echo "  parsetextmerger   Merge segement parse_text/part-nnnnn directories."
+    echo "  add-dates         Add dates to a parallel index"
+    echo "  dumpindex         Dump an index or set of parallel indices to stdout"
     echo ""
     exit 1
     ;;


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.

[Archive-access-cvs] SF.net SVN: archive-access:[2848] trunk/archive-access/projects/nutchwax/ archive/bin/nutchwax

[<bi...@us...>]

Revision: 2848
          http://archive-access.svn.sourceforge.net/archive-access/?rev=2848&view=rev
Author:   binzino
Date:     2009-10-28 00:04:43 +0000 (Wed, 28 Oct 2009)

Log Message:
-----------
Ported fixes and updates from NW 0.12.9.

Modified Paths:
--------------
    trunk/archive-access/projects/nutchwax/archive/bin/nutchwax

Modified: trunk/archive-access/projects/nutchwax/archive/bin/nutchwax
===================================================================
--- trunk/archive-access/projects/nutchwax/archive/bin/nutchwax	2009-10-28 00:04:14 UTC (rev 2847)
+++ trunk/archive-access/projects/nutchwax/archive/bin/nutchwax	2009-10-28 00:04:43 UTC (rev 2848)
@@ -40,32 +40,48 @@
 case "$1" in
   import)
     shift
-    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.Importer $@
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.Importer "$@"
     ;;
   pagerankdb)
     shift
-    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.PageRankDb $@
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.PageRankDb "$@"
     ;;
   pagerankdbmerger)
     shift
-    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.PageRankDbMerger $@
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.PageRankDbMerger "$@"
     ;;
+  pageranker)
+    shift
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.PageRanker "$@"
+    ;;
+  parsetextmerger)
+    shift
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.ParseTextCombiner "$@"
+    ;;
   add-dates)
     shift
-    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.DateAdder $@
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.DateAdder "$@"
     ;;
-  dumpindex)
+  index)
     shift
-    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.DumpParallelIndex $@
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.Indexer "$@"
     ;;
-  pageranker)
+  merge)
     shift
-    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.PageRanker $@
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.IndexMerger "$@"
     ;;
-  parsetextmerger)
+  reboost)
     shift
-    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.ParseTextCombiner $@
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.LengthNormUpdater "$@"
     ;;
+  dumpindex)
+    shift
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.tools.DumpParallelIndex "$@"
+    ;;
+  search)
+    shift
+    ${NUTCH_HOME}/bin/nutch org.archive.nutchwax.NutchWaxBean "$@"
+    ;;
   *)
     echo ""
     echo "Usage: nutchwax COMMAND"
@@ -76,7 +92,11 @@
     echo "  pageranker        Generate pagerank.txt file from 'pagerankdb's or 'linkdb's"
     echo "  parsetextmerger   Merge segement parse_text/part-nnnnn directories."
     echo "  add-dates         Add dates to a parallel index"
+    echo "  index             Build Lucene index from segment(s) without crawl & linkdbs"
+    echo "  merge             Merge indexes or parallel indexes"
+    echo "  reboost           Update document boosts based on pagerank info"
     echo "  dumpindex         Dump an index or set of parallel indices to stdout"
+    echo "  search            Query a search index"
     echo ""
     exit 1
     ;;


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.