Re: [Katta-developer] Creating a Katta Index
Brought to you by:
joa23
Menu
▾
▴
Re: [Katta-developer] Creating a Katta Index
|
From: Johannes Z. <jzi...@go...> - 2013-03-25 10:52:15
|
Hey Varun, looks like you run into an test-failure. Can you have a look at modules/katta-core/build/unit-reports/TEST-net.sf.katta.master.MasterZkTest.xml and see/post what is the reason? Also i checked the guide and it looks broken in different places (http://oss.101tec.com/jira/browse/KATTA-224). I updated the guide a bit and if you update you katta version to the latest master (git pull) you should come as far as creating a sample index in hadoop. But for the 'Deploy the index in Katta' you will need to build (see http://katta.sourceforge.net/documentation/build-katta) or download a katta distribution, since bin/katta does not work out of the project anymore! So you could get this to work, but since this is only sample code i would suggest using a pure lucene index and deploying this on katta might give you faster results! HTH Johannes PS: the currently active branches are master and v0.6 On Mar 25, 2013, at 10:48 AM, Varun Chandramouli wrote: > Hi All, > > Let me begin by saying that I am relatively new to java, and totally new to katta. I was going through the tutorial given here: http://katta.sourceforge.net/documentation/how-to-create-a-katta-index to create a katta index. When I try to compile, I am getting the following errors: > > varunc@varunc-virtual-machine:~/katta-tutorial/katta$ ant compile > Buildfile: /home/varunc/katta-tutorial/katta/build.xml > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/lib/test > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/lib/compile > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/src/main/java > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/src/test/java > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/src/it/java > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/src/main/resources > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/src/test/resources > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/src/it/resources > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/build/modules-classes > > setupModuleArtifactClassPath: > > compile: > [echo] *** katta *** > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/build/classes-main > > BUILD SUCCESSFUL > Total time: 0 seconds > varunc@varunc-virtual-machine:~/katta-tutorial/katta$ bin/katta > -bash: bin/katta: No such file or directory > varunc@varunc-virtual-machine:~/katta-tutorial/katta$ ant > Buildfile: /home/varunc/katta-tutorial/katta/build.xml > > jar: > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-core/lib/build > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-core/src/it/resources > [echo] building classpathes for module katta-core... > > setupModuleArtifactClassPath: > > compile: > [echo] *** katta-core *** > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-core/build/classes-main > [javac] Compiling 123 source files to /home/varunc/katta-tutorial/katta/modules/katta-core/build/classes-main > [javac] Note: /home/varunc/katta-tutorial/katta/modules/katta-core/src/main/java/net/sf/katta/node/ShardManager.java uses unchecked or unsafe operations. > [javac] Note: Recompile with -Xlint:unchecked for details. > [copy] Copying 1 file to /home/varunc/katta-tutorial/katta/modules/katta-core/build/classes-main > > jar: > [echo] Git Revision: bdc2340575c65359259ebda4242d477af6371aa7 > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-core/build/artifacts > [echo] Building jar build/artifacts/katta-core-0.7.dev.jar > [jar] Building jar: /home/varunc/katta-tutorial/katta/modules/katta-core/build/artifacts/katta-core-0.7.dev.jar > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/lib/build > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/lib/test > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/lib/compile > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/src/it/java > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/src/main/resources > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/src/test/resources > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/src/it/resources > [echo] building classpathes for module katta-core... > [echo] building classpathes for module katta-indexing-sample... > > setupModuleArtifactClassPath: > > compile: > [echo] *** katta-indexing-sample *** > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/build/classes-main > [javac] Compiling 2 source files to /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/build/classes-main > [javac] Note: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/src/main/java/net/sf/katta/indexing/IndexerJob.java uses or overrides a deprecated API. > [javac] Note: Recompile with -Xlint:deprecation for details. > > jar: > [echo] Git Revision: bdc2340575c65359259ebda4242d477af6371aa7 > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/build/artifacts > [echo] Building jar build/artifacts/katta-indexing-sample-0.7.dev.jar > [jar] Building jar: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/build/artifacts/katta-indexing-sample-0.7.dev.jar > > unit-jar: > [echo] building classpathes for module katta-core... > > setupModuleArtifactClassPath: > > compile-unit: > [echo] *** Building Test Sources for katta-core *** > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-core/build/classes-test > [javac] Compiling 83 source files to /home/varunc/katta-tutorial/katta/modules/katta-core/build/classes-test > [javac] Note: /home/varunc/katta-tutorial/katta/modules/katta-core/src/test/java/net/sf/katta/master/LowestShardCountDistributionPolicyTest.java uses or overrides a deprecated API. > [javac] Note: Recompile with -Xlint:deprecation for details. > [javac] Note: Some input files use unchecked or unsafe operations. > [javac] Note: Recompile with -Xlint:unchecked for details. > [copy] Copying 7 files to /home/varunc/katta-tutorial/katta/modules/katta-core/build/classes-test > > unit-jar: > [echo] Git Revision: bdc2340575c65359259ebda4242d477af6371aa7 > [echo] Building jar build/artifacts/katta-core-0.7.dev.jar > [jar] Building jar: /home/varunc/katta-tutorial/katta/modules/katta-core/build/artifacts/katta-core-0.7.dev-test.jar > [echo] building classpathes for module katta-core... > [echo] building classpathes for module katta-indexing-sample... > > setupModuleArtifactClassPath: > > compile-unit: > [echo] *** Building Test Sources for katta-indexing-sample *** > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/build/classes-test > [javac] Compiling 3 source files to /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/build/classes-test > > unit-jar: > [echo] Git Revision: bdc2340575c65359259ebda4242d477af6371aa7 > [echo] Building jar build/artifacts/katta-indexing-sample-0.7.dev.jar > [jar] Building jar: /home/varunc/katta-tutorial/katta/modules/katta-indexing-sample/build/artifacts/katta-indexing-sample-0.7.dev-test.jar > > unit: > [echo] building classpathes for module katta-core... > > setupModuleArtifactClassPath: > > unit: > [echo] *** katta-core *** > [echo] forkmode=once > [echo] haltOnFailure=true > [echo] showOutput=false > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/modules/katta-core/build/unit-reports > [echo] Using test classes build/classes-test > [junit] Running net.sf.katta.KattaTest > [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 11.126 sec > [junit] Running net.sf.katta.client.ClientResultTest > [junit] Tests run: 24, Failures: 0, Errors: 0, Time elapsed: 1.872 sec > [junit] Running net.sf.katta.client.ClientTest > [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.367 sec > [junit] Running net.sf.katta.client.DefaultNodeSelectionPolicyTest > [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 0.024 sec > [junit] Running net.sf.katta.client.DeployClientTest > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.015 sec > [junit] Running net.sf.katta.client.DeployClientZkTest > [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.277 sec > [junit] Running net.sf.katta.client.IndexDeployFutureTest > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.892 sec > [junit] Running net.sf.katta.client.NodeInteractionTest > [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 0.05 sec > [junit] Running net.sf.katta.client.NodeProxyManagerTest > [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.068 sec > [junit] Running net.sf.katta.client.ResultCompletePolicyTest > [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 5.217 sec > [junit] Running net.sf.katta.client.WorkQueueTest > [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 8.503 sec > [junit] Running net.sf.katta.lib.lucene.DocumentFrequencyWritableTest > [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.331 sec > [junit] Running net.sf.katta.lib.lucene.FieldSortComparatorTest > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.02 sec > [junit] Running net.sf.katta.lib.lucene.FilterWritableTest > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.013 sec > [junit] Running net.sf.katta.lib.lucene.HitSortPerformanceTest > [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 2.66 sec > [junit] Running net.sf.katta.lib.lucene.HitsMapWritableTest > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.015 sec > [junit] Running net.sf.katta.lib.lucene.LuceneServerTest > [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 2.492 sec > [junit] Running net.sf.katta.lib.lucene.QueryWritableTest > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.005 sec > [junit] Running net.sf.katta.lib.mapfile.MapFileServerTest > [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 5.04 sec > [junit] Running net.sf.katta.master.DefaultDistributionPolicyTest > [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.008 sec > [junit] Running net.sf.katta.master.LowestShardCountDistributionPolicyTest > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.023 sec > [junit] Running net.sf.katta.master.MasterMockTest > [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 2.297 sec > [junit] Running net.sf.katta.master.MasterZkTest > [junit] Tests run: 5, Failures: 1, Errors: 0, Time elapsed: 46.325 sec > > BUILD FAILED > /home/varunc/katta-tutorial/katta/build.xml:107: The following error occurred while executing this line: > /home/varunc/katta-tutorial/katta/src/build/ant/common-build.xml:225: The following error occurred while executing this line: > /home/varunc/katta-tutorial/katta/src/build/ant/build-all.xml:70: /home/varunc/katta-tutorial/katta/src/build/ant/build-all.xml:72: Tests failed > > Total time: 1 minute 34 seconds > > Can anyone guide me past this? > > I also tried to build a different source of katta (stable-0.5) which built successfully, but when I tried to subsequently create the index (ran the command "ant jar"), I got the following error: > varunc@varunc3-virtual-machine:~/katta-tutorial/hadoop$ cd ~/katta-tutorial/katta/extras/indexing/ > varunc@varunc3-virtual-machine:~/katta-tutorial/katta/extras/indexing$ ls > build.properties build.xml ivy.xml src > varunc@varunc3-virtual-machine:~/katta-tutorial/katta/extras/indexing$ ant jar > Buildfile: /home/varunc/katta-tutorial/katta/extras/indexing/build.xml > > check-ivy-available: > > download-ivy: > > install-ivy: > [echo] Ivy path > > resolve: > [ivy:resolve] :: Ivy 2.0.0 - 20090108225011 :: http://ant.apache.org/ivy/ :: > :: loading settings :: file = /home/varunc/katta-tutorial/katta/ivy/ivysettings.xml > [ivy:resolve] DEPRECATED: useOrigin option is deprecated when calling resolve, use useOrigin setting on the cache implementation instead > [ivy:resolve] :: resolving dependencies :: emi#event-processing/grid;working@varunc3-virtual-machine > [ivy:resolve] confs: [ant, eclipse, compile, test, instrument, job] > [ivy:resolve] found svnant#svnant;1.2.1 in libraries > [ivy:resolve] found svnClientAdapter#svnClientAdapter;1.2.1 in libraries > [ivy:resolve] found svnjavahl#svnjavahl;1.2.1 in libraries > [ivy:resolve] found org.apache.commons#commons-cli;2.0-SNAPSHOT in libraries > [ivy:resolve] found org.apache.commons#commons-codec;1.3 in libraries > [ivy:resolve] found org.apache.commons#commons-httpclient;3.0.1 in libraries > [ivy:resolve] found org.apache.commons#commons-logging;1.0.4 in libraries > [ivy:resolve] found org.apache.commons#commons-logging-api;1.0.4 in libraries > [ivy:resolve] found org.apache.hadoop#hadoop-core;0.19.0 in libraries > [ivy:resolve] found org.apache.hadoop#hadoop-test;0.19.0 in libraries > [ivy:resolve] found jasper#jasper-compiler;x in libraries > [ivy:resolve] found jasper#jasper-runtime;x in libraries > [ivy:resolve] found jets3t#jets3t;0.5.0 in libraries > [ivy:resolve] found jetty#jetty;5.1.4 in libraries > [ivy:resolve] found jsp-api#jsp-api;2.0 in libraries > [ivy:resolve] found servlet-api#servlet-api;2.4 in libraries > [ivy:resolve] found org.apache#log4j;1.2.13 in libraries > [ivy:resolve] found org.apache.lucene#lucene-core;2.3.2 in ibiblio > [ivy:resolve] found junit#junit;3.8.1 in local-resolver-chain > [ivy:resolve] found net.sourceforge.cobertura#cobertura;1.9 in ibiblio > [ivy:resolve] found oro#oro;2.0.8 in local-resolver-chain > [ivy:resolve] found asm#asm;2.2.1 in ibiblio > [ivy:resolve] found asm#asm-tree;2.2.1 in ibiblio > [ivy:resolve] found log4j#log4j;1.2.9 in ibiblio > [ivy:resolve] found org.apache.ant#ant;1.7.0 in ibiblio > [ivy:resolve] found org.apache.ant#ant-launcher;1.7.0 in ibiblio > [ivy:resolve] downloading http://repo1.maven.org/maven2/org/apache/lucene/lucene-core/2.3.2/lucene-core-2.3.2.jar ... > [ivy:resolve] ... > [ivy:resolve] ................................................................. (650kB) > [ivy:resolve] .. (0kB) > [ivy:resolve] [SUCCESSFUL ] org.apache.lucene#lucene-core;2.3.2!lucene-core.jar (11571ms) > [ivy:resolve] :: resolution report :: resolve 3859ms :: artifacts dl 11589ms > --------------------------------------------------------------------- > | | modules || artifacts | > | conf | number| search|dwnlded|evicted|| number|dwnlded| > --------------------------------------------------------------------- > | ant | 3 | 0 | 0 | 0 || 3 | 0 | > | eclipse | 0 | 0 | 0 | 0 || 0 | 0 | > | compile | 15 | 1 | 1 | 0 || 15 | 1 | > | test | 16 | 1 | 1 | 0 || 16 | 1 | > | instrument | 7 | 0 | 0 | 0 || 7 | 0 | > | job | 1 | 1 | 1 | 0 || 1 | 1 | > --------------------------------------------------------------------- > [ivy:resolve] > [ivy:resolve] :: problems summary :: > [ivy:resolve] :::: ERRORS > [ivy:resolve] unknown resolver default > [ivy:resolve] > [ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS > > compile: > [mkdir] Created dir: /home/varunc/katta-tutorial/katta/extras/indexing/build/classes-main > [javac] /home/varunc/katta-tutorial/katta/src/build/ant/common-build.xml:64: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds > [javac] Compiling 2 source files to /home/varunc/katta-tutorial/katta/extras/indexing/build/classes-main > > jar: > [svn] <WcVersion> started ... > > BUILD FAILED > /home/varunc/katta-tutorial/katta/src/build/ant/common-build.xml:174: java.lang.NullPointerException > at org.tigris.subversion.svnant.commands.WcVersion.getWorkingCopySumary(Unknown Source) > at org.tigris.subversion.svnant.commands.WcVersion.execute(Unknown Source) > at org.tigris.subversion.svnant.commands.SvnCommand.executeCommand(Unknown Source) > at org.tigris.subversion.svnant.SvnTask.execute(Unknown Source) > at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) > at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) > at org.apache.tools.ant.Task.perform(Task.java:348) > at org.apache.tools.ant.Target.execute(Target.java:390) > at org.apache.tools.ant.Target.performTasks(Target.java:411) > at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399) > at org.apache.tools.ant.Project.executeTarget(Project.java:1368) > at org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41) > at org.apache.tools.ant.Project.executeTargets(Project.java:1251) > at org.apache.tools.ant.Main.runBuild(Main.java:809) > at org.apache.tools.ant.Main.startAnt(Main.java:217) > at org.apache.tools.ant.launch.Launcher.run(Launcher.java:280) > at org.apache.tools.ant.launch.Launcher.main(Launcher.java:109) > > Total time: 17 seconds > > If anyone could guide me on how to get past these errors and successfully generate an index using katta, then I will be extremely grateful. > > Thanks and Regards > Varun > > ------------------------------------------------------------------------------ > Everyone hates slow websites. So do we. > Make your web apps faster with AppDynamics > Download AppDynamics Lite for free today: > http://p.sf.net/sfu/appdyn_d2d_mar_______________________________________________ > Katta-developer mailing list > Kat...@li... > https://lists.sourceforge.net/lists/listinfo/katta-developer |