From: Ted P. <dul...@gm...> - 2010-04-06 16:04:29
|
Hi Jyoti, About the only thing I see that's a little out of the ordinary is that you are using version 2.01 of WordNet::Similarity, while the most current version is 2.05. I would suggest updating to 2.05 and seeing if that doesn't resolve these issues. You can find download links from CPAN and sourceforge for 2.05 here: http://wn-similarity.sourceforge.net/ Good luck, and let us know what happens. If you continue to get errors, go ahead and send the output of make test again. Ted On Tue, Apr 6, 2010 at 10:38 AM, Kamal, Jyoti <JK...@et...> wrote: > Hi Ted: > > Thanks so much for your response. I really didn't expect such a quick > response & I truly appreciate it. It's been a while, I have been struggling > with this. > > Please find my comments below. > > Thanks! > > Jyoti > > -----Original Message----- > From: Ted Pedersen [mailto:dul...@gm...] > Sent: Tuesday, April 06, 2010 11:22 AM > To: Kamal, Jyoti > Cc: sen...@li...; senserelate-users > Subject: Re: [Senserelate-users] > [Senserelate-developers]WordNet::SenseRelate > > Hi Jyoti, > > If you have installed WordNet::Similarity, you should have gotten > > WordNet::Tools as a result of that. But, we can double check that... > > 1) what kind of system are you running on? If linux can you send me > > the output of > > uname –a > > Linux etsis134.ets.org 2.6.9-78.ELsmp #1 SMP Wed Jul 9 15:46:26 EDT 2008 > x86_64 x86_64 x86_64 GNU/Linux > > 2) can you send the output of > > similarity.pl --measure WordNet::Similarity::path dog cat > > [jkamal@etsis134 bin]$ similarity.pl --type=WordNet::Similarity::path dog#n > cat#n > > Loading WordNet... done. > > Loading Module... done. > > dog#n#1 cat#n#1 0.2 > > (just to check that similarity is ok) > > 4) can you send the output of > > perl -MWordNet::QueryData -e 'print "$WordNet::QueryData::VERSION\n"' > > perl -MWordNet::Similarity -e 'print "$WordNet::Similarity::VERSION\n"' > > perl -MWordNet::Tools -e 'print "$WordNet::Tools::VERSION\n"' > > perl -MWordNet::SenseRelate::AllWords -e 'print > > "$WordNet::SenseRelate::AllWords::VERSION\n"' > > [jkamal@etsis134 bin]$ perl -MWordNet::QueryData -e 'print > "$WordNet::QueryData::VERSION\n"' > > 1.49 > > [jkamal@etsis134 bin]$ perl -MWordNet::Similarity -e 'print > "$WordNet::Similarity::VERSION\n"' > > 2.01 > > [jkamal@etsis134 bin]$ perl -MWordNet::Tools -e 'print > "$WordNet::Tools::VERSION\n"' > > 2.01 > > [jkamal@etsis134 bin]$ perl -MWordNet::SenseRelate::AllWords -e 'print > "$WordNet::SenseRelate::AllWords::VERSION\n"' > > 0.19 > > (this will show what versions of modules you are using..) > > 5) What version of WordNet are you using? > > [JK] WordNet 3.0 > > on linux > > wn -l > > should show that... > > 6) can you send the complete output from > > WordNet::SenseRelate::AllWords make test? > > --------------------------------------------------------------------- > > [jkamal@etsis134 WordNet-SenseRelate-AllWords-0.19]$ make test > > PERL_DL_NONLAZY=1 /usr/bin/perl "-MExtUtils::Command::MM" "-e" > "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t > > t/Error-Suffixes-tagged-wntagged....ok 2/41# Failed test > (t/Error-Suffixes-tagged-wntagged.t at line 71) > > t/Error-Suffixes-tagged-wntagged....NOK 3# got: 'The#NT' > > # expected: 'The#CL' > > # Failed test (t/Error-Suffixes-tagged-wntagged.t at line 71) > > # got: 'DT#NT' > > # expected: 'star#n#1' > > t/Error-Suffixes-tagged-wntagged....NOK 4# Failed test > (t/Error-Suffixes-tagged-wntagged.t at line 71) > > # got: 'star#NT' > > # expected: 'marry#v#1' > > t/Error-Suffixes-tagged-wntagged....NOK 5# Failed test > (t/Error-Suffixes-tagged-wntagged.t at line 71) > > # got: 'NN#NT' > > # expected: 'qn#CL' > > t/Error-Suffixes-tagged-wntagged....NOK 6# Failed test > (t/Error-Suffixes-tagged-wntagged.t at line 71) > > t/Error-Suffixes-tagged-wntagged....NOK 7# got: 'married#NT' > > # expected: 'astronomer#n#1' > > # Failed test (t/Error-Suffixes-tagged-wntagged.t at line 71) > > t/Error-Suffixes-tagged-wntagged....NOK 8# got: 'VBD#NT' > > # expected: '.#IT' > > t/Error-Suffixes-tagged-wntagged....ok 41/41# Looks like you failed 6 tests > of 41. > > t/Error-Suffixes-tagged-wntagged....dubious > > Test returned status 6 (wstat 1536, 0x600) > > DIED. FAILED tests 3-8 > > Failed 6/41 tests, 85.37% okay > > t/WordNet-SenseRelate-AllWords......# WordNet hash : > eOS9lXC6GvMWznF1wkZofDdtbBU > > t/WordNet-SenseRelate-AllWords......ok 1/30# WordNet path : > /home/jkamal/myWordNet3//dict/ > > t/WordNet-SenseRelate-AllWords......ok 3/30# Failed test > (t/WordNet-SenseRelate-AllWords.t at line 96) > > t/WordNet-SenseRelate-AllWords......NOK 4# got: '11' > > # expected: '5' > > # Failed test (t/WordNet-SenseRelate-AllWords.t at line 99) > > t/WordNet-SenseRelate-AllWords......NOK 5# got: 'my#NT' > > # expected: 'my#CL' > > # Failed test (t/WordNet-SenseRelate-AllWords.t at line 99) > > t/WordNet-SenseRelate-AllWords......NOK 6# got: 'PRP#NT' > > # expected: 'cat#n#7' > > # Failed test (t/WordNet-SenseRelate-AllWords.t at line 99) > > t/WordNet-SenseRelate-AllWords......NOK 7# got: 'cat#NT' > > # expected: 'be#v#1' > > # Failed test (t/WordNet-SenseRelate-AllWords.t at line 99) > > t/WordNet-SenseRelate-AllWords......NOK 8# got: 'NN#NT' > > # expected: 'a#CL' > > # Failed test (t/WordNet-SenseRelate-AllWords.t at line 99) > > t/WordNet-SenseRelate-AllWords......NOK 9# got: 'is#NT' > > # expected: 'wise#a#1' > > # Failed test (t/WordNet-SenseRelate-AllWords.t at line 99) > > # got: 'VBZ#NT' > > # expected: 'cat#n#7' > > t/WordNet-SenseRelate-AllWords......NOK 13# Failed test > (t/WordNet-SenseRelate-AllWords.t at line 131) > > t/WordNet-SenseRelate-AllWords......NOK 14# Failed test > (t/WordNet-SenseRelate-AllWords.t at line 136) > > # got: 'my#NT' > > # expected: 'my#CL' > > t/WordNet-SenseRelate-AllWords......NOK 15# Failed test > (t/WordNet-SenseRelate-AllWords.t at line 136) > > # got: 'PRP#NT' > > # expected: 'cat#n#NR' > > t/WordNet-SenseRelate-AllWords......NOK 16# Failed test > (t/WordNet-SenseRelate-AllWords.t at line 136) > > # got: 'cat#NT' > > # expected: 'be#v#1' > > t/WordNet-SenseRelate-AllWords......NOK 17# Failed test > (t/WordNet-SenseRelate-AllWords.t at line 136) > > # got: 'NN#NT' > > # expected: 'a#CL' > > t/WordNet-SenseRelate-AllWords......NOK 18# Failed test > (t/WordNet-SenseRelate-AllWords.t at line 136) > > # got: 'is#NT' > > # expected: 'wise#a#1' > > t/WordNet-SenseRelate-AllWords......NOK 19# Failed test > (t/WordNet-SenseRelate-AllWords.t at line 136) > > # got: 'VBZ#NT' > > # expected: 'cat#n#7' > > t/WordNet-SenseRelate-AllWords......ok 30/30# Looks like you failed 14 tests > of 30. > > t/WordNet-SenseRelate-AllWords......dubious > > Test returned status 14 (wstat 3584, 0xe00) > > DIED. FAILED tests 4-10, 13-19 > > Failed 14/30 tests, 53.33% okay > > t/wsd...............................ok 2/5Current configuration: > > context file : /tmp/25819.1in > > format : tagged > > scheme : normal > > tagged text : yes > > measure : WordNet::Similarity::lesk > > window : 3 > > contextScore : 0 > > pairScore : 0 > > measure config: (none) > > glosses : no > > nocompoundify : no > > usemono : no > > backoff : no > > trace : no > > forcepos : no > > stoplist : (none) > > Loading WordNet... done. > > Use of uninitialized value in pattern match (m//) at utils/wsd.pl line 228. > > Use of uninitialized value in concatenation (.) or string at utils/wsd.pl > line 229. > > Use of uninitialized value in pattern match (m//) at utils/wsd.pl line 228. > > Use of uninitialized value in concatenation (.) or string at utils/wsd.pl > line 229. > > Use of uninitialized value in pattern match (m//) at utils/wsd.pl line 228. > > Use of uninitialized value in concatenation (.) or string at utils/wsd.pl > line 229. > > # Failed test (t/wsd.t at line 59) > > # got: 'parking_tickets#NT are#NT expensive#NT #NT #NT #NT ' > > # expected: 'parking_tickets#n#1 are#v#1 expensive#a#1 ' > > t/wsd...............................ok 4/5Current configuration: > > context file : /tmp/25819.2in > > format : raw > > scheme : normal > > tagged text : no > > measure : WordNet::Similarity::lesk > > window : 3 > > contextScore : 0 > > pairScore : 0 > > measure config: (none) > > glosses : no > > nocompoundify : no > > usemono : no > > backoff : no > > trace : no > > forcepos : no > > stoplist : (none) > > Loading WordNet... done. > > t/wsd...............................ok 5/5# Looks like you failed 1 tests of > 5. > > t/wsd...............................dubious > > Test returned status 1 (wstat 256, 0x100) > > DIED. FAILED test 3 > > Failed 1/5 tests, 80.00% okay > > Failed Test Stat Wstat Total Fail Failed List of > Failed > > ------------------------------------------------------------------------------- > > t/Error-Suffixes-tagged-wntagged. 6 1536 41 6 14.63% 3-8 > > t/WordNet-SenseRelate-AllWords.t 14 3584 30 14 46.67% 4-10 13-19 > > t/wsd.t 1 256 5 1 20.00% 3 > > Failed 3/3 test scripts, 0.00% okay. 21/76 subtests failed, 72.37% okay. > > make: *** [test_dynamic] Error 1 > > -------------------------------------------------------- > > Thanks! > > Ted > > On Tue, Apr 6, 2010 at 9:59 AM, Kamal, Jyoti <JK...@et...> wrote: > >> Hello Everyone: > >> I just joined the senserelate mailing group. I work for a project in ETS > >> & we are doing some experiments with various tools out there for > >> semantic similarity. > >> I was able to get WordNet::Similarity to work but it seems that without > >> senserelate, I cannot do much & the combination of both is what I am > >> looking for. I am having really hard time getting senserelate to install > >> on my linux box. Can someone please help? > >> > >> Here is some description of my error. Please let me know if you need > >> more info. > >> ------------------------------------------------------------------------ > >> ------------------------------ > >> > >> Something doesn't seem to be right in extracting the WordNet Tags. It > >> seems that before we get the sense number for each word, we try to tag > >> each word with wordNet Tags & something is missing here. > >> One thing I wanted to bring to attention is that one of the modules > >> needed for SenseRelate is WordNet::Tools but I could not find anywhere > >> of how to install this module. After doing all my study, I came to the > >> conclusion that it comes as a part of WordNet::Similarity & since I > >> already have that up & running, I have Wordnet::Tools working as well. I > >> may be wrong here. > >> > >> After doing the make, When I run "make test", I get various errors > >> like.. > >> > >> [jkamal@etsis134 WordNet-SenseRelate-AllWords-0.19]$ make test > >> PERL_DL_NONLAZY=1 /usr/bin/perl "-MExtUtils::Command::MM" "-e" > >> "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t > >> t/Error-Suffixes-tagged-wntagged....ok 2/41# Failed test > >> (t/Error-Suffixes-tagged-wntagged.t at line 71) > >> t/Error-Suffixes-tagged-wntagged....NOK 3# got: 'The#NT' > >> # expected: 'The#CL' > >> # Failed test (t/Error-Suffixes-tagged-wntagged.t at line 71) > >> . > >> . > >> . > >> Loading WordNet... done. > >> Use of uninitialized value in pattern match (m//) at utils/wsd.pl line > >> 228. > >> Use of uninitialized value in concatenation (.) or string at > >> utils/wsd.pl line 229. > >> Use of uninitialized value in pattern match (m//) at utils/wsd.pl line > >> 228. > >> Use of uninitialized value in concatenation (.) or string at > >> utils/wsd.pl line 229. > >> Use of uninitialized value in pattern match (m//) at utils/wsd.pl line > >> 228. > >> Use of uninitialized value in concatenation (.) or string at > >> utils/wsd.pl line 229. > >> # Failed test (t/wsd.t at line 59) > >> # got: 'parking_tickets#NT are#NT expensive#NT #NT #NT #NT ' > >> # expected: 'parking_tickets#n#1 are#v#1 expensive#a#1 ' > >> > >> ------------------------------------------------------------------------ > >> --------------------------------- > >> Please let me know if you have any question. > >> > >> Thanks! > >> Jyoti > >> > >> > >> -----Original Message----- > >> From: Siddharth Patwardhan [mailto:si...@cs...] > >> Sent: Monday, April 05, 2010 7:15 PM > >> To: Ted Pedersen > >> Cc: Ambikesh jayal; sen...@li...; > >> senserelate-users; sat...@gm... > >> Subject: Re: [Senserelate-users] > >> [Senserelate-developers]WordNet::SenseRelate > >> > >> I remember a little while back Linas Vepsats wrote something that could > >> deal with sensekeys. He's released it on CPAN: > >> > >> http://search.cpan.org/dist/WordNet-SenseKey/ > >> > >> -- Sid. > >> > >> On Mon, 2010-04-05 at 17:34 -0500, Ted Pedersen wrote: > >>> Hi Bano, > >>> > >>> Very impressive memory. :) That had totally slipped my mind, but > >>> indeed it is here (on my very own web page :) > >>> > >>> http://www.d.umn.edu/~tpederse/wordnet.html > >>> > >>> Here's the short description from that page... > >>> > >>> Map from QueryData to WordNet sense-keys > >>> > >>> QueryData identifies WordNet senses using a word#pos#sense format. > >>> WordNet identifies senses using sense-keys (aka mnemonics). This > >>> program creates a mapping between the QueryData format and the WordNet > >>> sense-key format. (This tool is not specific to Senseval-2 data - it > >>> is generally useful if are using QueryData to access WordNet.) > >>> > >>> So, this sounds very much like what Ambikesh may want to use. Thanks > >>> for pointing this out, I absolutely missed this! > >>> > >>> Thanks! > >>> Ted > >>> > >>> On Mon, Apr 5, 2010 at 5:26 PM, Satanjeev Banerjee > >> <sat...@gm...> wrote: > >>> > Hi Ted, > >>> > > >>> > I'm pretty rusty with Senserelate, but I vaguely recall having > >> written a > >>> > program (way back when!) that at least created a map between the > >> sensekeys > >>> > and the word#pos#sense format (but maybe we are talking of something > >> else > >>> > here?) I googled around for it, and found this link: > >>> > http://www.d.umn.edu/~tpederse/Code/Readme-qd2wn.txt. Does this > >> program > >>> > still exist? As far as I remember, it depended on the minutiae of > >> the > >>> > various file formats in WordNet, so I wouldn't be surprised if those > >> formats > >>> > have changed now rendering the program useless :-). > >>> > > >>> > -Bano > >>> > > >>> > On Mon, Apr 5, 2010 at 6:11 PM, Ted Pedersen <dul...@gm...> > >> wrote: > >>> >> > >>> >> Hi Ambikesh, > >>> >> > >>> >> See my comments inline... > >>> >> > >>> >> On Mon, Apr 5, 2010 at 4:43 PM, Ambikesh jayal > >> <jay...@ya...> > >>> >> wrote: > >>> >> > > >>> >> > Hi, > >>> >> > The WordNet::SenseRelate returns the value in the format > >> "infer#v#5". To > >>> >> > run my experiments I need to compare it with a value in the > >> format > >>> >> > "infer%2:31:01::". > >>> >> > 1. Is there a function that takes sense key as input and returns > >> the > >>> >> > corresponding sense number? For example inputting "infer%2:31:01" > >> should > >>> >> > return "infer#v#5". > >>> >> > >>> >> I am not sure, but if there is it would be in WordNet::QueryData. > >>> >> > >>> >> http://search.cpan.org/dist/WordNet-QueryData/ > >>> >> > >>> >> While we use WordNet::QueryData, we don't include all of its > >>> >> functionality, so this might be something that they provide but we > >>> >> don't use. There is mailing list devoted to QueryData that might be > >>> >> the best place to ask this - it's a google group named wn-perl > >>> >> (details can be found at the site above). > >>> >> > >>> >> > > >>> >> > 2. Can WordNet::SenseRelate be configured to return the results > >> in the > >>> >> > format "infer%2:31:01::" ? > >>> >> > >>> >> No, we only support the wps format (word#part-of-speech#sense, as > >> in > >>> >> dog#n#2). > >>> >> > >>> >> > Also can WordNet::SenseRelate be configured for list of > >> stopwords, > >>> >> > special characters? > >>> >> > >>> >> Yes. See the stoplist option described here > >>> >> > >>> >> > >>> >> > >> http://search.cpan.org/dist/WordNet-SenseRelate-AllWords/lib/WordNet/Sen > >> seRelate/AllWords.pm > >>> >> > >>> >> and here > >>> >> > >>> >> > >> http://search.cpan.org/dist/WordNet-SenseRelate-AllWords/utils/wsd.pl > >>> >> > >>> >> and find a sample stoplist here : > >>> >> > >>> >> > >>> >> > >> http://cpansearch.perl.org/src/TPEDERSE/WordNet-SenseRelate-AllWords-0.1 > >> 9/samples/default-stoplist-raw.txt > >>> >> > >>> >> ;) > >>> >> > >>> >> Good luck, > >>> >> Ted > >>> >> > >>> >> > Thanks, > >>> >> > Regards, > >>> >> > Ambikesh Jayal. > >>> >> > School of IS, Computing & Maths, > >>> >> > Brunel University, > >>> >> > Uxbridge, UB8 3PH, > >>> >> > United Kingdom. > >>> >> > Email: amb...@br... > >>> >> > Webpage: http://people.brunel.ac.uk/~cspgaaj > >>> >> > > >>> >> > >>> >> > >>> >> -- > >>> >> Ted Pedersen > >>> >> http://www.d.umn.edu/~tpederse > >>> >> > >>> >> > >>> >> > >> ------------------------------------------------------------------------ > >> ------ > >>> >> Download Intel® Parallel Studio Eval > >>> >> Try the new software tools for yourself. Speed compiling, find bugs > >>> >> proactively, and fine-tune applications for parallel performance. > >>> >> See why Intel Parallel Studio got high marks during beta. > >>> >> http://p.sf.net/sfu/intel-sw-dev > >>> >> _______________________________________________ > >>> >> senserelate-developers mailing list > >>> >> sen...@li... > >>> >> https://lists.sourceforge.net/lists/listinfo/senserelate-developers > >>> > > >>> > > >>> > >>> > >>> > >>> -- > >>> Ted Pedersen > >>> http://www.d.umn.edu/~tpederse > >>> > >>> > >> ------------------------------------------------------------------------ > >> ------ > >>> Download Intel® Parallel Studio Eval > >>> Try the new software tools for yourself. Speed compiling, find bugs > >>> proactively, and fine-tune applications for parallel performance. > >>> See why Intel Parallel Studio got high marks during beta. > >>> http://p.sf.net/sfu/intel-sw-dev > >>> _______________________________________________ > >>> senserelate-developers mailing list > >>> sen...@li... > >>> https://lists.sourceforge.net/lists/listinfo/senserelate-developers > >> > >> > >> ------------------------------------------------------------------------ > >> ------ > >> Download Intel® Parallel Studio Eval > >> Try the new software tools for yourself. Speed compiling, find bugs > >> proactively, and fine-tune applications for parallel performance. > >> See why Intel Parallel Studio got high marks during beta. > >> http://p.sf.net/sfu/intel-sw-dev > >> _______________________________________________ > >> senserelate-users mailing list > >> sen...@li... > >> https://lists.sourceforge.net/lists/listinfo/senserelate-users > >> > >> -------------------------------------------------- > >> This e-mail and any files transmitted with it may contain privileged or >> confidential information. > >> It is solely for use by the individual for whom it is intended, even if >> addressed incorrectly. > >> If you received this e-mail in error, please notify the sender; do not >> disclose, copy, distribute, > >> or take any action in reliance on the contents of this information; and >> delete it from > >> your system. Any other use of this e-mail is prohibited. > >> > >> Thank you for your compliance. > >> -------------------------------------------------- > >> > >> > > -- > > Ted Pedersen > > http://www.d.umn.edu/~tpederse > > -------------------------------------------------- > This e-mail and any files transmitted with it may contain privileged or > confidential information. > It is solely for use by the individual for whom it is intended, even if > addressed incorrectly. > If you received this e-mail in error, please notify the sender; do not > disclose, copy, distribute, > or take any action in reliance on the contents of this information; and > delete it from > your system. Any other use of this e-mail is prohibited. > > Thank you for your compliance. > -------------------------------------------------- > -- Ted Pedersen http://www.d.umn.edu/~tpederse |