Menu
▾
▴
infomap-nlp-users
|
From: Scott C. <ced...@gm...> - 2007-02-09 17:46:22
|
---------- Forwarded message ----------
From: Marie Gustafsson <mag...@ps...>
Date: Feb 9, 2007 4:26 AM
Subject: [infomap-nlp-devel] FEWER THAN EXPECTED SINGULAR VALUES
To: inf...@li...,
inf...@li...
Dear all,
While infomap-build -s, during svd.interface I get this message:
FEWER THAN EXPECTED SINGULAR VALUES
Anyone who can help me solve this problem?
Best regards,
Marie Gustafsson
==================================================
Building target: /home/sverker/infomap_models/test22/left
Prerequisites: /home/sverker/infomap_models/test22/coll
/home/sverker/infomap_models/test22/indx
Tue Jan 23 01:18:31 PST 2007
..................................................
cd /home/sverker/infomap_models/test22 && rm -f svd_diag left \
rght sing
cd /home/sverker/infomap_models/test22 && svdinterface \
-singvals 100 \
-iter 100
This is svdinterface.
Writing to: left
Writing to: rght
Writing to: sing
Writing to: svd_diag
Reading: indx
Reading: indx
Reading: coll
FEWER THAN EXPECTED SINGULAR VALUES
..................................................
Finishing target: /home/sverker/infomap_models/test22/left
==================================================
==================================================
Building target: /home/sverker/infomap_models/test22/wordvec.bin
Prerequisites: /home/sverker/infomap_models/test22/left
/home/sverker/infomap_models/test22/dic
Tue Jan 23 01:18:31 PST 2007
..................................................
encode_wordvec \
-m /home/sverker/infomap_models/test22
Opening File for "r":
"/home/sverker/infomap_models/test22/left"
Opening File for "w":
"/home/sverker/infomap_models/test22/wordvec.bin"
Reading the dictionary...
Opening File for "r":
"/home/sverker/infomap_models/test22/dic"
Initializing row indices...Done.
..................................................
Finishing target: /home/sverker/infomap_models/test22/wordvec.bin
==================================================
-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
infomap-nlp-devel mailing list
inf...@li...
https://lists.sourceforge.net/lists/listinfo/infomap-nlp-devel
|
|
From: Dominic W. <wi...@ma...> - 2007-02-12 17:37:40
|
Dear Marie, I've seen this happen a few times with smaller corpora. I think that the basic reason is that sometimes the singular value decomposition "completes" with fewer values than you asked for. With smaller matrices, this is reasonably obvious - there's no point asking for a 100-dimensional simplification of a matrix that has fewer than 100 independent rows or columns. So the number of singular values can't exceed the rank of the matrix. I don't really understand what effect this has within the SVDPACK that infomap uses - all I've seen is the warning message, and that for smaller corpora, the reduced vectors often contain a lot of trailing zeros. But the models still work - it's a warning, not an error as such. Is this your experience or are you actually unable to search the models you create? Best wishes, Dominic On Feb 9, 2007, at 12:46 PM, Scott Cederberg wrote: > ---------- Forwarded message ---------- > From: Marie Gustafsson <mag...@ps...> > Date: Feb 9, 2007 4:26 AM > Subject: [infomap-nlp-devel] FEWER THAN EXPECTED SINGULAR VALUES > To: inf...@li..., > "inf...@li..."@smtp3.su.se > > > > Dear all, > > While infomap-build -s, during svd.interface I get this message: > > FEWER THAN EXPECTED SINGULAR VALUES > > Anyone who can help me solve this problem? > > Best regards, > Marie Gustafsson > > > > ================================================== > Building target: /home/sverker/infomap_models/test22/left > Prerequisites: /home/sverker/infomap_models/test22/coll > /home/sverker/infomap_models/test22/indx > Tue Jan 23 01:18:31 PST 2007 > .................................................. > cd /home/sverker/infomap_models/test22 && rm -f svd_diag left \ > rght sing > cd /home/sverker/infomap_models/test22 && svdinterface \ > -singvals 100 \ > -iter 100 > > This is svdinterface. > > Writing to: left > Writing to: rght > Writing to: sing > Writing to: svd_diag > Reading: indx > Reading: indx > Reading: coll > > FEWER THAN EXPECTED SINGULAR VALUES > .................................................. > Finishing target: /home/sverker/infomap_models/test22/left > ================================================== > > > ================================================== > Building target: /home/sverker/infomap_models/test22/wordvec.bin > Prerequisites: /home/sverker/infomap_models/test22/left > /home/sverker/infomap_models/test22/dic > Tue Jan 23 01:18:31 PST 2007 > .................................................. > encode_wordvec \ > -m /home/sverker/infomap_models/test22 > Opening File for "r": > "/home/sverker/infomap_models/test22/left" > Opening File for "w": > "/home/sverker/infomap_models/test22/wordvec.bin" > Reading the dictionary... > Opening File for "r": > "/home/sverker/infomap_models/test22/dic" > Initializing row indices...Done. > .................................................. > Finishing target: /home/sverker/infomap_models/test22/wordvec.bin > ================================================== > > > ---------------------------------------------------------------------- > --- > Using Tomcat but need to do more? Need to support web services, > security? > Get stuff done quickly with pre-integrated technology to make your > job easier. > Download IBM WebSphere Application Server v.1.0.1 based on Apache > Geronimo > http://sel.as-us.falkag.net/sel? > cmd=lnk&kid=120709&bid=263057&dat=121642 > _______________________________________________ > infomap-nlp-devel mailing list > inf...@li... > https://lists.sourceforge.net/lists/listinfo/infomap-nlp-devel > > ---------------------------------------------------------------------- > --- > Using Tomcat but need to do more? Need to support web services, > security? > Get stuff done quickly with pre-integrated technology to make your > job easier. > Download IBM WebSphere Application Server v.1.0.1 based on Apache > Geronimo > http://sel.as-us.falkag.net/sel? > cmd=lnk&kid=120709&bid=263057&dat=121642 > _______________________________________________ > infomap-nlp-users mailing list > inf...@li... > https://lists.sourceforge.net/lists/listinfo/infomap-nlp-users > |
|
From: Rob M. <rm...@ma...> - 2007-02-12 18:21:02
|
Hi, For larger corpora, raising the number of iterations can help SVDPACK find more singular values, and also increases the accuracy of the smaller ones. --- Rob Malouf <rm...@ma...> Department of Linguistics and Asian/Middle Eastern Languages San Diego State University On Feb 12, 2007, at 9:37 AM, Dominic Widdows wrote: > Dear Marie, > > I've seen this happen a few times with smaller corpora. > > I think that the basic reason is that sometimes the singular value > decomposition "completes" with fewer values than you asked for. With > smaller matrices, this is reasonably obvious - there's no point > asking for a 100-dimensional simplification of a matrix that has > fewer than 100 independent rows or columns. So the number of singular > values can't exceed the rank of the matrix. I don't really understand > what effect this has within the SVDPACK that infomap uses - all I've > seen is the warning message, and that for smaller corpora, the > reduced vectors often contain a lot of trailing zeros. > > But the models still work - it's a warning, not an error as such. Is > this your experience or are you actually unable to search the models > you create? > > Best wishes, > Dominic > > > On Feb 9, 2007, at 12:46 PM, Scott Cederberg wrote: > >> ---------- Forwarded message ---------- >> From: Marie Gustafsson <mag...@ps...> >> Date: Feb 9, 2007 4:26 AM >> Subject: [infomap-nlp-devel] FEWER THAN EXPECTED SINGULAR VALUES >> To: inf...@li..., >> "inf...@li..."@smtp3.su.se >> >> >> >> Dear all, >> >> While infomap-build -s, during svd.interface I get this message: >> >> FEWER THAN EXPECTED SINGULAR VALUES >> >> Anyone who can help me solve this problem? >> >> Best regards, >> Marie Gustafsson >> >> >> >> ================================================== >> Building target: /home/sverker/infomap_models/test22/left >> Prerequisites: /home/sverker/infomap_models/test22/coll >> /home/sverker/infomap_models/test22/indx >> Tue Jan 23 01:18:31 PST 2007 >> .................................................. >> cd /home/sverker/infomap_models/test22 && rm -f svd_diag left \ >> rght sing >> cd /home/sverker/infomap_models/test22 && svdinterface \ >> -singvals 100 \ >> -iter 100 >> >> This is svdinterface. >> >> Writing to: left >> Writing to: rght >> Writing to: sing >> Writing to: svd_diag >> Reading: indx >> Reading: indx >> Reading: coll >> >> FEWER THAN EXPECTED SINGULAR VALUES >> .................................................. >> Finishing target: /home/sverker/infomap_models/test22/left >> ================================================== >> >> >> ================================================== >> Building target: /home/sverker/infomap_models/test22/wordvec.bin >> Prerequisites: /home/sverker/infomap_models/test22/left >> /home/sverker/infomap_models/test22/dic >> Tue Jan 23 01:18:31 PST 2007 >> .................................................. >> encode_wordvec \ >> -m /home/sverker/infomap_models/test22 >> Opening File for "r": >> "/home/sverker/infomap_models/test22/left" >> Opening File for "w": >> "/home/sverker/infomap_models/test22/wordvec.bin" >> Reading the dictionary... >> Opening File for "r": >> "/home/sverker/infomap_models/test22/dic" >> Initializing row indices...Done. >> .................................................. >> Finishing target: /home/sverker/infomap_models/test22/wordvec.bin >> ================================================== >> >> >> --------------------------------------------------------------------- >> - >> --- >> Using Tomcat but need to do more? Need to support web services, >> security? >> Get stuff done quickly with pre-integrated technology to make your >> job easier. >> Download IBM WebSphere Application Server v.1.0.1 based on Apache >> Geronimo >> http://sel.as-us.falkag.net/sel? >> cmd=lnk&kid=120709&bid=263057&dat=121642 >> _______________________________________________ >> infomap-nlp-devel mailing list >> inf...@li... >> https://lists.sourceforge.net/lists/listinfo/infomap-nlp-devel >> >> --------------------------------------------------------------------- >> - >> --- >> Using Tomcat but need to do more? Need to support web services, >> security? >> Get stuff done quickly with pre-integrated technology to make your >> job easier. >> Download IBM WebSphere Application Server v.1.0.1 based on Apache >> Geronimo >> http://sel.as-us.falkag.net/sel? >> cmd=lnk&kid=120709&bid=263057&dat=121642 >> _______________________________________________ >> infomap-nlp-users mailing list >> inf...@li... >> https://lists.sourceforge.net/lists/listinfo/infomap-nlp-users >> > > > ---------------------------------------------------------------------- > --- > Using Tomcat but need to do more? Need to support web services, > security? > Get stuff done quickly with pre-integrated technology to make your > job easier. > Download IBM WebSphere Application Server v.1.0.1 based on Apache > Geronimo > http://sel.as-us.falkag.net/sel? > cmd=lnk&kid=120709&bid=263057&dat=121642 > _______________________________________________ > infomap-nlp-users mailing list > inf...@li... > https://lists.sourceforge.net/lists/listinfo/infomap-nlp-users |
×
Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.
Thanks for helping keep SourceForge clean.
X