Re: [infomap-nlp-users] Fwd: [infomap-nlp-devel] FEWER THAN EXPECTED SINGULAR VALUES

[Rob M. <rm...@ma...>]

Hi,

For larger corpora, raising the number of iterations can help SVDPACK  
find more singular values, and also increases the accuracy of the  
smaller ones.

---
Rob Malouf <rm...@ma...>
Department of Linguistics and Asian/Middle Eastern Languages
San Diego State University


On Feb 12, 2007, at 9:37 AM, Dominic Widdows wrote:

> Dear Marie,
>
> I've seen this happen a few times with smaller corpora.
>
> I think that the basic reason is that sometimes the singular value
> decomposition "completes" with fewer values than you asked for. With
> smaller matrices, this is reasonably obvious - there's no point
> asking for a 100-dimensional simplification of a matrix that has
> fewer than 100 independent rows or columns. So the number of singular
> values can't exceed the rank of the matrix. I don't really understand
> what effect this has within the SVDPACK that infomap uses - all I've
> seen is the warning message, and that for smaller corpora, the
> reduced vectors often contain a lot of trailing zeros.
>
> But the models still work - it's a warning, not an error as such. Is
> this your experience or are you actually unable to search the models
> you create?
>
> Best wishes,
> Dominic
>
>
> On Feb 9, 2007, at 12:46 PM, Scott Cederberg wrote:
>
>> ---------- Forwarded message ----------
>> From: Marie Gustafsson <mag...@ps...>
>> Date: Feb 9, 2007 4:26 AM
>> Subject: [infomap-nlp-devel] FEWER THAN EXPECTED SINGULAR VALUES
>> To: inf...@li...,
>> "inf...@li..."@smtp3.su.se
>>
>>
>>
>>  Dear all,
>>
>>  While infomap-build -s, during svd.interface I get this message:
>>
>>    FEWER THAN EXPECTED SINGULAR VALUES
>>
>>  Anyone who can help me solve this problem?
>>
>>  Best regards,
>>  Marie Gustafsson
>>
>>
>>
>>  ==================================================
>>  Building target: /home/sverker/infomap_models/test22/left
>>  Prerequisites: /home/sverker/infomap_models/test22/coll
>> /home/sverker/infomap_models/test22/indx
>>  Tue Jan 23 01:18:31 PST 2007
>>  ..................................................
>>  cd /home/sverker/infomap_models/test22 && rm -f svd_diag left \
>>                          rght sing
>>  cd /home/sverker/infomap_models/test22 && svdinterface \
>>          -singvals 100 \
>>          -iter 100
>>
>>    This is svdinterface.
>>
>>    Writing to: left
>>    Writing to: rght
>>    Writing to: sing
>>    Writing to: svd_diag
>>    Reading: indx
>>    Reading: indx
>>    Reading: coll
>>
>>    FEWER THAN EXPECTED SINGULAR VALUES
>>  ..................................................
>>  Finishing target: /home/sverker/infomap_models/test22/left
>>  ==================================================
>>
>>
>>  ==================================================
>>  Building target: /home/sverker/infomap_models/test22/wordvec.bin
>>  Prerequisites: /home/sverker/infomap_models/test22/left
>> /home/sverker/infomap_models/test22/dic
>>  Tue Jan 23 01:18:31 PST 2007
>>  ..................................................
>>  encode_wordvec \
>>          -m /home/sverker/infomap_models/test22
>>  Opening File for "r":
>>          "/home/sverker/infomap_models/test22/left"
>>  Opening File for "w":
>>          "/home/sverker/infomap_models/test22/wordvec.bin"
>>  Reading the dictionary...
>>  Opening File for "r":
>>          "/home/sverker/infomap_models/test22/dic"
>>  Initializing row indices...Done.
>>  ..................................................
>>  Finishing target: /home/sverker/infomap_models/test22/wordvec.bin
>>  ==================================================
>>
>>
>> --------------------------------------------------------------------- 
>> -
>> ---
>> Using Tomcat but need to do more? Need to support web services,
>> security?
>> Get stuff done quickly with pre-integrated technology to make your
>> job easier.
>> Download IBM WebSphere Application Server v.1.0.1 based on Apache
>> Geronimo
>> http://sel.as-us.falkag.net/sel?
>> cmd=lnk&kid=120709&bid=263057&dat=121642
>> _______________________________________________
>> infomap-nlp-devel mailing list
>> inf...@li...
>> https://lists.sourceforge.net/lists/listinfo/infomap-nlp-devel
>>
>> --------------------------------------------------------------------- 
>> -
>> ---
>> Using Tomcat but need to do more? Need to support web services,
>> security?
>> Get stuff done quickly with pre-integrated technology to make your
>> job easier.
>> Download IBM WebSphere Application Server v.1.0.1 based on Apache
>> Geronimo
>> http://sel.as-us.falkag.net/sel?
>> cmd=lnk&kid=120709&bid=263057&dat=121642
>> _______________________________________________
>> infomap-nlp-users mailing list
>> inf...@li...
>> https://lists.sourceforge.net/lists/listinfo/infomap-nlp-users
>>
>
>
> ---------------------------------------------------------------------- 
> ---
> Using Tomcat but need to do more? Need to support web services,  
> security?
> Get stuff done quickly with pre-integrated technology to make your  
> job easier.
> Download IBM WebSphere Application Server v.1.0.1 based on Apache  
> Geronimo
> http://sel.as-us.falkag.net/sel? 
> cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> infomap-nlp-users mailing list
> inf...@li...
> https://lists.sourceforge.net/lists/listinfo/infomap-nlp-users