Re: [infomap-nlp-users] Fwd: [infomap-nlp-devel] FEWER THAN EXPECTED SINGULAR VALUES

[Dominic W. <wi...@ma...>]

Dear Marie,

I've seen this happen a few times with smaller corpora.

I think that the basic reason is that sometimes the singular value  
decomposition "completes" with fewer values than you asked for. With  
smaller matrices, this is reasonably obvious - there's no point  
asking for a 100-dimensional simplification of a matrix that has  
fewer than 100 independent rows or columns. So the number of singular  
values can't exceed the rank of the matrix. I don't really understand  
what effect this has within the SVDPACK that infomap uses - all I've  
seen is the warning message, and that for smaller corpora, the  
reduced vectors often contain a lot of trailing zeros.

But the models still work - it's a warning, not an error as such. Is  
this your experience or are you actually unable to search the models  
you create?

Best wishes,
Dominic


On Feb 9, 2007, at 12:46 PM, Scott Cederberg wrote:

> ---------- Forwarded message ----------
> From: Marie Gustafsson <mag...@ps...>
> Date: Feb 9, 2007 4:26 AM
> Subject: [infomap-nlp-devel] FEWER THAN EXPECTED SINGULAR VALUES
> To: inf...@li...,
> "inf...@li..."@smtp3.su.se
>
>
>
>  Dear all,
>
>  While infomap-build -s, during svd.interface I get this message:
>
>    FEWER THAN EXPECTED SINGULAR VALUES
>
>  Anyone who can help me solve this problem?
>
>  Best regards,
>  Marie Gustafsson
>
>
>
>  ==================================================
>  Building target: /home/sverker/infomap_models/test22/left
>  Prerequisites: /home/sverker/infomap_models/test22/coll
> /home/sverker/infomap_models/test22/indx
>  Tue Jan 23 01:18:31 PST 2007
>  ..................................................
>  cd /home/sverker/infomap_models/test22 && rm -f svd_diag left \
>                          rght sing
>  cd /home/sverker/infomap_models/test22 && svdinterface \
>          -singvals 100 \
>          -iter 100
>
>    This is svdinterface.
>
>    Writing to: left
>    Writing to: rght
>    Writing to: sing
>    Writing to: svd_diag
>    Reading: indx
>    Reading: indx
>    Reading: coll
>
>    FEWER THAN EXPECTED SINGULAR VALUES
>  ..................................................
>  Finishing target: /home/sverker/infomap_models/test22/left
>  ==================================================
>
>
>  ==================================================
>  Building target: /home/sverker/infomap_models/test22/wordvec.bin
>  Prerequisites: /home/sverker/infomap_models/test22/left
> /home/sverker/infomap_models/test22/dic
>  Tue Jan 23 01:18:31 PST 2007
>  ..................................................
>  encode_wordvec \
>          -m /home/sverker/infomap_models/test22
>  Opening File for "r":
>          "/home/sverker/infomap_models/test22/left"
>  Opening File for "w":
>          "/home/sverker/infomap_models/test22/wordvec.bin"
>  Reading the dictionary...
>  Opening File for "r":
>          "/home/sverker/infomap_models/test22/dic"
>  Initializing row indices...Done.
>  ..................................................
>  Finishing target: /home/sverker/infomap_models/test22/wordvec.bin
>  ==================================================
>
>
> ---------------------------------------------------------------------- 
> ---
> Using Tomcat but need to do more? Need to support web services,  
> security?
> Get stuff done quickly with pre-integrated technology to make your  
> job easier.
> Download IBM WebSphere Application Server v.1.0.1 based on Apache  
> Geronimo
> http://sel.as-us.falkag.net/sel? 
> cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> infomap-nlp-devel mailing list
> inf...@li...
> https://lists.sourceforge.net/lists/listinfo/infomap-nlp-devel
>
> ---------------------------------------------------------------------- 
> ---
> Using Tomcat but need to do more? Need to support web services,  
> security?
> Get stuff done quickly with pre-integrated technology to make your  
> job easier.
> Download IBM WebSphere Application Server v.1.0.1 based on Apache  
> Geronimo
> http://sel.as-us.falkag.net/sel? 
> cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> infomap-nlp-users mailing list
> inf...@li...
> https://lists.sourceforge.net/lists/listinfo/infomap-nlp-users
>