[Refdb-devel] [ refdb-Bugs-1951835 ] risx url multiplying
Status: Beta
Brought to you by:
mhoenicka
From: SourceForge.net <no...@so...> - 2011-03-09 06:31:40
|
Bugs item #1951835, was opened at 2008-04-25 18:32 Message generated for change (Comment added) made by nobody You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1951835&group_id=26091 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: refdbd Group: None Status: Closed Resolution: Fixed Priority: 5 Private: No Submitted By: Damien Jade Duff (damienjadeduff) Assigned to: Markus Hoenicka (mhoenicka) Summary: risx url multiplying Initial Comment: Hiya! Sorry but got another one here for the pile! Now I'm using sqlite here and the issue seems similar to a previous one in which it wasn't refdb but libdbi. If I UPDATE a reference using refdbc that already has a LINK TYPE="url" but I have changed the url (i.e. the update is one in which the url changes), the url tag multiplies - I get another tag, one with the old url, one with the new. I presume I can get any number of them but I haven't checked. The way I judge the intended behaviour of updateref, an update should swap the reference with everything in the RIS tag and drop the old information. Whaddya reckon? Details below. Cheerios! Damien SETUP: refdb-1.0.0-pre1 (also happening on the svn as of this morning) libdbi-cvs-20080421 libdbi-drivers-cvs-20080421 sqlite-3.5.8 Linux acws-0175 2.6.9-67.0.7.ELsmp #1 SMP Sat Mar 15 06:54:55 EDT 2008 i686 i686 i386 GNU/Linux EXAMPLE: mycomp% cat thisisatest2.risx <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN" "http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [ <!ENTITY lt "&#60;"> <!ENTITY gt ">"> <!ENTITY amp "&#38;"> <!ENTITY mdash "—"> <!ENTITY lsquo "‘"> <!ENTITY rsquo "’"> ]> <ris> <entry type="CONF" citekey="THISISATEST"> <part> <title type="full">A New Extension of the Kalman Filter to Nonlinear Systems</title> <author role="author"> <name>Simon J. Julier</name> </author> <author role="author"> <name>Jeffrey K. Uhlmann</name> </author> </part> <publication> <title type="full">Int. Symp. Aerospace/Defense Sensing, Simul. and Controls</title> <pubinfo> <pubdate type="primary"> <date><year>1997</year><month>00</month><day>00</day></date> </pubdate> <city>Orlando, Florida</city> <link type="url">http://www.cs.unc.edu/~welch/kalman/media/pdf/Julier1997_SPIE_KF.pdf</link> </pubinfo> </publication> <libinfo user="djd"> <notes></notes> <reprint status="INFILE"/> <availability type="useroot"/> </libinfo> <contents> <keyword>bayesian</keyword> <keyword>kalman</keyword> <keyword>non-linear</keyword> <keyword>nonlinear</keyword> <keyword>probability</keyword> <keyword>recursive estimation</keyword> <keyword>tracking</keyword> <keyword>unscented</keyword> </contents> </entry> </ris> mycomp% refdbc -d djdphd -u djd -w abc -C addref -A risx < thisisatest2.risx 999:1 added:0 skipped:0 failed mycomp% refdbc -d djdphd -u djd -w abc -C getref -t risx :CK:=THISISATEST > testout1.risx 999:1 retrieved:0 failed mycomp% cat testout1.risx <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN" "http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [ <!ENTITY lt "&#60;"> <!ENTITY gt ">"> <!ENTITY amp "&#38;"> <!ENTITY mdash "—"> <!ENTITY lsquo "‘"> <!ENTITY rsquo "’"> ]> <ris> <entry type="CONF" id="209" citekey="THISISATEST"> <part> <title type="full">A New Extension of the Kalman Filter to Nonlinear Systems</title> <author role="author"> <name>Simon J. Julier</name> </author> <author role="author"> <name>Jeffrey K. Uhlmann</name> </author> </part> <publication> <title type="full">Int. Symp. Aerospace/Defense Sensing, Simul. and Controls</title> <pubinfo> <pubdate type="primary"> <date><year>1997</year><month>00</month><day>00</day></date> </pubdate> <city>Orlando, Florida</city> <link type="url">http://www.cs.unc.edu/~welch/kalman/media/pdf/Julier1997_SPIE_KF.pdf</link> </pubinfo> </publication> <libinfo user="djd"> <reprint status="INFILE"/> <availability type="useroot"/> </libinfo> <contents> <keyword>bayesian</keyword> <keyword>kalman</keyword> <keyword>non-linear</keyword> <keyword>nonlinear</keyword> <keyword>probability</keyword> <keyword>recursive estimation</keyword> <keyword>tracking</keyword> <keyword>unscented</keyword> </contents> </entry> </ris> mycomp% cat thisisatest.risx <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN" "http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [ <!ENTITY lt "&#60;"> <!ENTITY gt ">"> <!ENTITY amp "&#38;"> <!ENTITY mdash "—"> <!ENTITY lsquo "‘"> <!ENTITY rsquo "’"> ]> <ris> <entry type="CONF" id="196" citekey="THISISATEST"> <part> <title type="full">A New Extension of the Kalman Filter to Nonlinear Systems</title> <author role="author"> <name>Simon J. Julier</name> </author> <author role="author"> <name>Jeffrey K. Uhlmann</name> </author> </part> <publication> <title type="full">Int. Symp. Aerospace/Defense Sensing, Simul. and Controls</title> <pubinfo> <pubdate type="primary"> <date><year>1997</year><month>00</month><day>00</day></date> </pubdate> <city>Orlando, Florida</city> <link type="url">http://tinyurl.com/4dqojq</link> </pubinfo> </publication> <libinfo user="djd"> <notes>bibtex doesn't seem to like all the escape characters refdb puts in the original URL so we switch to tinurl for now...</notes> <reprint status="INFILE"/> <availability type="useroot"/> </libinfo> <contents> <keyword>bayesian</keyword> <keyword>kalman</keyword> <keyword>non-linear</keyword> <keyword>nonlinear</keyword> <keyword>probability</keyword> <keyword>recursive estimation</keyword> <keyword>tracking</keyword> <keyword>unscented</keyword> </contents> </entry> </ris> mycomp% refdbc -d djdphd -u djd -w abc -C updateref -A risx < thisisatest.risx 999:1 updated:0 added:0 skipped:0 failed mycomp% refdbc -d djdphd -u djd -w abc -C getref -t risx :CK:=THISISATEST > testout2.risx 999:1 retrieved:0 failed mycomp% cat testout2.risx <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN" "http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [ <!ENTITY lt "&#60;"> <!ENTITY gt ">"> <!ENTITY amp "&#38;"> <!ENTITY mdash "—"> <!ENTITY lsquo "‘"> <!ENTITY rsquo "’"> ]> <ris> <entry type="CONF" id="209" citekey="THISISATEST"> <part> <title type="full">A New Extension of the Kalman Filter to Nonlinear Systems</title> <author role="author"> <name>Simon J. Julier</name> </author> <author role="author"> <name>Jeffrey K. Uhlmann</name> </author> </part> <publication> <title type="full">Int. Symp. Aerospace/Defense Sensing, Simul. and Controls</title> <pubinfo> <pubdate type="primary"> <date><year>1997</year><month>00</month><day>00</day></date> </pubdate> <city>Orlando, Florida</city> <link type="url">http://tinyurl.com/4dqojq</link> <link type="url">http://www.cs.unc.edu/~welch/kalman/media/pdf/Julier1997_SPIE_KF.pdf</link> </pubinfo> </publication> <libinfo user="djd"> <notes>bibtex doesn't seem to like all the escape characters refdb puts in the original URL so we switch to tinurl for now...</notes> <reprint status="INFILE"/> <availability type="useroot"/> </libinfo> <contents> <keyword>bayesian</keyword> <keyword>kalman</keyword> <keyword>non-linear</keyword> <keyword>nonlinear</keyword> <keyword>probability</keyword> <keyword>recursive estimation</keyword> <keyword>tracking</keyword> <keyword>unscented</keyword> </contents> </entry> </ris> ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2011-03-09 06:31 Message: CbOMe1 <a href="http://jcbmzlajqoyl.com/">jcbmzlajqoyl</a>, [url=http://istruweloufy.com/]istruweloufy[/url], [link=http://jgcaxqmvkzdg.com/]jgcaxqmvkzdg[/link], http://yizhxnypuhmv.com/ ---------------------------------------------------------------------- Comment By: Markus Hoenicka (mhoenicka) Date: 2008-04-29 22:11 Message: Logged In: YES user_id=85809 Originator: NO Hi again, I've checked in a fix which resolves the URL duplication (and hopefully doesn't break anything else), as well as an updated installation chapter which avoids naming the dump file versions explicitly. I'm going to close this bug, but feel free to reopen it if updating references should still fail on your box. regards, Markus ---------------------------------------------------------------------- Comment By: Markus Hoenicka (mhoenicka) Date: 2008-04-29 19:55 Message: Logged In: YES user_id=85809 Originator: NO Hi, lets go through your tests one by one: Part 1: URL duplication I'm afraid I made an error when checking the URL duplication stuff. Apparently I updated an existing entry with the original dataset - this reproducibly does not duplicate the URL. However, if I follow your instructions step by step, I do see the duplicate. I'll provide a fix asap. Part 2: refdb main database file creation If the manual still mentions refdb.2.dump.sqlite, the information is outdated. I'll try and rewrite the sections so I don't have to update them with each new version of the dump files. Indeed, refdb.3.dump.sqlite is the current version which should work ok. Part 3: refdbd -a As for upgrading from a main database version 2 to version 3, there was indeed a bug caused by an incomplete migration to the latest libdbi version. I've fixed that in svn, and I can successfully update a sqlite3 main database. Other stuff: I had forgotten to check in refdbrtfrc. It should pop up next time you upgrade your svn version. regards, Markus ---------------------------------------------------------------------- Comment By: Damien Jade Duff (damienjadeduff) Date: 2008-04-29 16:51 Message: Logged In: YES user_id=2066694 Originator: YES Oh, hi Incidentally, I should mention that the same stuff also happens if I don't ever add the ~/simplerisx.risx file, which only is an older version of risx because I used an older xml skeleton and haven't updated. I just was using it to check that the system was working. Peace Damien ---------------------------------------------------------------------- Comment By: Damien Jade Duff (damienjadeduff) Date: 2008-04-29 16:43 Message: Logged In: YES user_id=2066694 Originator: YES Hi there! Thanks very much for your reply! I appreciate you taking a look! I was, it is true, using 0.9.9-1 when I first started using refdb again recently, but I'm now using the svn. But the thing is I put the refs into the DB by adding an old dumped RISX file into an empty DB (I give an example below). I was thinking that it may be my route to installation that is specific? Since 'refdbd -a' segfaults (not sure why, but details below - part *3) and refdb complains that a DB created with refdb.2.dump.sqlite is an out of date DB (again below, part *2 - though I think the manual still refers to refdb.2.dump.sqlite), I was creating a basic refdb DB using the provided sql file refdb.3.dump.sqlite (full details below, part *1, including a replication of bug 1951835 after creating a new DB from scratch) - which *seemed* to produce the desired results, except for the bugs I mentioned which made themselves apparent later, so I had (perhaps foolishingly) assumed it was the way to go. The other two things that are unique about my install is that I'm using my own database file directory for the embedded DB, and the whole install was done onto a user owned file system (i.e. nothing from root). I'm not sure if that would make any difference. ALSO, in the source directory I needed to go to /etc and type "touch refdbrtfrc" as the make script seemed to need it but it wasn't there, and I renamed the man and doc directories (and put in dummy Makefiles) so that it would compile without the docs (again, I don't think any of that should make a difference?). Anyway, I'll just put the logs of my journey, from DB creation to insertion, below, and hope the tale will amuse... Cheerios! Damien **** FIRST PART *1 - REFDB.3.DUMP.SQLITE + DUPLICATED URLS **** mycomp% ls mycomp% sqlite3 refdb < ~/HD/binary/share/refdb/sql/refdb.3.dump.sqlite mycomp% ls refdb ** (start refdbd in another window) ** mycomp% refdbd -s -l 7 -e 0 dbi_driver_dir went to: dbi is up using default driver dir Available libdbi database drivers: pgsql sqlite3 Requested libdbi driver found: sqlite3 Database directory: /data/private/djd/Library/ReferenceDatabaseSqlite3/ application server started share extended notes by default use /tmp/refdbd_fifo8917 as fifo server waiting n_max_fd=4 ** (back to original window) ** mycomp% refdba refdba: createdb djdphd 999:1 created:0 failed refdba: quit mycomp% ls DB_VERSION djdphd refdb mycomp% refdbc -u 132 -w 123 -C addref -A risx < ~/simplerisx.risx 999:1 added:0 skipped:0 failed mycomp% refdbc -u 132 -w 123 -C addref -A risx < ~/thisisatest2.risx 999:1 added:0 skipped:0 failed mycomp% refdbc -u 132 -w 123 -C updateref -A risx < ~/thisisatest.risx 999:1 updated:0 added:0 skipped:0 failed mycomp% refdbc -u 132 -w 123 -C getref -t risx :ID:\>0 > ~/aftertesting.risx 999:2 retrieved:0 failed mycomp% cat ~/aftertesting.risx <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN" "http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [ <!ENTITY lt "&#60;"> <!ENTITY gt ">"> <!ENTITY amp "&#38;"> <!ENTITY mdash "—"> <!ENTITY lsquo "‘"> <!ENTITY rsquo "’"> ]> <ris> <entry type="GEN" id="1" citekey="TESTY"> <part> <title type="full"/> </part> <publication> <title type="full">test1</title> <author> <name>testa testb</name> </author> <pubinfo> <pubdate type="primary"> <date><year>2008</year><month>00</month><day>00</day></date> </pubdate> </pubinfo> </publication> </entry> <entry type="CONF" id="2" citekey="THISISATEST"> <part> <title type="full">A New Extension of the Kalman Filter to Nonlinear Systems</title> <author role="author"> <name>Simon J. Julier</name> </author> <author role="author"> <name>Jeffrey K. Uhlmann</name> </author> </part> <publication> <title type="full">Int. Symp. Aerospace/Defense Sensing, Simul. and Controls</title> <pubinfo> <pubdate type="primary"> <date><year>1997</year><month>00</month><day>00</day></date> </pubdate> <city>Orlando, Florida</city> <link type="url">http://tinyurl.com/4dqojq</link> <link type="url">http://www.cs.unc.edu/~welch/kalman/media/pdf/Julier1997_SPIE_KF.pdf</link> </pubinfo> </publication> <libinfo user="djd"> <notes>bibtex doesn't seem to like all the escape characters refdb puts in the original URL so we switch to tinurl for now...</notes> <reprint status="INFILE"/> <availability type="useroot"/> </libinfo> <contents> <keyword>bayesian</keyword> <keyword>kalman</keyword> <keyword>non-linear</keyword> <keyword>nonlinear</keyword> <keyword>probability</keyword> <keyword>recursive estimation</keyword> <keyword>tracking</keyword> <keyword>unscented</keyword> </contents> </entry> </ris> mycomp% cat ~/thisisatest2.risx <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN" "http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [ <!ENTITY lt "&#60;"> <!ENTITY gt ">"> <!ENTITY amp "&#38;"> <!ENTITY mdash "—"> <!ENTITY lsquo "‘"> <!ENTITY rsquo "’"> ]> <ris> <entry type="CONF" citekey="THISISATEST"> <part> <title type="full">A New Extension of the Kalman Filter to Nonlinear Systems</title> <author role="author"> <name>Simon J. Julier</name> </author> <author role="author"> <name>Jeffrey K. Uhlmann</name> </author> </part> <publication> <title type="full">Int. Symp. Aerospace/Defense Sensing, Simul. and Controls</title> <pubinfo> <pubdate type="primary"> <date><year>1997</year><month>00</month><day>00</day></date> </pubdate> <city>Orlando, Florida</city> <link type="url">http://www.cs.unc.edu/~welch/kalman/media/pdf/Julier1997_SPIE_KF.pdf</link> </pubinfo> </publication> <libinfo user="djd"> <notes></notes> <reprint status="INFILE"/> <availability type="useroot"/> </libinfo> <contents> <keyword>bayesian</keyword> <keyword>kalman</keyword> <keyword>non-linear</keyword> <keyword>nonlinear</keyword> <keyword>probability</keyword> <keyword>recursive estimation</keyword> <keyword>tracking</keyword> <keyword>unscented</keyword> </contents> </entry> </ris> mycomp% cat ~/thisisatest.risx <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN" "http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [ <!ENTITY lt "&#60;"> <!ENTITY gt ">"> <!ENTITY amp "&#38;"> <!ENTITY mdash "—"> <!ENTITY lsquo "‘"> <!ENTITY rsquo "’"> ]> <ris> <entry type="CONF" id="196" citekey="THISISATEST"> <part> <title type="full">A New Extension of the Kalman Filter to Nonlinear Systems</title> <author role="author"> <name>Simon J. Julier</name> </author> <author role="author"> <name>Jeffrey K. Uhlmann</name> </author> </part> <publication> <title type="full">Int. Symp. Aerospace/Defense Sensing, Simul. and Controls</title> <pubinfo> <pubdate type="primary"> <date><year>1997</year><month>00</month><day>00</day></date> </pubdate> <city>Orlando, Florida</city> <link type="url">http://tinyurl.com/4dqojq</link> </pubinfo> </publication> <libinfo user="djd"> <notes>bibtex doesn't seem to like all the escape characters refdb puts in the original URL so we switch to tinurl for now...</notes> <reprint status="INFILE"/> <availability type="useroot"/> </libinfo> <contents> <keyword>bayesian</keyword> <keyword>kalman</keyword> <keyword>non-linear</keyword> <keyword>nonlinear</keyword> <keyword>probability</keyword> <keyword>recursive estimation</keyword> <keyword>tracking</keyword> <keyword>unscented</keyword> </contents> </entry> </ris> mycomp% cat ~/simplerisx.risx <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.0.2//EN" "/data/private/djd/binary/share/refdb/dtd/risx.dtd" [ <!ENTITY lt "&#60;"> <!ENTITY gt ">"> <!ENTITY amp "&#38;"> ]> <ris> <entry type="GEN" citekey="TESTY"> <publication> <title type="full">test1</title> <author> <name>testa testb</name> </author> <pubinfo> <pubdate> <date> <year>2008</year> <month></month> <day></day> </date> </pubdate> </pubinfo> </publication> </entry> </ris> mycomp% **** SECOND PART *2 - REFDB.2.DUMP.SQLITE **** (go to other window and close refdbd) (then come back) mycomp% pwd /data/private/djd/Library/ReferenceDatabaseSqlite3 mycomp% rm * mycomp% sqlite3 refdb < ~/HD/binary/share/refdb/sql/refdb.2.dump.sqlite ** (go back now and restart refdbd) ** mycomp% refdbd -s -l 7 -e 0 dbi_driver_dir went to: dbi is up using default driver dir Available libdbi database drivers: pgsql sqlite3 Requested libdbi driver found: sqlite3 Database directory: /data/private/djd/Library/ReferenceDatabaseSqlite3/ application server started share extended notes by default use /tmp/refdbd_fifo9031 as fifo server waiting n_max_fd=4 ** (and now back to original window) ** mycomp% refdba refdba: createdb djdphd main database version is not supported refdba: quit **** THIRD PART *3 - REFDBD -A **** ** (go to other window and close refdbd)** ** (then come back) ** mycomp% pwd /data/private/djd/Library/ReferenceDatabaseSqlite3 mycomp% rm * mycomp% refdbd -a -e 0 -l 7 dbi_driver_dir went to: dbi is up using default driver dir Available libdbi database drivers: pgsql sqlite3 Requested libdbi driver found: sqlite3 Database directory: /data/private/djd/Library/ReferenceDatabaseSqlite3/ check main database version localhost djd sqlite3 /data/private/djd/Library/ReferenceDatabaseSqlite3/ UTF-8 Segmentation fault mycomp% **** SYSTEM INFO **** mycomp% refdbd -v refdbd 1.0.0-pre1 built from svn revision 613 ma...@mh... You may redistribute and modify this software under the terms of the GNU General Public License. mycomp% refdbc -v refdbc 1.0.0-pre1 built from svn revision 613 ma...@mh... You may redistribute and modify this software under the terms of the GNU General Public License. mycomp% refdba -v refdba 1.0.0-pre1 built from svn revision 613 ma...@mh... You may redistribute and modify this software under the terms of the GNU General Public License. mycomp% uname -a Linux mycomp 2.6.9-67.0.7.ELsmp #1 SMP Sat Mar 15 06:54:55 EDT 2008 i686 i686 i386 GNU/Linux mycomp% LIBDBI: libdbi-cvs-20080421 libdbi-drivers-cvs-20080421 mycomp% cat ~/HD/binary/etc/refdb/refdbdrc | sed s/^#.\*\$// | grep '.' refdblib /data/private/djd/binary/share/refdb main_db refdb serverip localhost dbsport dbserver sqlite3 dbpath /data/private/djd/Library/ReferenceDatabaseSqlite3/ port 9734 logfile /data/private/djd/binary/var/log/refdbd.log logdest file loglevel info pidfile /data/private/djd/binary/var/run/refdbd.pid remoteadmin f remoteconnect f keep_pnames t keyword_scan f db_encoding UTF-8 in_encoding UTF-8 mycomp% cat ~/.refdbarc | sed s/^#.\*\$// | grep '.' serverip 127.0.0.1 port 9734 pager less username root passwd logdest file loglevel info logfile /data/private/djd/binary/var/log/refdba.log mycomp% cat ~/.refdbcrc | sed s/^#.\*\$// | grep '.' serverip 127.0.0.1 port 9734 pager less passwd * defaultdb djdphd pdfroot /data/private/djd/Library logdest file loglevel info logfile /data/private/djd/binary/var/log/refdbc.log cssurl /data/private/djd/binary/share/refdb/css/refdb.css fromencoding UTF-8 toencoding UTF-8 ---------------------------------------------------------------------- Comment By: Markus Hoenicka (mhoenicka) Date: 2008-04-27 20:48 Message: Logged In: YES user_id=85809 Originator: NO I guess this is sort of a duplicate of #1951049. If you missed the upgrade notice from 0.9.8 or earlier to 0.9.9 or later, I reckon you'd see this kind of problem. Please see the comments to bug #1951049 for further instructions. regards, Markus ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1951835&group_id=26091 |