Thread: [Cs-rssdb-commits] SF.net SVN: cs-rssdb:[20] trunk/0.1
Status: Abandoned
Brought to you by:
crazedsanity
From: <cra...@us...> - 2008-12-26 22:02:50
|
Revision: 20 http://cs-rssdb.svn.sourceforge.net/cs-rssdb/?rev=20&view=rev Author: crazedsanity Date: 2008-12-26 22:02:39 +0000 (Fri, 26 Dec 2008) Log Message: ----------- Add the script that parses the RSS feeds... Added Paths: ----------- trunk/0.1/bin/ trunk/0.1/bin/parse_rss_feeds.php This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <cra...@us...> - 2009-01-30 14:45:12
|
Revision: 37 http://cs-rssdb.svn.sourceforge.net/cs-rssdb/?rev=37&view=rev Author: crazedsanity Date: 2009-01-30 14:45:05 +0000 (Fri, 30 Jan 2009) Log Message: ----------- *** RELEASE 0.1.2 *** Fixes to class names to match cs-phpxml v1.0-ALPHA2 Modified Paths: -------------- trunk/0.1/VERSION trunk/0.1/rssDBClass.php This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <cra...@us...> - 2009-01-30 14:57:15
|
Revision: 39 http://cs-rssdb.svn.sourceforge.net/cs-rssdb/?rev=39&view=rev Author: crazedsanity Date: 2009-01-30 14:57:12 +0000 (Fri, 30 Jan 2009) Log Message: ----------- *** RELEASE 0.1.3 *** Fix class references for cs_arrayToPath{} to match cs-arrayToPath v1.0 Modified Paths: -------------- trunk/0.1/VERSION trunk/0.1/rssDBClass.php This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <cra...@us...> - 2009-09-10 17:52:49
|
Revision: 46 http://cs-rssdb.svn.sourceforge.net/cs-rssdb/?rev=46&view=rev Author: crazedsanity Date: 2009-09-10 17:52:43 +0000 (Thu, 10 Sep 2009) Log Message: ----------- Move schema to be similar to my existing projects. Added Paths: ----------- trunk/0.1/schema/ trunk/0.1/schema/rss-source-inserts.sql trunk/0.1/schema/rss_schema.pgsql.sql Removed Paths: ------------- trunk/0.1/docs/ This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <cra...@us...> - 2009-09-10 17:53:45
|
Revision: 47 http://cs-rssdb.svn.sourceforge.net/cs-rssdb/?rev=47&view=rev Author: crazedsanity Date: 2009-09-10 17:53:37 +0000 (Thu, 10 Sep 2009) Log Message: ----------- Beginning of script for unit testing. Added Paths: ----------- trunk/0.1/tests/ trunk/0.1/tests/testOfCSRSSDB.php This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <cra...@us...> - 2009-09-11 17:51:06
|
Revision: 57 http://cs-rssdb.svn.sourceforge.net/cs-rssdb/?rev=57&view=rev Author: crazedsanity Date: 2009-09-11 17:50:53 +0000 (Fri, 11 Sep 2009) Log Message: ----------- Drop columns, store last_downloaded, get list of downloadable files, ++... /rssDBClass.php: * run_sql() [DELETED]: -- use cs_phpDB::run_query(), cs_phpDB::run_insert(), and cs_phpDB::run_update() to run these SQL commands instead. * get_source_from_filename(): -- use source_name to create filename automatically -- drop extension from filename to match to source. -- use cs_phpDB methods instead of run_sql() * insert_article(): -- call cs_phpDB::run_insert() instead of run_sql() * article_exists(): -- call cs_phpDB::run_query() to pull data instead of run_sql(). * get_source(): -- use cs_phpDB::run_query() instead of run_sql() * get_recent_articles(): -- use cs_phpDB::run_query() instead of run_sql() * get_download_list() [NEW]: -- retrieve list of downloadable files -- NOTE::: this is to be used wiht pending downloader.php... /bin/parse_rss_feeds(): * remove unnecessary includes * pass RSS_FILES_DIR constant to rssDB::__construct(). /schema/rss_schema.pgsql.sql: * rss_source_table: -- drop filename (now derived) -- add column for "last_downloaded" for scriptiness. * SOURCE LIST::: -- update to not have filename. /tests/testOfCSRSSDB.php: * setUp(): -- attempt to drop tables -- load schema in a transaction * tearDown(): -- rollback the transaction * test_basics(): -- test pulling articles & retrieving list of downloadable feeds. Modified Paths: -------------- trunk/0.1/bin/parse_rss_feeds.php trunk/0.1/rssDBClass.php trunk/0.1/schema/rss_schema.pgsql.sql trunk/0.1/tests/testOfCSRSSDB.php This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |
From: <cra...@us...> - 2009-09-16 15:43:01
|
Revision: 58 http://cs-rssdb.svn.sourceforge.net/cs-rssdb/?rev=58&view=rev Author: crazedsanity Date: 2009-09-16 15:42:48 +0000 (Wed, 16 Sep 2009) Log Message: ----------- Changes to handle new downloader, remove require_once stuff. NOTE::: to cope with no require_once() statements, use cs-content's __autoload.php script: it should get everything needed. /rssDBClass.php: * MAIN::: -- removed all require_once() statements. * parse_file(): -- ARG CHANGE: NEW ARG: #2 $sourceId=null -- instead of always determining source from the filename, now it can accept an argument indicating which sourceId to use, so the lookup is less problematic. -- checks to ensure the appropriate fields were retrieved from source. * get_download_list(): -- fix backward logic for $getEntireList * update_last_download() [NEW]: -- method for updating the "last_downloaded" field for the given source, used by downloader.php: this way, the script can run as frequently as wanted without unnecessarily downloading sources. -- NOTE::: the idea behind limiting the time between downloads is because somewhere on Slashdot.org, when I was getting ready to download their RSS feed, I found something saying that anyone downloading their feed more than once every 30 minutes would get banned by IP. /bin/downloader.php [NEW]: * replacement for poorly-written Perl script * writes & parses files without downloading too much too often. * sets user agent header and such. Modified Paths: -------------- trunk/0.1/rssDBClass.php Added Paths: ----------- trunk/0.1/bin/downloader.php This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site. |