[Cs-rssdb-commits] SF.net SVN: cs-rssdb:[58] trunk/0.1

[<cra...@us...>]

Revision: 58
          http://cs-rssdb.svn.sourceforge.net/cs-rssdb/?rev=58&view=rev
Author:   crazedsanity
Date:     2009-09-16 15:42:48 +0000 (Wed, 16 Sep 2009)

Log Message:
-----------
Changes to handle new downloader, remove require_once stuff.

NOTE::: to cope with no require_once() statements, use cs-content's
__autoload.php script: it should get everything needed.

/rssDBClass.php:
	* MAIN:::
		-- removed all require_once() statements.
	* parse_file():
		-- ARG CHANGE: NEW ARG: #2 $sourceId=null
		-- instead of always determining source from the filename, now it can
		accept an argument indicating which sourceId to use, so the lookup is
		less problematic.
		-- checks to ensure the appropriate fields were retrieved from source.
	* get_download_list():
		-- fix backward logic for $getEntireList
	* update_last_download() [NEW]:
		-- method for updating the "last_downloaded" field for the given
		source, used by downloader.php: this way, the script can run as
		frequently as wanted without unnecessarily downloading sources.
		-- NOTE::: the idea behind limiting the time between downloads is
		because somewhere on Slashdot.org, when I was getting ready to
		download their RSS feed, I found something saying that anyone
		downloading their feed more than once every 30 minutes would get
		banned by IP.
/bin/downloader.php [NEW]:
	* replacement for poorly-written Perl script
	* writes & parses files without downloading too much too often.
	* sets user agent header and such.

Modified Paths:
--------------
    trunk/0.1/rssDBClass.php

Added Paths:
-----------
    trunk/0.1/bin/downloader.php


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.