Re: [btqueue-users] setting up Crawler and auto downloads
Status: Beta
Brought to you by:
xgie
Menu
▾
▴
Re: [btqueue-users] setting up Crawler and auto downloads
|
From: Sugree P. <su...@hp...> - 2005-02-22 07:15:43
|
You don't need to specify filter tag in case of using RSSFilter. ------ <TrackerList> <Tracker publisher=3D"btefnet" filter=3D"RSSFilter"> <Url name=3D"catalog" url=3D"http://btefnet.net/backend.php" method=3D"ge= t"></Url> </Tracker> </TrackerList> ------ Sugree Phatanapherom su...@hp... Benjamin Taft wrote: > Hi all! >=20 > Thanks for a nice app Sugree Phatanapherom, a torrent app that runs as = a=20 > daemon and is text based is just what I've been looking for! I've got=20 > btqueue up and running and I think I figured out the basic functions an= d=20 > setup. I struggling with the auto-download part though. I've looked=20 > through the mailing-list archive, the project forums and the example=20 > files that came with btqueue but I don't really know what I'm doing yet= =20 > ;) I've never posted to a sourceforge mailinglist before, hope this=20 > message isn't to long... >=20 > any pointers would be of great help, best regards, >=20 > /Benjamin > --- >=20 > I'm trying to get the torrents from http://btefnet.net/backend.php >=20 > here's my current files: >=20 > tracker.xml > --- > <TrackerList>=20 >=20 > <Tracker publisher=3D"btefnet" filter=3D"RSSFilter"> > <Url name=3D"catalog" url=3D"http://btefnet.net/backend.php" method=3D"= get"> >=20 > <Filter name=3D"main"><![CDATA[<?xml version=3D"1.0" encoding=3D"ISO-88= 59-1"?> > <rss version=3D"2.0"> > <channel> > <title>BT-EFNET</title> > <link>http://www.btefnet.net/</link> > <description>Backend > for > btefnet.net</description> > <language>en-us</language> > <copyright>Copyright > 2005, #BT EFnet</copyright> > <ttl>60</ttl> <item> > <title>(?P<title>[^"]+)</title> >=20 > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> > </item> > <item> > <title>(?P<title>[^"]+)</title> >=20 > <pub(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> > </item> > <item> > <title>(?P<title>[^"]+)</title> > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> >=20 > </item> > <item> > <title>(?P<title>[^"]+)</title> > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> > </item> > <item> >=20 > <title>(?P<title>[^"]+)</title> > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> > </item> > <item> > <title>(?P<title>[^"]+)</title> >=20 > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> > </item> > <item> > <title>(?P<title>[^"]+)</title> > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> >=20 > </item> > <item> > <title>(?P<title>[^"]+)</title> > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> > </item> > <item> >=20 > <title>(?P<title>[^"]+)</title> > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> > </item> > <item> > <title>(?P<title>[^"]+)</title> >=20 > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> > </item> > <item> > <title>(?P<title>[^"]+)</title> > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> >=20 > </item> > <item> > <title>(?P<title>[^"]+)</title> > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> > </item> > <item> >=20 > <title>(?P<title>[^"]+)</title> > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> > </item> > <item> > <title>(?P<title>[^"]+)</title> > <pubDate>(?P<date>[^']+)</pubDate> >=20 > <link>(?P<download>[^"]+)</link> > </item> > <item> > <title>(?P<title>[^"]+)</title> > <pubDate>(?P<date>[^']+)</pubDate> > <link>(?P<download>[^"]+)</link> > </item> >=20 > </channel> > </rss>]]></Filter> > </Url> >=20 > </Tracker>=20 > </TrackerList> >=20 > --- > interest.xml > --- > <?xml version=3D"1.0" encoding=3D"iso-8859-1"?> > <InterestList> > <Interest attribute=3D"title" mode=3D"include">show</Interest> > </InterestList> > --- >=20 > the error I get when running btqueue.py crawler: > --- > File "/usr/local/bin/btqueue.py", line 83, in ? > app =3D Crawler(options.test_crawler) > File "/usr/local/lib/python2.3/site-packages/BitCrawler/crawler.py", = > line 52, in __init__ > tag=3D'InterestList') > File "/usr/local/lib/python2.3/site-packages/BitCrawler/crawler.py", = > line 17, in __init__ > self.obj =3D factory.from_file(self.file) > File "/usr/local/lib/python2.3/site-packages/BitCrawler/media.py",=20 > line 210, in from_file > return self.from_element(e) > File "/usr/local/lib/python2.3/site-packages/BitCrawler/media.py",=20 > line 224, in from_element > obj.append(factory.from_element(e)) > File "/usr/local/lib/python2.3/site-packages/BitCrawler/media.py",=20 > line 221, in from_element > obj =3D media_class(tag,attrs=3Delement.attrs,content=3Delement.con= tent) > File "/usr/local/lib/python2.3/site-packages/BitCrawler/media.py",=20 > line 331, in __init__ > self.cre =3D re.compile(self.content,re.I|re.S|re.M) > File "/usr/local/lib/python2.3/sre.py", line 179, in compile > return _compile(pattern, flags) > File "/usr/local/lib/python2.3/sre.py", line 229, in _compile > raise error, v # invalid expression > sre_constants.error: nothing to repeat > --- >=20 > Some references: > http://sourceforge.net/forum/forum.php?thread_id=3D1083519&forum_id=3D3= 60659 > http://sourceforge.net/forum/forum.php?thread_id=3D1148022&forum_id=3D3= 60659 > http://btqueue.sourceforge.net/ >=20 >=20 > ------------------------------------------------------- > SF email is sponsored by - The IT Product Guide > Read honest & candid reviews on hundreds of IT Products from real users= =2E > Discover which products truly live up to the hype. Start reading now. > http://ads.osdn.com/?ad_ide95&alloc_id=14396&op=CCk > _______________________________________________ > btqueue-users mailing list > btq...@li... > https://lists.sourceforge.net/lists/listinfo/btqueue-users >=20 |
