#1065 Scrapping scripts are not working.

v1.8
closed-works-for-me
Lars Windolf
5
2013-06-09
2013-03-17
BPS
No

Hello,

i want to write a script which will be scrapping a website. I want to add it to my feed list in liferea, so i:
1) click on New Subscription -> Advanced -> Local File -> Select File to add my script as feed source.
2) I select it on left panel and click on "Update" in context menu.
3) and now i get 2 errors
a) Error: Could not open file /path/to/favicon.ico (this file exists on my drive and path is valid).
b) XML Parser Output: The URL you want Liferea to subscribe to points to a webpage and the auto discovery found no feeds on this page. Maybe this webpage just does not support feed auto discovery.Could not determine the feed type.

Is it a program bug or im missing something in topic of writing scripts compatibile with Liferea?

Ive attached test script written in Python.

1 Attachments

Discussion

  • Hi!

    The XML printed by your script is not valid RSS. I put the output in a file and ran it through the W3C feed validator. See results here. The first thing to fix is that the "<?xml ..." line needs to be at the very start of the script. Your Python code outputs a newline before the tag. After fixing that, there are other errors. I suggest you first fix these and then see if there are still problems when your script outputs valid RSS! (At least this should be what bug "b" is about. The error given by Liferea could be more helpful...)

    Regards, Simon

     
  • BPS
    BPS
    2013-05-10

    Hello, I made new script with simpler rss output, this time it validates but Liferea is still giving me same errors :(

    New script version in attachment.

     
    Attachments
  • Hi again BPS! Unfortunately the RSS from your new script still doesn't quite validate, but this doesn't seem to be the issue.

    I just tried adding your news.py as a command line source to Liferea, and it worked just fine without any errors. I'm using the version from git, however. Could you try installing Liferea 1.10RC1 and see how that works?

     
  • Lars Windolf
    Lars Windolf
    2013-06-09

    • status: open --> closed-works-for-me
    • assigned_to: Lars Windolf
     
  • Lars Windolf
    Lars Windolf
    2013-06-09

    Closing as unreproducible.