#375 Incorrect HTTP_User-Agent for arXive.org/rss/cs

v1.2.0.117
closed
Dare Obasanjo
5
2012-09-23
2005-02-07
Anonymous
No

It's not clear bug, but desire.

Description.

For feeds on arXiv.org, for example,

http://arxiv.org/rss/physics

RSSBandit produce "Feed Error": 403 Forbidden.

After some experemental with HTTP header I found, that
reason of it is UserAgent.

Correction.

In CSharp
Source "RssComponents.Net.AsyncWebRequest.cs"
(private static void QueueRequest)

submission
"""//httpRequest.UserAgent =
AsyncWebRequest.FullUserAgent
(requestParameter.UserAgent); """

on

"""httpRequest.UserAgent
= "Mozilla/4.0 (compatible; MSIE 6.0; Windows
NT 5.0) Opera 7.54 [en]""";

will correct this problem.

I do not know what exactly incorrect in 'static
AsyncWebRequest()', which produce string:
"User-Agent: RssBandit/1.2.0.117 (.NET CLR
1.1.4322.573; WinNT 5.0.2195.0;
http://www.rssbandit.org)"

May be "Windows ", May be "compatible; MSIE 6.0;"...

But I hope, that in future there will be option of 'user-
agent' in preferences.

Discussion

  • Dare Obasanjo
    Dare Obasanjo
    2005-02-07

    Logged In: YES
    user_id=24549

    This isn't a bug. If a site is banning specific user agents then
    it is up to readers of the site to report that legitimate
    applications are being banned. We will not use an incorrect
    user agent because of the policies of one website.