#49 Some servers dont't accept headers send by PHPCrawl

[Uwe Hunfeld]

Some servers dont't accept http-headers send by phpcrawl.
(Example: pastebin.com)

See this forum post:
https://sourceforge.net/p/phpcrawl/discussion/307696/thread/2beb00b6/

NOTE:
When testing on pastebin.com it's a little confusing:
The server doen't accept headers from phpcrawl and BLOCKS the client-ip after a "bad-header" was send for a time.
During this time no requests are possible (event with other clients like webbrowsers), the connection will get refused!

[Uwe Hunfeld]

Update:

The server pastebin.com didn't accept headers from phpcrawl because of HTTP 1.0 protocol and uppercase "HOST"-word in the header.

Switched to HTTP 1.1 and changed "HOST" to "Host" in the request-header. Now everything works fine.

See the attached and fixed PHPCrawlerHTTPRequest.class.php file.

Weill be officialy fixed in the next release.

[Anonymous]

[Uwe Hunfeld]

Fixed since version 0.82

[Anonymous]

It's works very well. Thanks