Hi, I'm currently using HttpClient + JTidy + Saxon in a web application to extract data from a legacy php4 web application and my extraction requirements vary fron day to day. Being able to configure the extraction process simply editing an XML configuration file is just what I was looking for, so I'm trying Web-Harvest.
However, I'm in trouble as my first test to access that legacy application is not working. I'm getting this trace:
java.lang.IllegalArgumentException: host parameter is null
org.apache.commons.httpclient.HttpConnection.setHost(HttpConnection.java:249)
org.apache.commons.httpclient.SimpleHttpConnectionManager.getConnectionWithTimeout(SimpleHttpConnectionManager.java:146)
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:152)
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396)
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:324)
org.webharvest.runtime.web.HttpClientManager.execute(HttpClientManager.java:103)
org.webharvest.runtime.processors.HttpProcessor.execute(HttpProcessor.java:46)
org.webharvest.runtime.processors.BaseProcessor.run(BaseProcessor.java:51)
org.webharvest.runtime.processors.BaseProcessor.executeBody(BaseProcessor.java:72)
org.webharvest.runtime.processors.BaseProcessor.getBodyListContent(BaseProcessor.java:104)
org.webharvest.runtime.processors.VarDefProcessor.execute(VarDefProcessor.java:22)
org.webharvest.runtime.processors.BaseProcessor.run(BaseProcessor.java:51)
org.webharvest.runtime.Scraper.execute(Scraper.java:73)
org.webharvest.runtime.Scraper.execute(Scraper.java:82)
org.chop.vishc.actions.SelPetPascoAction.executePA(SelPetPascoAction.java:76)
...
My XML config:
<?xml version="1.0" encoding="UTF-8"?>
<config>
<var-def name="result">
<http url="http://myhost/acceso.php4" method="post" id="dynamic_http">
<http-param name="idusu">uid</http-param>
<http-param name="pass">pwd</http-param>
</http>
</var-def>
</config>
Trying to access other pages via get methods are working. I suspect it might have to do with the fact that the remote host sends a redirect (I was using followRedirects=true in my HttpClient code) that might not be well formed.
Thanks a lot. Web-Harvest is just the tool I'd have written if I had the skills.
Regards.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Anonymous
-
2006-10-30
Oh well this is very embarrasing but it looks like I was having some kind of jar-hell in my \WEB-INF\lib directory, it needed some serious cleanup.
I must say you had the problem fixed the first time (with version 0.24) but for some reason my web app was still building with the previous version.
Anyway, things are going fine now.
Regards
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Yes - it throws exception when trying to redirect. Redirection generally works, but I suppose there is some special situation there.
Can you check which is your redirection URL?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Anonymous
-
2006-09-13
Of course. The location response header returned by the server is:
'conspac.php4?PHPSESSID=<hash>&new_login=1'
There's no leading slash. Now I recall that in my httpClient code I had to turn followRedirects off to append a '/' to this uri before trying to open it.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Well, I tried to reproduce your situation and found the same exception. After fixing that relative redirection URL everything was ok. I created one php page which is doing only redirection to the relative page:
header( 'Location: test.php' ) ;
Before fixing the bug in Web-Harvest I was getting the sme exception which you had reported.
So I thought that it was fixed.
Did you run your config from the command line or from the Java code?
If you are running it from Java, can you try to debug it and see what is going on?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Anonymous
-
2006-10-09
Sorry but I've been on vacation.
I'm running my config from Java code. Do you mean tracing into Web-Harvest classes?
I've upgraded Web-Harvest to version 0.26 to see if there were changes for me, but the exception trace I get is the same.
I see you have upgraded tagsoup to v1.0.1 ... any plans to upgrade HttpClient to 3.0.1?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Well, about HttpClient - it is not so important - I suppose 3.0.1 is backword compatibile with 3.0 and I didn't find any bugs in 3.0. You can use 3.0.1.
About the bug: I need more info but I cannot make such scenario at my place. I thought that I've fixed the bug. Maybe you could debug your execution, but use source java files from web harvest in your project in order to find what exactly is going on. I suppose you should debug HttpClientManager class which is actually the wrapper around Commons HttpClient.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Anonymous
-
2006-10-17
As a first step I enabled logging on org.webharvest and org.apache.commons.httpclient
I set logging level to TRACE and this is what came out (I'm afraid it's mostly httpclient's stuff):
366676 [http-8080-Processor4] INFO org.webharvest.definition.XmlParser - XML parsed in 0ms.
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Java version: 1.5.0_03
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Java vendor: Sun Microsystems Inc.
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Java class path: C:\Borland\JBuilder2006\thirdparty\jakarta-tomcat-5.5.9\bin\bootstrap.jar;C:\Borland\JBuilder2006\jdk1.5\lib\tools.jar
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Operating system name: Windows 2003
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Operating system architecture: x86
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Operating system version: 5.2
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SUN 1.5: SUN (DSA key/parameter generation; DSA signing; SHA-1, MD5 digests; SecureRandom; X.509 certificates; JKS keystore; PKIX CertPathValidator; PKIX CertPathBuilder; LDAP, Collection CertStores)
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SunRsaSign 1.5: Sun RSA signature provider
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SunJSSE 1.5: Sun JSSE provider(PKCS12, SunX509 key/trust factories, SSLv3, TLSv1)
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SunJCE 1.5: SunJCE Provider (implements RSA, DES, Triple DES, AES, Blowfish, ARCFOUR, RC2, PBE, Diffie-Hellman, HMAC)
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SunJGSS 1.0: Sun (Kerberos v5)
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SunSASL 1.5: Sun SASL provider(implements client mechanisms for: DIGEST-MD5, GSSAPI, EXTERNAL, PLAIN, CRAM-MD5; server mechanisms for: DIGEST-MD5, GSSAPI, CRAM-MD5)
366817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.useragent = Jakarta Commons-HttpClient/3.0-rc3
366817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.version = HTTP/1.1
366817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.connection-manager.class = class org.apache.commons.httpclient.SimpleHttpConnectionManager
366817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.cookie-policy = rfc2109
366832 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.element-charset = US-ASCII
366832 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.content-charset = ISO-8859-1
366832 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.method.retry-handler = org.apache.commons.httpclient.DefaultHttpMethodRetryHandler@1958cc2
366832 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.dateparser.patterns = [EEE, dd MMM yyyy HH:mm:ss zzz, EEEE, dd-MMM-yy HH:mm:ss zzz, EEE MMM d HH:mm:ss yyyy, EEE, dd-MMM-yyyy HH:mm:ss z, EEE, dd-MMM-yyyy HH-mm-ss z, EEE, dd MMM yy HH:mm:ss z, EEE dd-MMM-yyyy HH:mm:ss z, EEE dd MMM yyyy HH:mm:ss z, EEE dd-MMM-yyyy HH-mm-ss z, EEE dd-MMM-yy HH:mm:ss z, EEE dd MMM yy HH:mm:ss z, EEE,dd-MMM-yy HH:mm:ss z, EEE,dd-MMM-yyyy HH:mm:ss z, EEE, dd-MM-yyyy HH:mm:ss z]
366848 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.allow-circular-redirects = true
org.apache.commons.httpclient.contrib.ssl.EasySSLProtocolSocketFactory@2cbc86
366895 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - VarDefProcessor starts processing...
366895 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - HttpProcessor starts processing...[ID=dynamic_http]
366895 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor starts processing...
366895 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor starts processing...
366895 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor processor executed in 0ms.
366910 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor processor executed in 15ms.
366910 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor starts processing...
366910 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor starts processing...
366910 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor processor executed in 0ms.
366910 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor processor executed in 0ms.
366957 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.setRequestBody(NameValuePair[])
366957 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.clearRequestBody()
366957 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.clearRequestBody()
366957 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.addParameters(NameValuePair[])
366973 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.clearRequestBody()
366973 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
366973 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HttpMethod)
366973 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HostConfiguration,HttpMethod,HttpState)
366989 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodDirector - Attempt number 1 to process request
366989 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.open()
366989 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - Open connection to 69.146.1.40:80
371504 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.execute(HttpState, HttpConnection)
371504 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequest(HttpState, HttpConnection)
371504 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequestLine(HttpState, HttpConnection)
371504 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.generateRequestLine(HttpConnection, String, String, String, String)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequestHeaders(HttpState,HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.addRequestHeaders(HttpState, HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.ExpectContinueMethod - enter ExpectContinueMethod.addRequestHeaders(HttpState, HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addRequestHeaders(HttpState, HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addUserAgentRequestHeaders(HttpState, HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addHostRequestHeader(HttpState, HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Adding Host request header
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addCookieRequestHeader(HttpState, HttpConnection)
371598 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.getCookies()
371598 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.match(String, int, String, boolean, Cookie[])
371598 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addProxyConnectionHeader(HttpState, HttpConnection)
371598 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.addContentLengthRequestHeader(HttpState, HttpConnection)
371614 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.getRequestContentLength()
371614 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
371614 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.getParameters()
371614 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter getContentCharSet( Header contentheader )
371614 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Default charset used: ISO-8859-1
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.getParameters()
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter getContentCharSet( Header contentheader )
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(String)
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.getParameterByName(String)
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Default charset used: ISO-8859-1
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.writeLine()
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.writeRequestBody(HttpState, HttpConnection)
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.getRequestContentLength()
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getRequestOutputStream()
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - Request body sent
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.flushRequestOutputStream()
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponse(HttpState, HttpConnection)
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readStatusLine(HttpState, HttpConnection)
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.readLine()
371676 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371676 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseHeaders(HttpState,HttpConnection)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getResponseInputStream()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HeaderParser.parseHeaders(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.processResponseHeaders(HttpState, HttpConnection)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, Header)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.Cookie - enter Cookie(String, String, String, String, Date, boolean)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.validate(String, int, String, boolean, Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.validate(String, port, path, boolean, Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.addCookie(Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.formatCookie(Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Cookie accepted: "$Version=0; PHPSESSID=24f48aeb57695020970a5991549b5b35; $Path=/"
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, String)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, Header)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.Cookie - enter Cookie(String, String, String, String, Date, boolean)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.validate(String, int, String, boolean, Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.validate(String, port, path, boolean, Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.addCookie(Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.formatCookie(Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Cookie accepted: "$Version=0; PHPSESSID=2fa16a2bd928e3a771df864b36c8b7d8; $Path=/"
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseBody(HttpState, HttpConnection)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseBody(HttpConnection)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getResponseInputStream()
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(String)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.isResponseAvailable(int)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.canResponseHaveBody(int)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodDirector - Redirect required
371817 [http-8080-Processor4] INFO org.apache.commons.httpclient.HttpMethodDirector - Redirect requested but followRedirects is disabled
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HeaderParser.parseHeaders(InputStream, String)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Resorting to protocol version default close connection policy
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Should NOT close connection, using HTTP/1.1
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.isResponseAvailable()
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.releaseConnection()
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - Releasing connection back to connection manager.
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.GetMethod - enter GetMethod(String)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HttpMethod)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HostConfiguration,HttpMethod,HttpState)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.close()
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.closeSockedAndStreams()
371817 [http-8080-Processor4] WARN org.apache.struts.action.RequestProcessor - Unhandled Exception thrown: class java.lang.IllegalArgumentException
371832 [http-8080-Processor4] ERROR org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/test].[action] - Servlet.service() para servlet action lanzó excepción
There are some lines near the end of the trace telling followRedirects is disabled somewhere, but I suppose you're handling this on your own as there are some reads below that...
I would try to enable the wire log in httpclient to see what's going on, but I need some help on that.
Greets
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Anonymous
-
2006-10-17
I finally enabled the wire log in httpclient (it was easier than I had thought) and ran a new trace. Again, lots of httpclient stuff:
121468 [http-8080-Processor3] INFO org.webharvest.definition.XmlParser - XML parsed in 0ms.
121530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Java version: 1.5.0_03
121530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Java vendor: Sun Microsystems Inc.
121530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Java class path: C:\Borland\JBuilder2006\thirdparty\jakarta-tomcat-5.5.9\bin\bootstrap.jar;C:\Borland\JBuilder2006\jdk1.5\lib\tools.jar
121561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Operating system name: Windows 2003
121561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Operating system architecture: x86
121561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Operating system version: 5.2
121608 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SUN 1.5: SUN (DSA key/parameter generation; DSA signing; SHA-1, MD5 digests; SecureRandom; X.509 certificates; JKS keystore; PKIX CertPathValidator; PKIX CertPathBuilder; LDAP, Collection CertStores)
121624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SunRsaSign 1.5: Sun RSA signature provider
121624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SunJSSE 1.5: Sun JSSE provider(PKCS12, SunX509 key/trust factories, SSLv3, TLSv1)
121624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SunJCE 1.5: SunJCE Provider (implements RSA, DES, Triple DES, AES, Blowfish, ARCFOUR, RC2, PBE, Diffie-Hellman, HMAC)
121624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SunJGSS 1.0: Sun (Kerberos v5)
121624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SunSASL 1.5: Sun SASL provider(implements client mechanisms for: DIGEST-MD5, GSSAPI, EXTERNAL, PLAIN, CRAM-MD5; server mechanisms for: DIGEST-MD5, GSSAPI, CRAM-MD5)
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.useragent = Jakarta Commons-HttpClient/3.0-rc3
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.version = HTTP/1.1
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.connection-manager.class = class org.apache.commons.httpclient.SimpleHttpConnectionManager
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.cookie-policy = rfc2109
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.element-charset = US-ASCII
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.content-charset = ISO-8859-1
121655 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.method.retry-handler = org.apache.commons.httpclient.DefaultHttpMethodRetryHandler@1c8fb4b
121655 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.dateparser.patterns = [EEE, dd MMM yyyy HH:mm:ss zzz, EEEE, dd-MMM-yy HH:mm:ss zzz, EEE MMM d HH:mm:ss yyyy, EEE, dd-MMM-yyyy HH:mm:ss z, EEE, dd-MMM-yyyy HH-mm-ss z, EEE, dd MMM yy HH:mm:ss z, EEE dd-MMM-yyyy HH:mm:ss z, EEE dd MMM yyyy HH:mm:ss z, EEE dd-MMM-yyyy HH-mm-ss z, EEE dd-MMM-yy HH:mm:ss z, EEE dd MMM yy HH:mm:ss z, EEE,dd-MMM-yy HH:mm:ss z, EEE,dd-MMM-yyyy HH:mm:ss z, EEE, dd-MM-yyyy HH:mm:ss z]
121655 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.allow-circular-redirects = true
org.apache.commons.httpclient.contrib.ssl.EasySSLProtocolSocketFactory@127f79d
121718 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - VarDefProcessor starts processing...
121718 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - HttpProcessor starts processing...[ID=dynamic_http]
121718 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor starts processing...
121718 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor starts processing...
121733 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor processor executed in 15ms.
121796 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor processor executed in 78ms.
121796 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor starts processing...
121796 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor starts processing...
121796 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor processor executed in 0ms.
121796 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor processor executed in 0ms.
121843 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.setRequestBody(NameValuePair[])
121843 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.clearRequestBody()
121843 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.clearRequestBody()
121843 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.addParameters(NameValuePair[])
121858 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.clearRequestBody()
121874 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
121874 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HttpMethod)
121874 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HostConfiguration,HttpMethod,HttpState)
121890 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodDirector - Attempt number 1 to process request
121890 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.open()
121890 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - Open connection to 69.146.1.40:80
126389 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.execute(HttpState, HttpConnection)
126389 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequest(HttpState, HttpConnection)
126389 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequestLine(HttpState, HttpConnection)
126389 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.generateRequestLine(HttpConnection, String, String, String, String)
126468 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "POST /acceso.php4 HTTP/1.1[\r][\n]"
126468 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
126468 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequestHeaders(HttpState,HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.addRequestHeaders(HttpState, HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.ExpectContinueMethod - enter ExpectContinueMethod.addRequestHeaders(HttpState, HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addRequestHeaders(HttpState, HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addUserAgentRequestHeaders(HttpState, HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addHostRequestHeader(HttpState, HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Adding Host request header
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addCookieRequestHeader(HttpState, HttpConnection)
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.getCookies()
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.match(String, int, String, boolean, Cookie[])
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addProxyConnectionHeader(HttpState, HttpConnection)
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.addContentLengthRequestHeader(HttpState, HttpConnection)
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.getRequestContentLength()
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.getParameters()
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter getContentCharSet( Header contentheader )
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Default charset used: ISO-8859-1
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.getParameters()
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter getContentCharSet( Header contentheader )
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(String)
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.getParameterByName(String)
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Default charset used: ISO-8859-1
126514 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1[\r][\n]"
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126530 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "Host: 69.146.1.40[\r][\n]"
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126530 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "Content-Length: 26[\r][\n]"
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126546 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "Content-Type: application/x-www-form-urlencoded[\r][\n]"
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.writeLine()
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126546 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "[\r][\n]"
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.writeRequestBody(HttpState, HttpConnection)
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.getRequestContentLength()
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getRequestOutputStream()
126561 [http-8080-Processor3] DEBUG httpclient.wire.content - >> "idusu=login&pass=password"
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - Request body sent
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.flushRequestOutputStream()
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponse(HttpState, HttpConnection)
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readStatusLine(HttpState, HttpConnection)
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.readLine()
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126561 [http-8080-Processor3] DEBUG httpclient.wire.header - << "HTTP/1.1 302 Found[\r][\n]"
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseHeaders(HttpState,HttpConnection)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getResponseInputStream()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HeaderParser.parseHeaders(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126608 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Date: Tue, 17 Oct 2006 12:47:08 GMT[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Server: Apache/1.3.23 (Unix) PHP/4.4.2[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "X-Powered-By: PHP/4.4.2[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Set-Cookie: PHPSESSID=a4ac207a561232ed32a86de6c70b81c9; path=/[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Expires: Thu, 19 Nov 1981 08:52:00 GMT[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Pragma: no-cache[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Set-Cookie: PHPSESSID=239c820a07ee40461e8ed32f18c3e235; path=/[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Location: conspac.php4?PHPSESSID=239c820a07ee40461e8ed32f18c3e235&new_login=1[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Transfer-Encoding: chunked[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Content-Type: text/html[\r][\n]"
126608 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.processResponseHeaders(HttpState, HttpConnection)
126608 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, String)
126608 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, Header)
126624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.Cookie - enter Cookie(String, String, String, String, Date, boolean)
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.validate(String, int, String, boolean, Cookie)
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.validate(String, port, path, boolean, Cookie)
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.addCookie(Cookie)
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.formatCookie(Cookie)
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Cookie accepted: "$Version=0; PHPSESSID=a4ac207a561232ed32a86de6c70b81c9; $Path=/"
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, String)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, Header)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.Cookie - enter Cookie(String, String, String, String, Date, boolean)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.validate(String, int, String, boolean, Cookie)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.validate(String, port, path, boolean, Cookie)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.addCookie(Cookie)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.formatCookie(Cookie)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Cookie accepted: "$Version=0; PHPSESSID=239c820a07ee40461e8ed32f18c3e235; $Path=/"
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseBody(HttpState, HttpConnection)
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseBody(HttpConnection)
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getResponseInputStream()
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(String)
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.isResponseAvailable(int)
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.canResponseHaveBody(int)
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodDirector - Redirect required
126780 [http-8080-Processor3] INFO org.apache.commons.httpclient.HttpMethodDirector - Redirect requested but followRedirects is disabled
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "1"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "a"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "f"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\r]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\n]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "<br />[\n]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "<b>Warning</b>: Unknown(): Your script possibly relies on a session side-effect which existed until PHP 4.2.3. Please be advised that the session extension does not consider global variables as a source of data, unless register_globals is enabled. You can disable this functionality and this warning by setting session.bug_compat_42 or session.bug_compat_warn to off, respectively. in <b>Unknown</b> on line <b>0</b><br />[\n]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\r]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\n]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "0"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\r]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\n]"
126796 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HeaderParser.parseHeaders(InputStream, String)
126796 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126796 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\r]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\n]"
126796 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Resorting to protocol version default close connection policy
126796 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Should NOT close connection, using HTTP/1.1
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.isResponseAvailable()
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.releaseConnection()
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - Releasing connection back to connection manager.
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.GetMethod - enter GetMethod(String)
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HttpMethod)
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HostConfiguration,HttpMethod,HttpState)
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.close()
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.closeSockedAndStreams()
126827 [http-8080-Processor3] WARN org.apache.struts.action.RequestProcessor - Unhandled Exception thrown: class java.lang.IllegalArgumentException
126827 [http-8080-Processor3] ERROR org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/test].[action] - Servlet.service() para servlet action lanzó excepción
java.lang.IllegalArgumentException: host parameter is null
at org.apache.commons.httpclient.HttpConnection.setHost(HttpConnection.java:249)
at org.apache.commons.httpclient.SimpleHttpConnectionManager.getConnectionWithTimeout(SimpleHttpConnectionManager.java:146)
at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:152)
at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396)
at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:324)
at org.webharvest.runtime.web.HttpClientManager.execute(HttpClientManager.java:103)
at org.webharvest.runtime.processors.HttpProcessor.execute(HttpProcessor.java:46)
at org.webharvest.runtime.processors.BaseProcessor.run(BaseProcessor.java:51)
at org.webharvest.runtime.processors.BaseProcessor.executeBody(BaseProcessor.java:72)
at org.webharvest.runtime.processors.BaseProcessor.getBodyListContent(BaseProcessor.java:104)
at org.webharvest.runtime.processors.VarDefProcessor.execute(VarDefProcessor.java:22)
at org.webharvest.runtime.processors.BaseProcessor.run(BaseProcessor.java:51)
at org.webharvest.runtime.Scraper.execute(Scraper.java:73)
at org.webharvest.runtime.Scraper.execute(Scraper.java:82)
at org.chop.vishc.actions.SelPetPascoAction.executePA(SelPetPascoAction.java:76)
at org.chop.vishc.actions.BaseProtectedAction.execute(BaseProtectedAction.java:46)
at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:484)
at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:274)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1482)
at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:507)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:744)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Hi, I'm currently using HttpClient + JTidy + Saxon in a web application to extract data from a legacy php4 web application and my extraction requirements vary fron day to day. Being able to configure the extraction process simply editing an XML configuration file is just what I was looking for, so I'm trying Web-Harvest.
However, I'm in trouble as my first test to access that legacy application is not working. I'm getting this trace:
java.lang.IllegalArgumentException: host parameter is null
org.apache.commons.httpclient.HttpConnection.setHost(HttpConnection.java:249)
org.apache.commons.httpclient.SimpleHttpConnectionManager.getConnectionWithTimeout(SimpleHttpConnectionManager.java:146)
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:152)
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396)
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:324)
org.webharvest.runtime.web.HttpClientManager.execute(HttpClientManager.java:103)
org.webharvest.runtime.processors.HttpProcessor.execute(HttpProcessor.java:46)
org.webharvest.runtime.processors.BaseProcessor.run(BaseProcessor.java:51)
org.webharvest.runtime.processors.BaseProcessor.executeBody(BaseProcessor.java:72)
org.webharvest.runtime.processors.BaseProcessor.getBodyListContent(BaseProcessor.java:104)
org.webharvest.runtime.processors.VarDefProcessor.execute(VarDefProcessor.java:22)
org.webharvest.runtime.processors.BaseProcessor.run(BaseProcessor.java:51)
org.webharvest.runtime.Scraper.execute(Scraper.java:73)
org.webharvest.runtime.Scraper.execute(Scraper.java:82)
org.chop.vishc.actions.SelPetPascoAction.executePA(SelPetPascoAction.java:76)
...
My XML config:
<?xml version="1.0" encoding="UTF-8"?>
<config>
<var-def name="result">
<http url="http://myhost/acceso.php4" method="post" id="dynamic_http">
<http-param name="idusu">uid</http-param>
<http-param name="pass">pwd</http-param>
</http>
</var-def>
</config>
Trying to access other pages via get methods are working. I suspect it might have to do with the fact that the remote host sends a redirect (I was using followRedirects=true in my HttpClient code) that might not be well formed.
Thanks a lot. Web-Harvest is just the tool I'd have written if I had the skills.
Regards.
Oh well this is very embarrasing but it looks like I was having some kind of jar-hell in my \WEB-INF\lib directory, it needed some serious cleanup.
I must say you had the problem fixed the first time (with version 0.24) but for some reason my web app was still building with the previous version.
Anyway, things are going fine now.
Regards
Yes - it throws exception when trying to redirect. Redirection generally works, but I suppose there is some special situation there.
Can you check which is your redirection URL?
Of course. The location response header returned by the server is:
'conspac.php4?PHPSESSID=<hash>&new_login=1'
There's no leading slash. Now I recall that in my httpClient code I had to turn followRedirects off to append a '/' to this uri before trying to open it.
OK it was about relative paths in redirection URL.
Please download new version (0.24) and try now.
Sorry, but I'm afraid I'm getting the same exception and trace as before.
Well, I tried to reproduce your situation and found the same exception. After fixing that relative redirection URL everything was ok. I created one php page which is doing only redirection to the relative page:
header( 'Location: test.php' ) ;
Before fixing the bug in Web-Harvest I was getting the sme exception which you had reported.
So I thought that it was fixed.
Did you run your config from the command line or from the Java code?
If you are running it from Java, can you try to debug it and see what is going on?
Sorry but I've been on vacation.
I'm running my config from Java code. Do you mean tracing into Web-Harvest classes?
I've upgraded Web-Harvest to version 0.26 to see if there were changes for me, but the exception trace I get is the same.
I see you have upgraded tagsoup to v1.0.1 ... any plans to upgrade HttpClient to 3.0.1?
Well, about HttpClient - it is not so important - I suppose 3.0.1 is backword compatibile with 3.0 and I didn't find any bugs in 3.0. You can use 3.0.1.
About the bug: I need more info but I cannot make such scenario at my place. I thought that I've fixed the bug. Maybe you could debug your execution, but use source java files from web harvest in your project in order to find what exactly is going on. I suppose you should debug HttpClientManager class which is actually the wrapper around Commons HttpClient.
As a first step I enabled logging on org.webharvest and org.apache.commons.httpclient
I set logging level to TRACE and this is what came out (I'm afraid it's mostly httpclient's stuff):
366676 [http-8080-Processor4] INFO org.webharvest.definition.XmlParser - XML parsed in 0ms.
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Java version: 1.5.0_03
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Java vendor: Sun Microsystems Inc.
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Java class path: C:\Borland\JBuilder2006\thirdparty\jakarta-tomcat-5.5.9\bin\bootstrap.jar;C:\Borland\JBuilder2006\jdk1.5\lib\tools.jar
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Operating system name: Windows 2003
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Operating system architecture: x86
366723 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - Operating system version: 5.2
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SUN 1.5: SUN (DSA key/parameter generation; DSA signing; SHA-1, MD5 digests; SecureRandom; X.509 certificates; JKS keystore; PKIX CertPathValidator; PKIX CertPathBuilder; LDAP, Collection CertStores)
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SunRsaSign 1.5: Sun RSA signature provider
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SunJSSE 1.5: Sun JSSE provider(PKCS12, SunX509 key/trust factories, SSLv3, TLSv1)
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SunJCE 1.5: SunJCE Provider (implements RSA, DES, Triple DES, AES, Blowfish, ARCFOUR, RC2, PBE, Diffie-Hellman, HMAC)
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SunJGSS 1.0: Sun (Kerberos v5)
366801 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - SunSASL 1.5: Sun SASL provider(implements client mechanisms for: DIGEST-MD5, GSSAPI, EXTERNAL, PLAIN, CRAM-MD5; server mechanisms for: DIGEST-MD5, GSSAPI, CRAM-MD5)
366817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.useragent = Jakarta Commons-HttpClient/3.0-rc3
366817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.version = HTTP/1.1
366817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.connection-manager.class = class org.apache.commons.httpclient.SimpleHttpConnectionManager
366817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.cookie-policy = rfc2109
366832 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.element-charset = US-ASCII
366832 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.content-charset = ISO-8859-1
366832 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.method.retry-handler = org.apache.commons.httpclient.DefaultHttpMethodRetryHandler@1958cc2
366832 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.dateparser.patterns = [EEE, dd MMM yyyy HH:mm:ss zzz, EEEE, dd-MMM-yy HH:mm:ss zzz, EEE MMM d HH:mm:ss yyyy, EEE, dd-MMM-yyyy HH:mm:ss z, EEE, dd-MMM-yyyy HH-mm-ss z, EEE, dd MMM yy HH:mm:ss z, EEE dd-MMM-yyyy HH:mm:ss z, EEE dd MMM yyyy HH:mm:ss z, EEE dd-MMM-yyyy HH-mm-ss z, EEE dd-MMM-yy HH:mm:ss z, EEE dd MMM yy HH:mm:ss z, EEE,dd-MMM-yy HH:mm:ss z, EEE,dd-MMM-yyyy HH:mm:ss z, EEE, dd-MM-yyyy HH:mm:ss z]
366848 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.allow-circular-redirects = true
org.apache.commons.httpclient.contrib.ssl.EasySSLProtocolSocketFactory@2cbc86
366895 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - VarDefProcessor starts processing...
366895 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - HttpProcessor starts processing...[ID=dynamic_http]
366895 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor starts processing...
366895 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor starts processing...
366895 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor processor executed in 0ms.
366910 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor processor executed in 15ms.
366910 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor starts processing...
366910 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor starts processing...
366910 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor processor executed in 0ms.
366910 [http-8080-Processor4] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor processor executed in 0ms.
366957 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.setRequestBody(NameValuePair[])
366957 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.clearRequestBody()
366957 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.clearRequestBody()
366957 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.addParameters(NameValuePair[])
366973 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.clearRequestBody()
366973 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
366973 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HttpMethod)
366973 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HostConfiguration,HttpMethod,HttpState)
366989 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodDirector - Attempt number 1 to process request
366989 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.open()
366989 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - Open connection to 69.146.1.40:80
371504 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.execute(HttpState, HttpConnection)
371504 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequest(HttpState, HttpConnection)
371504 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequestLine(HttpState, HttpConnection)
371504 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.generateRequestLine(HttpConnection, String, String, String, String)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequestHeaders(HttpState,HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.addRequestHeaders(HttpState, HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.ExpectContinueMethod - enter ExpectContinueMethod.addRequestHeaders(HttpState, HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addRequestHeaders(HttpState, HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addUserAgentRequestHeaders(HttpState, HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addHostRequestHeader(HttpState, HttpConnection)
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Adding Host request header
371582 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addCookieRequestHeader(HttpState, HttpConnection)
371598 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.getCookies()
371598 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.match(String, int, String, boolean, Cookie[])
371598 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addProxyConnectionHeader(HttpState, HttpConnection)
371598 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.addContentLengthRequestHeader(HttpState, HttpConnection)
371614 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.getRequestContentLength()
371614 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
371614 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.getParameters()
371614 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter getContentCharSet( Header contentheader )
371614 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Default charset used: ISO-8859-1
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.getParameters()
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter getContentCharSet( Header contentheader )
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(String)
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.getParameterByName(String)
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Default charset used: ISO-8859-1
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
371629 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.writeLine()
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
371645 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.writeRequestBody(HttpState, HttpConnection)
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.getRequestContentLength()
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getRequestOutputStream()
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - Request body sent
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.flushRequestOutputStream()
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponse(HttpState, HttpConnection)
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readStatusLine(HttpState, HttpConnection)
371661 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.readLine()
371676 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371676 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseHeaders(HttpState,HttpConnection)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getResponseInputStream()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HeaderParser.parseHeaders(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.processResponseHeaders(HttpState, HttpConnection)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, String)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, Header)
371692 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.Cookie - enter Cookie(String, String, String, String, Date, boolean)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.validate(String, int, String, boolean, Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.validate(String, port, path, boolean, Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.addCookie(Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.formatCookie(Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Cookie accepted: "$Version=0; PHPSESSID=24f48aeb57695020970a5991549b5b35; $Path=/"
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, String)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, Header)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.Cookie - enter Cookie(String, String, String, String, Date, boolean)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.validate(String, int, String, boolean, Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.validate(String, port, path, boolean, Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.addCookie(Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.formatCookie(Cookie)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Cookie accepted: "$Version=0; PHPSESSID=2fa16a2bd928e3a771df864b36c8b7d8; $Path=/"
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseBody(HttpState, HttpConnection)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseBody(HttpConnection)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getResponseInputStream()
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(String)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.isResponseAvailable(int)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.canResponseHaveBody(int)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodDirector - Redirect required
371817 [http-8080-Processor4] INFO org.apache.commons.httpclient.HttpMethodDirector - Redirect requested but followRedirects is disabled
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HeaderParser.parseHeaders(InputStream, String)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Resorting to protocol version default close connection policy
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - Should NOT close connection, using HTTP/1.1
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.isResponseAvailable()
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.releaseConnection()
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - Releasing connection back to connection manager.
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.methods.GetMethod - enter GetMethod(String)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HttpMethod)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HostConfiguration,HttpMethod,HttpState)
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.close()
371817 [http-8080-Processor4] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.closeSockedAndStreams()
371817 [http-8080-Processor4] WARN org.apache.struts.action.RequestProcessor - Unhandled Exception thrown: class java.lang.IllegalArgumentException
371832 [http-8080-Processor4] ERROR org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/test].[action] - Servlet.service() para servlet action lanzó excepción
There are some lines near the end of the trace telling followRedirects is disabled somewhere, but I suppose you're handling this on your own as there are some reads below that...
I would try to enable the wire log in httpclient to see what's going on, but I need some help on that.
Greets
I finally enabled the wire log in httpclient (it was easier than I had thought) and ran a new trace. Again, lots of httpclient stuff:
121468 [http-8080-Processor3] INFO org.webharvest.definition.XmlParser - XML parsed in 0ms.
121530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Java version: 1.5.0_03
121530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Java vendor: Sun Microsystems Inc.
121530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Java class path: C:\Borland\JBuilder2006\thirdparty\jakarta-tomcat-5.5.9\bin\bootstrap.jar;C:\Borland\JBuilder2006\jdk1.5\lib\tools.jar
121561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Operating system name: Windows 2003
121561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Operating system architecture: x86
121561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - Operating system version: 5.2
121608 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SUN 1.5: SUN (DSA key/parameter generation; DSA signing; SHA-1, MD5 digests; SecureRandom; X.509 certificates; JKS keystore; PKIX CertPathValidator; PKIX CertPathBuilder; LDAP, Collection CertStores)
121624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SunRsaSign 1.5: Sun RSA signature provider
121624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SunJSSE 1.5: Sun JSSE provider(PKCS12, SunX509 key/trust factories, SSLv3, TLSv1)
121624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SunJCE 1.5: SunJCE Provider (implements RSA, DES, Triple DES, AES, Blowfish, ARCFOUR, RC2, PBE, Diffie-Hellman, HMAC)
121624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SunJGSS 1.0: Sun (Kerberos v5)
121624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - SunSASL 1.5: Sun SASL provider(implements client mechanisms for: DIGEST-MD5, GSSAPI, EXTERNAL, PLAIN, CRAM-MD5; server mechanisms for: DIGEST-MD5, GSSAPI, CRAM-MD5)
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.useragent = Jakarta Commons-HttpClient/3.0-rc3
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.version = HTTP/1.1
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.connection-manager.class = class org.apache.commons.httpclient.SimpleHttpConnectionManager
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.cookie-policy = rfc2109
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.element-charset = US-ASCII
121640 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.content-charset = ISO-8859-1
121655 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.method.retry-handler = org.apache.commons.httpclient.DefaultHttpMethodRetryHandler@1c8fb4b
121655 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.dateparser.patterns = [EEE, dd MMM yyyy HH:mm:ss zzz, EEEE, dd-MMM-yy HH:mm:ss zzz, EEE MMM d HH:mm:ss yyyy, EEE, dd-MMM-yyyy HH:mm:ss z, EEE, dd-MMM-yyyy HH-mm-ss z, EEE, dd MMM yy HH:mm:ss z, EEE dd-MMM-yyyy HH:mm:ss z, EEE dd MMM yyyy HH:mm:ss z, EEE dd-MMM-yyyy HH-mm-ss z, EEE dd-MMM-yy HH:mm:ss z, EEE dd MMM yy HH:mm:ss z, EEE,dd-MMM-yy HH:mm:ss z, EEE,dd-MMM-yyyy HH:mm:ss z, EEE, dd-MM-yyyy HH:mm:ss z]
121655 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.params.DefaultHttpParams - Set parameter http.protocol.allow-circular-redirects = true
org.apache.commons.httpclient.contrib.ssl.EasySSLProtocolSocketFactory@127f79d
121718 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - VarDefProcessor starts processing...
121718 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - HttpProcessor starts processing...[ID=dynamic_http]
121718 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor starts processing...
121718 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor starts processing...
121733 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor processor executed in 15ms.
121796 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor processor executed in 78ms.
121796 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor starts processing...
121796 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor starts processing...
121796 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - ConstantProcessor processor executed in 0ms.
121796 [http-8080-Processor3] INFO org.webharvest.runtime.processors.BaseProcessor - HttpParamProcessor processor executed in 0ms.
121843 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.setRequestBody(NameValuePair[])
121843 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.clearRequestBody()
121843 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.clearRequestBody()
121843 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.addParameters(NameValuePair[])
121858 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.clearRequestBody()
121874 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
121874 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HttpMethod)
121874 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HostConfiguration,HttpMethod,HttpState)
121890 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodDirector - Attempt number 1 to process request
121890 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.open()
121890 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - Open connection to 69.146.1.40:80
126389 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.execute(HttpState, HttpConnection)
126389 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequest(HttpState, HttpConnection)
126389 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequestLine(HttpState, HttpConnection)
126389 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.generateRequestLine(HttpConnection, String, String, String, String)
126468 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "POST /acceso.php4 HTTP/1.1[\r][\n]"
126468 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
126468 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.writeRequestHeaders(HttpState,HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.addRequestHeaders(HttpState, HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.ExpectContinueMethod - enter ExpectContinueMethod.addRequestHeaders(HttpState, HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addRequestHeaders(HttpState, HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addUserAgentRequestHeaders(HttpState, HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addHostRequestHeader(HttpState, HttpConnection)
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Adding Host request header
126483 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addCookieRequestHeader(HttpState, HttpConnection)
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.getCookies()
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.match(String, int, String, boolean, Cookie[])
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.addProxyConnectionHeader(HttpState, HttpConnection)
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.addContentLengthRequestHeader(HttpState, HttpConnection)
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.getRequestContentLength()
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.getParameters()
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter getContentCharSet( Header contentheader )
126499 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Default charset used: ISO-8859-1
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.getParameters()
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter getContentCharSet( Header contentheader )
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(String)
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.getParameterByName(String)
126514 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Default charset used: ISO-8859-1
126514 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1[\r][\n]"
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126530 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "Host: 69.146.1.40[\r][\n]"
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126530 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "Content-Length: 26[\r][\n]"
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
126530 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126546 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "Content-Type: application/x-www-form-urlencoded[\r][\n]"
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.print(String)
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.writeLine()
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[])
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.write(byte[], int, int)
126546 [http-8080-Processor3] DEBUG httpclient.wire.header - >> "[\r][\n]"
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.writeRequestBody(HttpState, HttpConnection)
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - enter EntityEnclosingMethod.getRequestContentLength()
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.PostMethod - enter PostMethod.hasRequestContent()
126546 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getRequestOutputStream()
126561 [http-8080-Processor3] DEBUG httpclient.wire.content - >> "idusu=login&pass=password"
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.EntityEnclosingMethod - Request body sent
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.flushRequestOutputStream()
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponse(HttpState, HttpConnection)
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readStatusLine(HttpState, HttpConnection)
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.readLine()
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126561 [http-8080-Processor3] DEBUG httpclient.wire.header - << "HTTP/1.1 302 Found[\r][\n]"
126561 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseHeaders(HttpState,HttpConnection)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getResponseInputStream()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HeaderParser.parseHeaders(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126577 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126593 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126608 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Date: Tue, 17 Oct 2006 12:47:08 GMT[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Server: Apache/1.3.23 (Unix) PHP/4.4.2[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "X-Powered-By: PHP/4.4.2[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Set-Cookie: PHPSESSID=a4ac207a561232ed32a86de6c70b81c9; path=/[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Expires: Thu, 19 Nov 1981 08:52:00 GMT[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Pragma: no-cache[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Set-Cookie: PHPSESSID=239c820a07ee40461e8ed32f18c3e235; path=/[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Location: conspac.php4?PHPSESSID=239c820a07ee40461e8ed32f18c3e235&new_login=1[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Transfer-Encoding: chunked[\r][\n]"
126608 [http-8080-Processor3] DEBUG httpclient.wire.header - << "Content-Type: text/html[\r][\n]"
126608 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.processResponseHeaders(HttpState, HttpConnection)
126608 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, String)
126608 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, Header)
126624 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.Cookie - enter Cookie(String, String, String, String, Date, boolean)
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.validate(String, int, String, boolean, Cookie)
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.validate(String, port, path, boolean, Cookie)
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.addCookie(Cookie)
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.formatCookie(Cookie)
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Cookie accepted: "$Version=0; PHPSESSID=a4ac207a561232ed32a86de6c70b81c9; $Path=/"
126749 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, String)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.parse(String, port, path, boolean, Header)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.Cookie - enter Cookie(String, String, String, String, Date, boolean)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.validate(String, int, String, boolean, Cookie)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter CookieSpecBase.validate(String, port, path, boolean, Cookie)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpState - enter HttpState.addCookie(Cookie)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.cookie.CookieSpec - enter RFC2109Spec.formatCookie(Cookie)
126764 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Cookie accepted: "$Version=0; PHPSESSID=239c820a07ee40461e8ed32f18c3e235; $Path=/"
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseBody(HttpState, HttpConnection)
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.readResponseBody(HttpConnection)
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.getResponseInputStream()
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(String)
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HeaderElement - enter HeaderElement.parseElements(char[])
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.isResponseAvailable(int)
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - enter HttpMethodBase.canResponseHaveBody(int)
126780 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodDirector - Redirect required
126780 [http-8080-Processor3] INFO org.apache.commons.httpclient.HttpMethodDirector - Redirect requested but followRedirects is disabled
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "1"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "a"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "f"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\r]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\n]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "<br />[\n]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "<b>Warning</b>: Unknown(): Your script possibly relies on a session side-effect which existed until PHP 4.2.3. Please be advised that the session extension does not consider global variables as a source of data, unless register_globals is enabled. You can disable this functionality and this warning by setting session.bug_compat_42 or session.bug_compat_warn to off, respectively. in <b>Unknown</b> on line <b>0</b><br />[\n]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\r]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\n]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "0"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\r]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\n]"
126796 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HeaderParser.parseHeaders(InputStream, String)
126796 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readLine(InputStream, String)
126796 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpParser - enter HttpParser.readRawLine()
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\r]"
126796 [http-8080-Processor3] DEBUG httpclient.wire.content - << "[\n]"
126796 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Resorting to protocol version default close connection policy
126796 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - Should NOT close connection, using HTTP/1.1
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.isResponseAvailable()
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.releaseConnection()
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - Releasing connection back to connection manager.
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.methods.GetMethod - enter GetMethod(String)
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpMethodBase - HttpMethodBase.addRequestHeader(Header)
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HttpMethod)
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpClient - enter HttpClient.executeMethod(HostConfiguration,HttpMethod,HttpState)
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.close()
126811 [http-8080-Processor3] DEBUG org.apache.commons.httpclient.HttpConnection - enter HttpConnection.closeSockedAndStreams()
126827 [http-8080-Processor3] WARN org.apache.struts.action.RequestProcessor - Unhandled Exception thrown: class java.lang.IllegalArgumentException
126827 [http-8080-Processor3] ERROR org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/test].[action] - Servlet.service() para servlet action lanzó excepción
java.lang.IllegalArgumentException: host parameter is null
at org.apache.commons.httpclient.HttpConnection.setHost(HttpConnection.java:249)
at org.apache.commons.httpclient.SimpleHttpConnectionManager.getConnectionWithTimeout(SimpleHttpConnectionManager.java:146)
at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:152)
at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396)
at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:324)
at org.webharvest.runtime.web.HttpClientManager.execute(HttpClientManager.java:103)
at org.webharvest.runtime.processors.HttpProcessor.execute(HttpProcessor.java:46)
at org.webharvest.runtime.processors.BaseProcessor.run(BaseProcessor.java:51)
at org.webharvest.runtime.processors.BaseProcessor.executeBody(BaseProcessor.java:72)
at org.webharvest.runtime.processors.BaseProcessor.getBodyListContent(BaseProcessor.java:104)
at org.webharvest.runtime.processors.VarDefProcessor.execute(VarDefProcessor.java:22)
at org.webharvest.runtime.processors.BaseProcessor.run(BaseProcessor.java:51)
at org.webharvest.runtime.Scraper.execute(Scraper.java:73)
at org.webharvest.runtime.Scraper.execute(Scraper.java:82)
at org.chop.vishc.actions.SelPetPascoAction.executePA(SelPetPascoAction.java:76)
at org.chop.vishc.actions.BaseProtectedAction.execute(BaseProtectedAction.java:46)
at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:484)
at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:274)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1482)
at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:507)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:744)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)