#1070 BigContentPageTest.chunkedBigContent() Not Implemented

[Anonymous]

Per Ahmed

BigContentPageTest.chunkedBigContent() test was added as @NotYetImplamented

This is related to allowing BigContentPage to support chunks.

[Ahmed Ashour]

Hello,

Please try latest snapsthot (local maven repository is also updated).

I couldn't be able to simulate 'chunked' response, as Jetty ignores setting 'Transfer-Encoding', an email was sent to jetty-user list, but no feedback yet.

The current implementation depends on HttpClient to handle chunked response, but if this is not the case the logic can be done at HtmlUnit level.

Please test the actual content received from chunked response, and reopen the bug report if you have an issue.

[Allen Servedio]

Hi - was this change checked for pages that load non-English content? We have reason to believe that the error below was caused by a page returning non-English content:

[2010-04-29 13:21:42.226] [SEVERE] URLHandlerInterceptor: Exception occured when processing page
with HTMLUnit.
[2010-04-29 13:21:42.226] java.io.IOException: com.gargoylesoftware.htmlunit.MemoryInputStream.re
ad() returned value out of range -1..255: -117
[2010-04-29 13:21:42.226] at java.util.zip.GZIPInputStream.readUByte(GZIPInputStream.java:2
11)
[2010-04-29 13:21:42.226] at java.util.zip.GZIPInputStream.readUShort(GZIPInputStream.java:
198)
[2010-04-29 13:21:42.226] at java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:
136)
[2010-04-29 13:21:42.226] at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:58)
[2010-04-29 13:21:42.226] at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:68)
[2010-04-29 13:21:42.226] at com.gargoylesoftware.htmlunit.WebResponseData.getBody(WebRespo
nseData.java:157)
[2010-04-29 13:21:42.226] at com.gargoylesoftware.htmlunit.WebResponseData.<init>(WebRespon
seData.java:113)
[2010-04-29 13:21:42.226] at com.gargoylesoftware.htmlunit.HttpWebConnection.newWebResponse
DataInstance(HttpWebConnection.java:452)
[2010-04-29 13:21:42.226] at com.gargoylesoftware.htmlunit.HttpWebConnection.makeWebRespons
e(HttpWebConnection.java:432)
[2010-04-29 13:21:42.226] at com.gargoylesoftware.htmlunit.HttpWebConnection.getResponse(Ht
tpWebConnection.java:104)
[2010-04-29 13:21:42.226] at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseFromWeb
Connection(WebClient.java:1436)
[2010-04-29 13:21:42.226] at com.gargoylesoftware.htmlunit.WebClient.loadWebResponse(WebCli
ent.java:1365)
[2010-04-29 13:21:42.226] at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java
:308)
[2010-04-29 13:21:42.226] at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java
:372)
[2010-04-29 13:21:42.226] at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java
:357)
[2010-04-29 13:21:42.226] at com.ihg.dec.apps.hi.config.seo.SEOMappingManager.processReques
t(SEOMappingManager.java:105)
[2010-04-29 13:21:42.226] at com.ihg.dec.apps.hi.servlet.filter.CrawlServlet.generateHtml(C
rawlServlet.java:180)
[2010-04-29 13:21:42.226] at com.ihg.dec.apps.hi.servlet.filter.CrawlServlet.doFilter(Crawl
Servlet.java:133)
[2010-04-29 13:21:42.226] at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFi
lterChain.java:87)
[2010-04-29 13:21:42.226] at com.caucho.server.cache.CacheFilterChain.doFilter(CacheFilterC
hain.java:194)
[2010-04-29 13:21:42.226] at com.caucho.server.webapp.WebAppFilterChain.doFilter(WebAppFilt
erChain.java:187)
[2010-04-29 13:21:42.226] at com.caucho.server.dispatch.ServletInvocation.service(ServletIn
vocation.java:266)
[2010-04-29 13:21:42.226] at com.caucho.server.hmux.HmuxRequest.handleRequest(HmuxRequest.j
ava:435)
[2010-04-29 13:21:42.226] at com.caucho.server.port.TcpConnection.run(TcpConnection.java:67
8)
[2010-04-29 13:21:42.226] at com.caucho.util.ThreadPool$Item.runTasks(ThreadPool.java:721)
[2010-04-29 13:21:42.226] at com.caucho.util.ThreadPool$Item.run(ThreadPool.java:643)
[2010-04-29 13:21:42.226] at java.lang.Thread.run(Thread.java:619)
[2010-04-29 13:21:42.226]

Allen

[Ahmed Ashour]

Please open another bug report, with a case that reproduces that error.