[Htmlunit-user] htmlunit 2.35 and 2.36 OSGi release (htmlunit-2.36.0-OSGi.jar) leaks threads and hangs the applications

[Wayne X. <wx...@ya...>]

Hi,
I recently upgraded to 2.35 and 2.36 using htmlunit as a crawling unit. After crawling a lot of pages, I started to see tons of the following threads in the thread dump and eventually it eats up system resource and hangs the container (in docker).
The problem looks very much like what's mentioned in this link:
'Re: [Htmlunit-user] Help with UpgradeException' - MARC


| 
| 
|  | 
'Re: [Htmlunit-user] Help with UpgradeException' - MARC


 |

 |

 |


I wonder if anybody else has seen it. I'm a little surprised that I couldn't find another recent report about this problem giving that 2.35 has been out for a while.
Any pointers would be highly appreciated.


"WebSocketClient@1404341633-126276" #126276 daemon prio=5 os_prio=0 tid=0x00007faba4228800 nid=0xbe7 runnable [0x00007fa1ec102000]   java.lang.Thread.State: RUNNABLE        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)        - locked <0x00007fba17c3b6f0> (a sun.nio.ch.Util$3)        - locked <0x00007fba17c3b6d8> (a java.util.Collections$UnmodifiableSet)        - locked <0x00007fba17c3b528> (a sun.nio.ch.EPollSelectorImpl)        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)        at org.eclipse.jetty.io.ManagedSelector$$Lambda$71/1759199424.run(Unknown Source)        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:786)        at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:743)        at java.lang.Thread.run(Thread.java:748)
"WebSocketClient@1404341633-126275" #126275 daemon prio=5 os_prio=0 tid=0x00007faba403b000 nid=0xbdb waiting on condition [0x00007fa28901c000]   java.lang.Thread.State: TIMED_WAITING (parking)        at sun.misc.Unsafe.park(Native Method)        - parking to wait for  <0x00007fba17d68fd8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)        at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:727)        at java.lang.Thread.run(Thread.java:748)


-Wayne