big black hole with no time out.

View: New views
3 Messages — Rating Filter:   Alert me  

big black hole with no time out.

by jason franklin-stokes :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

dear groupies,

I have a very strange problem. It seems that html unit does not return  
from fetching a particular website (http://www.pharma-druck-dresden.de).

There is something strange about this website anyway - the pictures on  
the site are big and they are sent it chunks - and I have a funny  
feeling that this could be a problem.

the other strange thing is that html unit only chokes on the website  
when I have fetched a number of other websites before hand.

this is the actual code that causes htmlunit to choke and never  
return. - any ideas??

browser = Celerity::Browser.new(:browser => :firefox3)

   %w( http://www.boesmueller.at
  http://www.donauchem.com
  http://www.prinux.com
  http://www.r12.at
  http://www.bauer-bauer.com
  http://www.plakativ.at
  http://www.kroneabo.at
  http://www.elcreco.net
  http://www.minerva.at
  http://www.atlasdruck.at
  http://www.kalle-repromedia.at
  http://www.man-roland.at
  http://www.constantia-patz.com
  http://www.diedrucker.biz
  http://www.gutenberg-linz.co.at
  http://www.weingartsberger.at
  http://www.fischer-ski.com
  http://www.flowerprint.at
  http://www.007print.com
  http://www.woergl.netwing.at
  http://www.maristechcon.com
  http://www.brigl-bergmeister.com
  http://www.gutenberghaus.at
  http://www.heyn.at
  http://www.sappi.com
  http://www.mahanna.com
  http://www.x-oc.com
  http://www.xeikon.com
  http://www.groupjoos.com
  http://www.duomedia.com
  http://www.vitzorint.com
  http://www.strobbegraphics.com
  http://www.esko-graphics.com
  http://www.bobstgroup.com
  http://www.festa.ch
  http://www.rollhandling.com
  http://www.wifag.ch
  http://www.bedag.ch
  http://www.swisspost.com
  http://www.piab.com
  http://www.kern.ch
  http://www.thoma-druck.ch
  http://www.prepress.ch
  http://www.birsdruck.ch
  http://www.markandy.com
  http://www.mullermartini.com
  http://www.hunkeler.ch
  http://www.luescher.com
  http://www.antalis.ch
  http://www.seyfferccw.ch
  http://www.abb.ch
  http://www.celfa.com
  http://www.systembrunner.ch
  http://www.baumeister.ch
  http://www.ropress.ch
  http://www.alpha-papier.com
  http://www.feldegg.ch
  http://www.chromos.ch
  http://www.photocolor.ch
  http://www.christinger.ch
  http://www.printoplast.com
  http://www.steinemann-ag.ch
  http://www.edo.ch
  http://www.ruesch-druck.ch
  http://www.printplus.ch
  http://www.zund.com
  http://www.printa.cz
  http://www.branaldi.eu
  http://www.leben.cz
  http://www.moraviapress.cz
  http://www.digi-dresden.de
  http://www.htw-dresden.de
  http://www.cms.de
  http://www.typo-sg.de
  http://www.udd-dd.de
  http://www.c-macs.de
  http://www.reprotechnik.de
  http://www.sz-online.de
  http://www.druckerei-freund.de
  http://www.sdv.de
  http://www.elbtaldruck.de
  http://www.sdz-directworld.de
  http://www.modig.de
  http://www.lks-heymann.de
  http://www.hille1880.de
  http://www.polygraph-kama.de
  http://www.poly-druck-dresden.de
  http://www.siebdruck-freudenberg.de
  http://www.druckhaus-dresden.de
  http://www.duplex-dresden.de
  http://www.druckerei-thieme.de
  http://www.vehmann.de
  http://www.sandstein.de
  http://www.plakat-digitaldruck.de
  http://www.fritzsche-werbung.de
  http://www.waf-multimedia.de
  http://www.klingenberg-gts.de
  http://www.kba-planeta.de
  http://www.loessnitz-druck.de
  http://www.b-krause.de
  http://www.mdh-online.de
  http://www.ellerhold.de
  http://www.grafia.de
  http://www.pharma-druck-dresden.de).each do |url|
     puts url
     browser.goto(url)
  end

------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: big black hole with no time out.

by anotherjosh :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

I've been seeing similar issues with v2.5.  When it hangs, it ends up pegging my processor at 99% utilization.  I'm still trying to isolate what is happening.  I'm about to throw in the towel and upgrade to 2.6 to see if that resolves it.

--josh

On Wed, Oct 28, 2009 at 3:06 PM, jason franklin-stokes <jasoninclass@...> wrote:
dear groupies,

I have a very strange problem. It seems that html unit does not return
from fetching a particular website (http://www.pharma-druck-dresden.de).

There is something strange about this website anyway - the pictures on
the site are big and they are sent it chunks - and I have a funny
feeling that this could be a problem.

the other strange thing is that html unit only chokes on the website
when I have fetched a number of other websites before hand.

this is the actual code that causes htmlunit to choke and never
return. - any ideas??

browser = Celerity::Browser.new(:browser => :firefox3)

  %w( http://www.boesmueller.at
 http://www.donauchem.com
 http://www.prinux.com
 http://www.r12.at
 http://www.bauer-bauer.com
 http://www.plakativ.at
 http://www.kroneabo.at
 http://www.elcreco.net
 http://www.minerva.at
 http://www.atlasdruck.at
 http://www.kalle-repromedia.at
 http://www.man-roland.at
 http://www.constantia-patz.com
 http://www.diedrucker.biz
 http://www.gutenberg-linz.co.at
 http://www.weingartsberger.at
 http://www.fischer-ski.com
 http://www.flowerprint.at
 http://www.007print.com
 http://www.woergl.netwing.at
 http://www.maristechcon.com
 http://www.brigl-bergmeister.com
 http://www.gutenberghaus.at
 http://www.heyn.at
 http://www.sappi.com
 http://www.mahanna.com
 http://www.x-oc.com
 http://www.xeikon.com
 http://www.groupjoos.com
 http://www.duomedia.com
 http://www.vitzorint.com
 http://www.strobbegraphics.com
 http://www.esko-graphics.com
 http://www.bobstgroup.com
 http://www.festa.ch
 http://www.rollhandling.com
 http://www.wifag.ch
 http://www.bedag.ch
 http://www.swisspost.com
 http://www.piab.com
 http://www.kern.ch
 http://www.thoma-druck.ch
 http://www.prepress.ch
 http://www.birsdruck.ch
 http://www.markandy.com
 http://www.mullermartini.com
 http://www.hunkeler.ch
 http://www.luescher.com
 http://www.antalis.ch
 http://www.seyfferccw.ch
 http://www.abb.ch
 http://www.celfa.com
 http://www.systembrunner.ch
 http://www.baumeister.ch
 http://www.ropress.ch
 http://www.alpha-papier.com
 http://www.feldegg.ch
 http://www.chromos.ch
 http://www.photocolor.ch
 http://www.christinger.ch
 http://www.printoplast.com
 http://www.steinemann-ag.ch
 http://www.edo.ch
 http://www.ruesch-druck.ch
 http://www.printplus.ch
 http://www.zund.com
 http://www.printa.cz
 http://www.branaldi.eu
 http://www.leben.cz
 http://www.moraviapress.cz
 http://www.digi-dresden.de
 http://www.htw-dresden.de
 http://www.cms.de
 http://www.typo-sg.de
 http://www.udd-dd.de
 http://www.c-macs.de
 http://www.reprotechnik.de
 http://www.sz-online.de
 http://www.druckerei-freund.de
 http://www.sdv.de
 http://www.elbtaldruck.de
 http://www.sdz-directworld.de
 http://www.modig.de
 http://www.lks-heymann.de
 http://www.hille1880.de
 http://www.polygraph-kama.de
 http://www.poly-druck-dresden.de
 http://www.siebdruck-freudenberg.de
 http://www.druckhaus-dresden.de
 http://www.duplex-dresden.de
 http://www.druckerei-thieme.de
 http://www.vehmann.de
 http://www.sandstein.de
 http://www.plakat-digitaldruck.de
 http://www.fritzsche-werbung.de
 http://www.waf-multimedia.de
 http://www.klingenberg-gts.de
 http://www.kba-planeta.de
 http://www.loessnitz-druck.de
 http://www.b-krause.de
 http://www.mdh-online.de
 http://www.ellerhold.de
 http://www.grafia.de
 http://www.pharma-druck-dresden.de).each do |url|
    puts url
    browser.goto(url)
 end

------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user


------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: big black hole with no time out.

by jason franklin-stokes :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message


ok - so what I have done is wrap it in a thread so that I can kill it if it messes up. I can live with this for now. 

example:

  thread = Thread.new(browser) do |mybrowser|
      mybrowser.resynchronized { mybrowser.goto(url) }
      mybrowser.wait
    end

    stime = Time.now
    while (Time.now - stime) < 30
      break unless thread.status
    end

    if (Time.now - stime) >= 30
      thread.kill
    end

On Oct 28, 2009, at 11:41 PM, Josh Lopez wrote:

I've been seeing similar issues with v2.5.  When it hangs, it ends up pegging my processor at 99% utilization.  I'm still trying to isolate what is happening.  I'm about to throw in the towel and upgrade to 2.6 to see if that resolves it.

--josh

On Wed, Oct 28, 2009 at 3:06 PM, jason franklin-stokes <jasoninclass@...> wrote:
dear groupies,

I have a very strange problem. It seems that html unit does not return
from fetching a particular website (http://www.pharma-druck-dresden.de).

There is something strange about this website anyway - the pictures on
the site are big and they are sent it chunks - and I have a funny
feeling that this could be a problem.

the other strange thing is that html unit only chokes on the website
when I have fetched a number of other websites before hand.

this is the actual code that causes htmlunit to choke and never
return. - any ideas??

browser = Celerity::Browser.new(:browser => :firefox3)

  %w( http://www.boesmueller.at
 http://www.donauchem.com
 http://www.prinux.com
 http://www.r12.at
 http://www.bauer-bauer.com
 http://www.plakativ.at
 http://www.kroneabo.at
 http://www.elcreco.net
 http://www.minerva.at
 http://www.atlasdruck.at
 http://www.kalle-repromedia.at
 http://www.man-roland.at
 http://www.constantia-patz.com
 http://www.diedrucker.biz
 http://www.gutenberg-linz.co.at
 http://www.weingartsberger.at
 http://www.fischer-ski.com
 http://www.flowerprint.at
 http://www.007print.com
 http://www.woergl.netwing.at
 http://www.maristechcon.com
 http://www.brigl-bergmeister.com
 http://www.gutenberghaus.at
 http://www.heyn.at
 http://www.sappi.com
 http://www.mahanna.com
 http://www.x-oc.com
 http://www.xeikon.com
 http://www.groupjoos.com
 http://www.duomedia.com
 http://www.vitzorint.com
 http://www.strobbegraphics.com
 http://www.esko-graphics.com
 http://www.bobstgroup.com
 http://www.festa.ch
 http://www.rollhandling.com
 http://www.wifag.ch
 http://www.bedag.ch
 http://www.swisspost.com
 http://www.piab.com
 http://www.kern.ch
 http://www.thoma-druck.ch
 http://www.prepress.ch
 http://www.birsdruck.ch
 http://www.markandy.com
 http://www.mullermartini.com
 http://www.hunkeler.ch
 http://www.luescher.com
 http://www.antalis.ch
 http://www.seyfferccw.ch
 http://www.abb.ch
 http://www.celfa.com
 http://www.systembrunner.ch
 http://www.baumeister.ch
 http://www.ropress.ch
 http://www.alpha-papier.com
 http://www.feldegg.ch
 http://www.chromos.ch
 http://www.photocolor.ch
 http://www.christinger.ch
 http://www.printoplast.com
 http://www.steinemann-ag.ch
 http://www.edo.ch
 http://www.ruesch-druck.ch
 http://www.printplus.ch
 http://www.zund.com
 http://www.printa.cz
 http://www.branaldi.eu
 http://www.leben.cz
 http://www.moraviapress.cz
 http://www.digi-dresden.de
 http://www.htw-dresden.de
 http://www.cms.de
 http://www.typo-sg.de
 http://www.udd-dd.de
 http://www.c-macs.de
 http://www.reprotechnik.de
 http://www.sz-online.de
 http://www.druckerei-freund.de
 http://www.sdv.de
 http://www.elbtaldruck.de
 http://www.sdz-directworld.de
 http://www.modig.de
 http://www.lks-heymann.de
 http://www.hille1880.de
 http://www.polygraph-kama.de
 http://www.poly-druck-dresden.de
 http://www.siebdruck-freudenberg.de
 http://www.druckhaus-dresden.de
 http://www.duplex-dresden.de
 http://www.druckerei-thieme.de
 http://www.vehmann.de
 http://www.sandstein.de
 http://www.plakat-digitaldruck.de
 http://www.fritzsche-werbung.de
 http://www.waf-multimedia.de
 http://www.klingenberg-gts.de
 http://www.kba-planeta.de
 http://www.loessnitz-druck.de
 http://www.b-krause.de
 http://www.mdh-online.de
 http://www.ellerhold.de
 http://www.grafia.de
 http://www.pharma-druck-dresden.de).each do |url|
    puts url
    browser.goto(url)
 end

------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user


------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user