Junit consistently dies after a certain number of tests

[dave.alvarado]

Hi,

I'm using JUnit 4.3.1 with Java 1.5 on a Mac 10.5.6.  We have a particular JUnit file that tests a web service client against a web service running locally.  The file has many test cases (over 1000).  No matter in what order we arrange the test cases, the file always dies at the 1016th test case, with the error below.  Was wondering what the next steps for troubleshooting should be.

Thanks, - Dave

junit.framework.AssertionFailedError: Got Axis Fault.  Test failed:Invalid argument
        at myco.dor.dmv.driver.matching.test.MatchingServiceTest._testMatch(MatchingServiceTest.java:16850)
        at myco.dor.dmv.driver.matching.test.MatchingServiceTest._testMatch(MatchingServiceTest.java:16817)
        at myco.dor.dmv.driver.matching.test.MatchingServiceTest._testMatchInvalidCaseType(MatchingServiceTest.java:16806)
        at myco.dor.dmv.driver.matching.test.MatchingServiceTest._testInvalidMatchMailingZipBlank(MatchingServiceTest.java:16523)
        at myco.dor.dmv.driver.matching.test.MatchingServiceTest.test35MatchInvalid_MailingZipBlank(MatchingServiceTest.java:4151)
        at org.apache.commons.jelly.tags.ant.AntTag.doTag(AntTag.java:195)
        at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
        at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
        at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
        at org.apache.commons.jelly.tags.core.OtherwiseTag.doTag(OtherwiseTag.java:41)
        at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
        at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
        at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
        at org.apache.commons.jelly.tags.core.ChooseTag.doTag(ChooseTag.java:38)
        at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
        at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
        at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
        at org.apache.commons.jelly.tags.core.IfTag.doTag(IfTag.java:42)
        at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
        at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
        at org.apache.maven.jelly.tags.werkz.MavenGoalTag.runBodyTag(MavenGoalTag.java:83)
        at org.apache.maven.jelly.tags.werkz.MavenGoalTag$MavenGoalAction.performAction(MavenGoalTag.java:116)
        at org.apache.maven.werkz.Goal.fire(Goal.java:691)
        at org.apache.maven.werkz.Goal.attain(Goal.java:623)
        at org.apache.maven.plugin.PluginManager.attainGoals(PluginManager.java:712)
        at org.apache.maven.MavenSession.attainGoals(MavenSession.java:265)
        at org.apache.maven.cli.App.doMain(App.java:307)
        at org.apache.maven.cli.App.main(App.java:217)
        at com.werken.forehead.Forehead.run(Forehead.java:551)
        at com.werken.forehead.Forehead.main(Forehead.java:581)

[dave.alvarado]

The file always dies after the 1016th case, meaning taht I can switch tests around but it will still die at the same place.  For example,I can put the code at line 16850 at line 1 (or at the beginning of the file) and taht code works, but now whatever test is at line 16850 will now fail.

I thought maybe there was smoe resource constraint, but I would see an OutOfMemoryError, right?

Thanks, - Dave

>  -------Original Message-------
>  From: Forsberg, Mike <mike.forsberg@...>
>  Subject: RE: [junit] Junit consistently dies after a certain number of tests
>  Sent: Oct 22 '09 12:25
>  
>  What is the code at MatchingServiceTest.java line 16850 and around  this
>  area?
>  
>  
>  The stack trace clearly shows that there is an error at this  location.�
>  
>  
>  Does the error move around with each run?
>  
>  
>  Big Mike
>  
>  
>  FROM:  junit@... [mailto:junit@...] ON BEHALF OF
>  dave.alvarado@...
>  SENT: Thursday, October 22, 2009 11:54 AM
>  TO: junit@...; junit YahooGroup
>  SUBJECT: [junit] Junit consistently dies after a certain number of tests
>  
>  
>  Hi,
>  
>  I'm using JUnit 4.3.1 with Java 1.5 on a Mac 10.5.6. We have a
>  particular JUnit  file that tests a web service client against a web
>  service running locally. The  file has many test cases (over 1000). No
>  matter in what order we arrange the  test cases, the file always dies at
>  the 1016th test case, with the error below.  Was wondering what the next
>  steps for troubleshooting should be.
>  
>  Thanks, - Dave
>  
>  junit.framework.AssertionFailedError: Got Axis Fault. Test
>  failed:Invalid argument
>  at
>  myco.dor.dmv.driver.matching.test.MatchingServiceTest._testMatch(MatchingServiceTest.java:16850)
>  at
>  myco.dor.dmv.driver.matching.test.MatchingServiceTest._testMatch(MatchingServiceTest.java:16817)
>  at
>  myco.dor.dmv.driver.matching.test.MatchingServiceTest._testMatchInvalidCaseType(MatchingServiceTest.java:16806)
>  at
>  myco.dor.dmv.driver.matching.test.MatchingServiceTest._testInvalidMatchMailingZipBlank(MatchingServiceTest.java:16523)
>  at
>  myco.dor.dmv.driver.matching.test.MatchingServiceTest.test35MatchInvalid_MailingZipBlank(MatchingServiceTest.java:4151)
>  at org.apache.commons.jelly.tags.ant.AntTag.doTag(AntTag.java:195)
>  at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
>  at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
>  at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
>  at
>  org.apache.commons.jelly.tags.core.OtherwiseTag.doTag(OtherwiseTag.java:41)
>  at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
>  at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
>  at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
>  at org.apache.commons.jelly.tags.core.ChooseTag.doTag(ChooseTag.java:38)
>  at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
>  at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
>  at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
>  at org.apache.commons.jelly.tags.core.IfTag.doTag(IfTag.java:42)
>  at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
>  at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
>  at
>  org.apache.maven.jelly.tags.werkz.MavenGoalTag.runBodyTag(MavenGoalTag.java:83)
>  at
>  org.apache.maven.jelly.tags.werkz.MavenGoalTag$MavenGoalAction.performAction(MavenGoalTag.java:116)
>  at org.apache.maven.werkz.Goal.fire(Goal.java:691)
>  at org.apache.maven.werkz.Goal.attain(Goal.java:623)
>  at
>  org.apache.maven.plugin.PluginManager.attainGoals(PluginManager.java:712)
>  at org.apache.maven.MavenSession.attainGoals(MavenSession.java:265)
>  at org.apache.maven.cli.App.doMain(App.java:307)
>  at org.apache.maven.cli.App.main(App.java:217)
>  at com.werken.forehead.Forehead.run(Forehead.java:551)
>  at com.werken.forehead.Forehead.main(Forehead.java:581)
>  
>  
>  

[Forsberg, Mike-2]

Just wondering if you’re recompiling the code when you make the change…

 

I assure you there is no logical reason for 1016 test cases to be a magical number.  Or line 16850 for that matter.

 

Big Mike

 

From: junit@... [mailto:junit@...] On Behalf Of dave.alvarado@...
Sent: Thursday, October 22, 2009 2:27 PM
To: junit@...
Subject: RE: [junit] Junit consistently dies after a certain number of tests

 

 

The file always dies after the 1016th case, meaning taht I can switch tests around but it will still die at the same place. For example,I can put the code at line 16850 at line 1 (or at the beginning of the file) and taht code works, but now whatever test is at line 16850 will now fail.

I thought maybe there was smoe resource constraint, but I would see an OutOfMemoryError, right?

Thanks, - Dave

> -------Original Message-------
> From: Forsberg, Mike <mike.forsberg@... <mailto:mike.forsberg%40globalfoundries.com> >
> Subject: RE: [junit] Junit consistently dies after a certain number of tests
> Sent: Oct 22 '09 12:25
>
> What is the code at MatchingServiceTest.java line 16850 and around this
> area?
>
>
> The stack trace clearly shows that there is an error at this location.�
>
>
> Does the error move around with each run?
>
>
> Big Mike
>
>
> FROM: junit@... <mailto:junit%40yahoogroups.com>  [mailto:junit@... <mailto:junit%40yahoogroups.com> ] ON BEHALF OF
> dave.alvarado@... <mailto:dave.alvarado%40remanresource.com>
> SENT: Thursday, October 22, 2009 11:54 AM
> TO: junit@... <mailto:junit%40yahoogroups.com> ; junit YahooGroup
> SUBJECT: [junit] Junit consistently dies after a certain number of tests
>
>
> Hi,
>
> I'm using JUnit 4.3.1 with Java 1.5 on a Mac 10.5.6. We have a
> particular JUnit file that tests a web service client against a web
> service running locally. The file has many test cases (over 1000). No
> matter in what order we arrange the test cases, the file always dies at
> the 1016th test case, with the error below. Was wondering what the next
> steps for troubleshooting should be.
>
> Thanks, - Dave
>
> junit.framework.AssertionFailedError: Got Axis Fault. Test
> failed:Invalid argument
> at
> myco.dor.dmv.driver.matching.test.MatchingServiceTest._testMatch(MatchingServiceTest.java:16850)
> at
> myco.dor.dmv.driver.matching.test.MatchingServiceTest._testMatch(MatchingServiceTest.java:16817)
> at
> myco.dor.dmv.driver.matching.test.MatchingServiceTest._testMatchInvalidCaseType(MatchingServiceTest.java:16806)
> at
> myco.dor.dmv.driver.matching.test.MatchingServiceTest._testInvalidMatchMailingZipBlank(MatchingServiceTest.java:16523)
> at
> myco.dor.dmv.driver.matching.test.MatchingServiceTest.test35MatchInvalid_MailingZipBlank(MatchingServiceTest.java:4151)
> at org.apache.commons.jelly.tags.ant.AntTag.doTag(AntTag.java:195)
> at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
> at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
> at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
> at
> org.apache.commons.jelly.tags.core.OtherwiseTag.doTag(OtherwiseTag.java:41)
> at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
> at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
> at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
> at org.apache.commons.jelly.tags.core.ChooseTag.doTag(ChooseTag.java:38)
> at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
> at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
> at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
> at org.apache.commons.jelly.tags.core.IfTag.doTag(IfTag.java:42)
> at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:250)
> at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
> at
> org.apache.maven.jelly.tags.werkz.MavenGoalTag.runBodyTag(MavenGoalTag.java:83)
> at
> org.apache.maven.jelly.tags.werkz.MavenGoalTag$MavenGoalAction.performAction(MavenGoalTag.java:116)
> at org.apache.maven.werkz.Goal.fire(Goal.java:691)
> at org.apache.maven.werkz.Goal.attain(Goal.java:623)
> at
> org.apache.maven.plugin.PluginManager.attainGoals(PluginManager.java:712)
> at org.apache.maven.MavenSession.attainGoals(MavenSession.java:265)
> at org.apache.maven.cli.App.doMain(App.java:307)
> at org.apache.maven.cli.App.main(App.java:217)
> at com.werken.forehead.Forehead.run(Forehead.java:551)
> at com.werken.forehead.Forehead.main(Forehead.java:581)
>
>
>

[Non-text portions of this message have been removed]