Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

View: New views
6 Messages — Rating Filter:   Alert me  

Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

by Chris Law :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hello, I'm running:
Artifactory 2.0.2 on Windows Server 2003 R2 SP2
Tomcat 6.0.18
JRE Sun 1.6.0_11-b03

I installed on Mar 16, 2009 using the default indexer settings.

I discovered that a large amount of storage was being used by
Artifactory and investigated.  It appears that when the indexer runs,
about 80% of time the artifactory.log shows:

<pre>
2009-03-21 15:00:37,687 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2: Retrieving 'http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip'...
2009-03-21 15:00:37,890 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2: Retrieving 'http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties'...
2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed to delete temporary file 'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.zip8081858316636526469.tmp'.
2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed to delete temporary file 'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.properties1715803088839234450.tmp'.
</pre>

The [CATALINA_HOME]/temp directory is full of the tmp files that
couldn't be deleted.  It is always these two files (different tmp
files, but the same base file names).

I don't know if this is related, but the .artifactory/data/store/ is
growing at a phenominal rate.  It is currently at 9.67 Gb.  The
.artifactory/data/db directory is 221 Mb and the typical size of a
developer's up-to-date local repository is about 400 Mb.

The store/seg0/C400.dat and C411.dat are the largest tables are
apparently updated each time the indexer runs.

I've searched the forum and saw one reference to a Unix tmp directory
filling up with some indexer temporary files but I'm not sure if this
is directly related.

I've since turned off the indexer, but I do know that the developers
use the eclipse m2 plugin.

Any help or ideas about the either problem would be greatly appreciated.  Thank you.

Re: Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

by Yoav Landman :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi,

The storage growth issue you see was resolved in 2.0.4.
As for the temp files cleanup, this may be a bug - are you able to delete these files manually using the user running artifactory?

Thanks,

Yoav

On Tue, Apr 7, 2009 at 3:33 PM, Chris Law <chris.law@...> wrote:

Hello, I'm running:
Artifactory 2.0.2 on Windows Server 2003 R2 SP2
Tomcat 6.0.18
JRE Sun 1.6.0_11-b03

I installed on Mar 16, 2009 using the default indexer settings.

I discovered that a large amount of storage was being used by
Artifactory and investigated.  It appears that when the indexer runs,
about 80% of time the artifactory.log shows:

<pre>
2009-03-21 15:00:37,687 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
Retrieving
'http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip'...
2009-03-21 15:00:37,890 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
Retrieving
'http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties'...
2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed to
delete temporary file
'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.zip8081858316636526469.tmp'.
2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed to
delete temporary file
'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.properties1715803088839234450.tmp'.
</pre>

The [CATALINA_HOME]/temp directory is full of the tmp files that
couldn't be deleted.  It is always these two files (different tmp
files, but the same base file names).

I don't know if this is related, but the .artifactory/data/store/ is
growing at a phenominal rate.  It is currently at 9.67 Gb.  The
.artifactory/data/db directory is 221 Mb and the typical size of a
developer's up-to-date local repository is about 400 Mb.

The store/seg0/C400.dat and C411.dat are the largest tables are
apparently updated each time the indexer runs.

I've searched the forum and saw one reference to a Unix tmp directory
filling up with some indexer temporary files but I'm not sure if this
is directly related.

I've since turned off the indexer, but I do know that the developers
use the eclipse m2 plugin.

Any help or ideas about the either problem would be greatly appreciated.
Thank you.

--
View this message in context: http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p22928014.html
Sent from the Artifactory-Users mailing list archive at Nabble.com.


------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Artifactory-users mailing list
Artifactory-users@...
https://lists.sourceforge.net/lists/listinfo/artifactory-users


------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Artifactory-users mailing list
Artifactory-users@...
https://lists.sourceforge.net/lists/listinfo/artifactory-users

Re: Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

by Chris Law :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hello!  Thank you responding.

I will upgrade to 2.0.4.  As for the temp files - yah, I can delete the old temp files - I deleted most of the older ones this morning and have had no new files since then (because I "turned off" the indexer).

So, I after I upgrade to 2.0.4, can I turn the indexer back on, or will that still be an issue?

Thank you again for responding so quickly!

Yoav Landman wrote:
Hi,

The storage growth issue you see was resolved in 2.0.4.
As for the temp files cleanup, this may be a bug - are you able to delete
these files manually using the user running artifactory?

Thanks,

Yoav

On Tue, Apr 7, 2009 at 3:33 PM, Chris Law <chris.law@snapon.com> wrote:

>
> Hello, I'm running:
> Artifactory 2.0.2 on Windows Server 2003 R2 SP2
> Tomcat 6.0.18
> JRE Sun 1.6.0_11-b03
>
> I installed on Mar 16, 2009 using the default indexer settings.
>
> I discovered that a large amount of storage was being used by
> Artifactory and investigated.  It appears that when the indexer runs,
> about 80% of time the artifactory.log shows:
>
> <pre>
> 2009-03-21 15:00:37,687 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
> Retrieving
> '
> http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip'.<http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip%27.>
> ..
> 2009-03-21 15:00:37,890 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
> Retrieving
> '
> http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties'.<http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties%27.>
> ..
> 2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed
> to
> delete temporary file
>
> 'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.zip8081858316636526469.tmp'.
> 2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed
> to
> delete temporary file
>
> 'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.properties1715803088839234450.tmp'.
> </pre>
>
> The [CATALINA_HOME]/temp directory is full of the tmp files that
> couldn't be deleted.  It is always these two files (different tmp
> files, but the same base file names).
>
> I don't know if this is related, but the .artifactory/data/store/ is
> growing at a phenominal rate.  It is currently at 9.67 Gb.  The
> .artifactory/data/db directory is 221 Mb and the typical size of a
> developer's up-to-date local repository is about 400 Mb.
>
> The store/seg0/C400.dat and C411.dat are the largest tables are
> apparently updated each time the indexer runs.
>
> I've searched the forum and saw one reference to a Unix tmp directory
> filling up with some indexer temporary files but I'm not sure if this
> is directly related.
>
> I've since turned off the indexer, but I do know that the developers
> use the eclipse m2 plugin.
>
> Any help or ideas about the either problem would be greatly appreciated.
> Thank you.
>
> --
> View this message in context:
> http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p22928014.html
> Sent from the Artifactory-Users mailing list archive at Nabble.com.
>
>
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by:
> High Quality Requirements in a Collaborative Environment.
> Download a free trial of Rational Requirements Composer Now!
> http://p.sf.net/sfu/www-ibm-com
> _______________________________________________
> Artifactory-users mailing list
> Artifactory-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/artifactory-users
>

------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Artifactory-users mailing list
Artifactory-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/artifactory-users

Re: Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

by Yoav Landman :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

The indexer temp files are a separate issue, so please keep watching them and let us know if it persists (this might be a Win-only issue, BTW).

On Wed, Apr 8, 2009 at 1:26 AM, Chris Law <chris.law@...> wrote:

Hello!  Thank you responding.

I will upgrade to 2.0.4.  As for the temp files - yah, I can delete the old
temp files - I deleted most of the older ones this morning and have had no
new files since then (because I "turned off" the indexer).

So, I after I upgrade to 2.0.4, can I turn the indexer back on, or will that
still be an issue?

Thank you again for responding so quickly!


Yoav  Landman wrote:
>
> Hi,
>
> The storage growth issue you see was resolved in 2.0.4.
> As for the temp files cleanup, this may be a bug - are you able to delete
> these files manually using the user running artifactory?
>
> Thanks,
>
> Yoav
>
> On Tue, Apr 7, 2009 at 3:33 PM, Chris Law <chris.law@...> wrote:
>
>>
>> Hello, I'm running:
>> Artifactory 2.0.2 on Windows Server 2003 R2 SP2
>> Tomcat 6.0.18
>> JRE Sun 1.6.0_11-b03
>>
>> I installed on Mar 16, 2009 using the default indexer settings.
>>
>> I discovered that a large amount of storage was being used by
>> Artifactory and investigated.  It appears that when the indexer runs,
>> about 80% of time the artifactory.log shows:
>>
>> <pre>
>> 2009-03-21 15:00:37,687 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
>> Retrieving
>> '
>> http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip'.<http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip%27.>
>> ..
>> 2009-03-21 15:00:37,890 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
>> Retrieving
>> '
>> http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties'.<http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties%27.>
>> ..
>> 2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed
>> to
>> delete temporary file
>>
>> 'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.zip8081858316636526469.tmp'.
>> 2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed
>> to
>> delete temporary file
>>
>> 'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.properties1715803088839234450.tmp'.
>> </pre>
>>
>> The [CATALINA_HOME]/temp directory is full of the tmp files that
>> couldn't be deleted.  It is always these two files (different tmp
>> files, but the same base file names).
>>
>> I don't know if this is related, but the .artifactory/data/store/ is
>> growing at a phenominal rate.  It is currently at 9.67 Gb.  The
>> .artifactory/data/db directory is 221 Mb and the typical size of a
>> developer's up-to-date local repository is about 400 Mb.
>>
>> The store/seg0/C400.dat and C411.dat are the largest tables are
>> apparently updated each time the indexer runs.
>>
>> I've searched the forum and saw one reference to a Unix tmp directory
>> filling up with some indexer temporary files but I'm not sure if this
>> is directly related.
>>
>> I've since turned off the indexer, but I do know that the developers
>> use the eclipse m2 plugin.
>>
>> Any help or ideas about the either problem would be greatly appreciated.
>> Thank you.
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p22928014.html
>> Sent from the Artifactory-Users mailing list archive at Nabble.com.
>>
>>
>>
>> ------------------------------------------------------------------------------
>> This SF.net email is sponsored by:
>> High Quality Requirements in a Collaborative Environment.
>> Download a free trial of Rational Requirements Composer Now!
>> http://p.sf.net/sfu/www-ibm-com
>> _______________________________________________
>> Artifactory-users mailing list
>> Artifactory-users@...
>> https://lists.sourceforge.net/lists/listinfo/artifactory-users
>>
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by:
> High Quality Requirements in a Collaborative Environment.
> Download a free trial of Rational Requirements Composer Now!
> http://p.sf.net/sfu/www-ibm-com
> _______________________________________________
> Artifactory-users mailing list
> Artifactory-users@...
> https://lists.sourceforge.net/lists/listinfo/artifactory-users
>
>

--
View this message in context: http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p22939581.html
Sent from the Artifactory-Users mailing list archive at Nabble.com.


------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Artifactory-users mailing list
Artifactory-users@...
https://lists.sourceforge.net/lists/listinfo/artifactory-users


------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Artifactory-users mailing list
Artifactory-users@...
https://lists.sourceforge.net/lists/listinfo/artifactory-users

Re: Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

by Vudathu :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Yova,
I am running into the same issue. Is it okay to delete all the *.dat files under /artifactory-2.0.0/data/store/seg0/ file for example (C400.dat and C411.dat)?

Thanks in advance.
Raghu

 

Hi,

The storage growth issue you see was resolved in 2.0.4.
As for the temp files cleanup, this may be a bug - are you able to delete
these files manually using the user running artifactory?

Thanks,

Yoav


Re: Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

by Yoav Landman :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

No, since these files are the repository storage files. I was referring to the files under the tomcat temp (or /tmp) directory, which are ok to delete.

Yoav

On Thu, Jul 16, 2009 at 7:56 AM, Vudathu <RaghuRam.Vudathu@...> wrote:

Hi Yova,
I am running into the same issue. Is it okay to delete all the *.dat files
under /artifactory-2.0.0/data/store/seg0/ file for example (C400.dat and
C411.dat)?

Thanks in advance.
Raghu



Hi,

The storage growth issue you see was resolved in 2.0.4.
As for the temp files cleanup, this may be a bug - are you able to delete
these files manually using the user running artifactory?

Thanks,

Yoav


--
View this message in context: http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p24510158.html
Sent from the Artifactory-Users mailing list archive at Nabble.com.


------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
Artifactory-users mailing list
Artifactory-users@...
https://lists.sourceforge.net/lists/listinfo/artifactory-users


------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge  
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize  
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
Artifactory-users mailing list
Artifactory-users@...
https://lists.sourceforge.net/lists/listinfo/artifactory-users