Artifactory Size on MySQL, snapshots not deleted really?

View: New views
5 Messages — Rating Filter:   Alert me  

Artifactory Size on MySQL, snapshots not deleted really?

by oddball :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi to all,

i have the artifactory-1.3.0-rc-1 version running on MySQL and works fine, however the artifactory database size is growing everyday more and more due to a snapshots management  (i think).
The "Max Unique Snapshots" parameter is set to 2 but it seems like for each snapshot there is a file in the database, altough in repository i only see 2 files for snapthot, that is to say all snapshots are in the database  but a lot of them are old snapshot (i think).

Every 2 weeks i have to make a new repository for to free disk space using a previous backup.

For example, now the database size is 7GB but if i do a backup, the backup's size is 2 GB.
Have i a mistake in my configuration??

Please, help!!! ;-)

(My MySQL version is 5.0.68)

Re: Artifactory Size on MySQL, snapshots not deleted really?

by Yoav Landman :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Did you create the MySQL tables using the InnoDB engine or MyISAM?
We highly recommend MyISAM - InnoDB is slower and does not auto-shrink when data is deleted (such as old snapshots).

Yoav

On Mon, Mar 9, 2009 at 5:42 PM, oddball <jorge.rodriguez.barba@...> wrote:

Hi to all,

i have the artifactory-1.3.0-rc-1 version running on MySQL and works fine,
however the artifactory database size is growing everyday more and more due
to a snapshots management  (i think).
The "Max Unique Snapshots" parameter is set to 2 but it seems like for each
snapshot there is a file in the database, altough in repository i only see 2
files for snapthot, that is to say all snapshots are in the database  but a
lot of them are old snapshot (i think).

Every 2 weeks i have to make a new repository for to free disk space using a
previous backup.

For example, now the database size is 7GB but if i do a backup, the backup's
size is 2 GB.
Have i a mistake in my configuration??

Please, help!!! ;-)

(My MySQL version is 5.0.68)
--
View this message in context: http://www.nabble.com/Artifactory-Size-on-MySQL%2C-snapshots-not-deleted-really--tp22413548p22413548.html
Sent from the Artifactory-Users mailing list archive at Nabble.com.


------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
_______________________________________________
Artifactory-users mailing list
Artifactory-users@...
https://lists.sourceforge.net/lists/listinfo/artifactory-users


------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
_______________________________________________
Artifactory-users mailing list
Artifactory-users@...
https://lists.sourceforge.net/lists/listinfo/artifactory-users

Re: Artifactory Size on MySQL, snapshots not deleted really?

by oddball :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Yoav, thanks for your reply.

My MySQL server uses the next variables:
 storage_engine                  | MyISAM  
 table_type                        | MyISAM

and if i invoke "show table status" for artifactory database, i can see:

+--------------+------+----+-------+------+--------------+-----------+----------------+------------
|Name          |Engine|Ver.|Row_for|Rows  |Avg_row_length|Data_length|Max_data_length |Index_length
+--------------+------+----+-------+------+--------------+-----------+----------------+------------
|datastore     |MyISAM|  10|Dynamic| 13873|        482667| 6696041948|281474976710655 |      908288
|default_binval|MyISAM|  10|Dynamic|     0|             0|          0|281474976710655 |        1024
|default_bundle|MyISAM|  10|Dynamic|357131|           151|   54070728|281474976710655 |    11951104
|default_names |MyISAM|  10|Dynamic|    81|            21|       1728|281474976710655 |        2048
|default_refs  |MyISAM|  10|Dynamic|     0|             0|          0|281474976710655 |        1024
|rep_fsentry   |MyISAM|  10|Dynamic|     9|           446|       4020|281474976710655 |        4096
+--------------+------+----+-------+------+--------------+-----------+----------------+------------
6 rows in set

Like you can see, i use MyISAM

Yoav Landman wrote:
Did you create the MySQL tables using the InnoDB engine or MyISAM?
We highly recommend MyISAM - InnoDB is slower and does not auto-shrink when
data is deleted (such as old snapshots).

Yoav

On Mon, Mar 9, 2009 at 5:42 PM, oddball <jorge.rodriguez.barba@gmail.com>wrote:

>
> Hi to all,
>
> i have the artifactory-1.3.0-rc-1 version running on MySQL and works fine,
> however the artifactory database size is growing everyday more and more due
> to a snapshots management  (i think).
> The "Max Unique Snapshots" parameter is set to 2 but it seems like for each
> snapshot there is a file in the database, altough in repository i only see
> 2
> files for snapthot, that is to say all snapshots are in the database  but a
> lot of them are old snapshot (i think).
>
> Every 2 weeks i have to make a new repository for to free disk space using
> a
> previous backup.
>
> For example, now the database size is 7GB but if i do a backup, the
> backup's
> size is 2 GB.
> Have i a mistake in my configuration??
>
> Please, help!!! ;-)
>
> (My MySQL version is 5.0.68)
> --
> View this message in context:
> http://www.nabble.com/Artifactory-Size-on-MySQL%2C-snapshots-not-deleted-really--tp22413548p22413548.html
> Sent from the Artifactory-Users mailing list archive at Nabble.com.
>
>
>
> ------------------------------------------------------------------------------
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
> CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the
> Enterprise
> -Strategies to boost innovation and cut costs with open source
> participation
> -Receive a $600 discount off the registration fee with the source code:
> SFAD
> http://p.sf.net/sfu/XcvMzF8H
> _______________________________________________
> Artifactory-users mailing list
> Artifactory-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/artifactory-users
>

------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
_______________________________________________
Artifactory-users mailing list
Artifactory-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/artifactory-users

Re: Artifactory Size on MySQL, snapshots not deleted really?

by Yoav Landman :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi,

Just to update that we have found what seems to be the cause for this growth. We will release 2.0.3 with a fix for that in a couple of days.
Thanks for reporting this. The problem is, BTW, not MySQL specific, but should affect Derby as well (or any database for that matter).

Thanks,

Yoav

On Tue, Mar 10, 2009 at 10:21 AM, oddball <jorge.rodriguez.barba@...> wrote:

Hi Yoav, thanks for your reply.

My MySQL server uses the next variables:
 storage_engine                  | MyISAM
 table_type                        | MyISAM

and if i invoke "show table status" for artifactory database, i can see:

+--------------+------+----+-------+------+--------------+-----------+----------------+------------
|Name          |Engine|Ver.|Row_for|Rows
|Avg_row_length|Data_length|Max_data_length |Index_length
+--------------+------+----+-------+------+--------------+-----------+----------------+------------
|datastore     |MyISAM|  10|Dynamic| 13873|        482667|
6696041948|281474976710655 |      908288
|default_binval|MyISAM|  10|Dynamic|     0|             0|
0|281474976710655 |        1024
|default_bundle|MyISAM|  10|Dynamic|357131|           151|
54070728|281474976710655 |    11951104
|default_names |MyISAM|  10|Dynamic|    81|            21|
1728|281474976710655 |        2048
|default_refs  |MyISAM|  10|Dynamic|     0|             0|
0|281474976710655 |        1024
|rep_fsentry   |MyISAM|  10|Dynamic|     9|           446|
4020|281474976710655 |        4096
+--------------+------+----+-------+------+--------------+-----------+----------------+------------
6 rows in set

Like you can see, i use MyISAM


Yoav  Landman wrote:
>
> Did you create the MySQL tables using the InnoDB engine or MyISAM?
> We highly recommend MyISAM - InnoDB is slower and does not auto-shrink
> when
> data is deleted (such as old snapshots).
>
> Yoav
>
> On Mon, Mar 9, 2009 at 5:42 PM, oddball
> <jorge.rodriguez.barba@...>wrote:
>
>>
>> Hi to all,
>>
>> i have the artifactory-1.3.0-rc-1 version running on MySQL and works
>> fine,
>> however the artifactory database size is growing everyday more and more
>> due
>> to a snapshots management  (i think).
>> The "Max Unique Snapshots" parameter is set to 2 but it seems like for
>> each
>> snapshot there is a file in the database, altough in repository i only
>> see
>> 2
>> files for snapthot, that is to say all snapshots are in the database  but
>> a
>> lot of them are old snapshot (i think).
>>
>> Every 2 weeks i have to make a new repository for to free disk space
>> using
>> a
>> previous backup.
>>
>> For example, now the database size is 7GB but if i do a backup, the
>> backup's
>> size is 2 GB.
>> Have i a mistake in my configuration??
>>
>> Please, help!!! ;-)
>>
>> (My MySQL version is 5.0.68)
>> --
>> View this message in context:
>> http://www.nabble.com/Artifactory-Size-on-MySQL%2C-snapshots-not-deleted-really--tp22413548p22413548.html
>> Sent from the Artifactory-Users mailing list archive at Nabble.com.
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
>> CA
>> -OSBC tackles the biggest issue in open source: Open Sourcing the
>> Enterprise
>> -Strategies to boost innovation and cut costs with open source
>> participation
>> -Receive a $600 discount off the registration fee with the source code:
>> SFAD
>> http://p.sf.net/sfu/XcvMzF8H
>> _______________________________________________
>> Artifactory-users mailing list
>> Artifactory-users@...
>> https://lists.sourceforge.net/lists/listinfo/artifactory-users
>>
>
> ------------------------------------------------------------------------------
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
> CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the
> Enterprise
> -Strategies to boost innovation and cut costs with open source
> participation
> -Receive a $600 discount off the registration fee with the source code:
> SFAD
> http://p.sf.net/sfu/XcvMzF8H
> _______________________________________________
> Artifactory-users mailing list
> Artifactory-users@...
> https://lists.sourceforge.net/lists/listinfo/artifactory-users
>
>

--
View this message in context: http://www.nabble.com/Artifactory-Size-on-MySQL%2C-snapshots-not-deleted-really--tp22413548p22429742.html
Sent from the Artifactory-Users mailing list archive at Nabble.com.


------------------------------------------------------------------------------
_______________________________________________
Artifactory-users mailing list
Artifactory-users@...
https://lists.sourceforge.net/lists/listinfo/artifactory-users


------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
Artifactory-users mailing list
Artifactory-users@...
https://lists.sourceforge.net/lists/listinfo/artifactory-users

Re: Artifactory Size on MySQL, snapshots not deleted really?

by oddball :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Thanks a lot Yoav

I will wait to the new version and i will update my artifactory.

My hard disk is happy now ;-)

Thanks again


Yoav Landman wrote:
Hi,

Just to update that we have found what seems to be the cause for this
growth. We will release 2.0.3 with a fix for that in a couple of days.
Thanks for reporting this. The problem is, BTW, not MySQL specific, but
should affect Derby as well (or any database for that matter).

Thanks,

Yoav

On Tue, Mar 10, 2009 at 10:21 AM, oddball
<jorge.rodriguez.barba@gmail.com>wrote:

>
> Hi Yoav, thanks for your reply.
>
> My MySQL server uses the next variables:
>  storage_engine                  | MyISAM
>  table_type                        | MyISAM
>
> and if i invoke "show table status" for artifactory database, i can see:
>
>
> +--------------+------+----+-------+------+--------------+-----------+----------------+------------
> |Name          |Engine|Ver.|Row_for|Rows
> |Avg_row_length|Data_length|Max_data_length |Index_length
>
> +--------------+------+----+-------+------+--------------+-----------+----------------+------------
> |datastore     |MyISAM|  10|Dynamic| 13873|        482667|
> 6696041948|281474976710655 |      908288
> |default_binval|MyISAM|  10|Dynamic|     0|             0|
> 0|281474976710655 |        1024
> |default_bundle|MyISAM|  10|Dynamic|357131|           151|
> 54070728|281474976710655 |    11951104
> |default_names |MyISAM|  10|Dynamic|    81|            21|
> 1728|281474976710655 |        2048
> |default_refs  |MyISAM|  10|Dynamic|     0|             0|
> 0|281474976710655 |        1024
> |rep_fsentry   |MyISAM|  10|Dynamic|     9|           446|
> 4020|281474976710655 |        4096
>
> +--------------+------+----+-------+------+--------------+-----------+----------------+------------
> 6 rows in set
>
> Like you can see, i use MyISAM
>
>
> Yoav  Landman wrote:
> >
> > Did you create the MySQL tables using the InnoDB engine or MyISAM?
> > We highly recommend MyISAM - InnoDB is slower and does not auto-shrink
> > when
> > data is deleted (such as old snapshots).
> >
> > Yoav
> >
> > On Mon, Mar 9, 2009 at 5:42 PM, oddball
> > <jorge.rodriguez.barba@gmail.com>wrote:
> >
> >>
> >> Hi to all,
> >>
> >> i have the artifactory-1.3.0-rc-1 version running on MySQL and works
> >> fine,
> >> however the artifactory database size is growing everyday more and more
> >> due
> >> to a snapshots management  (i think).
> >> The "Max Unique Snapshots" parameter is set to 2 but it seems like for
> >> each
> >> snapshot there is a file in the database, altough in repository i only
> >> see
> >> 2
> >> files for snapthot, that is to say all snapshots are in the database
>  but
> >> a
> >> lot of them are old snapshot (i think).
> >>
> >> Every 2 weeks i have to make a new repository for to free disk space
> >> using
> >> a
> >> previous backup.
> >>
> >> For example, now the database size is 7GB but if i do a backup, the
> >> backup's
> >> size is 2 GB.
> >> Have i a mistake in my configuration??
> >>
> >> Please, help!!! ;-)
> >>
> >> (My MySQL version is 5.0.68)
> >> --
> >> View this message in context:
> >>
> http://www.nabble.com/Artifactory-Size-on-MySQL%2C-snapshots-not-deleted-really--tp22413548p22413548.html
> >> Sent from the Artifactory-Users mailing list archive at Nabble.com.
> >>
> >>
> >>
> >>
> ------------------------------------------------------------------------------
> >> Open Source Business Conference (OSBC), March 24-25, 2009, San
> Francisco,
> >> CA
> >> -OSBC tackles the biggest issue in open source: Open Sourcing the
> >> Enterprise
> >> -Strategies to boost innovation and cut costs with open source
> >> participation
> >> -Receive a $600 discount off the registration fee with the source code:
> >> SFAD
> >> http://p.sf.net/sfu/XcvMzF8H
> >> _______________________________________________
> >> Artifactory-users mailing list
> >> Artifactory-users@lists.sourceforge.net
> >> https://lists.sourceforge.net/lists/listinfo/artifactory-users
> >>
> >
> >
> ------------------------------------------------------------------------------
> > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
> > CA
> > -OSBC tackles the biggest issue in open source: Open Sourcing the
> > Enterprise
> > -Strategies to boost innovation and cut costs with open source
> > participation
> > -Receive a $600 discount off the registration fee with the source code:
> > SFAD
> > http://p.sf.net/sfu/XcvMzF8H
> > _______________________________________________
> > Artifactory-users mailing list
> > Artifactory-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/artifactory-users
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/Artifactory-Size-on-MySQL%2C-snapshots-not-deleted-really--tp22413548p22429742.html
> Sent from the Artifactory-Users mailing list archive at Nabble.com.
>
>
>
> ------------------------------------------------------------------------------
> _______________________________________________
> Artifactory-users mailing list
> Artifactory-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/artifactory-users
>

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
Artifactory-users mailing list
Artifactory-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/artifactory-users