Typo3 backup

[De Contardi Riccardo]

A little question about how to backup a Typo3 on linux

I want to set up a little script to back up my typo3 installation

(I know there's an extension, but I'd prefer to set up a script of my
own)

 

This is my "plan":

-          tar & gz all the source folders (in my case
usr/share/typo3-core/

-          tar & gz all the dummy folders (in my case under
var/lib/typo3-sites/ dummy-4.2.10/

-          dump the DB & tar & gz

 

In order to minimize the weight of zipped files, what could be
neglected?

For example: the folder /var/lib/typo3-sites/dummy-4.2.10/typo3temp/
could be skipped?

 

The files named temp_CACHED_* under

 

/var/lib/typo3-sites/dummy-4.2.10/typo3conf

 

Could be skipped, right?

 

I also found this
http://typofree.org/article/archive/2008/july/title/typo3-database-backu
p-without-the-heavy-tables/

Some suggestions?

 

Thanks in advance

 

**************************************

Riccardo De Contardi

 

B Human Srl - www.bhuman.it
<file:///C:\Documents%20and%20Settings\riccardo.decontardi\Dati%20applic
azioni\Microsoft\Firme%20elettroniche\www.bhuman.it>  

Via Canzio, 15 - 20131 Milano

Tel [phone] - Fax [phone]

 



Chi riceve il presente messaggio e' tenuto a verificare se lo stesso non gli sia pervenuto per errore. In tal caso e' pregato di avvisare immediatamente il mittente e, tenuto conto delle responsabilita connesse all'indebito utilizzo e/o divulgazione del messaggio e/o delle informazioni in esso contenute, voglia cancellare l'originale e distruggere le varie copie o stampe.

The receiver of this message is required to check if he/she has received it erroneously. If so, the receiver is requested to immediately inform the sender and - in consideration of the responsibilities arising from undue use and/or disclosure of the message and/or the information contained therein - destroy the original message and any copy or printout thereof.


_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[Andreas Lappe]

On  4.11.09, De Contardi Riccardo wrote:
> A little question about how to backup a Typo3 on linux
> I want to set up a little script to back up my typo3 installation
> (I know there's an extension, but I'd prefer to set up a script of my
> own)
> This is my "plan":
> -          tar & gz all the source folders (in my case
> usr/share/typo3-core/

As you already say, this is the typo3-source and unless you installed
yourself some extensions systemwide you can ignore this directory
completely.

HTH
Andy

--
,,Typographie ist keine neutrale Kodierung des gesprochenen Wortes.´´
  -Neil Postman
_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[Krystian Szymukowicz]

De Contardi Riccardo wrote:
> A little question about how to backup a Typo3 on linux
>
> I want to set up a little script to back up my typo3 installation
>
> (I know there's an extension, but I'd prefer to set up a script of my
> own)

I never touch core files so I do not backup them. I do zip only:
fileadmin/
typo3conf/
uploads/
.htaccess


And as in the article I do skip "cache_*" tables in mysql dump.


--
grtz
Krystian Szymukowicz
_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[Rik Willems - Actiview]

Dmitry once wrote a nice article about this. Although it concerns
migration, this in fact is the same as backup:
http://dmitry-dulepov.com/article/migrating-typo3-installation-to-a-different-server.html

Greets!

De Contardi Riccardo schreef:

> A little question about how to backup a Typo3 on linux
>
> I want to set up a little script to back up my typo3 installation
>
> (I know there's an extension, but I'd prefer to set up a script of my
> own)
>
>  
>
> This is my "plan":
>
> -          tar & gz all the source folders (in my case
> usr/share/typo3-core/
>
> -          tar & gz all the dummy folders (in my case under
> var/lib/typo3-sites/ dummy-4.2.10/
>
> -          dump the DB & tar & gz
>
>  
>
> In order to minimize the weight of zipped files, what could be
> neglected?
>
> For example: the folder /var/lib/typo3-sites/dummy-4.2.10/typo3temp/
> could be skipped?
>
>  
>
> The files named temp_CACHED_* under
>
>  
>
> /var/lib/typo3-sites/dummy-4.2.10/typo3conf
>
>  
>
> Could be skipped, right?
>
>  
>
> I also found this
> http://typofree.org/article/archive/2008/july/title/typo3-database-backu
> p-without-the-heavy-tables/
>
> Some suggestions?
>
>  
>
> Thanks in advance
>
>  
>
> **************************************
>
> Riccardo De Contardi
>
>  
>
> B Human Srl - www.bhuman.it
> <file:///C:\Documents%20and%20Settings\riccardo.decontardi\Dati%20applic
> azioni\Microsoft\Firme%20elettroniche\www.bhuman.it>  
>
> Via Canzio, 15 - 20131 Milano
>
> Tel [phone] - Fax [phone]
>
>  
>
>
>
> Chi riceve il presente messaggio e' tenuto a verificare se lo stesso non gli sia pervenuto per errore. In tal caso e' pregato di avvisare immediatamente il mittente e, tenuto conto delle responsabilita connesse all'indebito utilizzo e/o divulgazione del messaggio e/o delle informazioni in esso contenute, voglia cancellare l'originale e distruggere le varie copie o stampe.
>
> The receiver of this message is required to check if he/she has received it erroneously. If so, the receiver is requested to immediately inform the sender and - in consideration of the responsibilities arising from undue use and/or disclosure of the message and/or the information contained therein - destroy the original message and any copy or printout thereof.
>
>

_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[Xavier Perseguers]

Hi,

Rik Willems wrote:
> Dmitry once wrote a nice article about this. Although it concerns
> migration, this in fact is the same as backup:
> http://dmitry-dulepov.com/article/migrating-typo3-installation-to-a-different-server.html 

I would add that you may search the mailing list too before posting. This question arises relatively often...

Regards

--
Xavier Perseguers
http://xavier.perseguers.ch/en

One contribution a day keeps the fork away
_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[Andreas Becker-2]

Hi

Why don't you use siomply the new extensiuon complete  backup which just
came out yesterday? It really does not make sense to always reinvent wheels
over and over again. better try to work together with the creator of
complete backup extensions to improve it to ONE very good backup extension
which than could even be included in core when stable and useful for
everyone. Everything else is only messing up the extension repository more
and more!

Inspire to share!

Andi

On Thu, Nov 5, 2009 at 12:22 AM, Xavier Perseguers <typo3@...>wrote:

> Hi,
>
>
> Rik Willems wrote:
>
>> Dmitry once wrote a nice article about this. Although it concerns
>> migration, this in fact is the same as backup:
>>
>> http://dmitry-dulepov.com/article/migrating-typo3-installation-to-a-different-server.html
>>
>
> I would add that you may search the mailing list too before posting. This
> question arises relatively often...
>
> Regards
>
>
> --
> Xavier Perseguers
> http://xavier.perseguers.ch/en
>
> One contribution a day keeps the fork away
> _______________________________________________
> TYPO3-english mailing list
> TYPO3-english@...
> http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english
>

_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[Thomas Allmer]

Andreas Becker wrote:
> Why don't you use siomply the new extensiuon complete  backup which just
> came out yesterday?

awesome.. how did you noticed? I mean do you regularly check for new
extensions at typo3.org or is there any other page/service to keep you
informed?

I mean I just released it didn't even wrote a manual or a blog post...

Here is a brief description:
- completely php based - no system calls at all
- function to clean all temporary data (for the filesystem and DB)
- generates a filesystem backup as *.tar.gz and a DB Backup as *.sql.gz
   * it may use multiple ajax requests if the filesystem is to big for a
single php execution (timeout) [needs extension mpm]
- a backup server can be notified to load the backupfiles
   * the backup server can afterwards contact the TYPO3 server to delete
the already saved backups
   * a simple example of a backup server is provided
- comes with a script to deploy this complete backup (2 files) with one
click an a server
   * means extracting, creating DB, inserting data - again may use
multiple ajax requests for the filesystem.

> It really does not make sense to always reinvent wheels
> over and over again.

so true, but sometimes its harder as you have to respect other rules...
with your own stuff you can do whatever you like :p [I still think that
working together is far better and I looked at the most promising backup
solution, but nothing had any potential in my eyes (besides most were
really, really old). So I created completebackup.

> better try to work together with the creator of
> complete backup extensions to improve it to ONE very good backup extension
> which than could even be included in core when stable and useful for
> everyone. [...]

hell yeah if anyone is eager enough to test this undocumented beast - I
got a lot to do...

cheers
--
+---------------------------------+-----------------------------------+
| Thomas Allmer                   |   http://www.delusionworld.com    |
| E-mail: at@...    |   phone: [phone]         |
+---------------------------------+-----------------------------------+
_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[Erik Svendsen]

Andreas Becker skrev:

> Hi
>
> Why don't you use siomply the new extensiuon complete  backup which just
> came out yesterday? It really does not make sense to always reinvent wheels
> over and over again. better try to work together with the creator of
> complete backup extensions to improve it to ONE very good backup extension
> which than could even be included in core when stable and useful for
> everyone. Everything else is only messing up the extension repository more
> and more!
>
> Inspire to share!
>
> Andi

Why install an extension for something that you can script outside TYPO3
  in a few minutes and where mostly all necessary code is already written.

The use of extra extensions has impact on performance.

Personally I'm backing up about 30 installations from 6 different
servers on daily basis to a backup-server. The whole process is 100 %
automatic.

regards

Erik Svendsen

> On Thu, Nov 5, 2009 at 12:22 AM, Xavier Perseguers <typo3@...>wrote:
>
>> Hi,
>>
>>
>> Rik Willems wrote:
>>
>>> Dmitry once wrote a nice article about this. Although it concerns
>>> migration, this in fact is the same as backup:
>>>
>>> http://dmitry-dulepov.com/article/migrating-typo3-installation-to-a-different-server.html
>>>
>> I would add that you may search the mailing list too before posting. This
>> question arises relatively often...
>>
>> Regards
>>
>>
>> --
>> Xavier Perseguers
>> http://xavier.perseguers.ch/en
>>
>> One contribution a day keeps the fork away
>> _______________________________________________
>> TYPO3-english mailing list
>> TYPO3-english@...
>> http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english
>>

_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[Andreas Becker-2]

Hi Erik

Very good point.

Could you simply post the code how you script the backup outside of TYPO3
because if you can backup 30 installations on a daily basis even from
different Servers to a backup server this would be great to see how you are
doing this. It would help lots of your collegues to secure their sites too
in the same way without using an extension. Do you have somewhere a
blog/tutorial post how you are doing it? - Let's inspire to share!

Andi


2009/11/5 Erik Svendsen <erik@...>

> Andreas Becker skrev:
>
>  Hi
>>
>> Why don't you use siomply the new extensiuon complete  backup which just
>> came out yesterday? It really does not make sense to always reinvent
>> wheels
>> over and over again. better try to work together with the creator of
>> complete backup extensions to improve it to ONE very good backup extension
>> which than could even be included in core when stable and useful for
>> everyone. Everything else is only messing up the extension repository more
>> and more!
>>
>> Inspire to share!
>>
>> Andi
>>
>
> Why install an extension for something that you can script outside TYPO3
>  in a few minutes and where mostly all necessary code is already written.
>
> The use of extra extensions has impact on performance.
>
> Personally I'm backing up about 30 installations from 6 different servers
> on daily basis to a backup-server. The whole process is 100 % automatic.
>
> regards
>
> Erik Svendsen
>
>
>
>  On Thu, Nov 5, 2009 at 12:22 AM, Xavier Perseguers <typo3@...
>> >wrote:
>>
>>  Hi,
>>>
>>>
>>> Rik Willems wrote:
>>>
>>>  Dmitry once wrote a nice article about this. Although it concerns
>>>> migration, this in fact is the same as backup:
>>>>
>>>>
>>>> http://dmitry-dulepov.com/article/migrating-typo3-installation-to-a-different-server.html
>>>>
>>>>  I would add that you may search the mailing list too before posting.
>>> This
>>> question arises relatively often...
>>>
>>> Regards
>>>
>>>
>>> --
>>> Xavier Perseguers
>>> http://xavier.perseguers.ch/en
>>>
>>> One contribution a day keeps the fork away
>>> _______________________________________________
>>> TYPO3-english mailing list
>>> TYPO3-english@...
>>> http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english
>>>
>>>  _______________________________________________
> TYPO3-english mailing list
> TYPO3-english@...
> http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english
>

_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[Thomas Allmer]

Erik Svendsen wrote:

> [...]
>
> Why install an extension for something that you can script outside TYPO3
>  in a few minutes and where mostly all necessary code is already written.
>
> The use of extra extensions has impact on performance.
>
> Personally I'm backing up about 30 installations from 6 different
> servers on daily basis to a backup-server. The whole process is 100 %
> automatic.

Does it needs console access to the server running TYPO3?
Does it work for windows servers?

If any of those answers is "no" I would be really interested in this
solution. Even if it's just the theoretical stuff, as I'm currently
can't get my head around how this should be possible without console...

cheers
--
+---------------------------------+-----------------------------------+
| Thomas Allmer                   |   http://www.delusionworld.com    |
| E-mail: at@...    |   phone: [phone]         |
+---------------------------------+-----------------------------------+
_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[J. Bakshi-2]

Thomas Allmer wrote:

> Erik Svendsen wrote:
>> [...]
>>
>> Why install an extension for something that you can script outside
>> TYPO3  in a few minutes and where mostly all necessary code is
>> already written.
>>
>> The use of extra extensions has impact on performance.
>>
>> Personally I'm backing up about 30 installations from 6 different
>> servers on daily basis to a backup-server. The whole process is 100 %
>> automatic.
>
> Does it needs console access to the server running TYPO3?
> Does it work for windows servers?
>
> If any of those answers is "no" I would be really interested in this
> solution. Even if it's just the theoretical stuff, as I'm currently
> can't get my head around how this should be possible without console...
>
> cheers

A shell script magic ? even I do take typo3 bckup from different
servers. Totally automatic. Shell script and cron.. What is the
technology here ??
interested to know.


_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[Erik Svendsen]

Thomas Allmer skrev:

> Erik Svendsen wrote:
>> [...]
>>
>> Why install an extension for something that you can script outside
>> TYPO3  in a few minutes and where mostly all necessary code is already
>> written.
>>
>> The use of extra extensions has impact on performance.
>>
>> Personally I'm backing up about 30 installations from 6 different
>> servers on daily basis to a backup-server. The whole process is 100 %
>> automatic.
>
> Does it needs console access to the server running TYPO3?
> Does it work for windows servers?
>
> If any of those answers is "no" I would be really interested in this
> solution. Even if it's just the theoretical stuff, as I'm currently
> can't get my head around how this should be possible without console...
>
> cheers

I suppose you know about a solution called ZMR (Zmanda Recovery Manager
for MySql). Combined with Amanda you have a perfect solutions when you
are working with multiple TYPO3 installations.

And it works with windows as clients (both of them). And I know ZMR
works without shell access. Amanda need client on the server/client
which are going to be backed up. And this needs to be installed.

Personally I'm doing like Bakshi, scripts on the backup-server (using
scp, sftp, ssh and direct mysqlport if neccessary). As I never uses
Windows on servers, never has installations where I don't have ssh,
scripts are the easy way. So I'm only testing ZMR and Amanda.

My reason to ask why, is not because I don't think anybody needs an
extension like this, but to point out easy and efficient solutions. An
efficient solutions isn't always an extension. I think a lot of people
with a single installation would like a solutions like this.

An inside backup solutions aren't efficient unless it's runs as a
cronjob and push the backed up files to another server. And if not, I
would recommend people to find other solutions.

Regards

Erik Svendsen
_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

[Andreas Becker-2]

Erik

you still sound very interesting, but until now you haven't really shown -
demonstrated HOW you actually do the backup. BlaBlaBla isn't helping others.
So we would be really interested to know the steps and the scripts to see
how it is possible to manage all these backups. Please try to write a small
tutorial for the community and post it here or with a link to your
blog/tutorial site, so that the TYPO3 Community can actually see - how you
are doing it and learn from it.

It is not the matter if someone needs an extension or not it is simply the
fact that this extension is helping the community and until now all your
wording isn't helpful at all. Well there are lots of Backup solutions out
there, commercial and others but it does not make any sense to name them
here!

Please show how you do!
Post your script with a short explanation!
Give an Example!
Inspire to share!
Get others to know about your solution!
Improve your solution by getting feedback from others!
Give people the freedom of knowing about and learning from it!

Andi




2009/11/7 Erik Svendsen <erik@...>

> Thomas Allmer skrev:
>
>  Erik Svendsen wrote:
>>
>>> [...]
>>>
>>> Why install an extension for something that you can script outside TYPO3
>>>  in a few minutes and where mostly all necessary code is already written.
>>>
>>> The use of extra extensions has impact on performance.
>>>
>>> Personally I'm backing up about 30 installations from 6 different servers
>>> on daily basis to a backup-server. The whole process is 100 % automatic.
>>>
>>
>> Does it needs console access to the server running TYPO3?
>> Does it work for windows servers?
>>
>> If any of those answers is "no" I would be really interested in this
>> solution. Even if it's just the theoretical stuff, as I'm currently can't
>> get my head around how this should be possible without console...
>>
>> cheers
>>
>
> I suppose you know about a solution called ZMR (Zmanda Recovery Manager for
> MySql). Combined with Amanda you have a perfect solutions when you are
> working with multiple TYPO3 installations.
>
> And it works with windows as clients (both of them). And I know ZMR works
> without shell access. Amanda need client on the server/client which are
> going to be backed up. And this needs to be installed.
>
> Personally I'm doing like Bakshi, scripts on the backup-server (using scp,
> sftp, ssh and direct mysqlport if neccessary). As I never uses Windows on
> servers, never has installations where I don't have ssh, scripts are the
> easy way. So I'm only testing ZMR and Amanda.
>
> My reason to ask why, is not because I don't think anybody needs an
> extension like this, but to point out easy and efficient solutions. An
> efficient solutions isn't always an extension. I think a lot of people with
> a single installation would like a solutions like this.
>
> An inside backup solutions aren't efficient unless it's runs as a cronjob
> and push the backed up files to another server. And if not, I would
> recommend people to find other solutions.
>
> Regards
>
> Erik Svendsen
>
> _______________________________________________
> TYPO3-english mailing list
> TYPO3-english@...
> http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english
>

_______________________________________________
TYPO3-english mailing list
TYPO3-english@...
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english