|

»

Reading from a .tgz takes a long long time

View: New views

6 Messages — Rating Filter: Alert me

	Reading from a .tgz takes a long long time by Merciadri Luca :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello folks, I use tar to make (not necessarily incremental) backups of my /etc/, /home/, and other important folders. I am encountering a problem: reading a file in a .tgz takes a really long time. I use the Archive Manager GUI (of GNOME) to go through all the folders of my .tgz. My archive is ~5 Gigs. For example, let's say that I want to read my old /etc/fstab in my .tgz. It takes something like 10 min to open it. The external HDD where the .tgz is saved is connected through USB2 (same problem with firewire) and other tasks are performed in a reasonable amount of time. Any ideas? Thanks. - -- Merciadri Luca See http://www.student.montefiore.ulg.ac.be/~merciadri/ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Processed by Mailcrypt 3.5.8 <http://mailcrypt.sourceforge.net/> iEYEARECAAYFAkruunEACgkQM0LLzLt8Mhz1zQCfTCPk8+oxGIAElwlhxF9x/yJ4 LtQAmgP9nMk+/Ri61FNrLCrDonuU6mWg =r3VU -----END PGP SIGNATURE----- -- To UNSUBSCRIBE, email to debian-user-REQUEST@... with a subject of "unsubscribe". Trouble? Contact listmaster@...
	Re: Reading from a .tgz takes a long long time by Alexey Salmin :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message Since tgz is .tar.gz (a tar file compressed via gzip) there is no surprise that it's slow to get a single file from it. The whole tarball will be decompressed first and it's definitely expensive. If you have enough space on your hdd you can store a plain tarball instead of compressed file - that should work faster. It's also worth splitting a single archive into multiple files. E.g. you can store your /home in home.tgz and your /etc (which is small) in a separate etc.tar file. Alexey On Mon, Nov 2, 2009 at 4:54 PM, Merciadri Luca <Luca.Merciadri@...> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hello folks, > > I use tar to make (not necessarily incremental) backups of my /etc/, > /home/, and other important folders. I am encountering a problem: > reading a file in a .tgz takes a really long time. I use the > Archive Manager GUI (of GNOME) to go through all the folders of my > .tgz. My archive is ~5 Gigs. > > For example, let's say that I want to read my old /etc/fstab in my > .tgz. It takes something like 10 min to open it. The external HDD > where the .tgz is saved is connected through USB2 (same problem with > firewire) and other tasks are performed in a reasonable amount of > time. > > Any ideas? > > Thanks. > - -- > Merciadri Luca > See http://www.student.montefiore.ulg.ac.be/~merciadri/ > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.9 (GNU/Linux) > Comment: Processed by Mailcrypt 3.5.8 <http://mailcrypt.sourceforge.net/> > > iEYEARECAAYFAkruunEACgkQM0LLzLt8Mhz1zQCfTCPk8+oxGIAElwlhxF9x/yJ4 > LtQAmgP9nMk+/Ri61FNrLCrDonuU6mWg > =r3VU > -----END PGP SIGNATURE----- > > > -- > To UNSUBSCRIBE, email to debian-user-REQUEST@... > with a subject of "unsubscribe". Trouble? Contact listmaster@... > > -- To UNSUBSCRIBE, email to debian-user-REQUEST@... with a subject of "unsubscribe". Trouble? Contact listmaster@...
	Re: Reading from a .tgz takes a long long time by Merciadri Luca :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Alexey Salmin <alexey.salmin@...> writes: > Since tgz is .tar.gz (a tar file compressed via gzip) there is no > surprise that it's slow to get a single file from it. The whole > tarball will be decompressed first and it's definitely expensive. > If you have enough space on your hdd you can store a plain tarball > instead of compressed file - that should work faster. It's also worth > splitting a single archive into multiple files. E.g. you can store > your /home in home.tgz and your /etc (which is small) in a separate > etc.tar file. Thanks. I did not know this. I never used big .tgz before. - -- Merciadri Luca See http://www.student.montefiore.ulg.ac.be/~merciadri/ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Processed by Mailcrypt 3.5.8 <http://mailcrypt.sourceforge.net/> iEYEARECAAYFAkrvAbgACgkQM0LLzLt8MhxbugCfbC161n3mepnkeQwgb0pZnlwP BVcAoI20h2H6Ui0gR2PKYKmZseGAnhd7 =NRb8 -----END PGP SIGNATURE----- -- To UNSUBSCRIBE, email to debian-user-REQUEST@... with a subject of "unsubscribe". Trouble? Contact listmaster@...
	Re: Reading from a .tgz takes a long long time by John Allen-2 :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message Merciadri Luca wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hello folks, > > I use tar to make (not necessarily incremental) backups of my /etc/, > /home/, and other important folders. I am encountering a problem: > reading a file in a .tgz takes a really long time. I use the > Archive Manager GUI (of GNOME) to go through all the folders of my > .tgz. My archive is ~5 Gigs. > > For example, let's say that I want to read my old /etc/fstab in my > .tgz. It takes something like 10 min to open it. The external HDD > where the .tgz is saved is connected through USB2 (same problem with > firewire) and other tasks are performed in a reasonable amount of > time. > > Any ideas? > > Well one idea is to stop using tar, and use a generational rsync backup tool instead. One such tool is http://rsnapshot.org/ > Thanks. > - -- > Merciadri Luca > See http://www.student.montefiore.ulg.ac.be/~merciadri/ > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.9 (GNU/Linux) > Comment: Processed by Mailcrypt 3.5.8 <http://mailcrypt.sourceforge.net/> > > iEYEARECAAYFAkruunEACgkQM0LLzLt8Mhz1zQCfTCPk8+oxGIAElwlhxF9x/yJ4 > LtQAmgP9nMk+/Ri61FNrLCrDonuU6mWg > =r3VU > -----END PGP SIGNATURE----- > > > -- To UNSUBSCRIBE, email to debian-user-REQUEST@... with a subject of "unsubscribe". Trouble? Contact listmaster@...
	Re: Reading from a .tgz takes a long long time by Alex Samad :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message On Wed, Nov 04, 2009 at 08:53:04AM +0000, John Allen wrote: > Merciadri Luca wrote: > >-----BEGIN PGP SIGNED MESSAGE----- > >Hash: SHA1 > > [snip] > > > >Any ideas? > > > Well one idea is to stop using tar, and use a generational rsync > backup tool instead. > > One such tool is http://rsnapshot.org/ i can highly recommend rdiff-backup signature.asc (205 bytes) Download Attachment
	Re: Reading from a .tgz takes a long long time by Merciadri Luca :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Alex Samad <alex@...> writes: > On Wed, Nov 04, 2009 at 08:53:04AM +0000, John Allen wrote: >> Merciadri Luca wrote: >> >-----BEGIN PGP SIGNED MESSAGE----- >> >Hash: SHA1 >> > > [snip] >> > >> >Any ideas? >> > >> Well one idea is to stop using tar, and use a generational rsync >> backup tool instead. >> >> One such tool is http://rsnapshot.org/ > > i can highly recommend rdiff-backup Thanks. :-) - -- Merciadri Luca See http://www.student.montefiore.ulg.ac.be/~merciadri/ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Processed by Mailcrypt 3.5.8 <http://mailcrypt.sourceforge.net/> iEYEARECAAYFAkrxmVgACgkQM0LLzLt8MhyQLQCeLn03MFu19kMJXzVBUTj1znek aesAmQEL/2fISfU5n0/B5uyZZuoDGaxc =XJM0 -----END PGP SIGNATURE----- -- To UNSUBSCRIBE, email to debian-user-REQUEST@... with a subject of "unsubscribe". Trouble? Contact listmaster@...