slow backup using lvm snapshots and tar

Hi list:
I'm using this command to create s snapshot of every LV's server,
mount the LV, make a TGZ to a shared folder (NFS), then umount LV
image and remove snapshot LV. The problem is tar backup is extremely
slow (it takes 3 hours to make backup of all servers).
This is the command I'm using:
for vps in `cat vps`; do lvcreate -L10G -s -n "$vps"snapshot
/dev/vg0/"$vps".domain-disk && mount /dev/vg0/"$vps"snapshot
/mnt/vmbackup && cd /mnt/vmbackup && nice -n 19 tar pczf
/shared/lvbackups/"$vps"_`date +%F` . && cd ; umount /mnt/vmbackup &&
lvremove -f /dev/vg0/"$vps"snapshot;done
My question is:
How can I make TAR backup faster? is it possible? Is there other
command faster than TGZ in this case?
thanks in advance.
--
Regards;
Israel Garcia
--
To UNSUBSCRIBE, email to debian-user-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org

On Thu, Nov 05, 2009 at 01:18:48AM -0500, Israel Garcia wrote:
> Hi list:
>=20
> I'm using this command to create s snapshot of every LV's server,
> mount the LV, make a TGZ to a shared folder (NFS), then umount LV
> image and remove snapshot LV. The problem is tar backup is extremely
> slow (it takes 3 hours to make backup of all servers).
>=20
> This is the command I'm using:
>=20
> for vps in `cat vps`; do lvcreate -L10G -s -n "$vps"snapshot
> /dev/vg0/"$vps".domain-disk && mount /dev/vg0/"$vps"snapshot
> /mnt/vmbackup && cd /mnt/vmbackup && nice -n 19 tar pczf
> /shared/lvbackups/"$vps"_`date +%F` . && cd ; umount /mnt/vmbackup &&
> lvremove -f /dev/vg0/"$vps"snapshot;done
>=20
> My question is:
> How can I make TAR backup faster? is it possible? Is there other
> command faster than TGZ in this case?
my guess is you have a single threaded process that is getting blocked
by the NFS - network being the slowest, previously when copy across nfs
(UDP, not tcp), I started 6 rsync to get about 600Mb across the 1G nic.
can I suggest looking at rdiff-backup. same process snapshot each lvm
and run in parrallel a rdiff-backup of each lv across NFS or instead
across ssh with compression !
that would speed it up, by only sending diff information and compression
and parallelism
alex
>=20
> thanks in advance.
>=20
--=20
standards, n.:
The principles we use to reject other people's code.

Israel Garcia wrote:
> Hi list:
>
> I'm using this command to create s snapshot of every LV's server,
> mount the LV, make a TGZ to a shared folder (NFS), then umount LV
> image and remove snapshot LV. The problem is tar backup is extremely
> slow (it takes 3 hours to make backup of all servers).
>
> This is the command I'm using:
>
> for vps in `cat vps`; do lvcreate -L10G -s -n "$vps"snapshot
> /dev/vg0/"$vps".domain-disk && mount /dev/vg0/"$vps"snapshot
> /mnt/vmbackup && cd /mnt/vmbackup && nice -n 19 tar pczf
> /shared/lvbackups/"$vps"_`date +%F` . && cd ; umount /mnt/vmbackup &&
> lvremove -f /dev/vg0/"$vps"snapshot;done
>
> My question is:
> How can I make TAR backup faster? is it possible? Is there other
> command faster than TGZ in this case?
>
> thanks in advance.
>
Great fun this kind of thing...
Look at the nfs export - fiddle with the r/wsize parameters:
http://www.linuxselfhelp.com/HOWTO/NFS-HOWTO/performance.html
Enough space. Produce the tar file locally then copy to the remote
server....if security permits with ftp.
Lots of space...Do the backups in parallel. bash wait is your friend:
http://www.museum.state.il.us/ismdepts/library/linuxguides/abs-guide/x5514.html
BTW: The p in pczf is an option for restore.
Enjoy...
--
To UNSUBSCRIBE, email to debian-user-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org