Home » forums » Imported debian.org Mailing Lists » Debian ISP

incremental backups via ftp

Tags:

Chistian wrote:
...
> * I've written a shellscript (sh) generating .tar files on-the-fly
> while uploading to the backup server (tar | ncftpput).
> - good, because no local backupspace is need (which might
> not be available anyway)
> - I failed to get incremental backup working, so the daily
> backup process took longer and longer as the /webspace grew
> (~6h!), also the ftp server occasionally closed the connection
> because the backups took so long.
...

In this case you could do something like:

touch new
find /webspace -newer timestamp > list
tar -T list ...
mv new timestamp

Regards,
/Karl

-----------------------------------------------------------------------
Karl Hammar Asp

Bookmark/Search this post with:
  • Delicious
  • Digg
  • StumbleUpon
  • Propeller
  • Reddit
  • Magnoliacom
  • Newsvine
  • Furl
  • Google
  • Yahoo
  • Technorati
0
‹ raid10?? Disk Management ›

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

incremental backups via ftp

Submitted by Marc Schiffbauer on Thu, 2007-08-23 05:00.

* Christian schrieb am 23.08.07 um 08:51 Uhr:
> Hi,
>
> we're having this box with 30GB of /webspace to backup (plus /etc and a few
> things from /usr/local) but our hosting provider is only offering a FTP
> server to backup. This might not be unusual and given the fact the we have
> 80GB of backupspace, this is pretty neat. However, I fail to get a proper
> backup solution working. I see a few options:

[...]

I suggest using curlftpfs to mount the ftp share on your machine.
This way you can use any backup solution that can save to disk.
Maybe rsnapshop or flexbackup would be good for you!

Cheers
-Marc
--
begin LOVE-LETTER-FOR-YOU.txt.vbs
I am a signature virus. Distribute me until the bitter
end

--

»

incremental backups via ftp

Submitted by Andrew McGlashan on Thu, 2007-08-23 07:00.

Christian wrote:
> On Thu, August 23, 2007 10:43, Karl Hammar wrote:
>> touch new find /webspace -newer timestamp > list
>> tar -T list ... mv new timestamp
>
> Hm, this was too easy :-\
>
> Thanks Karl, I'll try this one out. Should help bringing the backup
> times down to reasonable values...

There is the problem of what to do when a file has been deleted. The above
method will still keep the deleted files with the backup -- you could do the
above for incrementals and do the occasional full refresh though.

Kind Regards

AndrewM

Andrew McGlashan
Broadband Solutions now including VoIP

Current Fixed Line No: 03 8705 0300
Mobile: 04 2574 1827 Fax: 03 8790 1224

National No: 1300 85 3804

Affinity Vision Australia Pty Ltd
http://www.affinityvision.com.au
http://adsl2choice.net

In Case of Emergency -- http://www.affinityvision.com.au/ice.html

--

»

incremental backups via ftp

Submitted by Marc Schiffbauer on Thu, 2007-08-23 08:00.

* Christian schrieb am 23.08.07 um 12:59 Uhr:
> On Thu, August 23, 2007 11:58, Marc Schiffbauer wrote:
> > I suggest using curlftpfs to mount the ftp share on your machine.
>
> Ah, I forgot to mention that I tried this one as well. Mounting ftp:// via
> FUSE and then using rsnapshot to store "locally" while it's really the ftp
> backupspace. I really liked the idea, but when I tried it
> (debian/oldstable, 2.6.8), the fuse processes got stuck sometimes and
> where not usable. I shall try again with the current kernel.

I am using it on etch with a kernel 2.6.19.3 and it works stable for months now.

>
> > This way you can use any backup solution that can save to disk.
> > Maybe rsnapshop or flexbackup would be good for you!
>
> I'll look into flexbackup, thanks!

you're welcome

-Marc
--
+------------------------------------------------------------------+
| --> http://www.links2linux.de <-- |
| |
+---Registered-Linux-User-#136487------------http://counter.li.org +

--

»

incremental backups via ftp

Submitted by Christian Kujau on Thu, 2007-08-23 15:00.

On Thu, 23 Aug 2007, "Michael Sørensen / apto.dk" wrote:
> Have a look at rdiff-backup (http://www.nongnu.org/rdiff-backup/)
> I'm using it over SFTP. do you have access to that?

No, sftp is not available either.

Right now I'm using curlftps (FTP over FUSE, thanks Marc:)) and with
the "new" debian 2.6.18 kernel it seems pretty stable so far, but
tests are still running. Currently I'm using "backup-manager" (debian
package available), but I shall try flexbackup and rdiff-backup as
well.

Thanks for all your input! If the curlftps method is failing again, I
shall try and add incremental stuff to my upload script (thanks Karl!)

Christian.
--
BOFH excuse #147:

Party-bug in the Aloha protocol.

»

incremental backups via ftp

Submitted by Craig Sanders on Thu, 2007-08-23 23:00.

On Thu, Aug 23, 2007 at 08:51:39AM +0200, Christian wrote:
> we're having this box with 30GB of /webspace to backup (plus /etc and a few
> things from /usr/local) but our hosting provider is only offering a FTP
> server to backup. This might not be unusual and given the fact the we have
> 80GB of backupspace, this is pretty neat. However, I fail to get a proper
> backup solution working. I see a few options:

sounds like a job for mirror (which can upload as well as download),
unless you really want to upload .tar.gz archives of your backups.

craig

--
craig sanders

--

»

incremental backups via ftp

Submitted by Christian Kujau on Sun, 2007-08-26 09:00.

On Thu, 23 Aug 2007, Christian Kujau wrote:
> Thanks for all your input! If the curlftps method is failing again, I shall
> try and add incremental stuff to my upload script (thanks Karl!)

Well, I tried FUSE and curlftpfs with 2.6.18 for the last few days, but
it hangs and gets stuck every now and then. A 'killall -9 curlftpfs'
seems to "help" (as suggested in the curlftpfs bugtracker), but I can't
use it in production. I've tried a current kernel on a different
machine, no good either. Which is too bad, because I really liked the
idea of treating ftp:// like just another directory.

Anyway, I'll see what I can do with incremental stuff in my own script.

Thanks,
Christian.
--
BOFH excuse #414:

tachyon emissions overloading the system

--

»

Re: incremental backups via ftp

Submitted by maryadavis on Mon, 2008-06-09 15:13.

So this will help speed up things? I keep all the important info on a ftp because a backup on my computer isn't really safe. Speed would help a lot!
---
cheap voip service

»
Syndicate content