Militantly FREE software support.
Militantly FREE software support.
NavigationUser loginSpam?See spam posts on this site? If so, please don't reply to the spam! Instead, just report the URL to the webmaster. |
FTP connectionI'm trying to backup a remotely-hosted website onto my local Debian Sarge machine using lftp's "mirror" command, but I keep running into a problem where it seems that the remote server persistently resets the connection after a certain length of time. For example, my latest attempt started at 19:09 tonight, and copied files successfully until 19:40, until it seems the remote server decided time was up, and reset all further connections until I killed the job a few hours later. The debug output for each failed connection attempt (at 10-minute intervals) looked like: 2007-03-29 19:40:56 dns cache hit Can anybody provide any clues as to why this is happening and how I can work around it? Thanks a lot. Tony. Bookmark/Search this post with: 
|
• Debian Weekly News - Essential reading for any Debian fan. • Documentation - Debian's own authoritative documentation, including installation docs. • FAQ - Got questions about Debian GNU/Linux? • From Windows to Debian - Tips for converting from Windows to Debian GNU/Linux • Package of the Day. • Security - Security information and alerts! • Bug System - Bug tracking and instructions on reporting bugs. • CD Images - Where/how to get Debian GNU/Linux CD images. • Mailing List Subscription - Dozens of Debian-specific support mailing lists! • Mailing List Archives - Searchable archives of Debian's mailing lists. • Free Software Guidelines - Learn Debian's idea of what "free" software really is. • Package Listings - A very valuable tool: searchable, integrated with bug reports. • Apt-Get Sources - Sources for *.debs which are not official Debian packages. • Backports - Unofficial new software packages that have been "back-ported" to work with the Debian stable/official release. • Developer's Corner - Info about the people behind Debian, policies, and how to package *.deb files.
FTP connection
There are many reasons why it could fail:
1. file does not exist at specified path
2. no access to path
3. attempting more than 1 connection on a machine which only allows 1 connection per IP# (having a browser open to the ftp site counts as a connection)
I'm sure there are other reasons why it would fail. Have you checked your logfiles to see if any useful information was dumped there? Also see if your tool has a 'verbose' option to display more info.
FTP connection
Thanks.
Like I said, I'm using lftp's "mirror" command, which backs up an entire site to a local machine, overwriting only those files which have not changed since the previous backup; it always stops working and goes into a disconnect/connect loop after a period of time, and for the rest of the day will not copy files at all if restarted. What I gave is the full debug output.
I've since come to the conclusion that the server limits FTP activity time on a daily basis (is that a common practice, anybody?), so I've rewritten the backup script to kill the mirroring process after a configurable amount of time (currently 35 mins); if I run the script every day, the backup archive gets bigger each time until it reaches full size and then it should just take a couple of minutes to do the incremental backup each time.
Tony.
$world=~s/war/peace/g;
FTP connection
Administrators can use any number of schemes to limit traffic and it is impossible to tell what is happening from the information provided. Some site maintainers don't like people mirroring without talking to them or have very strict rules on how to go about creating a mirror. Whatever the cause, you're better off talking to the site maintainers.
FTP connection
Thanks again.
All I'm doing is backing up the site (which I have taken over maintaining), not mirroring it as such.
Rather than it being a deliberate time-limit disconnection, I've since discovered (on the lftp mailing list archives) that it's a ProFTPd server bug (or maybe a feature), something to do with it not liking empty directory lists. I'm using the recommended workaround, and it seems to work fine now.
Tony.
$world=~s/war/peace/g;
(P.S. I'm really excited, today is the latest Etch target release date! What do people reckon are the odds of it actually happening?)