Home » forums » Debian Help Forums: Users Helping Users » Internet and WWW

cherry-picking file copy

Tags:

I need to copy a very large number of (large) files from one computer to another over samba (although ftp is also an option).
The problem is that I need to be able to cherry-pick certain files or directories that I need to copy and exclude those which are unnecessary.

Why I don't want to use nautilus for this:
1. It opens a new window for each thing I choose - there would be two many.
2. It does not (at least seem to) download the files sequentially, resulting in a performance hit.
3. I need to be able to resume from where I left off if the connection is interrupted.

Any ideas on how I should do this?

I would probably mount the samba filesystem, unless someone suggests a good client.
Are there any programs with a "copying queue" that I could use? I have tried smbc in the past, but it had terrible memory leaks, bringing my computer to a halt. It also does not quite scale to this operation.

I could possibly create a shell script with a list of directories to copy. Does anyone know of an interface / way to make a script like this?
FTP would be an option if wget can be used to download entire directories. Is that possible?

Ideas, anyone?

Bookmark/Search this post with:
  • Delicious
  • Digg
  • StumbleUpon
  • Propeller
  • Reddit
  • Magnoliacom
  • Newsvine
  • Furl
  • Google
  • Yahoo
  • Technorati
0
‹ Slow firefox/konqueror text flow p2p clients/limewire/java ›

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

wget

Submitted by pinniped on Mon, 2006-11-20 07:38.

Yes, wget is even available to run on the WinDos command line! The list of files and the script is best to auto-generate (and hand-edit) on the *NIX machine which hosts the files. Don't forget to change the end-of-line character to something suitable for WinDos before you bring the script over. As an example of what you can do on *NIX:

cd /home/me
find ./ -name * > ./mylist

Hmm... I'm on WinDos at the moment so I can't tell you exactly how to proceed from there, but it would go something like this:
a. filter 'mylist' through 'cut' to obtain just the file names and write the results to 'mylist2'
b. create the batch file via something like:
for X in $(cat mylist2); do echo "wget -c 192.168.1.1/$X" >> mybatch ; done

You need to read the wget manual of course to see exactly how to construct the URL and how to specify user/passwd to the system you are copying from. There are also options to trim the directory structure so you don't get ridiculous directory nests (the default).

»

thanks, pinniped

Submitted by jamei on Tue, 2006-11-21 01:33.

cheers, that was a great help - everything is running smoothly.

»
Syndicate content