rsync

Best way to wrap rsync progress in a gui?

I use rsync to synchronize files to Windows clients in a server agnostic way. What methods are available to send the progress of rsync to the parent process for display in a gui progress bar? I imagine two or three choices exist. (1) Watch STDOUT (2) Watch rsync.exe log file, similar to unix tail (3) Watch rsync console output in memory...

Securely sync folders over a public network

I need to keep the files & folders on two Windows-based, non-domain machines synchronized across a public network. I was thinking rsync over SSH - but I was wondering if there is a simpler solution? Any possibility of using the sync framework over SFTP/SCP/SSH? Or I'm open to better ideas? ...

RSync only if filesystem is mounted

I want to setup a cron job to rsync a remote system to a backup partition, something like: bash -c 'rsync -avz --delete --exclude=proc --exclude=sys root@remote1:/ /mnt/remote1/' I would like to be able to "set it and forget it" but what if /mnt/remote1 becomes unmounted? (After a reboot or something) I'd like to error out if /mnt/rem...

Technical Hurdles for Win32 rsync port

Despite primarily being a windows user, I am a huge fan of rsync. Now, I don't want to argue the virtues of rsync vs any other tool...this is not my point. The only way I've ever found of running rsync on windows is via a version that is built to run on top of Cygwin, and as Cygwin has issues with Unicode, so does rsync. Is anyone fam...

keep rsync from removing unfinished source files

I have two machines, speed and mass. speed has a fast Internet connection and is running a crawler which downloads a lot of files to disk. mass has a lot of disk space. I want to move the files from speed to mass after they're done downloading. Ideally, I'd just run: $ rsync --remove-source-files speed:/var/crawldir . but I worry that...

How can I associate .sh files with Cygwin?

I'd like to run a long rsync command in Cygwin by double clicking on a .sh file in Windows. It must start in the file's containing directory (e.g. /cygdrive/c/scripts/) so that relative paths work. Anyone gotten this to work? Note: I've just found chere, a Cygwin package that manages Windows context menus (Bash Prompt Here). It might...

Rsync on Windows - Socket operation on non-socket

I get the following error when trying to run the latest Cygwin version of rsync in Windows XP SP2. The error occurs for attempts at both local syncs (that is: source and destination on the local harddisk only) and remote syncs (using "-e ssh" from the openssh package). Any advice on how to fix/workaround it? bash-3.2$ rsync -a dir1 dir...

What's the best way to keep multiple Linux servers synced?

I have several different locations in a fairly wide area, each with a Linux server storing company data. This data changes every day in different ways at each different location. I need a way to keep this data up-to-date and synced between all these locations. For example: In one location someone places a set of images on their local s...

Using emacs tramp vs. rsync for remote development

I have been doing some remote development using emacs tramp and found that it was quite slow. Every time I save a file, it takes about 10 seconds to complete the save. So, now I am using rsync to transfer the files remotely and it works much faster, it takes about a second plus the local saves from emacs are instant. Are there any con...

rsync ignoring --SUFFIX option

rsync -auve ssh --backup --suffix='2008-10-03-1514539' --backup-dir='/tmp/' module.pm root@web1:/path/to/module.pm I run this command without the --backup-dir option and when it copies the file over, it creates a backup with a current timestamp. When I include the --backup-dir option, it makes the backup into the /tmp/ directory but ne...

Error Trying To Make Easier rsync Command

I normally use scp to copy stuff, but now I'm trying to get used to the more powerful rsync command. It helps me use less bandwidth by copying up only files that have changed. However, rsync has a lot of complex parameters, so I thought, hey, I'll just make a little Bash script that makes it easy for me, and call the command 'rscp'. So, ...

Getting the path of a remote rsync depot

Hey, I know if you run in rsync rsync some.domain.com:: It will return me a list of the rsync depots. Is there any way of getting it to return the details of the depot, the path specifically. Thanks ...

OS X run rsync under sudo using ssh_config

I want to set up an automatic rsync job to backup a bunch of user accounts on my OS X machine to a linux fileserver. I have set up password-free ssh from my account to another machine, and it works great, so I tried using this command: sudo rsync -avz /Users/jbloggs myserv:/var/Backup/ where myserv is an alias set up in my ~/.ssh/conf...

Ftp transfer the rsync-way

Hi! I'm downloading a logfile quite often from a ftp-server (which I'm not in control over, btw), and it seems rather rediciolus to download the whole file every time. So I'm looking for a program (linux-ish) or Perl module that in a way combines ftp and rsync, and only "updates" the file. The logfile is constantly growing. Anyth...

How do I tell rsync to run only if the destination directory exists?

I have this bash script running my backup to an external hard drive... only if that drive is mounted (OS X): DIR=/Volumes/External; if [ -e $DIR ]; then rsync -av ~/dir_to_backup $DIR; else echo "$DIR does not exist"; fi This works, but I sense I am misreading the rsync man page. Is there a builtin rsync option to abort the run i...

Best way to copy millions of files between 2 servers

I have roughly around 5 million small (5-30k) files in a single directory that I would like to copy to another machine on the same gigabit network. I tried using rsync, but it would slow down to a crawl after a few hours of running, I assume due to the fact that rsync has to check the source & destination file each time? My second thoug...

rsync hang with many remote files specified

Using the following rsync command will let you copy numerous remote files to your local machine, when the remote machine is using rsyncd: rsync -R hostname::'module/path1/file1 module/path2/file2 module/path3/file3 module/path4/file4' /local/path If the number of files is too great, however, rsync hangs, not creating the files in the t...

Using rsync to delete a single file

File foo.txt exists on the remote machine at: /home/user/foo.txt It doesn't exist on the local machine. I want to delete foo.txt using rsync. I do not know (and assume for the purposes of this question that I cannot find out) what other files are in /home/user on either the local or remote machines, so I can't just sync the whole dire...

Rsync for Windows

Does anyone know of a tool or framework that provides rsync type functionality for windows. I'd like to write an rsync type program in windows and not actually wrap rsync and cygwin as DeltaCopy does. (I'd like to have more features than DeltaCopy like continuous replication, firewall transparency, IPSec encryption etc.) I have given ...

help understanding rsync's output

path/to/file 16 100% 0.01kB/s 0:00:01 (xfer#10857, to-check=427700/441502) There are some numbers there, can u help me complete the missing ones: 16 ??? 100% amount of transfer completed in this file 0.0.1kB/s speed of current file transfer 0:00:01: time elapsed in current file transfer 10857 count of files transfe...