Using wget to recursively fetch a directory with arbitrary files in it

Question

I have a web directory where I store some config files. I'd like to use wget to pull those files down and maintain their current structure. For instance, the remote directory looks like:

http://mysite.com/configs/.vim/

.vim holds multiple files and directories. I want to replicate that on the client using wget. Can't seem to find the right combo of wget flags to get this done. Any ideas?

Answer 1

wget -r http://mysite.com/configs/.vim/

works for me.

Perhaps you have a .wgetrc which is interfering with it?

Answer 2

You should be able to do it simply by adding a -r

wget -r http://stackoverflow.com/

Answer 3

For me I have to pass the --no-parent option, otherwise it will follow the link in the directory index on my site to the parent directory. So the command would look like this:

wget -r --no-parent http://mysite.com/configs/.vim/

Edit: To avoid downloading the index.html files, use this command:

wget -r --no-parent --reject "index.html*" http://mysite.com/configs/.vim/