High volume large file uploads

Question

Trying to find a suitable method of accepting large file uploads that has to be scalable. By large I mean up to 5-10gb files.

I also need to process the files afterwards. I was thinking of using PHP and HTTP PUT for uploads, then passing the stream of data directly to disk. I'd then process the file afterwards.

Doing a custom server and protocol would be my second attempt but I'd like to avoid that.

I'll also be implementing a custom desktop upload client, so would HTTP PUT be good for that too?

Thanks in advance!

Answer 1

HTTP would be too fragile for that and usually client uploads are a lot slower which doesn't help.

You'd be better off using some other method to upload big files like using flash, Java or perhaps Silverligth ;-)