Hey guys!
I am searching for a service which will provide me with the functionality of S3 but for self hosted use. It seems like something simple which must have been written and perfected a bunch of times. I have these machines with 2000 GB drives in our servers anyways and the connection is good enough for my purposes.
Thomas
Based on the information that you have given, I would suggest Eucalyptus ( http://open.eucalyptus.com/ ). They do have an S3 compatible storage system.
The reliable, distributed object store RADOS, which is part of the ceph file system, provides an S3 gateway.
We used the Eucalyptus storage system, Walrus, but we had reliably problems.