A common technique for storing a lot of files/blobs in a filesystem is to use a hash function to determine the filepath; eg hash(identifier) -> "o238455789" -> o23/8455/789 (there is often a hash-collision strategy too) Does this technique have a name (is it a 'pattern'?) so that I may find it with a search of ACM Digital Library or sim...
I'm working on a web application right now using Rails and wanted to see if anyone knew of a good way to keep track of file storage limits? We want to give users a specific amount of room that they can use to upload files and we are using paperclip for storage on Amazon S3. Any thoughts? Thanks ...
Simple question, doesn't seem to have been directly asked yet. What are the benefits to storing files (images/videos/documents/etc) on Amazon S3-and-related vs. on the File System your app is deployed on? It seems that the general consensus is to store files on the File System over the Database (here and here), but where does the Cloud...
After reading this, it sounds like a great idea to store files using the SHA-1 for the directory. I have no idea what this means however, all I know is that SHA-1 and MD5 are hashing algorithms. If I calculate the SHA-1 hash using this ruby script, and I change the file's content (which changes the hash), how do I know where the file i...
Where can I find information on storing ".dll" files in SQL Server 2005? Is it the same as storing Binary data? ...
We're creating an ASP.Net MVC site that will need to store 1 million+ pictures, all around 2k-5k in size. From previous ressearch, it looks like a file server is probably better than a db (feel free to comment otherwise). Is there anything special to consider when storing this many files? Are there any issues with Windows being able...
I need to store about 600,000 images on a web server that uses NTFS. Am I better off storing images in 20,000-image chunks in subfolders? (Windows Server 2008) I'm concerned about incurring operating system overhead during image retrieval ...
I have developed a Java EE web application. This application allows a user to upload a file with the help of a browser. Once the user has uploaded his file, this application first stores the uploaded file on the server (on which it is running) and then processes it. At present, I am storing the file on the server as follows: try { ...
Having had some Sql Compact db corruption issues in the past and gone through the article on these, I got the idea that storing the database sdf file on a storage card significantly increases the risk of data loss due to db corruption. Do you store the sdf file on a storage card? Have you had any issues caused by it? What should I pay ...
I want to create a small document management system. There are several users who store their files. Each file which is uploaded contains info about which user uploaded it and the document content itself. In a view all files of ONE specific user will be displayed, ordered by date. What would be better: giving the documents a name or m...
It's a pattern I've seen on websites that allow users to upload content like images before. For example, why http://upload.wikimedia.org/wikipedia/commons/7/70/Example.png instead of just something like http://upload.wikimedia.org/wikipedia/commons/Example.png? Is there a practical reason for this, or is it just cargo-cult? ...
My site will feature dozens and dozens of front end live demos ( html pages with cross browser bugs ), but instead of just throwing it on jsfiddle.net and linking to demos from articles I would actually like to store them in a database or organized dynamically generated flat files. Example: http://site/css-bug/ will feature an article ...
I need a way to store several images in one/two (some projects seems to us an index too) for both .NET and java. The file-format needs to be easy to decompress (I'm planing to do so on android). And also, for each file I need to be able to store the following metadata: file-index, name, md5-checksum. Also, the footprint of the framewor...
I have a site that allows people to upload files to their account, and they're displayed in a list. Files for all users are stored on different servers, and they move around based on how popular they are (its a file hosting site). I want to add the ability for users to group files into folders. I could go the conventional route and crea...
Hello, What is the default location for reposatory files in SVN? And how does it store them? (plain files,some sort of database)? Thanks ...
I am trying to catch a file sent with form and perform some operations on it before it will be saved. So I need to create a copy of this file in temp directory, but I don't know how to reach it. Shutil's functions fail to copy this file, since there is no path to it. So is there a way to do this operation in some other way ? My code : ...
I'm working on a system that will need to store a lot of documents (PDFs, Word files etc.) I'm using Solr/Lucene to search for revelant information extracted from those documents but I also need a place to store the original files so that they can be opened/downloaded by the users. I was thinking about several possibilities: file syst...
Hello, I need to write an Android app that would download sounds from the internet for further use. Where should i store these sounds? Is Sqlite an option? And what's the best way to load and play these files? Thanks in advance. ...