storage

How to store data accessible to both a web site and android application?

I’m developing an Android and web application that will function as a service (use the same data). My question is how should the data be stored to allow for both the web and the android application to have access to the same set of data? Should the android application connect to the sites MySQL server to store/access data? If so how d...

What Cloud Storage Metering to Use to Track Individual User's Use: Mezeo, Vembu or Other?

We want to offer cloud storage services as part of a portal and want to meter the usage of each user and bill them for that usage. Basic features needed are: Meter actual usage per user account (and either provide invoice per user or allow easy API tools to pull such data into our reporting/billing program) Backup management Synch fil...

Looking for a FIFO/LRU file storage system

I'm looking to implement a disk based caching system. The idea is to allocate a certain amount of disk space and save however much data fits in there, discarding of old files as I run out of space. LRU is my first choice of deletion strategy, but I'm willing to settle for FIFO. When googling for cache algorithms, the discussion seems to...

Sharing storage between servers

I have a PHP based web application which is currently only using one webserver but will shortly be scaling up to another. In most regards this is pretty straightforward, but the application also stores a lot of files on the filesystem. It seems that there are many approaches to sharing the files between the two servers, from the very s...

Nodejs in-memory storage

How do i store data to be used for all the clients in my server? (like the messages of a chat) ...

Best way to store many files in disk

I couldn't find a good title for the question, this is what I'm trying to do: This is .NET application. I need to store up to 200000 objects (between 3KB-500KB) I need to store about 10 of them per second from multiple-threads I use binaryserialization before storing it I need to access them later on by an integer, unique id What's...

What backing storage engine should I use for my Python library?

I'm writing a data processing library in Python that reads data from a variety of sources into memory, manipulates it, then exports it into a variety of different formats. I was loading this data into memory, but some of the datasets I'm processing can be particularly large (over 4 Gig). I need an open source library for a backing stor...

How can I write a Python list to persistent storage?

I am currently trying to solve this problem in MySQL. I have MySQLdb installed. What is the best way to write a list in Python, e.g. [1, 2, -1, -2] to a column of a MySQL database table? I would like each consecutive entry of the list to be put into consecutive rows of a MySQL column. I can obviously run individual queries in a loop, ...

Django upload file into specific directory that depends on the POST URI

I'd like to store uploaded files into a specific directory that depends on the URI of the POST request. Perhaps, I'd also like to rename the file to something fixed (the name of the file input for example) so I have an easy way to grep the file system, etc. and also to avoid possible security problems. What's the preferred way to do th...

Online storage: Google Spreadsheet v.s. GAE Bigtable

As an online storage, two of them can be a choice, with officially supported API. Both of them have its advantage and weakness. Google SpreadSheet supports RSS feed, but has limited no. of rows. GAE Bigtable is more scalable, but harder to be remotely accessed by external party. Any other comparison? and what's your favorite? ...

Creating a unique, auto assigned variable with Microsofts Extensible Storage Engine

I'm using Extensible Storage Engine and want a unique column (32bits wide). I need the values in this column to be auto assigned by the database I'm hoping to find something like JET_bitIndexUnique that I can mask in? if there isnt such a mask whats the proper way to achieve the goal? ...

Is there any benefit to my rather quirky character sizing convention?

I love things that are a power of 2. I celebrated my 32nd birthday knowing it was the last time in 32 years I'd be able to claim that my age was a power of 2. I'm obsessed. It's like being some Z-list Batman villain, except without the colourful adventures and a face full of batarangs. I ensure that all my enum values are powers of 2...

C++ string literal data type storage

void f() { char *c = "Hello World!" } Where is the string stored? What's the property of it? I just know it is a constant, what else? Can I return it from inside of the function body? ...

How exactly does subversion store files in the repository?

I read the subversion book and it is clear to me that subversion does not store individual files but only deltas in order to minimize disk space. Subversion also does the same with binary files as well (this used to be a huge weakness of CVS). However I do not understand the exact mechanism. When I commit a file what happens? Subversi...

Organizing thousands of images on a server

Hi I'm developing a website which might grow up to a few thousand users, all of which would upload up to ten pictures on the server. I'm wondering what would be the best way of storing pictures. Lets assume that I have, 5000 users with 10 pictures each, which gives us 50 000 pics. (I guess it wouldn't be a good idea to store them in th...

How should I store extremely large amounts of traffic data for easy retrieval?

Hello, for a traffic accounting system I need to store large amounts of datasets about internet packets sent through our gateway router (containing timestamp, user id, destination or source ip, number of bytes, etc.). This data has to be stored for some time, at least a few days. Easy retrieval should be possible as well. What is a go...

How may I store geographical data in an android database and query for it?

I want to store locations in my Android phone and be able for the application to tell me if I am inside these points&radius. What is the best way to store many point&radius locations and efficiently query for them? ...

Simple online key-value storage service

In a number of projects I plan to create (widgets/local client software) I want to store some user preferences etc. I could do this client side, the widgets have this functionality, or I could store it online somewhere, giving the user access to those preferences on any computer, or after a reinstall etc.. The problem is that I don't wa...

Why there is a delay of adding a record in database in some websites?

In stackoverflow, and some other websites where people submits questions or posts, there is a delay of 20 seconds before the post displayed, is that means the post is delayed by the SQL server, or the website does not allows instant posting, or it's a CDN cache matter ? And the important thing , why there is a delay, is it in order to m...

Persistance JDO - How to query a property of a collection with JDOQL?

I want to build an application where a user identified by an email address can have several application accounts. Each account can have one o more users. I am trying to use the JDO Storage capabilities with Google App Engine Java. Here is my attempt: @PersistenceCapable @Inheritance(strategy = InheritanceStrategy.NEW_TABLE) public class...