nosql

os.walk() caching/speeding up

I have a prototype server[0] that's doing an os.walk()[1] for each query a client[0] makes. I'm currently looking in to ways of caching this data in memory, speeding up queries and hopefully allowing for expansion in to storing metadata and data persistence later on. I've experimented with SQLite before, but I find SQL complicated for ...

Best storage engine for high volume, static analytics data

I'm building an application that requires storage and querying of very large amount of timestamped data. Specifically, this is analytics type data whereby a particular "set" can contain up to 100 separate data points tied together via a shared timestamp. This data is static, in that it will never change once stored but may be queried mul...

why everyone wants NOSQL other than large-scale Oracle Clusters?

oracle has a good reputation for handling large-scale applications and it's also flexible to extend to cluster environment. Why everyone wants NOSQL? because nosql db is much cheaper? why not swith object-oriented db? ...

Could document-based databases be used instead of RDBMS throughout the application in the future?

The more I read/use non-sql databases, the more I love it. It's so for the OOP world and it's easy to use, like Rails for Frameworks. I know the disadvantages. The major concern seems to be the no-transaction and no-concurrency part. Am I correct? Are these the only features making it hard for developers to choose to use non-sql datab...

Databases for easy comparison

We have an application which has metadata information stored in database (some tables with relations between). The metadata can be edited through web app or directly manipulating values in SQL Server database. The problem: metadata changes and needs to be merged between different environments (test, staging, production, etc.). There ar...

Distributed Key/Value Stores that can run on Windows, and have .Net clients?

As the title says, does anyone know of any Distributed Key/Value Stores that can run on Windows, and have .Net clients? Thank you Update: Sorry, forgot to add that it needs to be persisted. ...

Creating logger in CouchDB?

I would like to create a logger using CouchDB. Basically, everytime someone accesses the file, I would like like to write to the database the username and time the file has been accessed. If this was MySQL, I would just add a row for every access correspond to the user. I am not sure what to do in CouchDB. Would I need to store each acce...

simplest key value store for xml data with best performance for .NET

I need a way to store large-numbers of variously sized XML data in a simple key/value store. So far I have tried two simple approaches: RAM: Store everything in a ConcurrentDictionary instance Problem: limited resources at project launch, a single server with 8GBs of RAM! Note: Windows AppFabric could be a solution here in the future...

Help in choosing the right type of database

Hi, As part of my learning, i am developing a google maps V3 application, to allow people to upload real estate and rental listings. I would like to know what database should i use? I am quite confused as i have researched mysql, coudb, cassandra, maria db and a whole lot more, the issue is that everyone has a + and - things to say wit...

NoSql (e.g. RavenDB) for financial time series data?

Hi, I started to look into NoSql and was wondering what others think of the suitability of such solutions for storing and querying financial time series data? For example, in a simple scenario, I would store the stock symbol, open, high, low, close, volume and a timestamp. I would then want to query for that data based on symbol and a ...

CouchDB install on Linux crashing when running test suite

Hi I've been trying to install CouchDB on my webfusion virtual server. I followed the latest instructions from the webfusion forum (see: http://forum.webfaction.com/viewtopic.php?id=2355 ) and it runs (just) Futon is very sluggish and I get 502 errors. Anyway when I run the test suite it crashes and the browser hangs on the first two ba...

Hard to think of a reason why MongoDB doesn't create /data/db for us automatically?

I installed MongoDB both on Win 7 and on Mac OS X, and both places, I got mongod (the server) and mongo (the client). But at both places, running mongod will fail if I double click on the file, and the error message was gone too quickly before I can see anything. (was better on Mac because Terminal didn't exit automatically and showe...

Can MongoDB compress or mark a word that shows up frequently (such as "shopping") as s1 to save space?

Say if the app is like Digg, where users post a web link and add tags. Then there will be many tags that says "shopping", repeatedly in the value part of the key/value pair. Will MongoDB automatically or be configured so that it will remember that word as "s1" so as to reduce the size of the database? What if it is the key part that r...

Gem that allows for data access using sharded mysql databases while maintaining the usage of Activerecord

This is a relatively complex problem that I am thinking of, so please suggest edits or comment on parts where you are not clear about. I will update and iterate based on your comments I am thinking of a developing a rails gem that simplifies the usage of sharded tables, even when most of your data is stored in relational databases. I be...

Basics of MongoDB Scripts - How to

What are the basics of MongoDB Scripts? I think the script will end with .js, and we run it using mongo try.js But if I put print(db.foo.find()) in try.js and use mongo try.js it will say MongoDB shell version: 1.6.1 connecting to: test DBQuery: test.foo -> undefined and if I use the interactive shell by typing mongo and type >...

Does MongoDB have a Ruby Shell or Python Shell in addition to the Javascript shell?

Or, does using Ruby's irb and then require 'mongo' and adding some Connect statement essentially act like a Ruby shell... it would be great if a Ruby shell can be possible which as convenient as the Javascript Shell. ...

is there any good book on NoSQL?

I am looking for a book on NoSQL. Can anybody suggest me any good book? Thanks Shekhar ...

Best NoSQL-way to store machinedata?

Hi there, I'm looking for a NoSQL-way to store machinedata like information about tools, work pieces, products, operations and so on... Currently I'm concentrating on BerkeleyDB and need input from you guys, whether I should consider using another nosql-database which might fit better on my requierements. Data stored in this db should b...

Is there any python web app framework that provides database abstraction layer for SQL and NoSQL?

Is it even possible to create an abstraction layer that can accommodate relational and non-relational databases? The purpose of this layer is to minimize repetition and allows a web application to use any kind of database by just changing/modifying the code in one place (ie, the abstraction layer). The part that sits on top of the abstra...

Referential Data Integrity: Necessity, nice-to-have, or old hat?

Frameworks like Rails have encouraged moving a lot of the logic, even stuff like constraints and foreign keys, off the database - in my opinion. for the better, as it's more manageable and easy to change. Even so, some operations are easier faster, or just plain only possible in SQL. The recent explosion in popularity of noSQL databa...