berkeley-db

Could my embedded key/value datastore eventually exceed an App Engine limit?

I have a BerkeleyDB key/value datastore embedded in my Google App Engine project, which does not use the Google Datastore. When I upload the application to Google App Engine, the database will be less than 1MB. But is it possible that, as it grows, over time it will eventually exceed an App Engine file-size limitation? What would be ...

Fast, scalable hash lookup database? (Berkeley'ish)

I use and love Berkeley but it seems to bog down once you get near a million or so entries, especially on the inserts. I've tried memcachedb which works but it's not being maintained so I'm worried of using it in production. Does anyone have any other similar solutions, basically I want to be able to do key lookups on a large(possibly ...

Building a Java based stock trading application, need pointers for technologies to use

I am building an application in Java (with a jQuery frontend) that needs to talk to a third party application. it needs to update the interface every two seconds at the most. Would it be a good idea to use comets? If so, how do they fit into the picture? What other means/technologies can I use to make the application better? The appli...

sqlite , berkeley db benchmarking

I want to create desktop application in c# for that i want to use embedded database like (sqlite,berkeley db), so how can i start benchmarking for these databases ? ...

Ideal string length for DBM database?

When using a DBM database (e.g. Berkeley or GDBM), is it better to store data using fewer long strings or more short strings? I can easily structure my data either way. I'm looking for 'better' in the performance sense, but I'm interested in other implications as well. ...

BDB Python Interface Error when Reading BDB

bsddb.db.DBInvalidArgError: (22, 'Invalid argument -- /dbs/supermodels.db: unexpected file type or format') Is this error a result of incompatible BDB versions (1.85 or 3+)? If so, how do I check the versions, trouble-shoot and solve this error? ...

Compiling BerkeleyDB-C on Fedora

Hi all, I'm trying to compile BerkeleyDB-C 4.7.25 on Linux but .configure gives me an error I don't know how to fix. uname -s -p -m -i -o -v Linux #1 SMP Wed May 27 17:14:37 EDT 2009 i686 i686 i386 GNU/Linux more /etc/redhat-release Fedora release 11 (Leonidas) ../dist/configure --enable-cxx --enable-java --enable-rpc (...) configure...

Performance lost when open a db multiple times in BerkeleyDB

I'm using BerkeleyDB to develop a small app. And I have a question about opening a database multiple time in BDB. I have a large set of text ( corpus ), and I want to load a part of it to do the calculation. I have two pseudo-code (mix with python) here @1 def getCorpus(token): DB.open() DB.get(token) DB.close() @2 #ope...

Look up values in a BDB for several files in parallel

What is the most efficient way to look up values in a BDB for several files in parallel? If I had a Perl script which did this for one file at a time, would forking/running the process in background with the ampersand in Linux work? How might Hadoop be used to solve this problem? Would threading be another solution? ...

LOBs in BerkeleyDB

Hi, what's the usual way to store a CLOB (a few 100KB) inside Berkeley DB? ...

A UML way to describe a key/value datastore ?

Hi all, I'm currently writing the documentation for a database using berkeleyDB. I'd like to draw UML diagram describing the keys and the values of the datastores. Is there a 'standard' way to describe this kind of database using UML ? Thanks ...

Berkeley Db platform migration

I have a large (several Gb) berkeley db that I am thinking of migrating from windows (2K) to Linux (either Redhat or Ubuntu). I am not sure how to go about this. Can I merely move the db files accross, or do I need a special conversion utility? ...

Berkeley DB(Unable to Locate Component)

Hello,i have a problem with berkeley DB.I get a dialog titled "Unable To Locate Componenent" saying "This application has failed to start because libdb48.dll was not found.Re-installing the application may fix this problem",then it crashes after clicking ok.i got the error message when running these simple code below: #include <iostream...

Is Berkeley DB XML a viable database backend?

Apparently, BDB-XML has been around since at least 2003 but I only recently stumbled upon it on Oracle's website: Berkeley DB XML. Here's the blurb: Oracle Berkeley DB XML is an open source, embeddable XML database with XQuery-based access to documents stored in containers and indexed based on their content. Oracle Berkeley DB XML is...

Recommend a fast & scalable persistent Map - Java

I need a disk backed Map structure to use in a Java app. It must have the following criteria: Capable of storing millions of records (even billions) Fast lookup - the majority of operations on the Map will simply to see if a key already exists. This, and 1 above are the most important criteria. There should be an effective in memory ca...

Problem with Berkeley DB and C++

I'm trying to write a simple C++ program that uses Berkeley DB for storage. The key of the database is of type time_t and the data is an integer. I need to take the difference between two adjacent data in a between two key. I open a cursor with the flag DB_SET_RANGE and then i use DB_NEXT to iterate. My problem is that the cursor retur...

Hierarhical data and BerkeleyDB

Good news! Since version 4.8 BerkeleyDB has c# interface. BerkeleyDB is a quite interesting thing for me due to it's non-SQL nature. I know it's an excellent tool if someone wants to store a lot of key/value pairs. And I know about 'attachable' tables. What i don't know is how to store hierarchical data with BerkeleyDB. Is it suitable f...

Django + dbxml + Apache = problems. Any solutions?

I'm trying to set up a Django application using WSGI. That works fine. However, I am having some issues with part of my Django app that uses BDB XML. My Apache config is as follows: Listen 8000 WSGISocketPrefix /tmp/wsgi <VirtualHost *:8000> ServerName <server name> DocumentRoot <path to doc root> LogLevel info WSGIScr...

can a berkeley database be opened and accessed from multiple programs at the same time?

Hi, according to the Berkeley documentation the Transactional (TS) and the Concurrent Datastore version of the Database, multiple threads may access (and change) the database. Does this also mean that I can have 2 programs linked to the berkely 'client' and have them access the same database file without any problems? (I ask, since f...

Must the keys and values in a Berkeley DB on Ruby be strings, not int, float, or any other type?

It seems that if I use Berkeley DB (DBM) on Ruby, the hash's keys and values must be strings? Can they be other data type? require 'dbm' d = DBM.open('test1') d[1] = 2 d[123] = 456 d[2] = 2.34 d['wa'] = Time.now.to_f p d.keys p d.values Result: C:\>ruby test_dbm.rb ["wa", "2", "1", "123"] ["1259229787.686", "2.34", "2", "456"] ...