i have been in the RDBMS world for many years now but wish to explore the whole nosql movement. so here's my first question: is it bad practice to have the possibility of duplicate keys? for example, an address book keyed off of last name (most probably search item?) could have multiple entities. is it bad practice to use the last na...
I recently learned about Tokyo Cabinet and more precisely Tokyo Dystopia, a full-text search engine built on top of TC. I'm looking for an approximate/fuzzy text index but it doesn't seem to be supported out-of-the-box by Dystopia. However, it seems like the engine is using a q-gram inverted index so this should be a relatively simple h...
We're setting out to build an online platform (API, Servers, Data, Wahoo!). For context, imagine that we need to build something like twitter, but with the comments (tweets) organized around a live event. Information about the live event itself must be delivered to clients as fast and consistently as possible, while comments about the ev...
I would like to determine the number of records that a query on a Tokyo Cabinet Table will return before I run the query. I am using the rufus-tokyo Ruby gem as my interface. What is the best way to do this? ...
I have built a pretty simple REST service in Sinatra, on Rack. It's backed by 3 Tokyo Cabinet/Table datastores, which have connections that need to be opened and closed. I have two model classes written in straight Ruby that currently simply connect, get or put what they need, and then disconnect. Obviously, this isn't going to work long...
Is this possible? I couldn't find an answer anywhere. Basically I'm looking at a setup where I have multiple workers (boxes) which must all store there data into a Tokyo Cabinet index/db eventually (I'm using Tokyto Tyrant over the memcached protocol abtw. not that it matters but still) Basically, I tried pushing the data directly t...
I have the following setup Source: Raid0 (4 disks) with about a Tokyo Cabinet Hash-db with ~ 100.000 key-values where values are in compressed format, and each value consist of ~ 100 'sub-values' (values on avg are 1.5 MB) Target Raid0 (4 disks) with empty Tokyo Cabinet db. with settings: #bnum=20000000#opts=l#xmsiz=268435456#thnum...
The library in question is Tokyo Cabinet. I want is to have the native library, JNI library, and all Java API classes in one JAR file to avoid redistribution headaches. There seems to be an attempt at this at GitHub, but It does not include the actual native library, only JNI library. It seems to be specific to Leiningen's native dep...
Can somebody refer a good tutorial on tokyo cabinet and tokyo tyrant ...
Is there any way I can store an array of numbers in a Tokyo Cabinet db? For example, I have predictable arrays of values such as 1 => [1, 2, 444, 0.987], 2 => [2, 23, 123, -0.234], 3 => [3, 1, 34, 1.456] I would like to store the above in a TC fixed length db. Is there a way to store the above as arrays instead of as strings? ...
I watched a free high quality video with Aaron Hillegass about Core Data vs Tokyo Cabinet. Besides that this guy is amazingly funny (really, if you want to laugh now, watch it!), he shows off Tokyo Cabinet beeing about 40x faster than Core Data. I wonder if it's worth thinking about how to attach this to Core Data? Does that make any se...
Hey guys, I'm trying to use Tokyo Cabinet in Python via the tokyo-python package. I've installed Cabinet, and the Cabinet development library. However, whenever I try to install tokyo-python with pip or easy_install, I get this ugliness. matt@amalgam:~/$ bin/pip install tokyo-python Downloading/unpacking tokyo-python Downloading tokyo-...
Hi, Just spend 3 straight hours trying to solve the java.lang.UnsatisfiedLinkError: no jtokyocabinet in java.library.path problem in Eclipse in Linux. Downloaded TC and TC-Java sources, Built them both using ./config --prefix=/usr (so everything "JNI" related should be in /usr/lib) Set the LD_LIBRARY_PATH=/usr/lib and CLASSPATH="$CL...
I'm developing a database that holds large scientific datasets. Typical usage scenario is that on the order of 5GB of new data will be written to the database every day; 5GB will also be deleted each day. The total database size will be around 50GB. The server I'm running on will not be able to store the entire dataset in memory. I've s...
hello, i am new to tokyo cabinet and i have installed it and i have run the example c program i am getting error... while i compile with gcc gcc -O tcadbex.c /tmp/cc7IEOht.o: In function `main': tcadbex.c:(.text+0xd): undefined reference to `tcadbnew' tcadbex.c:(.text+0x1f): undefined reference to `tcadbopen' tcadbex.c:(.text+0x58):...
I need to convert objects to a byte[] to be stored in the Tokyo Cabinet key-value store. I also need to unbyte the byte[] to an Object when reading from the key-value store. Are there any packages out there that will help me with this task? Or would the best solution to implement it myself? ...
hello, From this documentation tokyodystopia The first field specifies the ID number of the record, and the second field specifies the text. i got that we can add only two fields one is id another is text is there is any way to add 3 or four or as many fields, bec i need to store some values like name address and etc etc and search...
hello, i am new to tokyo cabin ate and i compile the example program and i am getting an error can any one tell me why i get this error invalid conversion from ‘const void*’ to ‘const char*’ #include <tcutil.h> #include <tctdb.h> #include <stdlib.h> #include <stdbool.h> #include <stdint.h> int main(int argc, char **argv){ TCTDB *...
I get the same issue attempting to install tokyocabinet's ruby bindings from source or from a gem: tokyocabinet.c: In function 'fdb_get_reverse': tokyocabinet.c:2377: error: 'TCFDB' undeclared (first use in this function) tokyocabinet.c:2377: error: 'fdb' undeclared (first use in this function) tokyocabinet.c:2383: error: expected expre...