tags:

views:

41

answers:

2
Q: 

Can i use Distributed Database for a crawler?

Hey friends
can i use a distributed DB for my WebCrawler,what all are the available Open Source Distributed Databases?? can i use MySQL as my distributed DB? how amount of data can be stored?

A: 

As said earlier in a comment: use Sphinx (for instance).

Wrikken  2010-08-05 17:39:22
+1  A: 

MongoDb might be right for you. It allows sharding and replication.

Marek Jelen  2010-08-05 20:06:14

related questions

Remove Quotes and Commas from a String in MySQL
What's the best way of converting a mysql database to a sqlite one?
How do you manage databases in development, test, and production?
Multiple foreign keys?
Add 1 to a field (MySQL)
Issues using MS Access as a front-end to a MySQL database back-end?
Bigger than a char but smaller than a blob
How do I retrieve my MySQL username and password?
Long-time LAMP Developer moving to VB.NET
How do I Concatenate entire result sets in MySQL?
Full complete MySQL database replication? Ideas? What do people do?
SQL: Distribution of table in time
SQLite vs MySQL
How do I create a new Ruby on Rails application using MySQL instead of SQLite?
Multiple Updates in MySQL
MySQL/Apache Error in PHP MySQL query
What all do I need to escape when sending a (My)SQL query?
Auto Generate Database Diagram MySQL
Mechanisms for tracking DB schema changes
How big can a MySQL database get before performance starts to degrade.
Python and MySQL
SQL Server 2005 implementation of MySQL REPLACE INTO?
How to export data from SQL Server 2005 to MySQL
Throw Error In MySQL Trigger
Binary Data in MySQL