We are gathering a large amount of custom analytics data. We will be using Hadoop for running batch processes on the analytics.
What real time reporting tool/datastore might we consider for storing and generating customized real time web based (as in displayed in a web page not web analytics) reporting. We are considering the rrdtool. We would like something that is centralized and scalable, maybe we should consider a document database like MongoDb. I played around with clicky (getclicky.com), and wondered what they are using as a data store for their real time reporting?