views:

781

answers:

2

What ready available algorithms could I use to data mine twitter to find out the degrees of separation between 2 people on twitter.

How does it change when the social graph keeps changing and updating constantly.

And then, is there any dump of twitter social graph data which I could use rather than making so many API calls to start over.

+3  A: 

From the Twitter API

What's the Data Mining Feed and can I have access to it?

The Data Mining Feed is an expanded version of our /statuses/public_timeline REST API method. It returns 600 recent public statuses, cached for a minute at a time. You can request it up to once per minute to get a representative sample of the public statuses on Twitter. We offer this for free (and with no quality of service guarantees) to researchers and hobbyists. All we ask is that you provide a brief description of your research or project and the IP address(es) you'll be requesting the feed from; just fill out this form. Note that the Data Mining Feed is not intended to provide a contiguous stream of all public updates on Twitter; please see above for more information on the forthcoming "firehose" solution.

and also see: Streaming API Documentation

Adrian Archer
Right.. but.. the algorithm?
Bluu
A: 

There was a company offering a dump of the social graph, but it was taken down and no longer available. As you already realized - it is kind of hard, as it is changing all the time.

I would recommend checking out their social_graph api methods as they give the most info with the least API calls.

arikfr