Twitter app development best practices?

Question

Let's imagine app which is not just another way to post tweets, but something like aggregator and need to store/have access to tweets posted throught.

Since twitter added a limit for API calls, app should/may use some cache, then it should periodically check if tweet was not deleted etc.

How do you manage limits? How do you think good trafficed apps live while not whitelistted?

Answer 1

To name a few.

• Aggressive caching. Don't call out to the API unless you have to.
  • I generally pull down as much data as I can upfront and store it somewhere. Then I operate off the local store until it runs out and needs to be refreshed.
• Avoid doing things in real time. Queue up requests and make them on a timer.
  • If you're on Linux, cronjobs are the easiest way to do this.
• Combine requests as much as possible.