Hello my fellow Web Developers. It seems I have been charged with the tall task at my new job of creating an application that would track (on a kind of "super-aggregate basis") a combined aggregate of SEARCH STRINGS (assumedly via Google), SOCIAL MEDIA MENTIONS (Twitter mentions, Facebook mentions, blog mentions,etc), and NEWS POSTINGS (again, I would assume obtained from Google API) for specific strings or groupings of strings [say for "transportation," "commercial bus", "vehicle manufacturing", etc]). I then would need to find a way to grab and actually ACCESS all of this feed data directly, and then look for any buzz words, hot topics, or general POPULAR TRENDS/frequent mentions, as well as an analysis of SENTIMENT (what topics are particularly being liked or disliked from around the Internet). Last of all I would need to establish a kind of leaderboard of the top 5 or 10 most mentioned phrases in the subset of this feed data and what topics are particularly being liked (+) or disliked (-), and the extent of this sentiment. From there, the data would need to be pushed to the end user, possibly in the form of alerts or other graphs or charts.
SOME NOTES/OTHER INFO: SocialMention.com does something quite similar to a majority of what I need this app to do (for example, they have a really awesome "Realtime Buzz Widget" where you can enter in a search string that you might be looking to track, and it generates a JavaScript widget you can embed into a Web page that will display a feed of "social mentions" made of your particular search string from around the blogosphere: They also achieve the "Sentiment" and "Top Keywords" functionality that I need when displaying search results in the lefthand sidebar (ex: http://socialmention.com/search?q=transportation&t=all&btnG=Search)
The problem here though is that there is no way to get a raw, manipulable handle on all the data generated through this feed (since it is being done by a third party, SocialMention.com), as is the case with the feeds generated by Google/Twitter API etc.
The following are some URLs I have been looking at for consultation on developing such an application:
Google AJAX Feeds API:
Google AJAX Search API:
jQuery.getJSON() - jQuery API
Building a Chumby-style feed reader using SJS
Any help or insight that anyone can provide me on this would be very much appreciated :).
Thank you so much,
Kevin Pajak - Interactive Web Developer [email protected]