aggregators

How do craigslist mashups get data?

I'm doing some research work into content aggregators, and I'm curious how some of the current craigslist aggregators get data into their mashups. For example, www.housingmaps.com and the now closed www.chicagocrime.org If there is a URL that can be used for reference, that would be perfect! ...

Is there a service that can take a feed and produce a daily digest from it?

I run a feed aggregator (http://planetdb2.com/) and I need to aggregate both prolific (many posts a day) and less prolific (one post a day at most) feeds. Creating a daily digest -- one post summary of the day's posts -- seems like the best solution. There's a way to create a daily digest just for Twitter feeds via Yahoo Pipes, but it...

Drupal Aggregator input format

Drupal Aggregator core module is a useful one but suffers many problems. There are many talking about improving it in Drupal 7. Right now I'm using Aggregator module which comes with Drupal 6. I'm building an aggregation site, and there is one BIG problem. Sometimes feeds contain HTML tags attributes (e.g. style, dir, title), but Aggreg...

Yahoo Pipes, configure a pipe at runtime with as many URLs as needed

Hi there, I'm having trouble to do something that I though it would be a 5 minutes thing. I want to create a Pipe that accepts at runtime as many URLs as needed. I know how I can combine many URLs within the editor, but I want a Pipe that anybody can configure to their needs. I thought I could use the URL Input module within a Loop, ...

Best practices for developing a feed aggregator / proxy?

I'm looking into writing a proxy aggregator for feeds, where a handful of users specify a feed URL and some set of conditions, and the system outputs a continually-updated RSS/Atom feed of entries that match those conditions. Are there best practices for feed aggregators? (Or filtering feed proxies?) For example: Are there certain fe...

Drupal - How can I use CCK to keep a local node copy of Aggregator items?

Hey, I received an learning project from my brother that includes: Create a Drupal site that employs Aggregator, CCK, and Views modules in the following way: Aggregator will fetch an RSS feed from an arbitrary source Views will allow you to create excerpts from the Aggregator materials, as well as links to orignal articles Determine i...

Which language is best for this editoral and op-ed aggregator project?

I'm looking for an aggregator for the editoral and op-ed pages of a bunch of English language newspapers I want to follow. The objective is to generate an HTML that is just a collection of editorial pieces from the dozen newspapers I want to follow internationally, so that I can print them off in the morning. Since this is a very narrow...

Is there a good .NET version of DelphiFeeds.com?

Delphifeeds.com aggregates a large number of Delphi-related feeds that include both the official feeds from Embarcadero and independent bloggers from the community. I am looking for a similar thing for .NET and C# in particular. I am aware of course of the official Microsoft feeds, but I can't find a good repository of unaffiliated and t...

SQL Pivot MIN( COUNT (

I have a complicated MS SQL 2005 query with a PIVOT in it... I have data like this : Data ( clients left join visits ): ClientID VisitID ServiceID 1 34 5 1 36 2 1 36 5 1 45 2 1 48 2 1 60 2 2 44 1 3 48 2 3 78 3 3 79 2 ...

When using Aggregate objects do you use custom collections for the associations or not ?

For example is it better to have: public class Case : EntityIdentifiable { public Jobs Jobs { get; set; } public Vehicles Vehicles { get; set; } public Locations Locations {get;set;} public IDistances Distances { get; set; } } or public class Case : EntityIdentifiable { public Dictionary<string,Job> { get; set; ...

Twilio - how do they send/receive SMS.

I'm interested to find out how twilio's SMS sending/receiving feature works, on long codes, or local numbers Outside of the states, mobile originated SMS terminated on a long number is very common, however, inside the US I had thought that the MMA required termination on approved shortcodes? Any ideas? Thanks ...

Aggregating from various sources

It could be a project well beyond my skills right now but I've got around one full month to spend on it so I think I can do it. What I want to build is this: Gather news about a specific subject from various sources. Easy, right? Just get the rss feeds and display them on a page. Well, I want something more advanced: Duplicates removed a...

How does a social network aggregator like Aol Lifestream Work?

Hey All, I've been messing around trying to create a social network aggregater for a while and I recently came across http://lifestream.aol.com/ and realized I'm going about it all wrong. For facebook, for example, I was using fql queries and the like to literally pull on a bunch of content and save it into my own databases etc; but th...

Open-source alternatives for price comparison aggregators like google base shopzilla, shopping.com?

Price comparison aggregators like Google Merchant (former Google Base) shopzilla, shopping.com provide a unified interface for e-commerce websites / vendors - which can submit their product listing through a standardized product feed (example). Visitors can then perform a comparison search in one place for all those products from diffe...