pipes-filters

How do you implement Pipes and Filters pattern with LinqToSQL/Entity Framework/NHibernate?

While building by DAL Repository, I stumbled upon a concept called Pipes and Filters. I read about it here, here and saw a screencast from here. I am still not sure how to go about implementing this pattern. Theoretically all sounds good , but how do we really implement this in an enterprise scenario? I will appreciate, if you have any ...

Buffering filtering pipe on Linux

I commonly build up long, multi-command pipes on Linux/Unix to process large text files (sed | grep | sort | less , etc.). I would like to be able to use a pipeline element that would buffer everything received via stdin until a key phrase/string is detected (e.g. "SUCCESS"), at which point it releases everything received up to that poi...

ASP.NET MVC with Pipes & Filters Pattern. Benefits ?

Hi everyone, I'm just about to start a new project on ASP.NET MVC using LINQ to SQL for ORM. So, I have read and watched various tutorials about best practices and I wonder: What is the benefit on using the pattern Pipes&Filters in my model (have in mind, I intend to use LINQ to SQL). Why just not use repository pattern in the model for...

What are the blocking issues when sending large amounts of data down a pipe using proc_open

Hi, I'm using proc_open to run a filter on some output from a database, potentially a large number of lines. Do I need to handle the potential for blocking specially, i.e. is it likely that sending a large chunk of data to the filter and not reading from it's stdout will cause it to block it's stdin, preventing my script from writing un...

How can i Batch the outputs of a step in pipe and filters pattern using Java and execute subsequent steps?

Basically, i have a series of steps that are processed using the pipes-filter pattern using the typical form: public interface IOperation<IN, OUT> { Iterator<OUT> execute(Iterator<IN> input); } So if i have a pipeline with steps X->Y->Z. I want to be able to batch the outputs of filter X and execute all subsequent steps Y and Z (...

Comparison of Specification Pattern, Func<T,bool> Predicates and Pipes & Filters

Hi Guys, I'm doing some R&D work, and as such am exploring design patterns. I have recently been reading up on the Specification pattern and was referred to this great article. I was intrigued by the simplicity and cleanliness of the code, but i started to draw some comparisons to implementing the same cleanliness using other techniq...