dataflow

Does this language feature already exist?

I'm currently developing a new language for programming in a continuous environment (compare it to electrical engineering), and I've got some ideas on a certain language construction. Let me explain the feature by explanation and then by definition: x = a U b; Where x is a variable and a and b are other variables (or static values). ...

How to deal with alias registers in data-flow analysis using SSA form? (e.g. EAX/AX/AH/AL in x86)

For exmaple: How to represent the following x86 in SSA form: xor eax, eax inc ax By introducing some pseudo functions, I come up with: eax@1 = eax@0 ^ eax@0 ax@1 = LOWORD(eax@1) al@1 = LOBYTE(ax@1) ah@1 = HIBYTE(ax@1) hax@1 = HIWORD(eax@1) ax@2 = ax@1 + 1 eax@2 = MAKEDWORD(ax@2, HIWORD(eax@1)) al@2 = LOBYTE(ax@2) ah@2 = HIBYTE(a...

Techniques for modeling a dynamic dataflow with Java concurrency API

Is there an elegant way to model a dynamic dataflow in Java? By dataflow, I mean there are various types of tasks, and these tasks can be "connected" arbitrarily, such that when a task finishes, successor tasks are executed in parallel using the finished tasks output as input, or when multiple tasks finish, their output is aggregated in ...

How do I get SSIS Data Flow to put '0.00' in a flat file?

I have an SSIS package with a Data Flow that takes an ADO.NET data source (just a small table), executes a select * query, and outputs the query results to a flat file (I've also tried just pulling the whole table and not using a SQL select). The problem is that the data source pulls a column that is a Money datatype, and if the value i...

What is a good motivating example for dataflow concurrency?

I understand the basics of dataflow programming and have encountered it a bit in Clojure APIs, talks from Jonas Boner, GPars in Groovy, etc. I know it's prevalent in languages like Io (although I have not studied Io). What I am missing is a compelling reason to care about dataflow as a paradigm when building a concurrent program. Wh...

Process results of conditional split in SSIS

I have a Data Flow Task and am connecting to a database via an OLE DB Source component to extract data. This data feeds into a Conditional Split component to separate the data based on a simple expression. After the evaluation of this expression, the data will end up in either of two locations: LocationA or LocationB. Alright, I have ...

Library for Dataflow in C

How can I do dataflow (pipes and filters, stream processing, flow based) in C? And not with UNIX pipes. I recently came across stream.py. Streams are iterables with a pipelining mechanism to enable data-flow programming and easy parallelization. The idea is to take the output of a function that turns an iterable into another it...

slow category import in magento

Hi I wrote a custom adapter for importing 6K categories using the advanced profiles. The import is too slow. I've tried increasing the number of records from 1 to 5 but it doesn't help. I also tried using ->setDisplayMode($dispMode) and ->setIsMassupdate(true) before saving the category but it also doesn't help. Any idea how to speed t...

export products to csv from the admin product grid

Hi, The import products profile allows you to filter which products to export by name, sku... I want to have the same functionality in the manage products page. The admin will filter products in the grid and then click a "export" button to get the filtered products. How can I add the "export" button? what template/block do I need to ov...

Magento - Module VS Dataflow

Magento - Module VS Dataflow I am consider the possibility of ---- using Magento DataFlow to extract information from db to tie in with a video CMS. It could save development time - or it might not. It could be more stable - or it might not. The question becomes is it better to tightly integrate the video system to magneto as module...

Pluggable vector processing units in Clojure

I'm developing some simulation software in Clojure that will need to process lots of vector data (basically originating as offsets into arrays of Java floats, length typically in 10-10000 range). Large numbers of these vectors will need to go through various processing steps - e.g. normalising the vectors, concatenating together two stre...