ansaurus

Question

Answer 1

A:

It is hard to tell, but it would be interesting to see what connections were active when it bombed... maybe it is spawning multiple somehow...

However; for transferring mass data, I would usually recommend either just a stored procedure (if the processing can be done in the database) - or if you need richer code, something like SqlBulkCopy hooked to an IDataReader - this will allow you to stream data from one table to the other with the minimum of buffering / overhead.

Representing an arbitrary data-source as an IDataReader (to feed to SqlBulkCopy) is a pain, but you can use SimpleDataReader for this. You would also use ExecuteReader on the source SqlCommand to consume the data from origin.

Marc Gravell 2009-05-02 08:58:29

The calculations I need to do can't unfortunately be done in a stored procedure.

Dofs 2009-05-02 09:04:22

I might try the SqlBulkCopy, but just thought that the entity framework could do it, since it is only 100k rows.

Dofs 2009-05-02 09:06:40

Answer 2

+1 A:

I move data from one table to another on the same database (some simple calculations are done)

I'm not sure why you're not just doing:

insert into destination_table( a, c, f, m, n, p)
select a, b, c, d + e, f * c + .1 * b, g || h 
from source_table
where some_predicate;

That is, including all your calculations in the select.

tpdi 2009-05-02 09:05:51

Some of the calculations could be done in SP, but I among others have a string containing a car e.g. Audi 100, and I need to find the corrosponding ID in a table which contains the different definitions (table containing: id, car, model). Which is much easier to do with the entity framework and linq. Is this doable in an easy way in a SP?

Dofs 2009-05-02 09:12:06

a subselect or a join: select a.*, (select id from cartable b where model = a.model) from source_table, or select a.*, b.id from source-table a left outer join cartable b on (a.something = b.model)

tpdi 2009-05-02 10:11:59

Dofs 2009-05-02 13:43:17

ansaurus

tags:

views:

answers:

SQL and entity framework

related questions