ssis

Row yielded no match during lookup SSIS LookUp Issue

I keep getting the error message Error: 0xC020901E at Data Flow Task, Lookup ProjectId [580]: Row yielded no match during lookup. Error: 0xC0047072 at Data Flow Task, DTS.Pipeline: No object exists with the ID 880. It does not reoccur in the same spot rather in different places each run. Even when everything is exactly th...

ValidateExternalMetadata property, what exactly does this do?

I have a package which reads data from a table and based on a column value stores the records in two other tables. Package uses Transaction required property. It was running smooth until recently when I created a non-clustered index on source table to improve performance. The package denies to proceed execution after showing the Progress...

SSIS data import in asp.net

Hi, In my project I have import data from CSV file using SSIS package in asp.net environment. The CSV file contains Header section and details section. The Header section will contains the summary of the details section. The details section contains the records of the item sold by the company. The header will contains the total number o...

Changing order of selects in stored proc affects SSIS hang issue

I am using an OLEDB source to call a stored proc to grab a set of rows each marked with either I U or D by doing a UNION between three SELECT statements in a stored procedure. A is a table populated with data brought over from a legacy system every night. B is our system's data we want to keep updated with the legacy system's data. SET...

ssis - INSERT variable values into a table

I have several variables in an SSIS package that I would like inserting into a table. example:- @financialMonth, @Status, @Comments The Variables have been populated along the way with values based on lookups, filename, dates, etc, and I want to store them in a results table. Is using the execute SQL task the way to do this ? Do I ...

SSIS - Multiple table insert

Hi, I am copying data from MS Access to SQL Server using SSIS. Only one time I am gonna copy, it is not repeated task. There is only one source table(Table_Source). I want to insert data into two tables (Table1 and Table2). Table1 contains a primary key which is a identity column. After inserting into table1, I need to get the ident...

Framework for loading flat files into SQL Server

Hello, I have to import flat files into SQL Server. So far, I've used SSIS packages and Delphi programs to do the job but I'm getting more and more files to load. Many are very wide (more than 90 fields) and they all have their own specifics: some are fixed-width, some are delimited with a wide set of characters used as field and row de...

Using SSIS 2008 to migrate data into Microsoft Dynamics CRM

I've recently been toying with data migration into Microsoft Dynamics CRM using MS SQL Server Integration Services. First, the basic problem domain: I have an exported flat file from a previous homebrew CRM system, the goal is to efficiently cleanup the data, and then to move the data over into Dynamics CRM. I've decided to put in one e...

Derived Column Task

What is the purpose of Derived Column Task ? ...

Merge and Merge Join Task

What are the purpose for Merge and Merge join Tasks in Data Flow ? ...

DateTime Conversion to Date

I wanted to convert DateTime data which will be pulled from source, to Date format only or I want to retrieve only Date with no time. How is it to be done here ? Also how is to be done for converting the Datetime data for a customised format while pulling from the source ? ...

Text Qualifier in flat file connection

Hi All, I have business scenario as source files (text files) comes to load into SQL database so I used the flat file connection manager as normal process. My requirement as, we are getting source files with qualifier (") so we used the text qualifier property in the connection manager. For the same set of files we are getting withou...

update the destination table

I want to pull data from an source destination. How can I insert rows that are not already in the table and update rows that already exist ? ...

Calling C# Assembly from SSIS Script Task

I've found this articles (liks below) but method which is described in those articles doesn't work for DLL which was compiled with target framework 4.0! Articles: http://oassaf.wordpress.com/2007/05/24/calling-c-assembly-from-ssis-script-task/ http://www.codeproject.com/KB/database/SSIS_Call.aspx http://blogs.msdn.com/b/michen/archive/2...

SSIS - when a connection is down

Hi. I've got a simple SSIS package that I edit in VS2008. What is basically does is run the same SQL StoredProc, residing in different SQL servers, and aggregating their output into a flat file. Simply put, four OLE DB Data Source going to a 'Union All' to output. If one of the servers is down, how can I make the package skip the valid...

Deadlock on logging variable value changes using a SQL task

Morning I've been reading "SQL Server 2008 Integration Services Problem - Design - Solution". It outlines a way of logging variable changes which I'm trying to replicate in SQL 2005. Create variables e.g. PackageId, RecordsAffected. - Set Raise ChangeEvent to true. Create a string variable g.g. strVariableValue. - Set Raise ChangeEve...

SQL Server Integration Services - Incremental data load hash comparison

Using SQL Server Integration Services (SSIS) to perform incremental data load, comparing a hash of to-be-imported and existing row data. I am using this: http://ssismhash.codeplex.com/ to create the SHA512 hash for comparison. When trying to compare data import hash and existing hash from database using a Conditional Split task (expres...

SSIS DTEXEC Package Variable Space Not Accepted

I'm attempting to execute an SSIS package on SQL 2005 using the following: dtexec /SQL "\MyPackageName" /SERVER mssql1 /MAXCONCURRENT " -1 " /CHECKPOINTING OFF /SET "\Package.Variables[FileFolder].Value";"\\SomeServer\Someshare\Output Batch\" this yields: Option "Batch " is not valid. The space at the end of the word Batch inside ...

Best approach to build reusable C# data integration assemblies

How have you addressed the issues when building a reuseable suite of C# data integration assemblies? We're a Microsoft shop using Sql Server and C#. We're consolidating a lot of our DB integration code into C# assemblies. In doing so we're hitting a number of common problems. 1) We like the source/destination flexibility of SSIS and th...

Split function in SSIS Expression

Hello All, I got a column values as '035-7448-001-3854535' In SSIS - Data Flow i need to split this into three different components as **Col1 Col2 Col3** 035 7448-001 3854535 this can be done using script component. Is there a way to deal with this in Derived Column Comp...