integration-services

Changing multiple SSIS Packages in an Automated way

Background: I have about 170 SSIS packages. A new requirement is that users from other workstations can run them from their command lines using dtexec. Question: To make this possible I'd like to set change the protection level to encrypt sensitive with password, and change the password in each package. Is there a way to automate th...

Execute SQL Task error -

I get the following error when I call a stored proc within an execute sql task in SSIS. "Description: Executing the query "Exec up_CallXXX" failed with the following error: "Incorrect syntax near '13'.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection ...

Using log4net as a logging mechanism for SSIS?

Does anyone know if it is possible to do logging in SSIS (SQL Server Integration Services) via log4net? If so, any pointers and pitfalls to be aware of? How's the deployment story? I know the best solution to my problem is to not use SSIS. The reality is that as much as I hate this POS technology, the company I work with encourages the...

cant start SSIS service on sql server 2008

Hello, In Sql Server Configuration Manager I Sql Server Integration Services has status stopped, when I try to start it aftger few seconds there is an error message: The request failed or the server did not respond in a timely fashion. Where the problme can be ? ...

Can't install Server tools with SSIS on top of Express Edition

I have a SQL Server Express edition with management studio and i'm trying to use the enterprise disks ("SQL Server 2005" Enterprise Edition 32-bit Server Applications") and I can't get it to give me the option of installing the server components or a server instance. What am I missing? ...

SQL Server: export data via SQL query?

I have FK and PK all over my db and table data needs to be specified in a certain order or else I get FK/PK insertion errors. I'm tired of executing the wizard again and again to transfer data one table at a time. In the SQL Server export data wizard there is an option to "Write a query to specify the data to transfer". I'd like to writ...

SSIS 2005 - How to Import a Fixed Width Flat File?

I have a flat file that looks something like this: junk I don't care about \n \n columns names\n val1 val2 val3\n val1 val2 val3\n columns names \n val1 val2 val3\n I only care the lines with values. These value lines are all fixed width format and have the same line length. The other junk lines and column names c...

Avoid writing SQL queries altogether in SSIS

Working on a Data Warehouse project, the guy that gave us the tutorial advised that we stick to using SQL queries over defining a lot of data flow transformations, citing points like it'll consume a lot of memory on the ETL box so we'd rather leave the processing to the DB box. Is this really advisable? Where's the balance between relyin...

Return dataset in dataflow

Hi All, Could I get ideas on retrieving the dataset using lookup method. Basically, my scenario as I have source data needs to lookup for other source table and on matching column from source I need to get all the records from other source data. its a one to many relations. I tried Lookup but gives only one record on matching condition...

SSIS Lookup component only returns matching rows when using partial mode

I am attempting to use a lookup transformation in my data transformation package and all of the other lookup transformations went well but one component returns the matching rows only when I enable the partial cache mode. If I use the full cache mode, all data is routed to the error path. I am using SQL 2005 SSIS. Any help appreciated.. ...

SSIS Runs Okay Individual Tasks, Not Together

I have a simple SSIS Project. In the control flow I have three steps: Step 1: Select Data from Db1.Table1 Step 2: Create Table2 in Db2 Step 3: Copy Data in Db1.Table1 to Db2.Table2 If I "Execute Task" one by one in order, it executes fine...but if I try running the entire project I receive the following error: Error a...

Abort processing of Row in ProcessInputRow method?

Is it possible to abort the processing of a row in the ProcessInputRow method? I'm doing some data validations with the incoming CSV data in this function. I'm setting the row values in a sub. If an error occurs i'll catch it in the ProcessInputRow and start writing the data into a staging table for a later approval. Everthing works fine...

SSIS Creating Two Columns of Data in Flat File?

I'm having a strange problem with SSIS. I'm exporting some data from a database into a flat file. It comes out all fine - except that rather than displaying the data like this: ID FirstName LastName Age It comes out like this: ID FirstName LastName Age ID1 FirstName1 LastName1 Age1 Now, its not repeating the same da...

how to import flat file source to database using sql

hi. im currently want to inport my data from flat file to the database. the flat file is in a txt file. in that txt file, i save a list of URLs. example: http://www.mimi.com/Hotels-g303188-Rurrenabaque-Hotels.html im using the SQL Server Import and Export wizard to do it. but when the time of execution, it has error saying Error 0xc...

Changing order of selects in stored proc affects SSIS hang issue

I am using an OLEDB source to call a stored proc to grab a set of rows each marked with either I U or D by doing a UNION between three SELECT statements in a stored procedure. A is a table populated with data brought over from a legacy system every night. B is our system's data we want to keep updated with the legacy system's data. SET...

Integration Service: Best Way to Compare Two Tables to Retreive Missing Keys For Use In Later Decisions

I am currently trying to develop a SSIS Package and am lost because I am a no0b. I have two tables, one is updated and one needs to be updated. I need to compare these two tables and find the primary keys that have been added to the first table and that are not present in the second table. I need these primary keys in the next set of qu...

Extracting Data Client Side

I need to be able to extract and transform data from a data source on a client machine and ship it off via a web service call to be loaded into our data store. I would love to be able leverage SSIS but the Sql Server licensing agreement is preventing me from installing Integration Services on a client machine. Can I just provide the clie...

Execute SQL Task on SSIS 2005. ADO.NET connection type and Stored Procedure Input Parameter. Not working. Syntax error

I am Execute SQL Task on SSIS 2005. ADO.NET connection type and Stored Procedure Input Parameter. Not working. Syntax error I read some documentation and blogs but its not working for me. This is what I have on SQL Statement of the Exeute sql task (ADO.NET) EXEC StoredProcedureName @ParameterName = It gives different errors on d...

SQL Server Integration Services tutorial for AdventureWorks > AdventureWorksDW export

Hello guys, I'm getting started with building a Business Intelligence system using MS technologies. I don't have any experience with Integration Services or with Analysis Services, so the learning curve is pretty steep for me. I have been looking for samples and tutorials and found some nice stuff such as: The AdventureWorksDW data w...

SSIS 2005 - Ignore row insert failures

Hi, I would like to ignore the errors that may occur when a batch is commited. In my case, unique columns. The OLE DB Destination Error Output is set to "Ignore failure" but it is still failling. The Data Flow "stop on failure properties" are set to false and the MaximumErrorCount to 0. I don't want to do row redirection to be able to...