I'm looking at the architecture for a DW project and there will be the need for some manual collection of [structured] data eg the monthly accounting results from a country manager where they need to complete a form and fill in half a dozen values etc. I really like the idea of using SP and InfoPath for this as it gives the security, th...
I am working on a data warehouse and looking for an ETL solution that uses Python. I have played with SnapLogic as an ETL, but I was wondering if there were any other solutions out there. This data warehouse is just getting started. Ihave not brought any data over yet. It will easily be over 100 gigs with the initial subset of data I wa...
Greetings, I've taken over from a prior team and writing ETL jobs which process csv files. I use a combination of shell scripts and perl on ubuntu. The csv files are huge; they arrive as zipped archives. Unzipped, many are more than 30Gb - yes, that's a G Legacy process is a batch job running on cron that unzips each file entirely, rea...
I'm trying to integrate LimeSurvey (a PHP web application to develop and collect responses to online surveys) with Pentaho (ETL, business intelligence, reporting, etc.), but I'm facing some serious problems. LimeSurvey automatically generates a new table for storing the answers of each survey created within my application, and I need to...
i am inserting values like '$5.99' (or trying to insert) into a money field. it doesnt like the dollars sign i am actually doing a bulk insert from a csv file. one of the columns in the csv file has money in it with a dollar sign can you please help me figure out how to do this bulk insert with the $ sign into a money field? Msg 4864,...
I'm writing a report and thought you guys could help by providing me with the costs of company support in setting up and training a client on a data integrator for Salesforce. E.g., if someone wants to use Salesforce, but first needs a tool to consolidate and transfer data from back office systems to Salesforce how much would that suppor...
In 5 days I'm going to ETL interview. It's my first interview on this subject. What question would I be asked? Most likely they will be about MS SQL Server Integration Service. If possible, provide the answers. =) ...
I want to take DB2 DBA certification and also want to learn Data-Warehousing and Business Intelligence. I want to know: (1) Whether DB2 DBA certification is demanding or not. I am a .NET developer since last three years and IT experience is even more. I worked on Oracle, MySQL, SQL Server and used DB2 also for some applications. For suc...
Here's an interesting problem. I have an ETL script written in c# that I have been running manually on a somewhat regular basis. It is used to update my web app's database. I want to automate the ETL process AND create an interface for the web app admins to manually start the ETL process. I could have sql server kick off the ETL proce...