Hi all,
I am looking for a generic way to load flat/text files (txt/csv) into a database table in a .Net application.
So far I know that... 1) I could MSSQL BCP - but that's MS SQL Server only 2) Use the JET engine to access flat files (pain with schema.ini file etc. as file names frequently vary) 3) Load txt/csv file into a .Net array and process it line by line (too much effort, performance?)
I am looking for a generic solution, i.e. that does not depend on a specific RDBMS. I also could develop my own loading/processing solution (#3) but why should I reinvent the wheel?
The solution should also have a good performance as the files that I am going to load are huge (>250MB, >1.5M rows).
Any suggestion?
TIA, Levend.