I have a windows console application that queries a single database and creates flat files of the data for another external system. I will use Task Scheduler to execute a batch that will start this data export. Each query is retrieving a few hundred thousand rows of data (200k+). What is the best way to make my application scalable so that we can optimize performance? Threads? Multiple Instances?
Thanks for any suggestions