batch-processing

Is it stupid to write a large batch processing program entirely in PL/SQL?

I'm starting work on a program which is perhaps most naturally described as a batch of calculations on database tables, and will be executed once a month. All input is in Oracle database tables, and all output will be to Oracle database tables. The program should stay maintainable for many years to come. It seems straight-forward to imp...

Java batch monitoring

We have 50+ Java batch processes that run at different times of the day. They run on a Solaris box, and are started via cron. Currently, the only way we only know if they succeed or fail is by an email generated at the end of each batch process. We have a support team that monitors these emails. Recently, we've had issues with emails...

Batch process images

I have to transform a few hundred images every day in a specific way. I need the best freeware tool or a piece of C# code that supports batch watermarking, resizing of images and can be automated (old configuration can be reused). What tool do you suggest? ...

How to reliably handle files uploaded periodically by an external agent?

It's a very common scenario: some process wants to drop a file on a server every 30 minutes or so. Simple, right? Well, I can think of a bunch of ways this could go wrong. For instance, processing a file may take more or less than 30 minutes, so it's possible for a new file to arrive before I'm done with the previous one. I don't want...

How can I get a batch at a time of all the rows in a sql table?

I have a table with 40 million rows. I want to pick up about 2 million at a time and "process" them. Why? Cos processing processing 10million+ rows degrades performance, and often times out. (I need this to work independant of data size, so i cant just keep increasing the time out limit.) Also, I'm using SQL Server. ...

What is the best character to use as a delimiter in a custom batch syntax?

I've written a little program to download images to different folders from the web. I want to create a quick and dirty batch file syntax and was wondering what the best delimiter would be for the different variables. The variables might include urls, folder paths, filenames and some custom messages. So are there any characters that can...

How to set ERRORLEVEL in SSIS?

I have a batch file that runs an SSIS job. I have no knowledge of how the SSIS job runs, I took over a project involving it. The batch file uses %ERRORLEVEL% to detect errors that occur within the SSIS job. It must be expanded to report other errors too. How do I set the ERRORLEVEL in SSIS? ...

Requested ThreadPool is inactive

While running the batch process in .net Application I am gettting this error "Requested ThreadPool is inactive". I dont know how to resolve. Please help out ...

AutoHotkey??

I am trying to extract the contents of cmd.exe IDE to a text file using autohotkey scripts ie one test.ahk and its written as shown below: WinGetText, text, "C:\WINDOWS\system32\cmd.exe" FileAppend, %text%, C:\ThreePartition\ACTUAL.txt I am not able to extract the contents. Can anyone please suggest the correct way to do the extract...

Batch file doubts

Hi, I have a .bat file shown below in which I want to redirect the whole contents present in my IDE to some text file. D:\WindRiver\wrenv.exe -p vxworks653-2.2.3 run D:\WindRiver\wrenv.exe -p vxworks653-2.2.3>C:\ThreePartition\output.txt PAUSE I am able to just get some partial output i.e I am unable to get the errors which are t...

What is the right solution for a high-availability authorization service?

I work for a software shop, which has an in house predictive dialer product, and we need to implement a solution to obey to the DO-NOT-CALL lists. Basically, I have a database with the customers/prospective customers that I need to call, and another database with the phone numbers I can't call. As the system is a predictive dialer, bas...

Server-side Batch process in a shared hosting enviroment

I'm writing a website that will be hosted on a shared hosting environment. As a consequence, I won't have any access to things such as the task scheduler. The website needs to perform various checks on a half-daily basis. What is the best way of firing these tasks in this scenario? The best two things I could think of where: Fire the ...

How to do long time batch processes in PHP ?

Hi All I have batch process when i need to update my db table, around 100000-500000 rows, from uploaded CVS file. Normally it takes 20-30 minutes, sometimes longer. What is the best way to do ? any good practice on that ? Any suggest would be appreciated Thanks. ...

windows batch programming: how to get the error level of commands in a pipe

Batch files return the error code of the last command by default. Is it somehow possible to return the error code of a former command. Most notably is it possible to return the error code of a command in a pipe? For example, this one-line batch script foo.exe returns the error code of foo. But this one: foo.exe | tee output.txt a...

Subversion Tagging and Security

I have set up an SVN repository from scratch, and I have successfully tagged some of my releases using the SVN copy command. I used the SSPI auth plugin for apache, so our developers just hit the server with their network credentials, and everything works nicely. I have created an AuthZ authorization file, added our developers to group...

Sybase stored proc called from isql on AIX: how to handle return code

I've got an AIX batch job that uses isql to execute a stored procedure in Sybase. The stored procedure is returning an error code under certain conditions. I would like for isql to pass that return code to the AIX script. Can I capture the the stored proc's return code within isql, or do I have to write an output file of some kind and h...

Saving 1000+ records to the database at a time

I'm using NHibernate currently. I have a situation where I need to save a bunch of records to the database like this: var relatedTopics = GetRelatedTopics(topic); foreach (var relatedTopic in relatedTopics /* could be anywhere from 10 - 1000+ */) { var newRelatedTopic = new RelatedTopic { RelatedTopicUrl = relatedTopic, TopicUrl = t...

Adobe Acrobat's "Automate password entry for a batch sequence" help page is WRONG/incomplete.?

On this help page for Adobe Acrobat 9: Automate Password Entry for a Batch Sequence The instructions are wrong. Pasted below: """""""""""""""""" Before you batch process PDFs that are encrypted or password protected, you can set your digital ID to enter the required password automatically. 1 Choose Advanced > Security Settings. 2 Sele...

"make" like scheduling sequences of tasks

The company I work for has lots of "complicated" file based batch processes, with sequences of files such as: take file A fetch file B join fields in file A to file B to make file C run some heuristics on file C to make file D upload file D to server X build a report based on files D and A and mail it to [email protected] Each step m...

Batch Script Install Process

I am planning a procedue to release our software to our customers using an advanced version of an existing procedure which uses windows batch scripts. I am hoping to improve this process and automate the installation of the following items: Files. Files are simply copied to a destination. MSSQL Databases. I guess I'll use the OSQL comm...