I've noticed the following behavior. I have a file that is about 3MB containing several thousand rows. In the rows I split and create prepared statement (about 250 000 statements). What I do is: preparedStatement addBatch do for every 200 rows { executeBatch clearBatch(). } at the end commit() The memory usage will increase to ...
I'm writing an application using Python that adds videos to a user's playlist on Youtube. Doing this one at a time causes Youtube to start throttling my requests. There is a batch processing API that allows you to submit 50 requests at once, but I can't find out from the docs how to submit a batch processing request. The only informatio...
I need to export big amount of data from database. Here is classes that represents my data: public class Product{ ... @OneToMany @JoinColumn(name = "product_id") @Cascade({SAVE_UPDATE, DELETE_ORPHAN}) List<ProductHtmlSource> htmlSources = new ArrayList<ProductHtmlSource>(); ... } ProductHtmlSource - contains big s...
Right, I have a photoshop PSD file, a spreadsheet filled with custom data and a folder full of images. I want a way to create a unique image for each entry in the spreadsheet, where the spread sheet contains data that must populate text elements in the PSD, and references an image which needs to be pasted in to photoshop. I would normal...
We have a weblogic batch application which processes multiple requests from consumers at the same time. We use log4j for logging puposes. Right now we log into a single log file for multiple requests. It becomes tedious to debug an issue for a given request as for all requests the logs are in a single file. So plan is to have one log f...
I have a few questions related to batch insert in Spring. When I do something like that: public void save(Car car) { String sql1 = "insert into Car values (1, 'toyota')"; String sql2 = "insert into Car values (2, 'chrysler')"; String sql3 = "insert into Car values (3, 'infinity')"; String[] tab = new String[2]; tab[0] = sql1;...
Hi all, I have to do batch processing to automate business process. I have to poll directory at regular interval to detect new files and do processing. While old files is being processed, new files can come in. For now, I use quartz scheduler and thread synchronization to ensure that only one thread can process files. Part of the code ...
I recently found that LINQPad can execute shell commands. Can someone show me an example how to use LINQPad queries to execute batch job? ...
I have a number of .sql files which I have to run in order to apply changes made by other developers on an SQL Server 2005 database. The files are named according to the following pattern: 0001 - abc.sql 0002 - abcef.sql 0003 - abc.sql ... Is there a way to run all of them in one go? ...
Can every body tell me by simple answer where & what i can create a batch process for ordinary operations such saving, changing file properties and so... ...
Our team needs to insert a cruel amount of data into our SQL Server 2008 database. We're looking for a good solution. Now we came up with one, but I have doubts with it, simply because it doesn't feel right. So I'm asking here if this seems like a good solution. Extra challange is that it's a peer-to-peer replicated database over 4 serve...
How do I write a batch process on the Mac for pdf2swf, I want to convert all pdfs in a folder into swf. But pdf2swf doesn't have a option to convert a folder of pdfs to swfs, you have to do it one at a time. I'm not sure how if I should use a Apple script or a Shell script, either one I'm not sure how to get or assign a file name variabl...
I have a batch file, 'buildAll.bat', that builds a set of projects. It will be called by another batch file, 'manager.bat'. The 'buildAll.bat' job executes in another window and outputs a lot of text. I want the progress of the build job to be displayed in the original window('manager.bat'), like this: Building project 1...done. Buildi...
I am trying to execute some queries using YQL. To gain some efficiency, I am thinking of executing them in batches. My queries are in a text file, each in one line. My (Java)program currently reads each query from one line and creates YQL query and executes it. I want this to be done in a batch of 10 or more. I could not find any exampl...
Is it possible to unzip .ZIP file using .BAT command on Windows XP? we have file.zip how to create a .BAT commands file to unzip\unpack it to some folder. USING ONLY NATIVE WINDOWS XP programms and commands. So.. How to do such thing? (code example, please) ...
So I am starting a consol programm from .bat file. I want it to run as a process but not showing any windows. How to do such thing? ...
Hi, I have over 1300 .txt files where I need to edit the first line of text, replacing one name for another. Can someone please advise of the best way to achieve this? Any advice would be appreciated. Thanks Stu ...
I'm using ruby on rails 2.3.8 and I'm kind of knew at this technology. I'm using Windows 7, but I'm planning to hire a Linux hosting soon. I'd like to know how to build processes that runs every night for things such as: checking stuff in the db, update values, send newsletter emails, etc. ...
I want to make a .bat to copy & rename a file multiple times. I want to have a list of names, and an original file, then I want to copy that file and rename it for each name on the list. How I can do this using a .bat file? Also is it possible to run winrar fromthe .bat to .rar or .zip every file after copying/renaming? Example: $fi...
Hi, I am new to CICS. I have one query, Can we trigger Batch job thorough CICS transaction? I want to trigger a batch job through program which is executed by CICS transaction,is it possible? ...