bulk

Perform conditional bulk update in Linq to SQL

I have a SQL table that stores photos with a smallint SortOrder field. Users can insert new photos, specifying a decimal sort order to place the new record between 2 existing photos (or before the first photo). The SortOrder will be stored as a smallint, so when I detect that an insertion will shift existing records, I need to update a...

Python .flv media file conversion

I'm looking for a library similar to FFDshow to help me convert .flv to .avi format and possibly do more. I understand that I can do this via VLC player, but I'd rather do it manually with Python (and in bulk). Similar to: http://stackoverflow.com/questions/1233685/media-conversion-library-plugin-preferably-php http://stackoverflow.com/...

Better way to send bulk mail using PHP without PEAR Mail and 'mail' function

What script, class or function you use to send many emails, excluding the in-built 'mail' function and excluding the PEAR Mail (many problems and compatibility issues in PHP 5.3). I want to send about 5000 emails per 'shot', but 'mail' function connect and disconnect for each email. PEAR Mail have many problems. I've tried Swiftmailer,...

Bulk insert from datatable in to Oracle using Oracle.DataAccess & VB.net

I am reading a csv file in to a datatable in vb.net and making a few checks and appending an extra column. I then want to perform a bulk insert using microsofts Oracle.DataAccess (no choice in this) to an Oracle database. what would be the best way to perform this as there is no bulkImport like in SQLserver. thanks ...

Does anyone know of a good free bulk upload tool for web apps?

I have a web application in which a user has to upload images to a gallery. At the moment they need to upload one image at a time so it's pretty tedious. I'd like to implement a system where they could potentially drag and drop files into the browser, or select a folder to upload. Any ideas? Thanks in advance! (By the way; it's a .Ne...

SSIS - Bulk Update at Database Field Level

Hello, Here's our mission: Receive files from clients. Each file contains anywhere from 1 to 1,000,000 records. Records are loaded to a staging area and business-rule validation is applied. Valid records are then pumped into an OLTP database in a batch fashion, with the following rules: If record does not exist (we have a key, so th...

Is the time cost constant when bulk inserting data into an indexed table?

I have created an archive table which will store data for selecting only. Daily there will be a program to transfer a batch of records into the archive table. There are several columns which are indexed; while others are not. I am concerned with time cost per batch insertion: - 1st batch insertion: N1 - 2nd batch insertion: N2 - 3rd b...

The Best solution to sending emails to group members in a social network.

I'm developing a social network in php. There is a feature to create custom groups by members and i want to enable the owner of the group to send emails in bulk to all group members. And most importantly i want to make sure that most mails are not going to end up in users' SPAM list. I'm using PHPMailer in my website What should be ...

How to create the automatic mass form submitter script to be used on the 3rd part websites, where I know their fields names-values ?

I need a script that can handle the following tasks. Take user data from my database and fill in and submit / post data to forms located on third part websites.: So I want to know if is it hard to create or do somebody knows if does exists some script for mass form submissions in PHP -Javascript-Ajax ? I run Dancers & Hostess & Model j...

How to finish a broken data upload to the production Google App Engine server?

I was uploading the data to App Engine (not dev server) through loader class and remote api, and I hit the quota in the middle of a CSV file. Based on logs and progress sqllite db, how can I select remaining portion of data to be uploaded? Going through tens of records to determine which was and which was not transfered, is not appealin...

Mysql bulk delete problem

Hello, Anybody can help me with this mysql query: delete from generic__campaings_included where dealer_id not in ('2,3,4') and campaing_id = '1' When i execute this query i didnt get normal result. Exceot 2 (dealer_id) all rows deleted. How can i use "not in" with "and" operator? PS. Sorry for my english) ...

Bulk Copy from one server to another

I've one situation where I need to copy part of the data from one server to another. The table schema are exactly same. I need to move partial data from the source, which may or may not be available in the destination table. The solution I'm thinking is, use bcp to export data to a text(or .dat) file and then take that file to the destin...

Getting past Salesforce trigger governors

I'm trying to write an "after update" trigger that does a batch update on all child records of the record that has just been updated. This needs to be able to handle 15k+ child records at a time. Unfortunately, the limit appears to be 100, which is so far below my needs it's not even close to acceptable. I haven't tried splitting the rec...

Update table instantly or “Bulk” Update in database later? And is it advisable?

Hi, I have a question regarding a semi-constant update in a database. In short it is regarding a checkout function on a web page, which each time the checkout function is evoked it do five steps. I want to try to optimize this function and have my eye on a step where I update a table each time the checkout is performed. I take the info...

How can I change column length using HQL query?

I tried session.createSQLQuery("ALTER TABLE People MODIFY address VARCHAR(1000);").executeUpdate(); but this throws org.hibernate.exception.SQLGrammarException: could not execute native bulk manipulation query After a lot of googling, the recommendation is to use HQL instead of SQL query to do bulk updates. Not sure how to use HQL to a...

Sending Bulk Emails using PHP

Hi All I have to send mails to all users in the site when a new user joins. My problem is the script stops execution after sending around 400 mails. I have set the set_time_limit to 0. And also I am giving sleep(2) after sending 10 mails. What may be the reason behind this issue.Any solution for this problem . Is there any better metho...

How to insert bulk data into mysql table from asp.net at once.

Hi, I have a requirement that I need to read an excel sheet using asp.net/C# and insert all the records into mysql table.The excel sheet consists of around 2000 rows and 50 columns. Currently,upon reading the excel records ,I am inserting the records one by one using a prepare statement into mysql table.But its taking around 70 secs to ...

Bulk data load in to a work flow engine?

Hi, So we are using a workflow management tool(BPM tool). each activity has a bunch of data elements and certain javascript stuff etc. So my question is, how can I automate a process which would intern use this work flow engine(mainly human tasks/activities) and fill out the data that we have and continue. My first thought was to use ...

Deadlock in SQL Server 2005! Two real-time bulk upserts are fighting. WHY?

Here's the scenario: I've got a table called MarketDataCurrent (MDC) that has live updating stock prices. I've got one process called 'LiveFeed' which reads prices streaming from the wire, queues up inserts, and uses a 'bulk upload to temp table then insert/update to MDC table.' (BulkUpsert) I've got another process which then rea...

Bulk adding items

Present Scenario, A custom page where complaints being logged by any authenticated users are added as items to a SharePoint lists. Whenever new complaints are logged a unique reference number gets generated and the new item will get added in the one of the SharePoint lists. Each item has few columns like, the category of the complaint ...