ansaurus

Question

Problems loading bulk data in mysql using php.

Answer 1

+1 A:

Is something in the chain treating the binary data as a string, in particular a C style null-terminated string? That could cause it to get cut off at the first null byte ('\0').

John Kugelman 2009-10-12 04:19:27

i mean what other way could i do it without using a string?

John 2009-10-12 04:39:36

but other than that i think you might be on to something...

John 2009-10-12 04:42:00

Answer 2

A:

Have you tried simply call your script that pulls the binary image, and dump it out. If you see the image correctly then its not pulling part, might be something to do with inserting.

Darkerstar 2009-10-12 04:24:47

$this->query("insert into images (db,pid,raw) values('".$s."','".$valid_pid."','".mysql_real_escape_string($new_image)."')");that's how i'm inserting it

John 2009-10-12 04:38:48

have you tried add_slashes?

Darkerstar 2009-10-12 05:05:45

in addition to, inside or outside of my "mysql_real_escape_string()", or what? and what would the difference be if any?

John 2009-10-12 05:42:02

Answer 3

A:

Are you setting the headers correctly?

ie:

header('Content-Length: '.strlen($imagedata));
header('Content-Type: image/png');
...

SeanJA 2009-10-12 04:30:53

is the content length necessary?

John 2009-10-12 04:37:50

Answer 4

A:

A string datatype would definitely not be the optimum for storing images in a DB.

In fact I've seen several recommendations that the image should go in a folder somewhere in your filesystem and the DB contains only the address/file path.

This is a link to a page about inserting images.

It contains the suggestion about the filepath and that a blob datatype is better if the images must go in the database.

If it's a blob, then treating it as a string won't work.

pavium 2009-10-12 04:51:48

Ok I'm not sure what you mean by string. If you refering to a PHP string, or a MySQL string, if it's the latter I've never heard of that.The images must go in the db, I am using blob, and it's set to binary. Could it be that my script is iterating through the loop to fast, the part that does the http request for the data and inserts it into the db?

John 2009-10-12 04:59:17

Ok, so the MySQL 'string' datype would be callled VARCHAR or CHAR, but all that means is a series of characters. In most programmming languages, and the other answers, that would be called a string. As John Kugelman said, treating binary data like a string might cause problems. Since his answer, you've commented that you're using a blob. That's good, but I thought John's suggestion was good at the time and I upvoted it. Now it seems the answer lies somewhere else. I wouldn't blame your loop because I haven't seen it.

pavium 2009-10-12 07:29:09

Answer 5

A:

If you make repeated requests to the same url, does the image eventually load?

If so that points to a networking issue. Large packet support is enabled in your kernal (assuming linux) which doesn't work correctly for a lot of windows clients. I've seen a similar issue with large(1+MB) javascript libraries served from a linux machine.

http://en.wikipedia.org/wiki/TCP%5Fwindow%5Fscale%5Foption

http://support.microsoft.com/kb/314053

txyoji 2009-10-12 04:51:52

It loads the same regardless of how many times you look at it, or ctrl+f5 the hell out of it, lol. Trust me, I'm lazy I tried that already.

John 2009-10-12 04:55:48

ansaurus

tags:

views:

answers:

Problems loading bulk data in mysql using php.

related questions