I have a bunch of URLs stored in a table waiting to be scraped by a script. However, many of those URLs are from the same site. I would like to return those URLs in a "site-friendly" order (that is, try to avoid two URLs from the same site in a row) so I won't be accidentally blocked by making too many http requests in a short time. The...
Hi, I am using a Postgres database and want to tweek the parameters. The problem is that when I set shared_buffer to a value larger than 20mb my server won't start. I am running it on Ubutu 8.10 OS with 1gb RAM. Any ideas? ...
I have a single database field that contains a start date, end date, and exclusions in the form available DD/MONTH/YYYY [to DD/MONTH/YYYY]?[, exclude WORD [, WORD]*]? Meaning it always starts with "available DD/MONTH/YYYY", optionally has a single "to DD/MONTH/YYYY", and optionally has an exclude clause that is a comma separated list ...
We had an applicationg running using MySql. We found MySql was not suitable for our app after we found that it didnt support some of the GIS capability that PostGIS has (note: mysql only supports minimum-bounding rectangle GIS search). So we changed our DB to PostgreSQL. We then found out that Postgresql 8.2 running on Windows is so muc...
I have been using Postgres for almost a year now and I've been able to accomplish all the tasks at hand so far by googling what I need. I'm looking for a good Postgres resource so I can discover things that are possible aside from just querying and maybe to learn things beyond what I need (or I didn't know that I needed) or probably lear...
I have a long running function that should be inserting new rows. How do I check the progress of this function? I was thinking dirty reads would work so I read http://www.postgresql.org/docs/8.4/interactive/sql-set-transaction.html and came up with the following code and ran it in a new session: SET SESSION CHARACTERISTICS AS SERIALI...
there's any tutorial who explains how to use asp mvc with postgres? (or any other db who don't be MSSQL) ...
Is there a simple way to do that? ...
I want to write documentation on my pet project. I have 30 tables and almost 50 views and about 30 functions (stored procedures) in my PostgreSQL database. I would like to see where tables ( which views and which functions ) are used. I would like to see where views ( which views and which functions ) are used. I would like to see if...
I am testing the fault tolerance of an ActiveMQ system configured as JDBC Master/Slave. In this setup there is one postgres database and two brokers--one is the master broker, the other is a slave broker. The way this mechanism works is the master takes out an exclusive lock on a table in the db. The slave tries to do this also and waits...
What are effective ways of writing faster queries specifically in Postgres? Please do not include generally good database practices (eg use indexes or normalization). I'm looking for hints like derived tables work faster than subqueries or using python string functions seems faster than the pgsql string functions. Ideally, this list w...
I do not understand when to use the different lengths for calling unicode. I have been using types.Unicode(255) for all my columns in my postgres database such as address, name, description, etc. Is it unwise to do this? ...
Hi guys we are on the way to start developing a big web platform. For db server we choosen postgresql. Would you suggest an OS for the postgresql server (we are looking for the maximum performance)? Thanks P.S. sorry for the bad english ...
I think there are a lot of places where my design may be screwing this up. I have very limited experience with Rails though. This is happening in Rails 2.3.2 with Postgres 8.3. We've got two tables in our DB. One called "survey" and one called "survey_timepoint". A survey can have multiple time points so in the survey_timepoint tabl...
Similar to this question, I need to group a large number of records into 1-hour "buckets". For example, let's say I've got a typical ORDER table with a datetime attached to each order. And I want to see the total number of orders per hour. So I'm using SQL roughly like this: SELECT datepart(hh, order_date), SUM(order_id) FROM ORDERS GRO...
What is your advice on configuring PostgreSQL such that BLOB can be written quickly? We are using PostgreSQL to insert BLOB at a high rate. We call a lo_write() roughly 220 times a second. We write roughly 30KB of binary data per lo_write(). This is equivalent to roughly 6 MB/s. Our computer is RAID-5, so the write speed is in the n...
Unfortunately setTimeout is not implemented for JDBC/postgres. Is there some way I can simulate or workaround this? Functionally I want to execute the query and the then break if it takes longer than N seconds ...
Hi there, I got a table 'foo' that looks like ID | NAME ------+---------------------------- 123 | PiratesAreCool 254 | NinjasAreCoolerThanPirates and a second table 'bar' SID | ID | created | dropped ------+------+------------+----------- 9871 | 123 | 03.24.2009 | 03.26.2009 9872 | 123 | 04.02.2009 | b...
I'm kind of rusty on my SQL, maybe you can help me out on this query. I have these two tables for a tickets system (I'm omitting some fields): table tickets id - bigint subject - text user_id - bigint closed - boolean first_message - bigint (foreign key, for next table's id) last_message - bigint (same as before) table ticket_me...
Suppose I have: untimedStatement = connection.createStatement() ; timedStatement = connection.createStatement(); And then run timedStatement.execute("SET statement_timeout TO " + timeout); Will the SET statement_timeout command also affect untimedStatement? I was hoping it would not but some of the behaviour I'm observing suggests...