Using SQLite, Got a table with ~10 columns. Theres ~25million rows. That table has an INDEX on 'sid, uid, area, type'. I run a select like so: SELECT sid from actions where uid=1234 and area=1 and type=2 That returns me 1571 results, and takes 4 minutes to complete. Is that sane? I'm far from an SQL expert, so hopefully someone ca...
I am in the process of porting a NAnt build script to MSBuild 4.0 and I am seeing a rather interesting behaviour. MSBuild is slightly faster when executing filesystem and compilation tasks, but takes twice as long to run NUnit tests. Here's some background info: I am using nant-0.91-alpha2 and MSBuild 4.0 I am using NUnit v2.5.7 NAn...
I need a high performance charting component. The underlying technology used is not specific; could be javascript, flash or java for what it's worth. I need to solve these issues: 1. I need to decide on the right kind of chart for this kind of data: 001. testA 002,003 002. testB 003,004 003. testC 004 004. testD Currently, I'm thi...
I have been recently involved in handling the console logs for a server and I was wondering, out of curiosity, that is there a performance issue in writing to a large file as compared to small ones. For instance is it a good idea to keep the log file size small instead of letting them grow bulky, but I was not able to argue much in favo...
I'm trying to put together a function that receives a file path, identifies what it is, sets the appropriate headers, and serves it just like Apache would. The reason I am doing this is because I need to use PHP to process some information about the request before serving the file. Speed is critical virtual() isn't an option Must wor...
How to tune up the performance of JSP through configuration? ...
hi together, think about having a skript where you have some words as input. now you trie to find matches of each word in a tablecolumn. i want to count the results for each word, so i think i have to do a query for each word, isn't it? in a second step i'm having a look at the counts of results and depending on that number i check sev...
When we keep JS and CSS files for IE only with tags, do other browsers read it. I understand they ignore it but do they download all the files and then ignore it or vice versa. My reason for asking is page performance. ...
Working on an in-house ticketing system in php/mysql. This short term ticketing system has been in place for a year or so now. We are reaching 10,000 tickets and I would like to make the queries more efficient, since 9,500 or so of the tickets do not need to be looked at each day. Right now the queries are getting rows by tech id, the...
I am interested to know in a very general situation (a home-brew amateur web crawler) what will be the performance of such. More specifically how many pages can a crawler process. When i say home-brew take that in all senses, a 2.4Ghz core 2 processor, java written, 50mbit internet speed, etc, etc. Any resources you may share in this r...
I have an application in C#, i want to implement perfcounters in this application so that i can track down the performance parameters and use them to make my application have better performance as of now the application has performance issues. Thanks ...
I have a list with 100 million domain names like www.microsoft.com and would like to resolve the IP-number to www.microsoft.com Running a local pdns server and query localhost using Python adns? ...
Hi everyone! To realize my application I have used a lot Blend3. When Blend3 wants to link a resource to another resource, it uses many times the link-type "DynamicResource". As I have understood (but I could have understood not well), the "Dynamic" links have sense only if I want to modify the links at runtime. In other cases they use m...
I have a query like the following and was wondering what kind of SQL is produced by batching a PreparedStatement. INSERT INTO table1 (id, version, data) VALUES (?, ?, ?) ON DUPLICATE KEY UPDATE table1.data = IF(table1.version > table2.version, table1.data, table2.data), table1.version = IF(table1.version > table2.version, t...
Hi I want to process a String, in which I want to find multiple strings, i am trying to make some highlighter in html text in java.. Example: Find and process phrases table, row, primary key in Each table row contains a primary key column The text is html text with tags like <b>,<img..>... if there is ignorable tag in the middle of phras...
I am using Javascript to display an 8*8 grid in a Sharepoint page. The code basically fetches the data from an array, creates a table with the data and adds it to the page when it first loads. It also adds onmouseout and onmouseover attributes to each cell of the table, which call 2 different Javascript functions: to add a description...
I am exploring Django with MySQL & have a few things that I wanted to discuss - How can I add an index (on some field)? Can I do it through the Django Model Layer? If I want to migrate some old data into these new DB tables/models, will I have to write some script myself or does Django provide schema to schema mapping tools? If I need...
Is there a big performance difference between those two sql count statements, when performing large counts (large here means 100k + records) first: SELECT count(*) FROM table1 WHERE <some very complex conditions> second: SELECT count(*) FROM (SELECT * FROM table1 WHERE <some very complex conditions>) subquery_alias I know that fir...
Hi, my windows app is reading text file and inserting it into the database. The problem is text file is extremely big (at least for our low-end machines). It has 100 thousands rows and it takes time to write it into the database. Can you guys suggest how should i read and write the data efficiently so that it does not hog machine memory...
Hello, Let's imagine that we have blog with category A. Category A is currently having 1000 posts on 100 pages. All pages are cached in files (for example, cached by Smarty template engine). I'm adding post and want it to be displayed on first page immediately. So, I have to clear or invalidate cache for all 100 pages of category A. De...