I have a web application written in ASP.Net 3.0 using C#, the production machine is a windows server 2003 with IIS 6.0 and sql server 2005. Application Structure The following shows the structure of my ASP.net web application: root application in IIS (//localhost/es) includes the common pages, for instance: master pages, theme, user ...
I have a table with 200,000 records. I want delete some data like below : DELETE FROM Table Where IdColumn IN ( SelectedID ) SelectedID fill with my desirable data identities that contains 5000 records. there are 2 approach: 1- I insert 20,000 identity as SelectedID that contains identities of desired 5000 records. 2- I insert only ...
I have this query that is bothering me; it is encapsulated as a new query operator, I made two versions of it, trying to see which one performs better. Both perform horribly. First attempt; declarative style public static IEnumerable<IEnumerable<α>> Section<α>(this IEnumerable<α> source, int length) { return source.Any() ? ...
We have a series of tables that have grown organically to several million rows, in production doing an insert or update can take up to two seconds. However if I dump the table and recreate it from the dump queries are lightning fast. We have rebuilt one of the tables by creating a copy rebuilding the indexes and then doing a rename swit...
I am using CultureInfo.CurrentCulture when formating my strings using string.format To quote this blog This just has the implication that if you are using CurrentCulture a lot, it might be worth reading it into a private variable rather than making lots of calls to CultureInfo.CurrentCulture, otherwise you're using up cl...
I have a Import function which takes a bunch of data in xml format and pastes it into my db. The problem is, that depending on the amount of data that process can take quite a long time. I see in the server log, that there are incredible lots of sql statements beeing executed do save back all the data. How can I improve performance for ...
I have to wait quite long time (comparing to my friends machines) for executing scripts on jRuby, especially when I'm running rake tasks or tests. I've tried jRuby version 1.3.1 and 1.4.1 with and without ruby-debug gem and the same problem occurred in each configuration. The question is simple: Is there any way to improve jRuby load p...
Hi: I'm designing a system, and by going deep into numbers, I realize that it could reach a point where there could be a table with 54,240,211,584 records/year (approximately). WOW!!!! So, I brook it down & down to 73,271,952 records/year (approximately). I got the numbers by making some excel running on what would happen if: a) no su...
We all know that performance is a feature. Slow load times are just about the fastest way to turn me off of a site. But at what point is a web app* fast enough? What is the latency threshold between "Hell with this" slow and "Ahhh..." fast? If this is too application-specific, then how do you determine this threshold for your app? Doe...
I am writing a text editor and need to provide a live word count. Right now I am using this extension method: public static int WordCount(this string s) { s = s.TrimEnd(); if (String.IsNullOrEmpty(s)) return 0; int count = 0; bool lastWasWordChar = false; foreach (char c in s) { ...
I'm experiencing some terrible performance with reading data off the OracleDataReader object compared to MS SQL Server. It is almost 10 times slower, which is unacceptable. Below is some sample test code that both tests use. What's the most optimum way to read data from OracleDataReader, is there a better way than shown below? I'm h...
Hi all, I'm wondering whether there is a bossibility to export some selected data from my rails mysql db to a other sqlite db. The aim is to send that sqlite file directly to my iPhone application... That way I don't have to do a lot of xml integration in the iPhone app. That seems to be very slow... Markus ...
Disclaimer: I have looked through this question and this question but they both got derailed by small details and general optimization-is-unnecessary concerns. I really need all the performance I can get in my current app, which is receiving-processing-spewing MIDI data in realtime. Also it needs to scale up as well...
Say I've got a table: CREATE TABLE Users ( Id INT IDENTITY (1, 1), FirstName VARCHAR(40), LastName VARCHAR(40) ) Queries are usually on FirstName or LastName, but also on FirstName and LastName. If I create a non-clustered index on FirstName and another on LastName, then my first two queries are catered for. Apparently, S...
Hello, I have the following problem: my table is big enought (millions of data rows), this is temporary data which I process. I need to select max and min of one column accrding to some criteria, process this information and remove data according to the same criteria. Actually, the simplest implementation looks like: select max(col), m...
If APC stores a lot of entries, clearing them crashes httpd. *If apc_clear_cache('user') takes longer than phps max_execution_time the script calling apc_clear_cache will be terminated by php before the clearing-operation is finished. this seems to leave some handles or sth. that will prevent apache from closing it's proc...
Hi, So I'm having a head against the wall moment and hoping somebody can come help either remove the wall or stop my head from moving!! Over the last 3/4 weeks I've been investigating ORM's in readyness for a new project. The ORM must map to an existing, large and ageing SQL database. So I tried Subsonic. I really liked v2 and v3 aft...
I have a problem where i need to walk through an object graph and pick out a particular property value. My original solution caches a linked list of property names that need to be applied in order to get from point A to point B in the object graph. I then use apache commons PropertyUtils to iterate through the linked list calling getProp...
A general CoreData/SQLite question Is there a significant difference between these two scenarios when saving a NSManagedObjectContext using an SQLite store: After adding/changing/deleting one object in a NSManagedObjectContext containing 10 otherwise unchanged NSManagedObjects After adding/changing/deleting one object in a NSManagedOb...
I couldn't find a good title for the question, this is what I'm trying to do: This is .NET application. I need to store up to 200000 objects (between 3KB-500KB) I need to store about 10 of them per second from multiple-threads I use binaryserialization before storing it I need to access them later on by an integer, unique id What's...