Which techniqes would you use to implement a search for contents in a column on a very big table in MySql? Say for instance that you have 10.000.000 emails stored in a table in the database and would like to implement a subject search, that would enable me to search for one or more words that was present in the email subject. If the us...
I'm trying to select more than 80,000 record in SQL Server in a table that has millions of records. The issue is that I've the correct Index, but it takes more than 15 minutes to return the recordset. I'm using MS SQL Server 2000, I found a pagination method using stored procedures but it uses a temporal table that I have to insert the ...
Hello folks, I have some questions about partitioning and strategy, how and when to use it. As I understood from Partitioned Tables and Indexes in SQL Server 2005, partitioning is not used only for manageability but also to improve performance on very large database tables (VLDB). We have a table with millions of records. This table st...
I think I've become quite good at the basics of programming (for a variety of languages). I can write a *good** line of code. I can write a good method. I can write a good class. I can write a good group of classes. I can write good small or medium application. I do not however know how to build a good large application. Particula...
The typical way of selecting data is: select * from my_table But what if the table contains 10 million records and you only want records 300,010 to 300,020 Is there a way to create a SQL statement on Microsoft SQL that only gets 10 records at once? Eg select * from my_table from records 300,010 to 300,020 This would be way more ef...
Hi, I'm working on a Java application that needs working on very large matrices. For example multiplying two 10 million * 10 million matrices! Of course the Java heap does not have enough space even for storing one of these matrices. What should I do? Should I use databases to store my matrices and bring to memory every needed part and ...
Hello, the code below(in C++) is what I am trying the convert into C# DWORD Func_X_4(DWORD arg1, DWORD arg2, DWORD arg3) { LARGE_INTEGER result = {1, 0}; LARGE_INTEGER temp1 = {0}; LARGE_INTEGER temp2 = {0}; LARGE_INTEGER temp3 = {0}; LARGE_INTEGER temp4 = {0}; for(int x = 0; x < 32; ++x) { if(arg2 & 1) { temp1.LowPart = arg3; te...
Hey, I am trying to do a project euler problem but it involves adding the digits of a very large number. (100!) Using java, int and long are too small. Thanks for any suggestions ...
Imagine you have a large software project where you have to support several branches (releases) at the same time. For instance you have a production release on the website, a integration test release that is currently tested by the customer, a testing release that for your local systems test and a development release where your developer...
Hi, This is my problem: I need to store a lot of log messages and thought it would be smart to keep it in a SQLite3 database to be able to search and filter it easily. I will display the log messages in a standard list widget (using wxWidgets). The list will have several columns and can be sorted and filtered by the user. Now, I'm not...
Hi, I need to export a large amount of data (~100mb) from a sql table to a user via the web. What would be the best solution for doing so? One thought was to export the data to a folder on the db server, compress it (by some means) and then provide a download link for the user. Any other methods for doing so? Also, can we compress data...
I have a dataset which is about 3 million records, and I would like to load them in to a Data Grid within an application (WinForm). What is the best approach / method of displaying the data. I need to be able to run a filter to the data to reduce down the data set, ideas would be welcomed ...
How would i go about doing calculations with extremely large numbers in Java? i have tried long but that maxes out at 9223372036854775807, and when using an integer it does not save enough digits and therefore is not accurate enough for what i need. Is there anyway around this? ...
In a previous discussion, bstoney provides a very nice example of how to wavy underline some text in WPF. It works great for normal fonts, but for bold and/or larger fonts, I find that the tiling gets off such that the tops of the wavy underline are clipped and they appear below the bottoms instead. I'm hoping to avoid learning all abo...
Hello everyone. Which of the Database servers would you people recommend for using in a moderate-to-large scale (will vary from customer to customer) application. I know MS SQL but since the app will be developed using delphi the .net framework is kind of annoying to deploy aswell. Also how realiable is Interbase. Thanks in advance. ...
Hi I have three tables, t1, t2 and t3. 80% of the fields/columns are similar in these tables. Around 75,000 records are posted in table t1 and t2 on daily basis, totaling to 150,000. A process, say P123, is executed which moves 40-60 % records from t1 and t2 to t3 in a pair. The user searches frequently for records in all three tables wi...
What I have to do I'm trying to manipulate some rather large amounts of data stored in Excel files (one of the workbooks has as much as 150 spreadsheets). The result of these manipulations may yield approximately 800.000 rows in a database table. The problem Data stored in the spreadsheets has unpredictable format. The company that ge...
I'm trying to optimize handling of large datasets using mmap. A dataset is in the gigabyte range. The idea was to mmap the whole file into memory, allowing multiple processes to work on the dataset concurrently (read-only). It isn't working as expected though. As a simple test I simply mmap the file (using perl's Sys::Mmap module, using...
Numpy is an extremely useful library, and from using it I've found that it's capable of handling matrices which are quite large (10000x10000) easily, but begins to struggle with anything much larger (trying to create a matrix of 50000x50000 fails). Obviously, this is because of the massive memory requirements. I was wondering if there ...
Hi, I want to know whether it is posible to have loader which will run till all the images in the page been loaded to the page . I have a website http://ranjoy.athost.net/ which is having some png large size images, i want all the images to load before the animation start .... plz help ...