large

MySQL structure help for joins ( large tables)

Hello I currently have 2 tables that are used for a select query with a simple join. The first table houses around 6-9 million rows, and this gets used as the join. The primary table is anywhere from 1mil to 300mil rows. However, I notice when I join above 10mil rows on the primary table the select query goes from instant to very slow (...

Gridview ControlState very large even when viewstate disabled and not using DataKeyNames

Hi, I have an asp:Gridview bound to an asp:ObjectDataSource. I have disabled the ViewState on the GridView, and have not set the DataKeyNames property. I have about 10 BoundFields and a few TemplateFields. These TemplateFields are not bound to server controls but to an anchor tag or to an img tag. However, at runtime, when I switch on ...

Java - computing large mathematical expressions

Hello all, Im facing a scenario where in ill have to compute some huge math expressions. The expressions in themselves are simple, ie have just the conventional BODMAS fundamental but the numbers that occur as operands are very large, to the tune of 1000 digit numbers. I do know of the BigInteger class of the java.math module but am loo...

Fast multiplication of very large integers

How to multiply two very large numbers greater than 32 characters for example multiplication of 100! with 122! or 22^122 with 11^200 by the help of divide and conquer, do any body have java code or C# code? ...

A good way to display large images online

I need to show an image that is 4000x6000 px. What are your experiences with displaying large images online? My initial idea was to use the GMap cutter and the Google Maps API to show the image. GMap Cutter takes an image and cuts it appropriately for use as a google map. My problem with approach is that the image will be changing often...

Has anyone got experience with Riak with a large dataset?

I am planning on using Riak for a project I am working on and want to hear from anyone who is using for development / production systems. In particular I am interested in: 1) insert speed 2) maximum cluster sizes 3) select / search performance Thanks Zubair ...

Creating an Extremely Large Index in Oracle

Can someone look at the linked reference and explain to me the precise statements to run? Oracle DBA's Guide: Creating a Large Index Here's what I came up with... CREATE TEMPORARY TABLESPACE ts_tmp TEMPFILE 'E:\temp01.dbf' SIZE 10000M REUSE AUTOEXTEND ON EXTENT MANAGEMENT LOCAL; ALTER USER me TEMPORARY TABLESPACE ts_tmp; CREATE UN...

Calculating large factorials in C++

Hi all, I understand this is a classic programming problem and therefore I want to be clear I'm not looking for code as a solution, but would appreciate a push in the right direction. I'm learning C++ and as part of the learning process I'm attempting some programming problems. I'm attempting to write a program which deals with numbers...

Counting Distinct Values in large dataset (40M rows): SELECT count(*) as count, name FROM names GROUP BY name ORDER BY name;

CREATE TABLE `names` ( `name` varchar(20) ); Assume the "names" table contains all 40 million first names of everyone living in California (for example). SELECT count(*) as count, name FROM names GROUP BY name ORDER BY name; How can I optimize this query? Expected Result: count | name 9999 | joe 9995 | mike 9990 | kate ... 2 | kal...

How are Agile development practices affected by a pervasive system change?

When a large system developed by Agile process requires a sudden large-scale change that affects most everything, what is the best way to go about it using Agile? Does the iterative part change at this point? For example, what if a decision is made to make a centralized system a distributed one? Or choose another large pervasive example...

Any way to easily show a very large image in a Java Applet (using lesser parts)?

Hi, I need the functionality to show large images on a Java Applet without increasing the default heap space. I'm getting the "Out of memory" exception when reading the large image using ImageIO.read() into a BufferedImage (what was expected to happen). To solve this issue, the first thing that comes to mind is to divide the large imag...

what's the best (most effecient) way in asp .net to return a whole page into tabbed content?

what i want to do is every time i click on a tab, the content area is replaced by pretty much a whole new page. i don't want a full page load so i want to do it in ajax, but i'm used to sending back small jason data via page methods. i'm not sure how i would construct a whole new page and return that via ajax and i would like to simply...

Problems with PHP when trying to create big array

Hi, Here is my code, which creates 2d array filled with zeros, array dimensions are (795,6942): function zeros($rowCount, $colCount){ $matrix = array(); for ($rowIndx=0; $rowIndx<$rowCount; $rowIndx++){ $matrix[] = array(); for($colIndx=0; $colIndx<$colCount; $colIndx++){ $matrix[$rowIndx][$colIndx]=...

Fortran: handling integer values of size: ~700000000000

Hey All... Currently I'm brushing up on my Fortran95 knowledge (don't ask why)... I'm running in to a problem though. How does one handle large integers, eg. the size of: ~700000000000 INTEGER(KIND=3) cannot hold this number. If anyone is interested the compiler I have available is Silverfrost FTN95. I am using the integer to run thr...

PHP bitwise left shifting 32 spaces problem and bad results with large numbers arithmetic operations

Hello, I have the following problems: First: I am trying to do a 32-spaces bitwise left shift on a large number, and for some reason the number is always returned as-is. For example: echo(516103988<<32); // echoes 516103988 Because shifting the bits to the left one space is the equivalent of multiplying by 2, i tried multiplying the...

What is the best practical way to add a major feature/service to an existing medium-sized Ruby on Rails project?

Hi there, I have an existing project written in Ruby on Rails. It is sort of backend solution for the upcoming major addition to the project. What I mean is it currently serves for the admins and it already has loads of features and actual Rails files in there. Now I am planning to add the new "Public" facing part of the App in Rails a...

Using Partitions for a large MySQL table

An update on my attempts to implement a 505,000,000-row table on MySQL on my MacBook Pro: Following the advice given, I have partitioned my table, tr: i UNSIGNED INT NOT NULL, j UNSIGNED INT NOT NULL, A FLOAT(12,8) NOT NULL, nu BIGINT NOT NULL, KEY (nu), key (A) with a range on nu. nu ought to be a real number, but because I only have...

I need to create a very large array of bits/boolean values. How would I do this in C/C++?

Is it even possible to create an array of bits with more than 100000000 elements? If it is, how would I go about doing this? I know that for a char array I can do this: char* array; array = (char*)malloc(100000000 * sizeof(char)); If I was to declare the array by char array[100000000] then I would get a segmentation fault, since the m...

Database structure for ecommerce site

Hey Guys, I have been tasked with designing an ecommerce solution. The aspect that is causing me the most problems is the database. Currently the site consists of 10+ country based shops each with their own database (all residing on the same mysql instance). For the new site I'd rather all these shop databases be merged into one da...

PHP File Upload second file does not upload, first file does without error

So I have a script I have been using and it generally works well with multiple files... When I upload a very large file in a multiple file upload, only the first file is uploaded. I am not seeing an errors as to why. I figure this is related to a timeout setting but can not figure it out - Any ideas? I have foloowing set in my htacc...