ansaurus

Question

Problem with small numbers in Objective C 2.0

Answer 1

+3 A:

1/98556321

This division gives you 0 because integer division is performed here - the result is an integer part of division. The following line should give you floating point result:

1/(double)98556321

Vladimir 2010-08-20 08:28:32

it still return's 0 even if I do the way you suggested...double nr1 = 1/(double)98556321;NSLog(@"Result = %f", nr1); //Output 0.000000

Ladislav 2010-08-20 08:32:11

NSLog displays 6 digits after comma by default but your value is less then that. Try NSLog(@"Result = %.12f", nr1); for example and you'll see that result is not 0.

Vladimir 2010-08-20 08:39:41

Oh, thanx, how many decimal places does double and long double support...

Ladislav 2010-08-20 10:07:52

Answer 2

+1 A:

integer/integer is always an integer

So either you convert the upper or the lower number to decimal

(double)1/98556321

or

1/(double)98556321

Which explicitely convert the number to double.

Happy coding....

Suriya 2010-08-20 08:32:16

I guess that's why he writes he is using doubles...

Eiko 2010-08-20 09:13:26

but the example gave the view that he is dividing integer/integerStill accepting its ma fault... Thanks for explaining Eiko.

Suriya 2010-08-20 09:54:09

One problem I have is that I use NSNumberFormatter to format my double values. When I have small numbers like 1E-6 it will convert them to 0.I instantiate NSNumber by initWithDouble method, and then I pass along NSNumber instance to NSNumberFormatter but, still do not get the desired result (only 6 digits)...any thoughts on that?

Ladislav 2010-08-20 10:53:45

ansaurus

tags:

views:

answers:

Problem with small numbers in Objective C 2.0

related questions