Clear trailing 0's on a double?
I have a double thats got a value of something like 0.50000 but I just want 0.5 - Is there any way to get rid of those trailing 0's? :) ...
rounding
Add a 0 to the end of a decimal number to make sure it's always 2 decimals?
I am using the following code to work out an inc and ext VAT price: $('#totalexvat').text(totalprice); var vat = totalprice / 100 * 17.5; vat = roundNumber(vat,2); $('#totalincvat').text(totalprice-vat); Sometimes i get .3 or .9 instead of what I would like to be .30 or .90 because it's money, is there a way to do this? ...
MySQL: Matching inexact values using "ON"
I'm way out of my league here... I have a mapping table (table1) to assign particular values (value) to a whole number (map_nu). My second table (table2), is a collection of averages (avg) for each user (user_id). (I couldn't figure out how to properly make a markdown table, please feel free to edit!) table1: table2: (value)...
Is there a way round numbers into a friendly format? (e.g. $1.1k)
Much like the Stackoverlow reputation rounding, I'm hoping to do the same thing with currency $1,000 => 1k $1,000,000 => 1m Is there a library out there already that does this? (preferably in jQuery) ...
Why does AddMilliseconds round the double paramater?
DateTime.Now.AddMilliseconds(1.5); // adds 2 milliseconds What on earth were they thinking here? It strikes me as horrendously bad practice to create a method that takes a double if it doesn't handle fractional values. Why didn't they implement this with a call to AddTicks and handle the fraction properly? Or at least take an int, so i...
Rounding a positive number to a power of another number
I'm trying to round a number to the next smallest power of another number. The number I'm trying to round is always positive. I'm not particular on which direction it rounds, but I prefer downwards if possible. I would like to be able to round towards arbitrary bases, but the ones I'm most concerned with at the moment is base 2 and frac...
Error in rounding off values using .round in Ruby
The following piece of code works perfectly in script/console but returns the following error when i compile the same in a ruby script.: :in `round': wrong number of arguments (1 for 0) (ArgumentError) tf={"ph"=>{0=>1.33333333333333, 1=>1.5}, "fee"=>{0=>1.66666666666667}, "test"=>{0=>1.16666666666667, 1=>1.25}, "what"=>{0=>2.0, 1=>2.0}...
obj-c : iphone programming disabling the round off of a number
hi, i need to show a number to a user : 1.96666777 (timeHour) moduloformat = [NSString stringWithFormat:@"%0.0f hours ",timeHour]; but it is rounding off the number automaticly. It gives "2" and i want to show "1" i could use a NSrange and take the first number but i wanna know how to deal with this. Thanks!! ...
C - floating point rounding
I'm trying to understand how floating point numbers work. I think I'd like to test out what I know / need to learn by evaluating the following: I would like to find the smallest x such that x + 1 = x, where x is a floating point number. As I understand it, this would happen in the case where x is large enough so that x + 1 is closer t...
getting Ceil() of Decimal in python?
Is there a way to get the ceil of a high precision Decimal in python? >>> import decimal; >>> decimal.Decimal(800000000000000000001)/100000000000000000000 Decimal('8.00000000000000000001') >>> math.ceil(decimal.Decimal(800000000000000000001)/100000000000000000000) 8.0 math rounds the value and returns non precise value ...
Round a double to 2 significant figures after decimal point
suppose if the value is 200.3456 it should be formatted to 200.34 or if it is 200 then it should be 200.00 ...
PHP given a series of arbitrary numbers, how can I choose a logical max value on a line graph?
I am constructing a line graph in PHP. I was setting the max value of the line graph to the max value of my collection of items, but this ended up making the graph less readable you are unable to view the highest line on the graph as it intersects with the top of it. So what I need is basically a formula to take a set of numbers and calc...
Round a decimal to the nearest quarter in C#
Hello, Is there a simple way in c# to round a decimal to the nearest quarter i.e. x.0, x.25, x.50 x.75 for example 0.21 would round to 0.25, 5.03 would round to 5.0 Thanks in advance for any help. ...
Common strategies to deal with rounding errors in currency-intensive soft?
What is your advice on: compensation of accumulated error in bulk math operations on collections of Money objects. How is this implemented in your production code for your locale? theory behind rounding in accountancy. any literature on topic. I currently read Fowler. He mentions Money type, it's typcal structure (int, long, BigDecim...
toFixed(2) - math round ?
Hi, I would like to find a function that will return this kind of formatted values : 1.5555 => 1.55 1.5556 => 1.56 1.5554 => 1.55 1.5651 => 1.56 toFixed() and math round return this value : 1.5651.fixedTo(2) => 1.57 This will be usefull for money rounding. ...
BigDecimal rounding question
Hi, I would like to be able to round up any number to quater of the whole number. For example: 100.33 -> 100.50 100.12 -> 100.25 100.66 -> 100.75 100.99 -> 101.00 100.70 -> 100.75 100.00 -> 100.00 100.25 -> 100.25 etc... thank guys... ...
Step math function
Hi I need function which returns: for any number from range => result [0.001,0.01) => 0.01 [0.01,0.1) => 0.1 [0.1,1) => 1 [1,10) => 10 [10,100) => 100 etc. My first idea was to use if, but this the worst way. Is there a simple solution? ...
What is the best way to find the digit at n position in a decimal number?
Background I'm working on a symmetric rounding class and I find that I'm stuck with regards to how to best find the number at position x that I will be rounding. I'm sure there is an efficient mathematical way to find the single digit and return it without having to resort to string parsing. Problem Suppose, I have the following (C#) ...
Rounding of calculated measure in MDX
How can i round a calculated mdx measure up to the nearest integer without having Excel on the server? The Excel-function is CEILING(number, significance), but it is not possible to install Excel on the production ssas-server. ...
System.Math.Round bug?
Hi All, I was writing a function for rounding a number to two places. And I found a bug when I was trying to round specific values. So, I ran the code: class Program { static void Main(string[] args) { int limit = 100; for (int number = 0; number <= limit; number++) { Console.WriteLine((System.Math.Roun...