openerp-india team mailing list archive
-
openerp-india team
-
Mailing list archive
-
Message #01246
[Bug 882036] Re: rounding error
> then I saw that Python has the same problems as well with Decimal …
What makes you believe that?
>>> from decimal import Decimal as d, ROUND_HALF_UP
>>> (d('0.565') * 100).quantize(d(1), ROUND_HALF_UP) / 100
Decimal('0.57')
>>> (d('0.575') * 100).quantize(d(1), ROUND_HALF_UP) / 100
Decimal('0.58')
Decimal also supports rounding directly, instead of doing arbitrary
computations:
>>> d('0.565').quantize(d('0.01'), ROUND_HALF_UP)
Decimal('0.57')
>>> d('0.575').quantize(d('0.01'), ROUND_HALF_UP)
Decimal('0.58')
--
You received this bug notification because you are a member of OpenERP
Indian Team, which is subscribed to OpenERP Server.
https://bugs.launchpad.net/bugs/882036
Title:
rounding error
Status in OpenERP Server:
New
Bug description:
Concerns 6.0 and trunk.
If you define a precision of 0.01, the rounding of 0.125 must be 0.13 and not 0.12. The error is in the call of the format string "%.2f"%val which introduces a mathematical error. The round function must be called to apply the correct rounding before formatting the string. It should be:
"%.2f"%round(val*100)/100
Fix class digits_change of class float in the server. BUT fix also the gtk client AND web client as they all have that error (I let you find the right line)
To manage notifications about this bug go to:
https://bugs.launchpad.net/openobject-server/+bug/882036/+subscriptions
References