[R] Rounding problem R vs Excel
Paul, David A
paulda at BATTELLE.ORG
Wed Jun 4 15:09:59 CEST 2003
I don't have the reference, but a biologist friend of mine
once showed me a refereed journal article that purported
to demonstrate numerical errors made by MSExcel. This
would have been Excel97 or Excel2000... In any case, the
journal's scope was biological in nature and the article
was of interest since Excel is heavily used in that community.
-david paul
-----Original Message-----
From: Duncan Murdoch [mailto:dmurdoch at pair.com]
Sent: Wednesday, June 04, 2003 8:34 AM
To: MSchwartz at medanalytics.com
Cc: R-help at stat.math.ethz.ch
Subject: Re: [R] Rounding problem R vs Excel
On 04 Jun 2003 00:24:08 -0500, you wrote:
>Excel 2002 (XP):
>
>Cell Formula Value
>= 0.5 - 0.4 - 0.1 0.00000000000000000000E+00
>=(0.5 - 0.4 - 0.1) -2.77555756156289000000E-17
...
>What is interesting is the change in the displayed value in Excel when
>the second formula is surrounded by parens (which I found purely by
>accident). This would suggest that there may be something going on in
>the parsing of the cell formula that affects the calculation and
>displayed value.
"Interesting"? I'd say "horrifying". When (expr) does not evaluate the
same as expr, what can you trust?
Duncan Murdoch
______________________________________________
R-help at stat.math.ethz.ch mailing list
https://www.stat.math.ethz.ch/mailman/listinfo/r-help
More information about the R-help
mailing list