[R] Rounding problem R vs Excel

Paul, David A paulda at BATTELLE.ORG
Wed Jun 4 15:09:59 CEST 2003


I don't have the reference, but a biologist friend of mine
once showed me a refereed journal article that purported
to demonstrate numerical errors made by MSExcel.  This 
would have been Excel97 or Excel2000... In any case, the
journal's scope was biological in nature and the article 
was of interest since Excel is heavily used in that community.

-david paul

-----Original Message-----
From: Duncan Murdoch [mailto:dmurdoch at pair.com] 
Sent: Wednesday, June 04, 2003 8:34 AM
To: MSchwartz at medanalytics.com
Cc: R-help at stat.math.ethz.ch
Subject: Re: [R] Rounding problem R vs Excel


On 04 Jun 2003 00:24:08 -0500, you wrote:

>Excel 2002 (XP):
>
>Cell Formula          Value
>= 0.5 - 0.4 - 0.1     0.00000000000000000000E+00
>=(0.5 - 0.4 - 0.1)    -2.77555756156289000000E-17
 ...
>What is interesting is the change in the displayed value in Excel when 
>the second formula is surrounded by parens (which I found purely by 
>accident). This would suggest that there may be something going on in 
>the parsing of the cell formula that affects the calculation and 
>displayed value.

"Interesting"?  I'd say "horrifying".  When (expr) does not evaluate the
same as expr, what can you trust?

Duncan Murdoch

______________________________________________
R-help at stat.math.ethz.ch mailing list
https://www.stat.math.ethz.ch/mailman/listinfo/r-help




More information about the R-help mailing list