[R] number point under-flow
Bob Wheeler
bwheeler at echip.com
Wed Feb 4 15:57:06 CET 2004
It's not the compiler. pghyper() in SuppDists does the same thing. Its
just rounding error. Set the result to 0 if it bothers you.
pghyper(24,514,53, 5961, lower.tail=F)
[1] -3.325965e-12
Roger D. Peng wrote:
> Did you compile with gcc-2.96? I think there were some problems with
> the floating point arithmetic with that compiler (at least for the
> earlier versions released by Red Hat).
>
> -roger
>
> Arne.Muller at aventis.com wrote:
>
>> Hello,
>>
>> I've come across the following situation in R-1.8.1 (compile + running
>> under
>> RedHat 7.1):
>>
>>
>>> phyper(24, 514, 5961-514, 53, lower.tail=T)
>>
>>
>> [1] 1
>>
>>> phyper(24, 514, 5961-514, 53, lower.tail=F)
>>
>>
>> [1] -1.037310e-11
>>
>> I'd expect the later to be 0 or some very small positive number. Is
>> this a
>> number under-flow of the calculation? Do you think I'm safe if I just
>> set the
>> result to 0 in these cases?
>>
>> kind regards,
>>
>> Arne
>>
>> ______________________________________________
>> R-help at stat.math.ethz.ch mailing list
>> https://www.stat.math.ethz.ch/mailman/listinfo/r-help
>> PLEASE do read the posting guide!
>> http://www.R-project.org/posting-guide.html
>>
>
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://www.stat.math.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide!
> http://www.R-project.org/posting-guide.html
>
--
Bob Wheeler --- http://www.bobwheeler.com/
ECHIP, Inc. ---
Randomness comes in bunches.
More information about the R-help
mailing list