Quantcast
Channel: Math.NET Numerics
Viewing all articles
Browse latest Browse all 971

New Post: Precision

$
0
0
No, it is not right now, since the .Net numeric type precision is not supposed to be machine dependent (assuming IEEE754 binary64, even though CPU registers may have higher precision. In memory, a double is always 64 bit wide, on both x86 and x64 platforms).

Do you have a scenario where this is an invalid assumption and causes you problems?

Thanks,
Christoph

Viewing all articles
Browse latest Browse all 971

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>