« Return to Thread: When integers go bad

Re: When integers go bad

by James Harkins-2 :: Rate this Message:

Reply to Author | View in Thread

Also, that's a questionable example because SC doesn't do integer
exponentiation.

(2**6).asCompileString
64.0

I think (??) many other languages behave similarly... but not totally sure.

hjh

On Wed, Feb 27, 2008 at 2:12 PM, Julian Rohrhuber
<rohrhuber@...> wrote:
> before you get infinities, you get degraded precision.
>
>  a = 3; b = 2147483647.0; b ** a ** (1/a) - b
>
>  -2.6226043701172e-06


--
James Harkins /// dewdrop world
jamshark70@...
http://www.dewdrop-world.net

"Come said the Muse,
Sing me a song no poet has yet chanted,
Sing me the universal."  -- Whitman
_______________________________________________
Sc-devel mailing list
Sc-devel@...
http://lists.create.ucsb.edu/mailman/listinfo/sc-devel

 « Return to Thread: When integers go bad