y = 1.0 / 12345678
y = 10 * y
n = 0
n = n+1
y = y-1
What I got is (0.)00000008100000664200054464404466081166218655665115538931309903877111288457712216
while it is actually 8100000664200054464404466081166218655629929761654240455647717363112823775(e-80)(calculated in machematica)
so how many digits can be guaranteed to be right?
Joined: 16 Jun 2003
Location: Kraków, Poland
fasmg manual, 4. Expression values wrote:
The floating-point numbers are handled by the assembler in the binary form. Their range and precision are at least as high as they are in the longest floating-point format that the assembler is able to produce in the output.
Please also take a look at the other thread where I mention how you can adjust the maximum available precision when re-assembling fasmg.
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum You cannot attach files in this forum You can download files in this forum