D notation bug
#7
Quote:1D17 * 1D17 should probably give us 9.999999D33

Right! that's about it with rounding errors, not almost 10 X's less that I am seeing. How does E do it with no rounding problems and correct exponent?

@matt
I tried the mantissa idea with 15 significant digits on the guy at the other forum and he didn't buy it, it's a bug and I think he's right because E works just fine.

@mnrvovrfc
It does work correctly in older QB according to the guy at other forum.

@jack yeah I am sure your code is likely correct! ;-))
   
b = b + ...
Reply


Messages In This Thread
D notation bug - by bplus - 07-09-2023, 05:00 PM
RE: D notation bug - by Jack - 07-09-2023, 05:53 PM
RE: D notation bug - by Jack - 07-09-2023, 06:10 PM
RE: D notation bug - by mnrvovrfc - 07-09-2023, 06:32 PM
RE: D notation bug - by mnrvovrfc - 07-14-2023, 09:53 PM
RE: D notation bug - by DSMan195276 - 07-09-2023, 06:39 PM
RE: D notation bug - by SMcNeill - 07-09-2023, 07:03 PM
RE: D notation bug - by bplus - 07-09-2023, 07:27 PM
RE: D notation bug - by Jack - 07-09-2023, 10:40 PM
RE: D notation bug - by bplus - 07-10-2023, 12:42 AM
RE: D notation bug - by Jack - 07-10-2023, 01:12 AM
RE: D notation bug - by bplus - 07-10-2023, 02:19 AM
RE: D notation bug - by bplus - 08-26-2023, 02:36 PM
RE: D notation bug - by Jack - 08-26-2023, 05:12 PM



Users browsing this thread: 9 Guest(s)