QB64 Phoenix Edition › QB64 Rising › Code and Stuff › Works in Progress v
Perpetual string math calculator.

Linear Mode
Perpetual string math calculator.
Pete Offline
Ad-mini-strator
*******
Posts: 1,616
Threads: 157
Joined: Apr 2022
Reputation: 77
#6
08-11-2022, 08:29 PM
(08-11-2022, 12:49 PM)Kernelpanic Wrote: A lot of work, but the rounding was correct. In QB64 it doesn't work with 34,545. The correct result is 34.55 not 34.54. With 34.546 it works correct.

[Image: Rundungsfehler-QB64.jpg]

That's why I coded my string math routine. You simply cannot "count" on binary computer math. (Please enjoy the pun.)

Pete
Find
Reply


Messages In This Thread
Perpetual string math calculator. - by Pete - 08-10-2022, 05:11 PM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 03:24 AM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 12:39 PM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 08:29 PM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 10:08 PM
RE: Perpetual string math calculator. - by bplus - 08-11-2022, 10:07 PM
RE: Perpetual string math calculator. - by Jack - 08-11-2022, 10:35 PM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 11:35 PM
RE: Perpetual string math calculator. - by Jack - 08-11-2022, 11:42 PM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 11:51 PM
RE: Perpetual string math calculator. - by Pete - 08-12-2022, 01:56 AM



Users browsing this thread: 4 Guest(s)