Single v Double
#10
(11-05-2022, 09:56 PM)Kernelpanic Wrote: According to the description: Abs is often used, for example in approximation algorithms, where it is important to stop the calculation above a certain level of accuracy. It doesn't matter whether the calculated value is larger or smaller than the comparison value.
Usually it's for very small numbers that cannot be displayed by the system such as 0.000001. Something like that is multiplied by a million along with something else, and then the difference of the two is checked to see if it's close to zero enough.

(11-05-2022, 07:00 PM)Jack Wrote: Pete
you have it wrong, int will round-down, fix simply truncates whether positive or negative, it's the same
int(-1234567.8) -> -1234568 , -1234568 < -1234567
Pete gave us the technical definition of your explanation.

https://qb64phoenix.com/qb64wiki/index.php/FIX
Reply


Messages In This Thread
Single v Double - by Dimster - 11-05-2022, 04:44 PM
RE: Single v Double - by Jack - 11-05-2022, 05:14 PM
RE: Single v Double - by Pete - 11-05-2022, 05:31 PM
RE: Single v Double - by mnrvovrfc - 11-05-2022, 05:43 PM
RE: Single v Double - by Jack - 11-05-2022, 06:00 PM
RE: Single v Double - by Dimster - 11-05-2022, 06:11 PM
RE: Single v Double - by Pete - 11-05-2022, 06:32 PM
RE: Single v Double - by Jack - 11-05-2022, 07:00 PM
RE: Single v Double - by Kernelpanic - 11-05-2022, 09:56 PM
RE: Single v Double - by mnrvovrfc - 11-05-2022, 10:10 PM
RE: Single v Double - by Pete - 11-05-2022, 10:48 PM
RE: Single v Double - by Jack - 11-05-2022, 11:46 PM
RE: Single v Double - by Kernelpanic - 11-05-2022, 11:50 PM
RE: Single v Double - by Pete - 11-05-2022, 11:59 PM
RE: Single v Double - by Jack - 11-06-2022, 12:35 AM
RE: Single v Double - by Pete - 11-06-2022, 12:38 AM
RE: Single v Double - by Kernelpanic - 11-06-2022, 02:03 AM
RE: Single v Double - by Richard - 11-06-2022, 12:42 AM
RE: Single v Double - by Pete - 11-06-2022, 02:07 AM



Users browsing this thread: 8 Guest(s)