Ran into an interesting issue with Excel’s handling of floating point numbers.
Take the following formula:
= IF((8.95-8) = .95, TRUE, FALSE)
You’d think that would return TRUE, but it does not.
If I enter
8.95 into cell A1, and
8 into cell A2, the formula
=A2-A1 into cell A3, and
=Round(A3,1) into cell A4, I get:
Shouldn’t 0.95 round up to 1? Cell A4 show 0.9.
If I change the format of those cells to Number (15 decimal places), it shows that 8.95 - 8 is not exactly 0.95
This became apparent when processing timeclock data. The timeclock system must have similar issues. Time is reported in hours, rounding to 10ths. From 8:00 to 8:57 is 57 minutes, which is exactly 0.95 hr, which should round up to 1.0 hours. But the timeclock system shows that as 0.9 hrs - like it was actual 0.9499999999 , which rounds to 0.9.