• Thomas Schlichter's avatar
    fix test log2_approx64.boundaries · d6f9bcd1
    Thomas Schlichter authored
    The test was actually never executed correctly (unsigned -10 is never <= 10), and log2_approx64_ref() was not accurate enough.
    Therefore replace it by directly comparing one value above and one value below each rounding boundary.
    d6f9bcd1
test_log2_approx.cpp 720 Bytes