Reduce rounding error in rshift of sum_det
- Use a uint64_t - move shift after the sum - add bias before shifting to reduce rounding error
Showing
Please register or sign in to comment
- Use a uint64_t - move shift after the sum - add bias before shifting to reduce rounding error