Fix for nr_ulsch_16/64/256qam_llr reading/writing past buffer size on x86 and ARM.
This fixes out-of-bounds access: nr_ulsch_16qam_llr, nr_ulsch_64qam_llr and nr_ulsch_256qam_llr. For 256qam this also fixes incorrect llr calculation on arm: the existing AVX code for 2 REs case produced results not in line with the rest of the code. A testcase check_2_res_256_qam was added to visualise the differences which can later be used to revive AVX acceleration for 2REs case.
Showing
This diff is collapsed.
This diff is collapsed.
Please register or sign in to comment