• Bartosz Podrygajlo's avatar
    Fix for nr_ulsch_16/64/256qam_llr reading/writing past buffer size on x86 and ARM. · bbd6f35a
    Bartosz Podrygajlo authored
    This fixes out-of-bounds access: nr_ulsch_16qam_llr, nr_ulsch_64qam_llr and nr_ulsch_256qam_llr.
    For 256qam this also fixes incorrect llr calculation on arm: the existing AVX code for 2 REs
    case produced results not in line with the rest of the code. A testcase check_2_res_256_qam was
    added to visualise the differences which can later be used to revive AVX acceleration for 2REs case.
    bbd6f35a
test_llr.cpp 16.8 KB