I had good times with Opus.

We have been capturing then encoding audio using Opus from a low-power chip (nRF52840) then sent encoded data through BLE.

Worked liked a charm! Encoding used 50% of the CPU time.