Continuous voice recognition on a microcontroller for a few euros: a model of 65.7 million parameters holds in 26.65 MB on the ESP32-P4
Compressed in 2 and 4 bits without retrain, the Kroko transducer processes 1.28 s of audio in 0.90 s on a chip without a neural accelerator.