Streaming Speech Recognition on a Microcontroller: a 65.7M-Parameter Transducer in 2 and 4 Bits on the ESP32-P4
The deployment-footprint data point: low-bit storage of the encoder's 290 matrices without any training, on a microcontroller.
3 items · 3 sources · 3 days
Operational story trace
Follow in this browser to see new updates on your Live feed.
Latest change
Earlybird, a 29M-parameter predictive streaming recognizer, targets the 90-400 ms that streaming ASR typically waits after a speaker finishes a word before outputting it, a delay it frames as a voice-agent cost.
This is a topical cluster of three independent arXiv papers on speech recognition, not one unfolding event. A late-October paper ran Kroko, a 65.7M-parameter streaming Zipformer2 transducer, at 2 and 4 bits on an ESP32-P4 microcontroller with no neural accelerator, and a second argued that ASR benchmarks still assume a single ground-truth transcript per utterance.
Arc
The deployment-footprint data point: low-bit storage of the encoder's 290 matrices without any training, on a microcontroller.
The evaluation angle: questions the single-ground-truth-transcript assumption behind current ASR benchmarks.
The latency angle: frames word-output delay as the cost a voice agent pays before it can start responding.
The deployment-footprint data point: low-bit storage of the encoder's 290 matrices without any training, on a microcontroller.
The evaluation angle: questions the single-ground-truth-transcript assumption behind current ASR benchmarks.
The latency angle: frames word-output delay as the cost a voice agent pays before it can start responding.
What to watch — open questions
Storylines are threaded mechanically from the feed: stories that share a distinctive anchor across multiple days and sources. Each item links to its original source. The evidence trace, current state, and open questions are written by the editor routine and refreshed whenever a new beat lands.