Whistle: Speech to Text in 16.9 MB(cactuscompute.com)
946 points by gmays 5 days ago | 181 comments
tl;dr: Cactus released Whistle, a 16.9 MB on-device speech recognition model that transcribes seven languages, runs on CPU with no dependencies, and shares its C++ engine with their Needle LLM so one binary can turn audio directly into tool calls. Benchmarks claim 11ms time-to-first-token and 1,319 tokens/sec decode on an M4 Pro, beating Whisper base on several WER tests at ~1/8th the size, though Whisper leads on TED-LIUM, AMI, and MLS. Weights are on Hugging Face with prebuilt binaries for 17 targets including mobile, embedded, and WASM.
HN Discussion:
  • ↓Accuracy is poor compared to alternatives like Qwen ASR, with high error rates in real use
  • ↓Model hallucinates words and gets stuck repeating defaults like 'Thank you.'
  • ↑Works impressively well and accurately for clear English speech
  • ↓Missing essential features like streaming transcription during recording
  • •Curious how it compares to existing lightweight alternatives like Parakeet