Last year, I wrote about accelerating speech-to-text for Home Assistant using Wyoming, Whisper, and TensorRT. The goal was simple: Make local voice assistants fast enough that people would actually want to use them. At the time, getting a fully local voice pipeline working well required compromises. You traded speed for…
Introduction In my last post, I showed how compiling Whisper with TensorRT dramatically boosted transcription speed for Home Assistant’s voice features. Since then, I’ve pushed the project even further—optimizing performance, reducing VRAM usage, and laying the groundwork for a voice assistant whose responsiveness rivals cloud services like Alexa or Google…
The evolution of Speech-to-Text (STT) systems has opened new possibilities for voice-driven applications, from virtual assistants to real-time transcription services. However, delivering fast and accurate STT remains a challenge, especially in resource-constrained environments. A promising solution lies in combining the Wyoming Protocol, OpenAI's Whisper, and Nvidia TensorRT, as demonstrated in…