Embed and broadcast Whisper speech-to-text in your Phoenix app in 15 minutes

Posted on March 14th, 2023 by Chris McCord

Elixir provides a rich and powerful set of Machine Learning libraries. Models are implemented directly in Elixir. From stable diffusion, to Whisper audio transcription, these features are now at your fingertips to use in your own applications.

In this screencast, I show just how quickly we can add audio transcription to the open-source LiveBeats application we saw in a previous video. There’s no third-party APIs to call out to, no background jobs to kick off, and no JavaScript to write. The only external dependency is ffmpeg. Let’s go!

Happy coding!