sadtalkerai.com

This is the best low latency AI speech engine that I’ve seen, and I’m going to talk to it and understand how it is built. The best part is the team is going to open source everything, that is what they’ve promised. This system is called unmute. It’s from a company called QI, and you … Read more

NVIDIA has launched a 600 million parameter automatic speech recognition model. It is completely open source under CC BY 4.0 and you can use it for commercial work. It handles punctuation, capitalization, and accurate timestamps, so turning audio into subtitles is easy. Words that usually trip models on my voice, like Cohere and Mistral, were … Read more

Forget about OpenAI voice mode. I have got the best voice assistant you can use today. This is not a paid promotion, but the free tier gives you 30 minutes, and I wanted to show how you can create your own voice agent. This is a text to speech system that can truly understand you, … Read more

We have a new very fast speech to text using Distil-Whisper. Distillation is a process in which you reduce the size of a deep learning model. The Hugging Face team has reduced the size of Whisper, which means Whisper is now faster, smaller, and can transcribe more text using less time and compute. This project … Read more

I am going to run Facebook’s all-in-one multimodal translation model on free Google Colab. Thanks to camenduru, there is already a Colab notebook that makes it a simple one-click step. We will explore that notebook, learn how to run the model, and use a graphical user interface to do all four tasks the model supports. … Read more

Meta’s new model, Seamless M4T, is absolutely nuts. I recorded an English audio saying I love making YouTube videos, and it instantly translated it into multiple languages. It did not stop at text translation, it also produced translated audio. Forget audio quality for a moment. The fact that you can feed an input audio and … Read more

You can create AI voice in more than 1100 languages using Meta MMS Text-to-Speech. By the end of this guide, you will be able to input text, pick a language, and generate natural-sounding speech. I will show the exact steps I use in a Google Colab notebook, and you can adapt them to your machine … Read more

Meta AI has launched a new speech to text model that supports 1,100 languages. The demo is impressive, with people speaking in languages I had never heard about. Meta AI calls it Massively Multilingual Speech, or MMS, and it can support these languages. The most important thing is that this model is open source. The … Read more

You can transcribe a 30 minute audio in just 30 seconds using Whisper JAX. Whisper is an open source library from OpenAI that can transcribe speech to text. It is one of the most popular options with a permissive license for speech recognition. JAX is an open source Python library developed by Google for high … Read more

Imagine you have 10 hours of audio and you want to ask questions using a large language model. That usually means setting up a vector database and a lot of plumbing. AssemblyAI has a new framework called LeMUR that applies large language models to transcribed speech. With LeMUR, you can transcribe a 10-hour audio clip … Read more