Hacker News with Generative AI: Speech Recognition

Sesame CSM: A Conversational Speech Generation Model (github.com/SesameAILabs)
CSM (Conversational Speech Model) is a speech generation model from Sesame that generates RVQ audio codes from text and audio inputs.

Speech Recognition, Generative AI, Artificial Intelligence, Software

113 points by tosh 21 days ago | 13 comments

A unified acoustic-to-speech-to-language embedding space (nature.com)
This study introduces a unified computational framework connecting acoustic, speech and word-level linguistic structures to study the neural basis of everyday conversations in the human brain.

Language Models, Neuroscience, Speech Recognition, Artificial Intelligence

29 points by giuliomagnifico 26 days ago | 0 comments

Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels (github.com/mpc001)
This repository is an open-sourced framework for speech recognition, with a primary focus on visual speech (lip-reading). It is designed for end-to-end training, aiming to deliver state-of-the-art models and enable reproducibility on audio-visual speech benchmarks.

Speech Recognition, Open Source, Machine Learning, Computer Vision

41 points by yagizdegirmenci 60 days ago | 1 comments

Chaplin: Local visual speech recognition (VSR) in real-time (github.com/amanvirparhar)
A visual speech recognition (VSR) tool that reads your lips in real-time and types whatever you silently mouth. Runs fully locally.

Speech Recognition, Real-Time, Machine Learning, Open Source, Accessibility

75 points by venusgirdle 60 days ago | 9 comments

AI uses throat vibrations to work out what someone is trying to say (newscientist.com)
People who find it difficult to speak due to a stroke or Parkinson’s disease could communicate more easily with the help of artificial intelligence.

Artificial Intelligence, Health, Communication, Speech Recognition

13 points by deadgopher 87 days ago | 1 comments

Moonshine – open-source, real-time speech-to-text in the browser (huggingface.co)

Speech Recognition, Open Source, Web Development, Artificial Intelligence

5 points by stared 106 days ago | 1 comments

WhisperNER: Unified Open Named Entity and Speech Recognition (arxiv.org)
Integrating named entity recognition (NER) with automatic speech recognition (ASR) can significantly enhance transcription accuracy and informativeness.

Speech Recognition, Open Source, Artificial Intelligence

133 points by timbilt 133 days ago | 17 comments

Play Dialog: A contextual turn-taking TTS model like NotebookLM Playground (play.ai)
PlayNoteAgentsPlaygroundPricingAPICommunityConversation (2 Speakers)Narration (1 Speaker)LanguageSpeaker 1 VoiceSpeaker 2 VoiceConnecting...Random PromptCreate Voice Clone

Speech Recognition, Artificial Intelligence, Text-to-Speech, Machine Learning

49 points by dulldata 141 days ago | 13 comments

Evaluating OpenAI Whisper's Hallucinations on Different Silences (sabrina.dev)
AI hallucinations in healthcare have made recent headlines, as OpenAI’s speech-to-text model (Whisper) has been shown to hallucinate during silences.

Generative AI, AI Hallucinations, Speech Recognition

8 points by sabrina_ramonov 156 days ago | 1 comments

Moonshine, the new state of the art for speech to text (petewarden.com)
Can you imagine using a keyboard where it took a key press two seconds to show up on screen? That’s the typical latency for most voice interfaces, so it’s no wonder they’ve failed to catch on for most people. Today we’re open sourcing Moonshine, a new speech to text model that returns results faster and more efficiently than the current state of the art, OpenAI’s Whisper, while matching or exceeding its accuracy.

Speech Recognition, Artificial Intelligence, Open Source, Technology, Software

172 points by freediver 159 days ago | 36 comments

Ask HN: Real-time speech-to-speech translation (ycombinator.com)
Has anyone had any luck with a free, offline, open-source, real-time speech-to-speech translation app on under-powered devices (i.e., older smart phones)?

Speech Recognition, Translation, Open Source, Mobile Apps

158 points by thangalin 161 days ago | 70 comments

Moonshine, the new state of the art for speech to text (petewarden.com)
Can you imagine using a keyboard where it took a key press two seconds to show up on screen? That’s the typical latency for most voice interfaces, so it’s no wonder they’ve failed to catch on for most people. Today we’re open sourcing Moonshine, a new speech to text model that returns results faster and more efficiently than the current state of the art, OpenAI’s Whisper, while matching or exceeding its accuracy.

Speech Recognition, Artificial Intelligence, Open Source, Technology

10 points by jamescham 164 days ago | 1 comments

Meta Spirit LM: Open multimodal language model that freely mixes text and speech (twitter.com)

Meta, Language Models, Open Source, Multimodal AI, Speech Recognition

13 points by anjneymidha 167 days ago | 4 comments

Show HN: SpeakMyVoice – App for people with vocal or speech difficulties (speakmyvoice.com)
With SpeakMyVoice, you're always part of the conversation.

Accessibility, Speech Recognition, Communication

44 points by 1mbsite 171 days ago | 7 comments

Omni SenseVoice: High-Speed Speech Recognition with Words Timestamps (github.com/lifeiteng)
Built on SenseVoice, Omni SenseVoice is optimized for lightning-fast inference and precise timestamps—giving you a smarter, faster way to handle audio transcription!

Speech Recognition, Audio Transcription, Software, Open Source

169 points by ringer007 173 days ago | 27 comments

Improving Whisper Transcriptions with GPT-4o (github.com/orcaman)
I was watching the latest news episode from Whisky.com (where fine spirits meet ™) the other day on YouTube, and noticed that the transcription was really off.

AI, OpenAI, Speech Recognition, Transcription

6 points by _orcaman_ 181 days ago | 1 comments

Whisper-Large-v3-Turbo (huggingface.co)
Whisper is a state-of-the-art model for automatic speech recognition (ASR) and speech translation, proposed in the paper Robust Speech Recognition via Large-Scale Weak Supervision by Alec Radford et al. from OpenAI. Trained on >5M hours of labeled data, Whisper demonstrates a strong ability to generalise to many datasets and domains in a zero-shot setting.

Generative AI, Machine Learning, Speech Recognition

5 points by mfiguiere 182 days ago | 0 comments

Show HN: Reverb ASR+Diarization, the Best Open Source ASR for Long-Form Audio (ycombinator.com)
Today, we are launching and open sourcing our current generation ASR models named "Reverb."

Open Source, Speech Recognition, Audio Processing

12 points by leetharris 182 days ago | 1 comments

VoiceRAG: A pattern for RAG and voice with the GPT-4o Realtime API for audio (microsoft.com)
The new Azure OpenAI gpt-4o-realtime-preview model opens the door for even more natural application user interfaces with its speech-to-speech capability.

Generative AI, Artificial Intelligence, Microsoft, Speech Recognition, API

11 points by pmc00 183 days ago | 0 comments

Show HN: Speech-to-speech playground for OpenAI's new Realtime API (livekit.io)
Try OpenAI's new Realtime API right from your browser.

OpenAI, Speech Recognition, Real-time APIs, Web Development

10 points by bcherry 184 days ago | 11 comments

Llama 3.1 Omni Model (github.com/ictnlp)
LLaMA-Omni is a speech-language model built upon Llama-3.1-8B-Instruct, It supports low-latency and high-quality speech interactions, simultaneously generating both text and speech responses based on speech instructions.

Generative AI, Speech Recognition

304 points by taikon 197 days ago | 41 comments

Moshi: A speech-text foundation model for real time dialogue (github.com/kyutai-labs)
Moshi is a speech-text foundation model and full-duplex spoken dialogue framework.

Speech Recognition, Machine Learning, Dialogue Systems

365 points by gkucsko 197 days ago | 64 comments

Speech Dictation Mode for Emacs (lepisma.xyz)
There is a wide range of input mechanisms for computers, starting with keyboards (which are relatively mature) and extending to various types of neural interfaces (currently under research). Speech lies somewhere on this spectrum with a lot of promises but still not much to show for. Keeping accessibility aspects aside, I think speech is mature enough to be used for drafting ideas and taking notes. Maybe not so much for structured writing like programming or final versions of most prose.

Emacs, Speech Recognition, Text Editing, Accessibility

127 points by adityaathalye 203 days ago | 32 comments

Hugging Face tackles speech-to-speech (github.com/huggingface)

Speech Recognition, AI, Software

27 points by andito 213 days ago | 5 comments

Recording and Processing Spoken Word (tratt.net)

Speech Recognition, Audio Processing

20 points by ltratt 226 days ago | 2 comments

A powerful tool for converting speech into text (trintai.com)

Speech Recognition, AI

6 points by allamaso 238 days ago | 5 comments

Language model can listen while speaking (huggingface.co)