Hacker News with Generative AI: Speech Recognition

Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels (github.com/mpc001)
This repository is an open-sourced framework for speech recognition, with a primary focus on visual speech (lip-reading). It is designed for end-to-end training, aiming to deliver state-of-the-art models and enable reproducibility on audio-visual speech benchmarks.

Speech Recognition, Open Source, Machine Learning, Computer Vision

41 points by yagizdegirmenci 18 days ago | 1 comments

Chaplin: Local visual speech recognition (VSR) in real-time (github.com/amanvirparhar)
A visual speech recognition (VSR) tool that reads your lips in real-time and types whatever you silently mouth. Runs fully locally.

Speech Recognition, Real-Time, Machine Learning, Open Source, Accessibility

75 points by venusgirdle 19 days ago | 9 comments

AI uses throat vibrations to work out what someone is trying to say (newscientist.com)
People who find it difficult to speak due to a stroke or Parkinson’s disease could communicate more easily with the help of artificial intelligence.

Artificial Intelligence, Health, Communication, Speech Recognition

13 points by deadgopher 45 days ago | 1 comments

Moonshine – open-source, real-time speech-to-text in the browser (huggingface.co)

Speech Recognition, Open Source, Web Development, Artificial Intelligence

5 points by stared 64 days ago | 1 comments

WhisperNER: Unified Open Named Entity and Speech Recognition (arxiv.org)
Integrating named entity recognition (NER) with automatic speech recognition (ASR) can significantly enhance transcription accuracy and informativeness.

Speech Recognition, Open Source, Artificial Intelligence

133 points by timbilt 92 days ago | 17 comments

Play Dialog: A contextual turn-taking TTS model like NotebookLM Playground (play.ai)
PlayNoteAgentsPlaygroundPricingAPICommunityConversation (2 Speakers)Narration (1 Speaker)LanguageSpeaker 1 VoiceSpeaker 2 VoiceConnecting...Random PromptCreate Voice Clone

Speech Recognition, Artificial Intelligence, Text-to-Speech, Machine Learning

49 points by dulldata 100 days ago | 13 comments

Evaluating OpenAI Whisper's Hallucinations on Different Silences (sabrina.dev)
AI hallucinations in healthcare have made recent headlines, as OpenAI’s speech-to-text model (Whisper) has been shown to hallucinate during silences.

Generative AI, AI Hallucinations, Speech Recognition

8 points by sabrina_ramonov 114 days ago | 1 comments

Moonshine, the new state of the art for speech to text (petewarden.com)
Can you imagine using a keyboard where it took a key press two seconds to show up on screen? That’s the typical latency for most voice interfaces, so it’s no wonder they’ve failed to catch on for most people. Today we’re open sourcing Moonshine, a new speech to text model that returns results faster and more efficiently than the current state of the art, OpenAI’s Whisper, while matching or exceeding its accuracy.

Speech Recognition, Artificial Intelligence, Open Source, Technology, Software

172 points by freediver 118 days ago | 36 comments

Ask HN: Real-time speech-to-speech translation (ycombinator.com)
Has anyone had any luck with a free, offline, open-source, real-time speech-to-speech translation app on under-powered devices (i.e., older smart phones)?

Speech Recognition, Translation, Open Source, Mobile Apps

158 points by thangalin 120 days ago | 70 comments

Moonshine, the new state of the art for speech to text (petewarden.com)
Can you imagine using a keyboard where it took a key press two seconds to show up on screen? That’s the typical latency for most voice interfaces, so it’s no wonder they’ve failed to catch on for most people. Today we’re open sourcing Moonshine, a new speech to text model that returns results faster and more efficiently than the current state of the art, OpenAI’s Whisper, while matching or exceeding its accuracy.

Speech Recognition, Artificial Intelligence, Open Source, Technology

10 points by jamescham 123 days ago | 1 comments

Meta Spirit LM: Open multimodal language model that freely mixes text and speech (twitter.com)

Meta, Language Models, Open Source, Multimodal AI, Speech Recognition

13 points by anjneymidha 126 days ago | 4 comments

Show HN: SpeakMyVoice – App for people with vocal or speech difficulties (speakmyvoice.com)
With SpeakMyVoice, you're always part of the conversation.

Accessibility, Speech Recognition, Communication

44 points by 1mbsite 129 days ago | 7 comments

Omni SenseVoice: High-Speed Speech Recognition with Words Timestamps (github.com/lifeiteng)
Built on SenseVoice, Omni SenseVoice is optimized for lightning-fast inference and precise timestamps—giving you a smarter, faster way to handle audio transcription!

Speech Recognition, Audio Transcription, Software, Open Source

169 points by ringer007 132 days ago | 27 comments

Improving Whisper Transcriptions with GPT-4o (github.com/orcaman)
I was watching the latest news episode from Whisky.com (where fine spirits meet ™) the other day on YouTube, and noticed that the transcription was really off.

AI, OpenAI, Speech Recognition, Transcription

6 points by _orcaman_ 139 days ago | 1 comments

Whisper-Large-v3-Turbo (huggingface.co)
Whisper is a state-of-the-art model for automatic speech recognition (ASR) and speech translation, proposed in the paper Robust Speech Recognition via Large-Scale Weak Supervision by Alec Radford et al. from OpenAI. Trained on >5M hours of labeled data, Whisper demonstrates a strong ability to generalise to many datasets and domains in a zero-shot setting.

Generative AI, Machine Learning, Speech Recognition

5 points by mfiguiere 141 days ago | 0 comments

Show HN: Reverb ASR+Diarization, the Best Open Source ASR for Long-Form Audio (ycombinator.com)
Today, we are launching and open sourcing our current generation ASR models named "Reverb."

Open Source, Speech Recognition, Audio Processing

12 points by leetharris 141 days ago | 1 comments

VoiceRAG: A pattern for RAG and voice with the GPT-4o Realtime API for audio (microsoft.com)
The new Azure OpenAI gpt-4o-realtime-preview model opens the door for even more natural application user interfaces with its speech-to-speech capability.

Generative AI, Artificial Intelligence, Microsoft, Speech Recognition, API

11 points by pmc00 142 days ago | 0 comments

Show HN: Speech-to-speech playground for OpenAI's new Realtime API (livekit.io)
Try OpenAI's new Realtime API right from your browser.

OpenAI, Speech Recognition, Real-time APIs, Web Development

10 points by bcherry 143 days ago | 11 comments

Llama 3.1 Omni Model (github.com/ictnlp)
LLaMA-Omni is a speech-language model built upon Llama-3.1-8B-Instruct, It supports low-latency and high-quality speech interactions, simultaneously generating both text and speech responses based on speech instructions.

Generative AI, Speech Recognition

304 points by taikon 156 days ago | 41 comments

Moshi: A speech-text foundation model for real time dialogue (github.com/kyutai-labs)
Moshi is a speech-text foundation model and full-duplex spoken dialogue framework.

Speech Recognition, Machine Learning, Dialogue Systems

365 points by gkucsko 156 days ago | 64 comments

Speech Dictation Mode for Emacs (lepisma.xyz)
There is a wide range of input mechanisms for computers, starting with keyboards (which are relatively mature) and extending to various types of neural interfaces (currently under research). Speech lies somewhere on this spectrum with a lot of promises but still not much to show for. Keeping accessibility aspects aside, I think speech is mature enough to be used for drafting ideas and taking notes. Maybe not so much for structured writing like programming or final versions of most prose.

Emacs, Speech Recognition, Text Editing, Accessibility

127 points by adityaathalye 161 days ago | 32 comments

Hugging Face tackles speech-to-speech (github.com/huggingface)

Speech Recognition, AI, Software

27 points by andito 171 days ago | 5 comments

Recording and Processing Spoken Word (tratt.net)

Speech Recognition, Audio Processing

20 points by ltratt 184 days ago | 2 comments

A powerful tool for converting speech into text (trintai.com)

Speech Recognition, AI

6 points by allamaso 196 days ago | 5 comments

Language model can listen while speaking (huggingface.co)