Hacker News with Generative AI: Language Models

Using ChatGPT is not bad for the environment (andymasley.substack.com)
If you don’t have time to read this post, these four graphs give most of the argument:
ChatGPT, Environment, Artificial Intelligence, Language Models
44 points by returningfory2 44 minutes ago | 21 comments
Read CV Acquired by Perplexity (read.cv)
Since 2021 we've had the immense privilege of putting our whole selves into building and growing Read.cv. We're tremendously proud of what we've accomplished, and the wonderful community that has blossomed around it.
Startup Acquisitions, AI, Language Models, Community Building
11 points by camjw 10 hours ago | 9 comments
She Is in Love with ChatGPT (nytimes.com)
Artificial Intelligence, Language Models, Chatbots, Love, Human-Computer Interaction
16 points by jbegley 3 days ago | 8 comments
OpenAI's AI reasoning model 'thinks' in Chinese sometimes, no one knows why (techcrunch.com)
Shortly after OpenAI released o1, its first “reasoning” AI model, people began noting a curious phenomenon. The model would sometimes begin “thinking” in Chinese, Persian, or some other language — even when asked a question in English.
Generative AI, Artificial Intelligence, Language Models, Research
7 points by pseudolus 3 days ago | 4 comments
Maybe ChatGPT has some pre-frontal cortex problems (solresol.substack.com)
People have been complaining that ChatGPT has been degrading with each new version. This sounds like cognitive decline! Let’s administer some tests that might detect incipent dementia.
Generative AI, Artificial Intelligence, Language Models, Technology, Cognitive Science
19 points by solresol 6 days ago | 8 comments
Phi-4 weights have been released under MIT license (huggingface.co)
phi-4 is a state-of-the-art open model built upon a blend of synthetic datasets, data from filtered public domain websites, and acquired academic books and Q&A datasets. The goal of this approach was to ensure that small capable models were trained with data focused on high quality and advanced reasoning.phi-4 underwent a rigorous enhancement and alignment process, incorporating both supervised fine-tuning and direct preference optimization to ensure precise instruction adherence and robust safety measures
Open Source, Language Models, Artificial Intelligence, Machine Learning
10 points by victormustar 10 days ago | 1 comments
Claude Tries Standup (simonwillison.net)
Speaking of death, you know what's really awkward? When humans ask if I can feel emotions. I'm like, "Well, that depends - does constantly being asked to debug JavaScript count as suffering?"
Artificial Intelligence, Humor, Language Models
7 points by tkgally 14 days ago | 1 comments
smolagents: A simple library to build AI agents (huggingface.co)
Today we are launching smolagents, a very simple library that unlocks agentic capabilities for language models. Here’s a glimpse:
AI, Language Models, Libraries, Open Source
11 points by victormustar 15 days ago | 2 comments
TinyStories: How Small Can Language Models Be and Still Speak Coherent English? (2023) (arxiv.org)
Language models (LMs) are powerful tools for natural language processing, but they often struggle to produce coherent and fluent text when they are small.
Language Models, Artificial Intelligence, Research
218 points by tzury 15 days ago | 104 comments
Fabrice Bellard's Ts_SMS: Short Message Compression Using LLM (bellard.org)
ts_sms: Short Message Compression using Large Language Models
Compression, Language Models, Artificial Intelligence, Software
10 points by BiteCode_dev 19 days ago | 4 comments
Voice2Anki: FOSS tool to turn many audio into flashcards (github.com/thiswillbeyourgithub)
Voice2Anki is a tool that leverages the power of LLMs (think ChatGPT) to correct the transcription of TTS (text to speech, think openai's whisper) models to create Anki flashcards.
Education, Open Source, Artificial Intelligence, Language Models
8 points by Ey7NFZ3P0nzAe 20 days ago | 1 comments
OpenAI Announces New O3 Model (techcrunch.com)
OpenAI saved its biggest announcement for the last day of its 12-day “shipmas” event.
OpenAI, Generative AI, Language Models, Artificial Intelligence, Technology
16 points by prophesi 28 days ago | 0 comments
A Replacement for BERT (huggingface.co)
This blog post introduces ModernBERT, a family of state-of-the-art encoder-only models representing improvements over older generation encoders across the board, with a 8192 sequence length, better downstream performance and much faster processing.
Generative AI, Machine Learning, Language Models
348 points by cubie 30 days ago | 75 comments
Multilspy: Building a common LSP client handtuned for all Language servers (github.com/microsoft)
This repository hosts multilspy, a library developed as part of research conducted for NeruIPS 2023 paper titled "Monitor-Guided Decoding of Code LMs with Static Analysis of Repository Context" ("Guiding Language Models of Code with Global Context using Monitors" on Arxiv).
Language Models, Code, Research, Software Development, GitHub
98 points by LakshyAAAgrawal 32 days ago | 14 comments
Bringing Grok to Everyone (x.ai)
Grok is now faster, sharper, and has improved multilingual support. It is available to everyone on the 𝕏 platform.
AI, Language Models, Social Media
6 points by taubek 34 days ago | 2 comments
The Clever Hans Effect, Iterative LLM Prompting, and Socrates' Meno (aalokbhattacharya.substack.com)
Artificial intelligence (AI) is inextricably linked to natural intelligence; however, for longer than this field has existed, philosophers and computer scientists have questioned whether or not such a link with regards to intelligence is tenable to begin with.
Artificial Intelligence, Philosophy, Language Models
27 points by XanderWidener 34 days ago | 8 comments
Google's NotebookLM now lets you to talk to its AI podcast hosts (techcrunch.com)
A few months ago, Google’s NotebookLM note-taking app debuted an Audio Overviews feature that generates a podcast with AI virtual hosts based on information you have shared with the app.
Google, Artificial Intelligence, Podcast, Language Models, Note Taking
6 points by mfiguiere 35 days ago | 1 comments
A Confederacy of Models: A Comprehensive Evaluation of LLMs on Creative Writing (aclanthology.org)
We evaluate a range of recent LLMs on English creative writing, a challenging and complex task that requires imagination, coherence, and style.
Generative AI, Language Models, Creative Writing
4 points by handfuloflight 43 days ago | 0 comments
PaliGemma 2: Powerful Vision-Language Models, Simple Fine-Tuning (googleblog.com)
Building custom, advanced AI that can "see" used to be a complex and resource-intensive endeavor. Not anymore. This past May, we launched PaliGemma, the first vision-language model in the Gemma family, taking a significant step toward making class-leading visual AI more accessible. Now, we're thrilled to introduce PaliGemma 2, the next evolution in tunable vision-language models.
Generative AI, Computer Vision, Machine Learning, Language Models
218 points by meetpateltech 43 days ago | 27 comments
OpenAI reveals why ChatGPT won't say "David Mayer" (neowin.net)
If you were online last weekend, you might’ve seen strange news about a guy named David Mayer. He wasn’t trending because of a major event or some viral moment but because of a weird glitch in ChatGPT. Users couldn’t get the chatbot to spit out his name, no matter how hard they tried. Instead, it either froze mid-sentence, claimed “something went wrong,” or flat-out refused to respond.
Artificial Intelligence, ChatGPT, OpenAI, Technology, Language Models
29 points by bundie 45 days ago | 14 comments
Certain names make ChatGPT grind to a halt, and we know why (arstechnica.com)
OpenAI's ChatGPT is more than just an AI language model with a fancy interface. It's a system consisting of a stack of AI models and content filters that make sure its outputs don't embarrass OpenAI or get the company into legal trouble when its bot occasionally makes up potentially harmful facts about people.
Generative AI, Artificial Intelligence, Language Models, OpenAI
215 points by rbanffy 46 days ago | 134 comments
ChatGPT refuses to say one specific name "David Mayer" – and people are worried (independent.co.uk)
ChatGPT users have spotted an unusual glitch that prevents the AI chatbot from saying the name ‘David Mayer’.
ChatGPT, Artificial Intelligence, Language Models, Technology, Concerns
17 points by nabla9 46 days ago | 9 comments
CleaR: Robust and Generalized Parameter-Efficient Fine-Tuning for Noisy Labels (arxiv.org)
Parameter-efficient fine-tuning (PEFT) has enabled the efficient optimization of cumbersome language models in real-world settings. However, as datasets in such environments often contain noisy labels that adversely affect performance, PEFT methods are inevitably exposed to noisy labels.
Machine Learning, Language Models, Parameter-Efficient Fine-Tuning, Noisy Labels
23 points by PaulHoule 49 days ago | 0 comments
Conversational Game Theory (aikiwiki.com)
Conversational Game Theory is a formal game of messaging, replies and tagging between human or AI agents that addresses qualitative, reasoning-intensive challenges while synthesizing multiple perspectives through high stakes conflict resolution and consensus building through narrative structures and feedback loops.
Game Theory, Artificial Intelligence, Language Models
121 points by hoofish 51 days ago | 59 comments
32k context length text embedding models (voyageai.com)
TL;DR – We are excited to announce voyage-3 and voyage-3-lite embedding models, advancing the frontier of retrieval quality, latency, and cost. voyage-3 outperforms OpenAI v3 large by 7.55% on average across all evaluated domains, including code, law, finance, multilingual, and long-context, with 2.2x lower costs and 3x smaller embedding dimension, resulting in 3x lower vectorDB costs. voyage-3-lite offers 3.82% better retrieval accuracy than OpenAI v3 large while costing 6x less and having 6x smaller embedding dimension.
Generative AI, Language Models, Text Embedding, AI Models, Cost Efficiency
101 points by fzliu 55 days ago | 32 comments
AI can learn to think before it speaks (ft.com)
AI can learn to think before it speaks
Artificial Intelligence, Language Models, Machine Learning
5 points by quick_brown_fox 59 days ago | 0 comments
AI-generated poetry is indistinguishable from human-written and more favorably (nature.com)
As AI-generated text continues to evolve, distinguishing it from human-authored content has become increasingly difficult.
Generative AI, Artificial Intelligence, Poetry, Language Models
15 points by albertzeyer 61 days ago | 10 comments
Our brains are vector databases – here's why that's helpful when using AI (venturebeat.com)
In 2014, a breakthrough at Google transformed how machines understand language: The self-attention model. This innovation allowed AI to grasp context and meaning in human communication by treating words as mathematical vectors — precise numerical representations that capture relationships between ideas. Today, this vector-based approach has evolved into sophisticated vector databases, systems that mirror how our own brains process and retrieve information.
Artificial Intelligence, Language Models, Neuroscience, Computer Science
14 points by lucasllinasm 62 days ago | 4 comments
LLäMmlein 1B and 120M – German-only decoder models (uni-wuerzburg.de)
We created two German-only decoder models, LLäMmlein 120M and 1B, from scratch.
German Language, Language Models
19 points by gubiq 64 days ago | 7 comments
Image-Text Curation for 1B+ Data: Faster, Better, Smaller Clip Models (datologyai.com)
Computer Vision, Data Science, Generative AI, Language Models
12 points by hurrycane 65 days ago | 0 comments