Hacker News with Generative AI: Reasoning

Sketch-of-Thought: Efficient LLM Reasoning (arxiv.org)
Recent advances in large language models have demonstrated remarkable reasoning capabilities through Chain of Thought (CoT) prompting, but often at the cost of excessive verbosity in their intermediate outputs, which increases computational overhead.
Generative AI, Reasoning
43 points by cal85 17 days ago | 4 comments
Engineering Reasoning LLMs: Notes and Observations (thelis.org)
Reasoning models are LLMs that are designed to tackle complex tasks that require multiple steps of reasoning. OpenAI’s o1 was the first mainstream reasoning model, and showed remarkable results on highly complex questions. A torrent of papers were published subsequent to o1, each exploring how to build these types of systems. Most recently, DeepSeek-R1 has captured attention as a state-of-the-art reasoning model with a published methodology.
Artificial Intelligence, Reasoning
6 points by rdli 22 days ago | 0 comments
Cognitive Behaviors That Enable Self-Improving Reasoners (arxiv.org)
Test-time inference has emerged as a powerful paradigm for enabling language models to ``think'' longer and more carefully about complex challenges, much like skilled human experts.
Artificial Intelligence, Language Models, Reasoning, Machine Learning
279 points by delifue 27 days ago | 103 comments
Order Doesn’t Matter, But Reasoning Does (arxiv.org)
Artificial Intelligence, Reasoning, Logic
14 points by spaintech 30 days ago | 16 comments
Claude 3.7 Sonnet and Claude Code (anthropic.com)
Today, we’re announcing Claude 3.7 Sonnet1, our most intelligent model to date and the first hybrid reasoning model on the market.
Generative AI, AI Models, Language Models, Reasoning
2127 points by bakugo 37 days ago | 963 comments
General Reasoning: Free, open resource for building large reasoning models (gr.inc)
1,568,725 questions and 268,241 chain-of-thought traces to train open models
Generative AI, Open Source, Reasoning
88 points by rglover 40 days ago | 30 comments
Grok 3 Beta – The Age of Reasoning Agents (x.ai)
We are thrilled to unveil an early preview of Grok 3, our most advanced model yet, blending superior reasoning with extensive pretraining knowledge.
Artificial Intelligence, Beta Releases, Reasoning
19 points by zachur 41 days ago | 1 comments
Reasoning models are just LLMs (antirez.com)
It’s not new, but it’s accelerating. People that used to say that LLMs were a fundamentally flawed way to reach any useful reasoning and, in general, to develop any useful tool with some degree of generality, are starting to shuffle the deck, in the hope to look less wrong. They say: “the progresses we are seeing are due to the fact that models like OpenAI o1 or DeepSeek R1 are not just LLMs”.
Artificial Intelligence, Reasoning, Generative AI
66 points by rognjen 52 days ago | 14 comments
LIMO: Less Is More for Reasoning (arxiv.org)
We present a fundamental discovery that challenges our understanding of how complex reasoning emerges in large language models.
Artificial Intelligence, Reasoning, Machine Learning
389 points by trott 52 days ago | 128 comments
Demystifying Long Chain-of-Thought Reasoning in LLMs (arxiv.org)
Scaling inference compute enhances reasoning in large language models (LLMs), with long chains-of-thought (CoTs) enabling strategies like backtracking and error correction.
Generative AI, Artificial Intelligence, Computer Science, Reasoning
11 points by Anon84 53 days ago | 0 comments
Understanding Reasoning LLMs (sebastianraschka.com)
This article describes the four main approaches to building reasoning models, or how we can enhance LLMs with reasoning capabilities. I hope this provides valuable insights and helps you navigate the rapidly evolving literature and hype surrounding this topic.
Artificial Intelligence, Reasoning, Machine Learning
473 points by sebg 55 days ago | 188 comments
Microsoft Phi 4 with R1 Reasoning (huggingface.co)
These LoRA adapters were trained using diverse reasoning datasets that incorporate structured Thought and Solution responses to enhance logical inference.
Generative AI, Artificial Intelligence, Reasoning
6 points by excsn 57 days ago | 2 comments
A Visual Guide to Reasoning LLMs (maartengrootendorst.com)
DeepSeek-R1, OpenAI o3-mini, and Google Gemini 2.0 Flash Thinking are prime examples of how LLMs can be scaled to new heights through “reasoning“ frameworks.
Generative AI, Artificial Intelligence, Reasoning
31 points by headalgorithm 58 days ago | 2 comments
Efficient Reasoning with Hidden Thinking (arxiv.org)
Chain-of-Thought (CoT) reasoning has become a powerful framework for improving complex problem-solving capabilities in Multimodal Large Language Models (MLLMs). However, the verbose nature of textual reasoning introduces significant inefficiencies.
Artificial Intelligence, Reasoning, Computer Science
172 points by fofoz 58 days ago | 43 comments
OpenAI launches o3-mini, its latest 'reasoning' model (techcrunch.com)
OpenAI on Friday launched a new AI “reasoning” model, o3-mini, the newest in the company’s o family of reasoning models.
OpenAI, Artificial Intelligence, Generative AI, Reasoning
19 points by iyn 61 days ago | 2 comments
DeepSeek-R1 at 3,872 tokens / second on a single Nvidia HGX H200 (nvidia.com)
DeepSeek-R1 is an open model with state-of-the-art reasoning capabilities. Instead of offering direct responses, reasoning models like DeepSeek-R1 perform multiple inference passes over a query, conducting chain-of-thought, consensus and search methods to generate the best answer.
Artificial Intelligence, Open Source, Reasoning
13 points by moondistance 61 days ago | 1 comments
Open-R1: an open reproduction of DeepSeek-R1 (huggingface.co)
OpenAI’s o1 model showed that when LLMs are trained to do the same—by using more compute during inference—they get significantly better at solving reasoning tasks like mathematics, coding, and logic.
Open Source, Artificial Intelligence, Reasoning, Computer Science
394 points by jonbaer 64 days ago | 233 comments
Bespoke-Stratos: The unreasonable effectiveness of reasoning distillation (bespokelabs.ai)
We trained Bespoke-Stratos-32B, our reasoning model distilled from DeepSeek-R1 using Berkeley NovaSky’s Sky-T1 data pipeline.
Generative AI, Machine Learning, Reasoning, AI Research
13 points by madiator 66 days ago | 2 comments
Official DeepSeek R1 Now on Ollama (ollama.com)
DeepSeek’s first-generation reasoning models, achieving performance comparable to OpenAI-o1 across math, code, and reasoning tasks.
AI, Reasoning, New Releases
234 points by excerionsforte 72 days ago | 80 comments
Mulberry: Empowering MLLM with o1-like Reasoning (arxiv.org)
In this work, we aim to develop an MLLM that understands and solves questions by learning to create each intermediate step of the reasoning involved till the final answer.
Artificial Intelligence, Reasoning, Research
3 points by Anon84 92 days ago | 0 comments
Coconut by Meta AI – Better LLM Reasoning with Chain of Continuous Thought? (aipapersacademy.com)
Large language models (LLMs) have demonstrated incredible reasoning abilities, penetrating an increasing number of domains in our lives.
Artificial Intelligence, Reasoning
362 points by TaurenHunter 92 days ago | 156 comments
Reimagining mathematics in a world of reasoning machines [video] (youtube.com)
Mathematics, Artificial Intelligence, Reasoning, Video
74 points by kentricon 104 days ago | 41 comments
Are LLMs capable of non-verbal reasoning? (arstechnica.com)
Processing in the "latent space" could help AI with tricky logical questions.
Generative AI, Artificial Intelligence, Reasoning
6 points by Netherland4TW 110 days ago | 0 comments
Phi-4: Microsoft's Newest Small Language Model Specializing in Complex Reasoning (microsoft.com)
Today we are introducing Phi-4, our 14B parameter state-of-the-art small language model (SLM) that excels at complex reasoning in areas such as math, in addition to conventional language processing.
Artificial Intelligence, Microsoft, Reasoning, Software
439 points by lappa 110 days ago | 143 comments
Training LLMs to Reason in a Continuous Latent Space (arxiv.org)
Large language models (LLMs) are restricted to reason in the "language space", where they typically express the reasoning process with a chain-of-thought (CoT) to solve a complex reasoning problem.
Generative AI, Machine Learning, Artificial Intelligence, Reasoning
283 points by omarsar 113 days ago | 114 comments
DeepThought-8B: A small, capable reasoning model (ruliad.co)
Today we're releasing DeepThought-8B, a small, capable AI reasoning model built on LLaMA-3.1 8B.
Artificial Intelligence, New Releases, Reasoning
134 points by AnhTho_FR 126 days ago | 104 comments
The Problem with Reasoners (notion.site)
Reasoning, Philosophy, Artificial Intelligence
32 points by lawrencechen 127 days ago | 2 comments
LLaVA-O1: Let Vision Language Models Reason Step-by-Step (arxiv.org)
Large language models have demonstrated substantial advancements in reasoning capabilities, particularly through inference-time scaling, as illustrated by models such as OpenAI's o1. However, current Vision-Language Models (VLMs) often struggle to perform systematic and structured reasoning, especially when handling complex visual question-answering tasks.
Computer Vision, Reasoning, Artificial Intelligence
177 points by lnyan 135 days ago | 32 comments
Reasonable Person Principle (cs.cmu.edu)
Everyone will be reasonable. Everyone expects everyone else to be reasonable. No one is special. Do not be offended if someone suggests you are not being reasonable.
Reasoning, Social Dynamics, Ethics
75 points by yamrzou 149 days ago | 69 comments
Detecting when LLMs are uncertain (thariq.io)
This post tries to explain the new reasoning techniques developed by XJDR in a new project called Entropix.
Generative AI, Artificial Intelligence, Reasoning
283 points by trq_ 159 days ago | 167 comments