Hacker News with Generative AI: Reinforcement Learning

A path to O1 open source (arxiv.org)
OpenAI o1 represents a significant milestone in Artificial Inteiligence, which achieves expert-level performances on many challanging tasks that require strong reasoning this http URL has claimed that the main techinique behinds o1 is the reinforcement learining.

Artificial Intelligence, Open Source, Reinforcement Learning

133 points by bchelli 14 days ago | 80 comments

Offline Reinforcement Learning for LLM Multi-Step Reasoning (arxiv.org)
Improving the multi-step reasoning ability of large language models (LLMs) with offline reinforcement learning (RL) is essential for quickly adapting them to complex tasks.

Reinforcement Learning, Artificial Intelligence

111 points by belter 26 days ago | 9 comments

Puffer.ai – Simplifying reinforcement learning for complex game environments (puffer.ai)
PufferLib is the reinforcement learning library I wish existed during my PhD. It started as a compatibility layer to make working with complex environments a breeze. Now, it's a high-performance toolkit for research and industry with optimized parallel simulation, environments that run and train at 1M+ steps/second, and tons of quality of life improvements for practitioners. All our tools are free and open source. We also offer priority service for companies, startups, and labs!

Reinforcement Learning, Artificial Intelligence, Open Source, Game Development, Research

9 points by marcin_konow 34 days ago | 0 comments

Decisions and Dragons (decisionsanddragons.com)
A guide to the perilous world of reinforcement learning.

Reinforcement Learning, Machine Learning, Artificial Intelligence, Computer Science

6 points by todsacerdoti 59 days ago | 0 comments

Batched reward model inference and Best-of-N sampling (raw.sh)
Reward models have been a key part of reinforcement learning on top of LLMs, used broadly in techniques like RLHF and as LLM-as-a-judge critics in evals.

Reinforcement Learning, Artificial Intelligence, Machine Learning

34 points by rawsh 60 days ago | 0 comments

Reinforcement Learning – My Algorithm vs. State of the Art [video] (youtube.com)

Reinforcement Learning, Machine Learning, Artificial Intelligence, Video

6 points by sandebert 67 days ago | 0 comments

Show HN: RL Agent that can auto-optimize your LLM prompts (nomadic-ml.github.io)
The RL Prompt Optimizer employs a reinforcement learning framework to iteratively improve prompts used for language model evaluations.

Reinforcement Learning, Machine Learning, Prompt Engineering

14 points by varunkrishnan17 70 days ago | 2 comments

WebRL: Training LLM Web Agents via Self-Evolving Online Reinforcement Learning (arxiv.org)
Large language models (LLMs) have shown remarkable potential as autonomous agents, particularly in web-based tasks.

Artificial Intelligence, Reinforcement Learning, Web Development

23 points by theredsix 74 days ago | 1 comments

Using reinforcement learning and $4.80 of GPU time to find the best HN post (openpipe.ai)
Using Reinforcement Learning and $4.80 of GPU Time to Find the Best HN Post Ever (RLHF Part 1)

Reinforcement Learning, Artificial Intelligence, Hacker News, Machine Learning

217 points by kcorbitt 82 days ago | 95 comments

Reinforcement Learning: An Introduction (2018) (incompleteideas.net)

Reinforcement Learning, Machine Learning, Artificial Intelligence, Computer Science, Education

120 points by ibobev 88 days ago | 23 comments

Supporting Task Switching with Reinforcement Learning (dl.acm.org)
Human attention is a limited resource, but it is stressed more than ever before in history [2, 81].

Reinforcement Learning, Human-Computer Interaction, Artificial Intelligence

20 points by Topfi 92 days ago | 0 comments

Diffusion for World Modeling (diamond-wm.github.io)
DIAMOND 💎 (DIffusion As a Model Of eNvironment Dreams) is a reinforcement learning agent trained entirely in a diffusion world model. The agent playing in the diffusion model is shown above.

Reinforcement Learning, World Modeling, Generative AI

476 points by francoisfleuret 97 days ago | 218 comments

Training Language Models to Self-Correct via Reinforcement Learning (arxiv.org)
Self-correction is a highly desirable capability of large language models (LLMs), yet it has consistently been found to be largely ineffective in modern LLMs.

Generative AI, Reinforcement Learning, Machine Learning

230 points by weirdcat 120 days ago | 92 comments

Show HN: LeanRL: Fast PyTorch RL with Torch.compile and CUDA Graphs (github.com/pytorch-labs)
LeanRL is a lightweight library consisting of single-file, pytorch-based implementations of popular Reinforcement Learning (RL) algorithms.

Reinforcement Learning, PyTorch, Machine Learning, Open Source, Software

53 points by vmoens 120 days ago | 5 comments

RLHF is just barely RL (twitter.com)

Machine Learning, Reinforcement Learning, Artificial Intelligence

386 points by tosh 163 days ago | 257 comments

Andrej Karpathy on X: RLHF is just barely RL (twitter.com)

Reinforcement Learning, Artificial Intelligence, Twitter

15 points by bilsbie 163 days ago | 0 comments

Solving Path of Exile Item Crafting with Reinforcement Learning (dennybritz.com)

Reinforcement Learning, Gaming, Optimization

87 points by dennybritz 188 days ago | 19 comments

Mental Modeling of Reinforcement Learning Agents by Language Models (arxiv.org)

Mental Modeling, Reinforcement Learning, Artificial Intelligence, Language Models

7 points by piecerough 198 days ago | 0 comments

Augmenting biological intelligence with RL in C.elegans using optogenetics [pdf] (tch.harvard.edu)

Neuroscience, Reinforcement Learning, Biology, Optogenetics

113 points by signa11 215 days ago | 22 comments

Shadow Robot’s three-fingered hand is robust enough for reinforcement learning (ieee.org)