Hacker News with Generative AI: Text Generation

Strengths and limitations of diffusion language models (seangoedecke.com)
Google recently released Gemini Diffusion, which is impressing everyone with its speed. Supposedly they even had to slow down the demo so people could see what was happening. What’s special about diffusion models that makes text generation so much faster? Should every text model be a diffusion model, going forward?

Generative AI, Text Generation

68 points by rbanffy 1 day ago | 7 comments

Refactoring Clojure (orsolabs.com)
This article is based on Writing Friendlier Clojure by Adam Bard, where he shows his approach at refactoring some Clojure code that implements an order-1 word-level Markov text generator.

Clojure, Programming Languages, Refactoring, Text Generation, Markov Chains

94 points by luu 8 days ago | 34 comments

Qwen2.5-Omni Technical Report (huggingface.co)
In this report, we present Qwen2.5-Omni, an end-to-end multimodal model designed to perceive diverse modalities, including text, images, audio, and video, while simultaneously generating text and natural speech responses in a streaming manner.

Generative AI, Multimodal, Text Generation, Speech Generation

6 points by wertyk 54 days ago | 0 comments

A new semantic chunking approach for RAG (gpt3experiments.substack.com)
As we saw in my last blog post, there is a shape for stories.

Artificial Intelligence, Text Generation, Information Retrieval

49 points by nutanc 241 days ago | 27 comments

Llms.txt (llmstxt.org)

Text Generation, AI

206 points by polyrand 262 days ago | 175 comments

LongWriter: Unleashing 10k Word Generation from Long Context LLMs (arxiv.org)

Generative AI, Text Generation

7 points by PaulHoule 269 days ago | 1 comments

Claude 3.5 Sonnet Reproduces BIG-Bench Canary String (lesswrong.com)