Hacker News with Generative AI: Training Data

SwiGLU activation function causes instability in FP8 LLM training (arxiv.org)
We train, for the first time, large language models using FP8 precision on datasets up to 2 trillion tokens -- a 20-fold increase over previous limits.
Artificial Intelligence, Machine Learning, Training Data, Hardware
10 points by LarsDu88 61 days ago | 2 comments
Leaked Docs Show Nvidia Scraping a Human Lifetime of Videos per Day to Train AI (404media.co)
Artificial Intelligence, Data Scraping, Privacy, Nvidia, Training Data
50 points by depingus 108 days ago | 11 comments
Apple, Nvidia, Anthropic Used Swiped YouTube Videos to Train AI (proofnews.org)
Artificial Intelligence, Training Data, YouTube, AI Ethics, Copyright
41 points by gwintrob 127 days ago | 66 comments
YouTube creators surprised to find Apple and others trained AI on their videos (arstechnica.com)
YouTube, Artificial Intelligence, Copyright, Training Data, Content Creation
5 points by ourmandave 127 days ago | 3 comments
Figma will use your content to train its AI (stackdiary.com)
Figma, Artificial Intelligence, Training Data
20 points by tgol 144 days ago | 4 comments
OpenAI destroyed a trove of books used to train AI models (businessinsider.com)
OpenAI, Artificial Intelligence, Data Sets, Training Data
34 points by nitramm 196 days ago | 35 comments