Hacker News with Generative AI: Data Sets

Meta torrented & seeded 81.7 TB dataset containing copyrighted data (arstechnica.com)
Newly unsealed emails allegedly provide the "most damning evidence" yet against Meta in a copyright case raised by book authors alleging that Meta illegally trained its AI models on pirated books.
Copyright Law, Artificial Intelligence, Meta, Legal Cases, Data Sets
1270 points by gameshot911 28 days ago | 934 comments
Bluesky Social Dataset (235M posts from 4M users) (zenodo.org)
Pollution of online social spaces caused by rampaging d/misinformation is a growing societal concern. However, recent decisions to reduce access to social media APIs are causing a shortage of publicly available, recent, social media data, thus hindering the advancement of computational social science as a whole. To address this pressing issue, we present a large, high-coverage dataset of social interactions and user-generated content from Bluesky Social.
Social Media, Data Sets, Information Misinformation
91 points by 7d7n 99 days ago | 40 comments
Foursquare Open Source Places: Foundational dataset for the geospatial community (foursquare.com)
In an effort to change that dynamic, we are announcing today the general availability of a foundational open data set, Foursquare Open Source Places (“FSQ OS Places”).
Open Source, Geospatial Data, Data Sets, Community
7 points by pr337h4m 107 days ago | 0 comments
Show HN: 4B+ DNS Records Dataset (merklemap.com)
Introducing the world's most comprehensive and extensive DNS (Domain Name System) records database with more than 4 billion records.
DNS, Data Sets, Databases, Internet, Networking
90 points by Eikon 142 days ago | 28 comments
Call of Duty: Warzone Caldera Data Set for Academic Use (activision.com)
Video Games, Data Sets, Academic Research
178 points by noch 219 days ago | 95 comments
OpenAI destroyed a trove of books used to train AI models (businessinsider.com)
OpenAI, Artificial Intelligence, Data Sets, Training Data
34 points by nitramm 301 days ago | 35 comments
Building a Large Japanese Web Corpus for Large Language Models (arxiv.org)
Japanese Language, Data Sets, Research
76 points by PaulHoule 310 days ago | 29 comments