Hacker News with Generative AI: Datasets

Harvard Is Releasing a Free AI Training Dataset (wired.com)
Harvard University announced Thursday it’s releasing a high-quality dataset of nearly 1 million public-domain books that could be used by anyone to train large language models and other AI tools.

Artificial Intelligence, Education, Datasets

75 points by ilamont 30 days ago | 11 comments

Datasaurus dozen – Different datasets with the same descriptive statistics (wikipedia.org)
The Datasaurus dozen comprises thirteen data sets that have nearly identical simple descriptive statistics to two decimal places, yet have very different distributions and appear very different when graphed.[1] It was inspired by the smaller Anscombe's quartet that was created in

Data Visualization, Statistics, Datasets, Data Science

14 points by yread 35 days ago | 1 comments

Foursquare Open Source Places: A new foundational dataset (simonwillison.net)
Foursquare Open Source Places: A new foundational dataset for the geospatial community (via) I did not expect this!

Open Source, Geospatial Data, Datasets, Foursquare, Location Data

154 points by po 59 days ago | 28 comments

Seeing faces in things: A model and dataset for pareidolia (mhamilton.net)
The human visual system is well-tuned to detect faces of all shapes and sizes. While this brings obvious survival advantages, such as a better chance of spotting unknown predators in the bush, it also leads to spurious face detections. "Face pareidolia" describes the perception of face-like structure among otherwise random stimuli: seeing faces in coffee stains or clouds in the sky. In this paper, we study face pareidolia from a computer vision perspective.

Computer Vision, Psychology, Artificial Intelligence, Datasets

61 points by sebg 88 days ago | 9 comments

Show HN: What's HN Working On – A structured dataset (github.com/getomni-ai)

Hacker News, Datasets, Data Analysis, Artificial Intelligence

7 points by themanmaran 145 days ago | 0 comments

Trailer Faces HQ Dataset (justinpinkney.com)

Computer Vision, Datasets, Machine Learning

46 points by surprisetalk 153 days ago | 9 comments

Show HN: Fineweb-Edu-Fortified dataset: Fineweb-Edu deduped, embeddings included (huggingface.co)

Machine Learning, Datasets

22 points by neutralino1 157 days ago | 0 comments

A multimodal dataset with one trillion tokens (github.com/mlfoundations)