Hacker News with Generative AI: Scraping

Wikipedia offers AI developers its article data on Kaggle to stop scraping (siliconangle.com)
The Wikimedia Foundation, the organization behind the internet’s largest free encyclopedia Wikipedia, is offering an artificial intelligence-ready dataset on Kaggle that’s aimed at dissuading AI companies and large language model trainers from scraping the website.

Wikipedia, AI, Data, Kaggle, Scraping

13 points by giuliomagnifico 9 days ago | 1 comments

Go-away (another HTTP proxy for LLM scraper defence) (gammaspectra.live)
Self-hosted abuse detection and rule enforcement against low-effort mass AI scraping and bots.

AI, Scraping, Security, Bots, Web Development

10 points by todsacerdoti 10 days ago | 0 comments

Amazon is reviewing whether Perplexity AI improperly scraped online content (apnews.com)

Amazon, Artificial Intelligence, Copyright, Scraping, Legal

10 points by belter 301 days ago | 1 comments

Open Source LinikedIn Scraper (ycombinator.com)

Open Source, LinkedIn, Scraping

13 points by devildani 345 days ago | 21 comments