Hacker News with Generative AI: Data Scraping

Show HN: I Built a FAANG Job Board – Only Jobs Scraped in the Last 24h (topjobstoday.com)
🌟 The #1 platform for tech job seekers - join our growing community today

Jobs, Tech, Software, Web Development, Data Scraping

11 points by stasman 2 days ago | 3 comments

League of Legends data scraping the hard and tedious way for fun (maknee.github.io)
League of Legends is one of the world’s most popular competitive games, with millions of players generating vast amounts of gameplay data daily. Basic match statistics are available, but accessing moment-by-moment gameplay data is near impossible. This article demonstrates how to create a high-fidelity dataset by reverse engineering the game engine, capturing information such as precise player positions to ability usage timings and damage calculations.

Game Development, Data Scraping

157 points by maknee 8 days ago | 37 comments

Microsoft Word and Excel AI data scraping switched to opt-in by default (tomshardware.com)

Microsoft Word, Excel, AI, Data Scraping, Privacy

103 points by oldnetguy 86 days ago | 50 comments

ByteDance is abusing the free video downloading service Cobalt for mass scraping (twitter.com)

ByteDance, Social Media, Data Scraping, Privacy, Ethics

138 points by jsheard 137 days ago | 56 comments

Cloudflare's new marketplace lets websites charge AI bots for scraping (techcrunch.com)
Cloudflare announced plans on Monday to launch a marketplace in the next year where website owners can sell AI model providers access to scrape their site’s content. The marketplace is the final step of Cloudflare CEO Matthew Prince’s larger plan to give publishers greater control over how and when AI bots scrape their websites.

Web Development, AI, Business, Data Scraping

412 points by boristsr 150 days ago | 270 comments

Some Suggestions to Improve Robots.txt (ietf.org)
The BBC does not believe the current scraping of its content and data without permission in order to train generative AI models is in the public interest, and wants to agree a more structured and sustainable approach with technology companies.

Web Development, Artificial Intelligence, Data Scraping

14 points by 0xFF0123 155 days ago | 2 comments

LinkedIn silently opts users into generative AI data scraping by default (bsky.app)

Privacy, Generative AI, LinkedIn, Data Scraping, Social Media

6 points by diggan 155 days ago | 2 comments

LinkedIn scraped user data for training before updating its terms of service (techcrunch.com)
LinkedIn may have trained AI models on user data without updating its terms.

Privacy, AI, LinkedIn, Data Scraping, Legal Issues

36 points by mfiguiere 155 days ago | 14 comments

Game UI Database slowdown caused by relentless OpenAI scraping (gamedeveloper.com)

Game Development, Artificial Intelligence, Data Scraping

13 points by raytopia 164 days ago | 3 comments

Is it legal and possible to scrape the social media platforms? (ycombinator.com)
Given links to posts, is it legal & possible to scrape from social media such as YT, FB, Insta, TikTok & Snap?

Legal Issues, Social Media, Data Scraping

13 points by iamnnk 167 days ago | 10 comments

Leaked Docs Show Nvidia Scraping a Human Lifetime of Videos per Day to Train AI (404media.co)

Artificial Intelligence, Data Scraping, Privacy, Nvidia, Training Data

50 points by depingus 199 days ago | 11 comments

AI startup Anthropic accused of 'egregious' data scraping (ft.com)

AI, Data Scraping, Ethics, Startups

7 points by marban 207 days ago | 0 comments

Show HN: I scraped 3.2B TikTok profiles and 9B posts to build this search engine (seeksocial.io)

Data Scraping, Social Media, Search Engines, TikTok

22 points by IWantAllTheData 220 days ago | 20 comments

Storing Scraped Data in an SQLite Database on GitHub (jerrynsh.com)