Hacker News with Generative AI: Data Analysis

DEDA – Tracking Dots Extraction, Decoding and Anonymisation Toolkit (github.com/dfd-tud)
Document Colour Tracking Dots, or yellow dots, are small systematic dots which encode information about the printer and/or the printout itself. This process is integrated in almost every commercial colour laser printer. This means that almost every printout contains coded information about the source device, such as the serial number.
Privacy, Security, Software, Data Analysis
125 points by pavel_lishin 4 hours ago | 41 comments
The R Inferno (2011) [pdf] (burns-stat.com)
Statistics, Programming, Software, Data Analysis, Books
10 points by Tomte 4 days ago | 0 comments
Most promoted and blocked domains on Kagi (kagi.com)
Kagi Search Stats
Search Engines, Privacy, Data Analysis
372 points by lucgommans 5 days ago | 181 comments
CNCF Git Data Miner (github.com/cncf)
This is the Cloud Native Computing Foundation's fork of Jon Corbet and Greg KH's gitdm tool for calculating contributions based on developers and their companies.
Open Source, Git, Software, Data Analysis
4 points by mmarian 5 days ago | 0 comments
Matrix Profiles (aneksteind.github.io)
Lately I’ve been thinking about time series analysis to aid in Reflect’s insights features. Towards this end, I’ve had a Hacker News thread about anomaly detection bookmarked in Later. I finally got to looking at it and there was a comment that mentioned the article left out matrix profiles, which I had never heard of, so I decided to look into them.
Anomaly Detection, Data Analysis, Machine Learning
11 points by todsacerdoti 6 days ago | 1 comments
Some Reflections After a Month of Tracking My Own Online Activity (mcwhittemore.com)
Since 8:38 PM on February 22nd, I’ve been recording all my browsing activity in a database I manage using a custom-built browser extension and a wrapper around @rosskevin/ifvisible. The result? I now have a clear picture of just how much time I’ve spent on the web this past month. And, well… I spend a lot of time reading email. Go figure.
Personal Productivity, Web Browsing, Data Analysis
49 points by mcwhittemore 6 days ago | 25 comments
The persistent mischaracterization of Google and Facebook A/B tests (sciencedirect.com)
Marketing research has increasingly relied on online platform studies, which are studies conducted in a naturalistic online environment and which leverage the A/B testing tool provided by platforms such as Facebook or Google Ads.
Marketing Research, A/B Testing, Social Media, Online Advertising, Data Analysis
56 points by PaulHoule 9 days ago | 13 comments
A glitch in an online survey replaced the word 'yes' with 'forks' (pewresearch.org)
At Pew Research Center, we routinely ask the people who take our surveys to give us feedback about their experience. Were the survey questions clear? Were they engaging? Were they politically neutral?
Surveys, User Experience, Research, Data Analysis
192 points by cpeterso 11 days ago | 97 comments
Honking Complaints Plunge 69% Inside Congestion Pricing Zone (thecity.nyc)
Honking-mad motorists are laying off the horn in the core of Manhattan since the January launch of congestion pricing, data reveals — with New Yorkers’ beefs about blaring horns plummeting nearly 70% from the same time last year.
Traffic, Congestion Pricing, Data Analysis, Urban Planning
6 points by PaulHoule 12 days ago | 1 comments
The Business of Phish (2013) (priceonomics.com)
Over the past four years, the rock band Phish has generated over $120 million in ticket sales, handily surpassing more well known artists like Radiohead, The Black Keys, and One Direction.
Music, Business, Data Analysis
84 points by Tomte 13 days ago | 44 comments
Ask HN: Is anyone with AI expertise analyzing JFK files? (ycombinator.com)
The JFK Files, some of which were just released today, are thousands of text-based PDF files. They seem like a really good match for the capabilities of current LLMs.
Artificial Intelligence, Government, History, Data Analysis
16 points by theoryofx 14 days ago | 11 comments
Password reuse is rampant: nearly half of observed user logins are compromised (cloudflare.com)
Based on Cloudflare's observed traffic between September - November 2024, 41% of successful logins across websites protected by Cloudflare involve compromised passwords.
Cybersecurity, Password Security, User Behavior, Data Analysis
32 points by cassianoleal 15 days ago | 45 comments
Cloudflare Analyzes Login Credentials (benjojo.co.uk)
Based on Cloudflare's observed traffic between September - November 2024, 41% of successful logins across websites protected by Cloudflare involve compromised passwords.
Security, Data Analysis, Internet Security, Password Security
6 points by dsr_ 15 days ago | 0 comments
Publications from 2025 are shared more on Bluesky than on X/Twitter (bsky.app)
Social Media, Twitter, Bluesky, Data Analysis
12 points by doener 17 days ago | 0 comments
Using traditional ML and LLMs to analyze Executive Orders (1789 – 2025) (hyperarc.com)
Executive orders have been making the news recently, but aside from basic counts and individual analysis, it’s been hard to make sense of the entirety of all 11,000 accessible documents — especially for numerical analysis and trending. Thankfully we have LLMs to help with that.
Machine Learning, Data Analysis, Government, Historical Data
12 points by tristantao 19 days ago | 1 comments
DOGE Makes Its Latest Errors Harder to Find (nytimes.com)
Elon Musk’s Department of Government Efficiency has repeatedly posted error-filled data that inflated its success at saving taxpayer money. But after a series of news reports called out those mistakes, the group changed its tactics.
Government Efficiency, Data Analysis, Elon Musk, Media Influence
39 points by jbegley 20 days ago | 11 comments
Optimizing a large SQLite database for reading (jacobfilipp.com)
I recently needed to speed up a simple read query on a large SQLite file (620Mb), for my grocery price CSV export tool.
Databases, SQLite, Performance Optimization, Data Analysis
5 points by hinkley 28 days ago | 1 comments
What if football championships were lineal? (ufnc.xyz)
Starting from Italian championship, you can follow titles, defenses and challenges.
Sports, Football, History, Data Analysis
14 points by tigro7 29 days ago | 12 comments
Show HN: Search and analyze millions of SEC filings with AI. (publicview.ai)
AI, Finance, Data Analysis, SEC Filings
41 points by ashr_ 29 days ago | 17 comments
Exploring UK Environment Agency Data with DuckDB and Rill (rmoff.net)
The UK Environment Agency publishes a feed of data relating to rainfall and river levels. As a prelude to building a streaming pipeline with this data, I wanted to understand the model of it first.
Data Analysis, DuckDB, Rill
29 points by rmoff 33 days ago | 1 comments
A data analysis of speeches at the Oscars (stephenfollows.com)
Some see the Oscars as the pinnacle of artistic achievement, a night of cinematic excellence that honours the best of the best.
Data Analysis, Film Industry, Awards, Oscars
168 points by PourquoiPas 34 days ago | 20 comments
Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse (github.com/iamtelescope)
Telescope is a web application designed to provide an intuitive interface for exploring log data. It is built to work with any type of logs, as long as they are stored in ClickHouse. Users can easily configure connections to their ClickHouse databases and run queries to filter, search, and analyze logs efficiently.
Open Source, Web Development, Data Analysis, ClickHouse, Logging
172 points by r0b3r4 35 days ago | 66 comments
ChatGPT clicks convert 6.8x higher than Google organic (medium.com)
Here’s the deal : I recently dug into some data in GA4 for our website and found that while Google Organic brings in more traffic, ChatGPT clicks convert way better — 6.8X better for free trial conversions, to be exact.
ChatGPT, Google Analytics, Marketing, Conversion Rates, Data Analysis
35 points by adorosario 35 days ago | 12 comments
What do people see when they're tripping? Analyzing Erowid's trip reports (themicrodose.substack.com)
The existence of synesthesia blew Sean Noah’s mind the first time he learned about it in high school biology class.
Psychedelics, Data Analysis, Substack, Synesthesia
189 points by cainxinth 36 days ago | 263 comments
Winners of the $10k ISBN visualization bounty (annas-archive.org)
A few months ago we announced a $10,000 bounty to make the best possible visualization of our data showing the ISBN space. We emphasized showing which files we have/haven’t archived already, and we later a dataset describing how many libraries hold ISBNs (a measure of rarity).
Data Visualization, Libraries, ISBN, Data Analysis, Competitions
600 points by yamrzou 36 days ago | 66 comments
Show HN: I scrape Steam data every month and it's yours to download for free (gginsights.io)
Leverage the power of AI to help answer your questions about the Steam market and become a data expert, transforming data into actionable insights.
Data Analysis, Gaming, Steam, AI, Web Scraping
161 points by csmets 37 days ago | 60 comments
The Deep Research problem (ben-evans.com)
Most what I do for a living is research and analysis. I think of data I’d like to see and go looking for it; I compile and collate it, make charts, decide they’re boring and try again, find new ways and new data to understand and explain the issue, and produce text and charts that try to express what I’m thinking. Then I go and talk to people about it.
Research, Data Analysis, Business
301 points by cratermoon 39 days ago | 137 comments
Rust, C++, and Python trends in jobs on Hacker News (February 2025) (wojtczyk.de)
How are Rust, C++, and Python trending on Hacker News in the job market?
Rust, Programming Languages, Job Market, Data Analysis, Hacker News
111 points by wojtczyk 41 days ago | 93 comments
Show HN: I analyzed 1500+ job ads to find the most wanted skills by recruiters (skillsets.tech)
Discover the most wanted skills by recruiters
Data Analysis, Job Search, Skills, Recruitment
45 points by jurajstefanic 42 days ago | 37 comments
Augurs demo (augu.rs)
augurs is a time series analysis library for Rust with bindings for JavaScript. It provides a set of tools for analyzing time series data, including clustering, outlier detection, forecasting, and changepoint detection.
Rust, JavaScript, Data Analysis, Libraries
185 points by weinzierl 43 days ago | 13 comments