Hacker News with Generative AI: Data Analysis

Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024) (arxiv.org)
Discord has evolved from a gaming-focused communication tool into a versatile platform supporting diverse online communities.
Social Media, Data Analysis, Communication, Research, Community
145 points by leotravis10 2 days ago | 175 comments
Capalyze – Natural language data analysis (capalyze.ai)
上传表格，提问智答，生成洞见
Data Analysis, Business Intelligence, Software, Tools
7 points by alexliu518 4 days ago | 9 comments
What Is This Thing Called Swing? (ds.mpg.de)
Jazz must swing - jazz musicians agree on that. However, even a century after the beginnings of jazz, there is still no general agreement what exactly constitutes the swing feel. With a dedicated experiment and data analyses on more than 450 well-known jazz solos, we have tried to unravel some secrets of swing.
Music, Jazz, Research, Data Analysis
8 points by Tomte 5 days ago | 1 comments
Show HN: Buckaroo – Data table UI for Notebooks (github.com/paddymul)
Buckaroo is a modern data table for Jupyter that expedites the most common exploratory data analysis tasks.
Data Visualization, Jupyter Notebooks, Data Analysis, Python, Open Source
105 points by paddy_m 5 days ago | 9 comments
Show HN: Fahmatrix – A Lightweight, Pandas-Like DataFrame Library for Java (github.com/moustafa-nasr)
Fahmatrix is a lightweight, modern Java library for working with tabular data, inspired by Python's Pandas and rooted in the idea of making data understanding (fahm) easy on the JVM.
Java, Data Analysis, Libraries, Python, Pandas
46 points by mousomashakel 6 days ago | 13 comments
Show HN: CSV GB+ by Data.olllo – Open and Process CSVs Locally (microsoft.com)
Data Analysis, Software, CSV, Open Source
51 points by olllo 9 days ago | 22 comments
Backblaze Drive Stats for Q1 2025 (backblaze.com)
Welcome to the first Drive Stats of 2025. In case you missed it, the 2024 Drive Stats report was the last for long-time Drive Stats guru, Andy Klein, who is happily retired—off putting the “green” in greener pastures by working on his golf game. We–being Backblaze staff writer Stephanie Doyle and Chief Technical Evangelist Pat Patterson–are picking up where Andy left off, bringing you the metrics and analysis you know and love. Now, on to the numbers! 
Data Analysis, Hard Drives, Cloud Storage
21 points by HieronymusBosch 10 days ago | 0 comments
Gmail to SQLite (github.com/marcboeker)
This is a script to download emails from Gmail and store them in a SQLite database for further analysis.
Email, Database, Python, Software, Data Analysis
338 points by tehlike 13 days ago | 114 comments
Launch HN: Nao Labs (YC X25) – Cursor for Data (ycombinator.com)
Hey HN, we’re Claire and Christophe from nao Labs (https://getnao.io/). We just launched nao, an AI code editor to work with data: a local editor, directly connected with your data warehouse, and powered by an AI copilot with built-in context of your data schema and data-specific tools.
Data Analysis, AI, Programming, Tools, Software
158 points by ClaireGz 14 days ago | 64 comments
Show HN: Using eBPF to see through encryption without a proxy (github.com/qpoint-io)
Qtap: An eBPF agent that captures pre-encrypted network traffic, providing rich context about egress connections and their originating processes.
Security, Networking, eBPF, Open Source, Data Analysis
259 points by tylerflint 15 days ago | 78 comments
Show HN: YouTube Time Machine – browser extension to find forgotten videos (frankmeeuwsen.com)
Did you know that the average YouTube video is viewed about 41 times? For a platform that seemingly features professional content creators and is the second most visited site after Google, this view count might seem disappointing. Or is something else going on? I’ll explain how this fact inspired me to create a browser extension that makes visible the videos that the YouTube algorithm keeps hidden.
Browser Extensions, YouTube, Data Analysis, Video Content
10 points by thatinternetguy 16 days ago | 0 comments
Energy efficiency of heat pumps in residential buildings using operation data (nature.com)
As heat pumps become more prevalent in residential buildings, effective performance monitoring is essential.
Energy Efficiency, Heat Pumps, Residential Buildings, Data Analysis
10 points by gnabgib 17 days ago | 2 comments
Show HN: TextQuery – Query CSV, JSON, XLSX Files with SQL (textquery.app)
TextQuery is an all-in-one desktop app to import, query, modify, and visualize your raw data with SQL.
Data Analysis, Software, Databases, SQL, Desktop Applications
163 points by shubhamjain 18 days ago | 57 comments
Internet usage pattern during power outage in Spain and Portugal (akamai-mpulse.com)
On Monday this week, the Iberian Peninsula suffered a major power outage that disabled many services across these countries. In this post I'll look at the patterns we saw in mPulse data during this time.
Internet Usage, Power Outages, Spain, Portugal, Data Analysis
108 points by ghoshbinayak 18 days ago | 110 comments
DuckDB is probably the most important geospatial software of the last decade (dbreunig.com)
What happens when you embed geospatial capabilities in generalist data tools? More people engaging with geo data.
Geospatial Data, Software, Databases, Data Analysis
491 points by dbreunig 20 days ago | 165 comments
Determining favorite t-shirt color using science (ostwilkens.se)
I'm looking to simplify my wardrobe, and the t-shirt is a staple. I like solid color t-shirts, and so the main differentiating factor is the color. But what color? There is only one way to find out. That is: create images of myself with different colored t-shirts, and evaluate them in an ELO-based arena.
Science, Fashion, Data Analysis, Personal Projects
16 points by KomoD 20 days ago | 7 comments
Backstory to the Survivorship Bias Plane (yuxi-liu-wired.github.io)
I discover the exact backstory to that picture of an airplane with red dots on top of it.
Statistics, Visualizations, Data Analysis, History
4 points by YuxiLiuWired 20 days ago | 0 comments
The PCAP (weberblog.net)
For the last couple of years, I captured many different network and upper-layer protocols and published the pcaps along with some information and Wireshark screenshots on this blog. However, it always takes me some time to find the correct pcap when I am searching for a concrete protocol example. There are way too many pcaps out there.
Networking, Capture Analysis, Wireshark, Blog Posts, Data Analysis
3 points by Tomte 21 days ago | 0 comments
Zipf's Law (wikipedia.org)
Zipf's law (/zɪf/; German pronunciation: [tsɪpf]) is an empirical law stating that when a list of measured values is sorted in decreasing order, the value of the n-th entry is often approximately inversely proportional to n.
Statistics, Mathematics, Linguistics, Language, Data Analysis
6 points by baxtr 21 days ago | 0 comments
Normalizing Ratings (blogspot.com)
Data Analysis, Statistics, Normalization
51 points by Symmetry 21 days ago | 52 comments
You Wouldn't Download a Hacker News (jasonthorsness.com)
And now I can analyze it with DuckDB. Behold the fraction of total comments and stories referencing key topics over time!
Hacker News, Data Analysis, DuckDB, Trends
458 points by jasonthorsness 23 days ago | 227 comments
US Tariff Flow Analyzer (tradeflows.us)
Trade, Economics, Data Analysis, United States
6 points by forthwall 25 days ago | 0 comments
We Found Insurance Fraud in Our Crash Data (levs.fyi)
When we set out to build geospatial risk scores for vehicle crashes at Matrisk AI, we never expected that a side by side look at Vehicle Identification Numbers and crash timelines would hint at possible insurance fraud. But data sometimes surprises you. Below, I’ll walk through how we stumbled upon this discovery, what we found, and why it might matter for anyone insuring vehicles.
Insurance Fraud, Data Analysis, Machine Learning, Risk Assessment, Transportation
74 points by Ostatnigrosh 25 days ago | 73 comments
Show HN: Deep Research across 30k GitHub repos (gitwiki.com)
Powered by DevinDeepWikipowered byDevinShare<h1>Which repo would you like to understand?</h1>
GitHub, Research, Software, Data Analysis
10 points by gaodrew 28 days ago | 0 comments
How effective and safe are measles vaccines? (ourworldindata.org)
Data from large meta-analyses show that measles vaccination is highly effective and safe, reducing the chances of getting measles by 95%.
Vaccines, Measles, Public Health, Data Analysis, Science
5 points by salonium_ 30 days ago | 1 comments
Web Browser telemetry – 2025 edition (sizeof.cat)
This is a re-release of my “world-renown” Web Browser Telemetry - 2021 edition article, updated for 2025.
Web Browsers, Telemetry, Data Analysis
5 points by jakobdabo 32 days ago | 1 comments
Show HN: Comparelists.org – Instantly Compare Two Lists, Find Differences (comparelists.org)
The easiest way to compare two lists online. Free tool to find matches, differences, duplicates and unique items between lists instantly. Support for TXT, CSV and Excel files.
Tools, Data Analysis, Comparison, Web Applications
10 points by Chipen 32 days ago | 2 comments
How to Run Python in Production (ashishb.net)
My previous article recommended that one should reconsider using Python in production. However, there’s one category of use case where Python is the dominant option for running production workloads. And that’s data analysis and machine learning.
Python, Production, Data Analysis, Machine Learning
34 points by ashishb 34 days ago | 30 comments
I analyzed chord progressions in 680k songs (cantgetmuchhigher.com)
I Analyzed the Chord Progressions of 680k Songs
Music, Data Analysis, Chord Progressions
308 points by jnord 36 days ago | 147 comments
ICE Hands Palantir Millions for Comprehensive Analysis of Known Groups (404media.co)
Last week Immigration and Customs Enforcement (ICE) paid contracting giant Palantir tens of millions of dollars to make modifications to a powerful ICE database and search tool to allow “complete target analysis of known populations” and to update the tool’s targeting and enforcement priorities, according to procurement records reviewed by 404 Media.
Government Contracts, Surveillance, Immigration, Data Analysis
19 points by bentobean 37 days ago | 4 comments