Hacker News with Generative AI: ClickHouse

ClickHouse gets lazier and faster: Introducing lazy materialization (clickhouse.com)
Imagine if you could skip packing your bags for a trip because you find out at the airport you’re not going. That’s what ClickHouse is doing with data now.
Data Storage, Databases, Performance, ClickHouse
363 points by tbragin 4 days ago | 121 comments
Lessons learned operating petabyte-scale ClickHouse clusters: Part II (tinybird.co)
This is the second part of the series. Here's more of what I've learned from operating petabyte-scale ClickHouse clusters for the last 5+ years.
ClickHouse, Databases, Big Data, Software Engineering
57 points by javisantana 5 days ago | 2 comments
ClickHouse Denormalization is not the answer to slow JOINs (glassflow.dev)
Reducing query times and optimizing performance are critical goals when working with ClickHouse, a fast, open-source, columnar database.
ClickHouse, Databases, Performance Optimization
18 points by super_ar 16 days ago | 5 comments
A year of Rust in ClickHouse (clickhouse.com)
Rust is a great programming language for terminal applications, fantasy consoles, and web3. If you do an experiment and say "C++" anywhere on the Internet, in a minute someone will chime in and educate you about the existence of Rust. Sadly, ClickHouse is written in C++, not in Rust. If only we had a chance to attract a large army of passionate Rust professionals... So, I decided that we must add Rust to ClickHouse.
Programming Languages, Databases, ClickHouse, Rust
125 points by valyala 20 days ago | 94 comments
Show HN: AGX – Open-Source Data Exploration for ClickHouse (The New Standard?) (github.com/agnosticeng)
agx is a desktop application built with Tauri and SvelteKit that provides a modern interface for exploring and querying data using ClickHouse's embedded database engine (chdb).
Open Source, Data Exploration, ClickHouse, Database, Desktop Applications
48 points by didierfranc 38 days ago | 3 comments
Postgres to ClickHouse: Data Modeling Tips V2 (clickhouse.com)
It is becoming increasingly common for customers to use Postgres and ClickHouse together, with Postgres powering transactional workloads and ClickHouse powering analytics.
Databases, Data Modeling, ClickHouse, Postgres
3 points by saisrirampur 39 days ago | 0 comments
ClickHouse acquires HyperDX: The future of open-source observability (clickhouse.com)
We are thrilled to announce that ClickHouse has acquired HyperDX, a fully open-source observability platform built on top of ClickHouse. This move reinforces our commitment to delivering the fastest, most cost-effective, and scalable observability platform to developers and enterprises worldwide. By integrating HyperDX's powerful UI and session replay capabilities with ClickHouse’s industry-leading database performance, we’re taking open-source observability to the next level.
Open Source, Observability, Acquisitions, Databases, ClickHouse
37 points by bboreham 44 days ago | 2 comments
ClickHouse 25.2 (clickhouse.com)
Another month goes by, which means it’s time for another release!
New Releases, Databases, ClickHouse
15 points by tosh 48 days ago | 0 comments
ClickHouse acquires OSS observability tool HyperDX (ycombinator.com)
Hello,<p>Thank you for your continued support and usage of HyperDX. We’re excited to share that DeploySentinel, Inc., the company behind HyperDX, will be acquired by ClickHouse.
Acquisition, Observability Tools, ClickHouse, Open Source
13 points by elviskahoro 52 days ago | 4 comments
Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse (github.com/iamtelescope)
Telescope is a web application designed to provide an intuitive interface for exploring log data. It is built to work with any type of logs, as long as they are stored in ClickHouse. Users can easily configure connections to their ClickHouse databases and run queries to filter, search, and analyze logs efficiently.
Open Source, Web Development, Data Analysis, ClickHouse, Logging
172 points by r0b3r4 59 days ago | 66 comments
Reliably replicating data between Postgres and ClickHouse (benjaminwootton.com)
In this series of articles we are going to demonstrate how to reliably replicate data from PostgreSQL to ClickHouse.
Databases, PostgreSQL, ClickHouse, Data Replication
97 points by saisrirampur 65 days ago | 42 comments
Bulk inserts on ClickHouse: How to avoid overstuffing your instance (runportcullis.co)
As we hit the midway point of the second month in 2025, a lot of you might be starting to really dig in on new data initiatives and planning key infrastructure changes to your company’s data stack.
Data Management, Databases, ClickHouse
42 points by mooreds 74 days ago | 12 comments
Show HN: Houseplant – Database Migrations for ClickHouse (readthedocs.io)
Houseplant is a CLI tool that helps you manage database migrations for ClickHouse.
Databases, ClickHouse, Software, Open Source
47 points by vortex_ape 119 days ago | 16 comments
Show HN: PDF2MD – Rust+Redis+ClickHouse+VLLM conversion pipeline for PDFs (github.com/devflowinc)
Rust, Redis, ClickHouse, PDF Conversion, Open Source
13 points by skeptrune 155 days ago | 0 comments
Building Observability with ClickHouse (cmtops.dev)
This is a summary of my experience in searching for and implementing an optimal observability stack at my workplace.
Observability, ClickHouse, Databases, DevOps
59 points by valyala 162 days ago | 23 comments
Show HN: Open-source Kibana alternative for logs and traces in ClickHouse (github.com/hyperdxio)
HyperDX helps engineers quickly figure out why production is broken by making it easy to search & visualize logs and traces on top of any Clickhouse cluster (imagine Kibana, for Clickhouse).
Open Source, ClickHouse, Data Visualization, Logging, Monitoring
125 points by mikeshi42 164 days ago | 40 comments
JIT in ClickHouse (2022) (clickhouse.com)
In this post, I will describe what JIT compilation is, how LLVM infrastructure can be used for JIT compilation, and how JIT compilation works in ClickHouse.
Databases, JIT Compilation, ClickHouse
12 points by thunderbong 169 days ago | 0 comments
From Zero to Terabytes: Building SaaS Analytics with ClickHouse (crisp.chat)
At Crisp, we help businesses manage all their customer conversations in one place—whether through chat, email, WhatsApp, or other channels - through a help desk platform. As our customers' needs grew, they asked for more detailed insights into their customer support, like response times and team performance.
Data Warehousing, SaaS, Analytics, ClickHouse
14 points by baptistejamin 171 days ago | 7 comments
Show HN: ClickHouse User Defined Table Function in Python (github.com/auxten)
I'm a SQL enthusiast and I want to query everything with SQL. This project is a collection of my experiments to query different data sources with SQL.
SQL, Databases, Python, ClickHouse
8 points by auxten 185 days ago | 3 comments
A new JSON data type for ClickHouse (clickhouse.com)
JSON has become the lingua franca for handling semi-structured and unstructured data in modern data systems. Whether it’s in logging and observability scenarios, real-time data streaming, mobile app storage, or machine learning pipelines, JSON’s flexible structure makes it the go-to format for capturing and transmitting data across distributed systems.
Data Management, JSON, ClickHouse
382 points by markhneedham 186 days ago | 122 comments
Show HN: Clickhttp: ClickHouse via HTTP Protocol (github.com/0xMihalich)
Working with Clickhouse Database via HTTP Protocol | Работа с БД Clickhouse по HTTP-протоколу
ClickHouse, Databases, HTTP, Programming, Open Source
9 points by 0xMihalich 186 days ago | 5 comments
Unraveling the Mystery of Idle Threads in ClickHouse (altinity.com)
ClickHouse is renowned for its lightning-fast analytics and ability to handle large-scale queries. However, like any high-performance database, it can run into challenges under heavy workloads. Imagine running ClickHouse on a well-provisioned machine—ample cores, plenty of memory—only to notice that during peak loads, performance starts to degrade. You check the usual suspects: CPU, disk, network… and everything seems fine. Yet queries seem to “hang,” with even the simplest SELECT 1 taking as long as 10 seconds to execute. What’s going on?
ClickHouse, Databases, Performance Optimization, Query Optimization
6 points by hodgesrm 192 days ago | 2 comments
Alert Evaluations: Incremental Merges in ClickHouse (highlight.io)
At Highlight, we rely on ClickHouse, an open-source columnar database built for handling large datasets and real-time analytics.
Databases, Open Source, Data Analytics, Real-time Data, ClickHouse
38 points by vadman97 206 days ago | 7 comments
I spent 5 hours learning how ClickHouse built their internal data warehouse (vutr.substack.com)
My name is Vu Trinh, and I am a data engineer.
Data Warehousing, Databases, ClickHouse, Data Engineering, Substack
47 points by markhneedham 213 days ago | 5 comments
ClickHouse Data Modeling for Postgres Users (clickhouse.com)
Last month, we acquired PeerDB, a company that specializes in Postgres CDC. PeerDB makes it fast and simple to replicate data from Postgres to ClickHouse. A common question from PeerDB users is how to model their data in ClickHouse after the replication process to maximize the benefits of ClickHouse.
ClickHouse, Databases, Postgres, Data Modeling, Data Replication
80 points by saisrirampur 228 days ago | 9 comments
Show HN: Storing and Analyzing 160 billion Quotes in ClickHouse (rafalkwasny.com)
Databases, Data Analysis, ClickHouse
8 points by rkwasny 241 days ago | 0 comments
ClickHouse acquires PeerDB for native Postgres CDC integration (peerdb.io)
ClickHouse, Databases, Data Warehousing, Data Integration, Postgres
16 points by davidgomes 270 days ago | 1 comments
ClickHouse acquires PeerDB to expand its Postgres support (techcrunch.com)
Database, Acquisitions, Postgres, ClickHouse
14 points by davidgomes 270 days ago | 1 comments
Materialized views in ClickHouse: The data transformation Swiss Army knife (propeldata.com)
Databases, Data Warehousing, ClickHouse, Data Transformation, Performance Optimization
17 points by acossta 270 days ago | 2 comments
Optimizing ClickHouse: Tactics that worked for us (highlight.io)
Database Optimization, ClickHouse, Performance Optimization
131 points by podoman 347 days ago | 25 comments