Hacker News with Generative AI: ClickHouse

Show HN: GlassFlow – OSS streaming dedup and joins from Kafka to ClickHouse (github.com/glassflow)
GlassFlow for ClickHouse Streaming ETL is a real-time stream processor designed to simplify data pipeline creation and management between Kafka and ClickHouse.

Data Pipelines, Apache Kafka, ClickHouse

78 points by super_ar 173 days ago | 32 comments

Visualizing Foursquare Places with ClickHouse (clickhouse.com)
Recently, we had an all-company offsite, where most of our company gathered together. I always use this event to organize a hackathon. This time, it was a data visualization hackathon with simple rules: you have two hours, you take a dataset and make a nice demo on top of it with ClickHouse. I also participated in this hackathon, and here is what I've made

Data Visualization, ClickHouse, Hackathons

10 points by ashvardanian 175 days ago | 0 comments

Show HN: Logchef – Schema-agnostic log viewer for ClickHouse (github.com/mr-karan)
Logchef is a lightweight, powerful log analytics platform designed for efficient log management and analysis.

Log Management, ClickHouse, Software, Open Source

41 points by mr-karan 187 days ago | 3 comments

ClickHouse gets lazier and faster: Introducing lazy materialization (clickhouse.com)
Imagine if you could skip packing your bags for a trip because you find out at the airport you’re not going. That’s what ClickHouse is doing with data now.

Data Storage, Databases, Performance, ClickHouse

366 points by tbragin 192 days ago | 122 comments

Lessons learned operating petabyte-scale ClickHouse clusters: Part II (tinybird.co)
This is the second part of the series. Here's more of what I've learned from operating petabyte-scale ClickHouse clusters for the last 5+ years.

ClickHouse, Databases, Big Data, Software Engineering

61 points by javisantana 193 days ago | 2 comments

ClickHouse Denormalization is not the answer to slow JOINs (glassflow.dev)
Reducing query times and optimizing performance are critical goals when working with ClickHouse, a fast, open-source, columnar database.

ClickHouse, Databases, Performance Optimization

18 points by super_ar 205 days ago | 5 comments

A year of Rust in ClickHouse (clickhouse.com)
Rust is a great programming language for terminal applications, fantasy consoles, and web3. If you do an experiment and say "C++" anywhere on the Internet, in a minute someone will chime in and educate you about the existence of Rust. Sadly, ClickHouse is written in C++, not in Rust. If only we had a chance to attract a large army of passionate Rust professionals... So, I decided that we must add Rust to ClickHouse.

Programming Languages, Databases, ClickHouse, Rust

125 points by valyala 209 days ago | 94 comments

Show HN: AGX – Open-Source Data Exploration for ClickHouse (The New Standard?) (github.com/agnosticeng)
agx is a desktop application built with Tauri and SvelteKit that provides a modern interface for exploring and querying data using ClickHouse's embedded database engine (chdb).

Open Source, Data Exploration, ClickHouse, Database, Desktop Applications

48 points by didierfranc 226 days ago | 3 comments

Postgres to ClickHouse: Data Modeling Tips V2 (clickhouse.com)
It is becoming increasingly common for customers to use Postgres and ClickHouse together, with Postgres powering transactional workloads and ClickHouse powering analytics.

Databases, Data Modeling, ClickHouse, Postgres

3 points by saisrirampur 227 days ago | 0 comments

ClickHouse acquires HyperDX: The future of open-source observability (clickhouse.com)
We are thrilled to announce that ClickHouse has acquired HyperDX, a fully open-source observability platform built on top of ClickHouse. This move reinforces our commitment to delivering the fastest, most cost-effective, and scalable observability platform to developers and enterprises worldwide. By integrating HyperDX's powerful UI and session replay capabilities with ClickHouse’s industry-leading database performance, we’re taking open-source observability to the next level.

Open Source, Observability, Acquisitions, Databases, ClickHouse

37 points by bboreham 232 days ago | 2 comments

ClickHouse 25.2 (clickhouse.com)
Another month goes by, which means it’s time for another release!

New Releases, Databases, ClickHouse

15 points by tosh 236 days ago | 0 comments

ClickHouse acquires OSS observability tool HyperDX (ycombinator.com)
Hello,<p>Thank you for your continued support and usage of HyperDX. We’re excited to share that DeploySentinel, Inc., the company behind HyperDX, will be acquired by ClickHouse.

Acquisition, Observability Tools, ClickHouse, Open Source

13 points by elviskahoro 240 days ago | 4 comments

Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse (github.com/iamtelescope)
Telescope is a web application designed to provide an intuitive interface for exploring log data. It is built to work with any type of logs, as long as they are stored in ClickHouse. Users can easily configure connections to their ClickHouse databases and run queries to filter, search, and analyze logs efficiently.

Open Source, Web Development, Data Analysis, ClickHouse, Logging

172 points by r0b3r4 247 days ago | 66 comments

Reliably replicating data between Postgres and ClickHouse (benjaminwootton.com)
In this series of articles we are going to demonstrate how to reliably replicate data from PostgreSQL to ClickHouse.

Databases, PostgreSQL, ClickHouse, Data Replication

97 points by saisrirampur 253 days ago | 42 comments

Bulk inserts on ClickHouse: How to avoid overstuffing your instance (runportcullis.co)
As we hit the midway point of the second month in 2025, a lot of you might be starting to really dig in on new data initiatives and planning key infrastructure changes to your company’s data stack.

Data Management, Databases, ClickHouse

42 points by mooreds 262 days ago | 12 comments

Show HN: Houseplant – Database Migrations for ClickHouse (readthedocs.io)
Houseplant is a CLI tool that helps you manage database migrations for ClickHouse.

Databases, ClickHouse, Software, Open Source

47 points by vortex_ape 308 days ago | 16 comments

Show HN: PDF2MD – Rust+Redis+ClickHouse+VLLM conversion pipeline for PDFs (github.com/devflowinc)

Rust, Redis, ClickHouse, PDF Conversion, Open Source

13 points by skeptrune 344 days ago | 0 comments

Building Observability with ClickHouse (cmtops.dev)
This is a summary of my experience in searching for and implementing an optimal observability stack at my workplace.

Observability, ClickHouse, Databases, DevOps

59 points by valyala 350 days ago | 23 comments

Show HN: Open-source Kibana alternative for logs and traces in ClickHouse (github.com/hyperdxio)
HyperDX helps engineers quickly figure out why production is broken by making it easy to search & visualize logs and traces on top of any Clickhouse cluster (imagine Kibana, for Clickhouse).

Open Source, ClickHouse, Data Visualization, Logging, Monitoring

125 points by mikeshi42 353 days ago | 40 comments

JIT in ClickHouse (2022) (clickhouse.com)
In this post, I will describe what JIT compilation is, how LLVM infrastructure can be used for JIT compilation, and how JIT compilation works in ClickHouse.

Databases, JIT Compilation, ClickHouse

12 points by thunderbong 357 days ago | 0 comments

From Zero to Terabytes: Building SaaS Analytics with ClickHouse (crisp.chat)
At Crisp, we help businesses manage all their customer conversations in one place—whether through chat, email, WhatsApp, or other channels - through a help desk platform. As our customers' needs grew, they asked for more detailed insights into their customer support, like response times and team performance.

Data Warehousing, SaaS, Analytics, ClickHouse

14 points by baptistejamin 360 days ago | 7 comments

Show HN: ClickHouse User Defined Table Function in Python (github.com/auxten)
I'm a SQL enthusiast and I want to query everything with SQL. This project is a collection of my experiments to query different data sources with SQL.

SQL, Databases, Python, ClickHouse

8 points by auxten 373 days ago | 3 comments

A new JSON data type for ClickHouse (clickhouse.com)
JSON has become the lingua franca for handling semi-structured and unstructured data in modern data systems. Whether it’s in logging and observability scenarios, real-time data streaming, mobile app storage, or machine learning pipelines, JSON’s flexible structure makes it the go-to format for capturing and transmitting data across distributed systems.

Data Management, JSON, ClickHouse

382 points by markhneedham 374 days ago | 122 comments

Show HN: Clickhttp: ClickHouse via HTTP Protocol (github.com/0xMihalich)
Working with Clickhouse Database via HTTP Protocol | Работа с БД Clickhouse по HTTP-протоколу

ClickHouse, Databases, HTTP, Programming, Open Source

9 points by 0xMihalich 374 days ago | 5 comments

Unraveling the Mystery of Idle Threads in ClickHouse (altinity.com)
ClickHouse is renowned for its lightning-fast analytics and ability to handle large-scale queries. However, like any high-performance database, it can run into challenges under heavy workloads. Imagine running ClickHouse on a well-provisioned machine—ample cores, plenty of memory—only to notice that during peak loads, performance starts to degrade. You check the usual suspects: CPU, disk, network… and everything seems fine. Yet queries seem to “hang,” with even the simplest SELECT 1 taking as long as 10 seconds to execute. What’s going on?

ClickHouse, Databases, Performance Optimization, Query Optimization

6 points by hodgesrm 380 days ago | 2 comments

Alert Evaluations: Incremental Merges in ClickHouse (highlight.io)
At Highlight, we rely on ClickHouse, an open-source columnar database built for handling large datasets and real-time analytics.

Databases, Open Source, Data Analytics, Real-time Data, ClickHouse

38 points by vadman97 394 days ago | 7 comments

I spent 5 hours learning how ClickHouse built their internal data warehouse (vutr.substack.com)
My name is Vu Trinh, and I am a data engineer.

Data Warehousing, Databases, ClickHouse, Data Engineering, Substack

47 points by markhneedham 402 days ago | 5 comments

ClickHouse Data Modeling for Postgres Users (clickhouse.com)
Last month, we acquired PeerDB, a company that specializes in Postgres CDC. PeerDB makes it fast and simple to replicate data from Postgres to ClickHouse. A common question from PeerDB users is how to model their data in ClickHouse after the replication process to maximize the benefits of ClickHouse.

ClickHouse, Databases, Postgres, Data Modeling, Data Replication

80 points by saisrirampur 416 days ago | 9 comments

Show HN: Storing and Analyzing 160 billion Quotes in ClickHouse (rafalkwasny.com)