Hacker News with Generative AI: ClickHouse

Show HN: Houseplant – Database Migrations for ClickHouse (readthedocs.io)
Houseplant is a CLI tool that helps you manage database migrations for ClickHouse.

Databases, ClickHouse, Software, Open Source

47 points by vortex_ape 22 days ago | 16 comments

Show HN: PDF2MD – Rust+Redis+ClickHouse+VLLM conversion pipeline for PDFs (github.com/devflowinc)

Rust, Redis, ClickHouse, PDF Conversion, Open Source

13 points by skeptrune 57 days ago | 0 comments

Building Observability with ClickHouse (cmtops.dev)
This is a summary of my experience in searching for and implementing an optimal observability stack at my workplace.

Observability, ClickHouse, Databases, DevOps

59 points by valyala 64 days ago | 23 comments

Show HN: Open-source Kibana alternative for logs and traces in ClickHouse (github.com/hyperdxio)
HyperDX helps engineers quickly figure out why production is broken by making it easy to search & visualize logs and traces on top of any Clickhouse cluster (imagine Kibana, for Clickhouse).

Open Source, ClickHouse, Data Visualization, Logging, Monitoring

125 points by mikeshi42 67 days ago | 40 comments

JIT in ClickHouse (2022) (clickhouse.com)
In this post, I will describe what JIT compilation is, how LLVM infrastructure can be used for JIT compilation, and how JIT compilation works in ClickHouse.

Databases, JIT Compilation, ClickHouse

12 points by thunderbong 71 days ago | 0 comments

From Zero to Terabytes: Building SaaS Analytics with ClickHouse (crisp.chat)
At Crisp, we help businesses manage all their customer conversations in one place—whether through chat, email, WhatsApp, or other channels - through a help desk platform. As our customers' needs grew, they asked for more detailed insights into their customer support, like response times and team performance.

Data Warehousing, SaaS, Analytics, ClickHouse

14 points by baptistejamin 74 days ago | 7 comments

Show HN: ClickHouse User Defined Table Function in Python (github.com/auxten)
I'm a SQL enthusiast and I want to query everything with SQL. This project is a collection of my experiments to query different data sources with SQL.

SQL, Databases, Python, ClickHouse

8 points by auxten 87 days ago | 3 comments

A new JSON data type for ClickHouse (clickhouse.com)
JSON has become the lingua franca for handling semi-structured and unstructured data in modern data systems. Whether it’s in logging and observability scenarios, real-time data streaming, mobile app storage, or machine learning pipelines, JSON’s flexible structure makes it the go-to format for capturing and transmitting data across distributed systems.

Data Management, JSON, ClickHouse

382 points by markhneedham 88 days ago | 122 comments

Show HN: Clickhttp: ClickHouse via HTTP Protocol (github.com/0xMihalich)
Working with Clickhouse Database via HTTP Protocol | Работа с БД Clickhouse по HTTP-протоколу

ClickHouse, Databases, HTTP, Programming, Open Source

9 points by 0xMihalich 88 days ago | 5 comments

Unraveling the Mystery of Idle Threads in ClickHouse (altinity.com)
ClickHouse is renowned for its lightning-fast analytics and ability to handle large-scale queries. However, like any high-performance database, it can run into challenges under heavy workloads. Imagine running ClickHouse on a well-provisioned machine—ample cores, plenty of memory—only to notice that during peak loads, performance starts to degrade. You check the usual suspects: CPU, disk, network… and everything seems fine. Yet queries seem to “hang,” with even the simplest SELECT 1 taking as long as 10 seconds to execute. What’s going on?

ClickHouse, Databases, Performance Optimization, Query Optimization

6 points by hodgesrm 94 days ago | 2 comments

Alert Evaluations: Incremental Merges in ClickHouse (highlight.io)
At Highlight, we rely on ClickHouse, an open-source columnar database built for handling large datasets and real-time analytics.

Databases, Open Source, Data Analytics, Real-time Data, ClickHouse

38 points by vadman97 108 days ago | 7 comments

I spent 5 hours learning how ClickHouse built their internal data warehouse (vutr.substack.com)
My name is Vu Trinh, and I am a data engineer.

Data Warehousing, Databases, ClickHouse, Data Engineering, Substack

47 points by markhneedham 116 days ago | 5 comments

ClickHouse Data Modeling for Postgres Users (clickhouse.com)
Last month, we acquired PeerDB, a company that specializes in Postgres CDC. PeerDB makes it fast and simple to replicate data from Postgres to ClickHouse. A common question from PeerDB users is how to model their data in ClickHouse after the replication process to maximize the benefits of ClickHouse.

ClickHouse, Databases, Postgres, Data Modeling, Data Replication

80 points by saisrirampur 130 days ago | 9 comments

Show HN: Storing and Analyzing 160 billion Quotes in ClickHouse (rafalkwasny.com)

Databases, Data Analysis, ClickHouse

8 points by rkwasny 144 days ago | 0 comments

ClickHouse acquires PeerDB for native Postgres CDC integration (peerdb.io)

ClickHouse, Databases, Data Warehousing, Data Integration, Postgres

16 points by davidgomes 172 days ago | 1 comments

ClickHouse acquires PeerDB to expand its Postgres support (techcrunch.com)

Database, Acquisitions, Postgres, ClickHouse

14 points by davidgomes 172 days ago | 1 comments

Materialized views in ClickHouse: The data transformation Swiss Army knife (propeldata.com)