Hacker News with Generative AI: Databases

Using Postgres pg_test_fsync tool for testing low latency writes (tanelpoder.com)
Here’s a useful tool for quickly testing whether a disk (or a cloud block store volume) is a good candidate for your database WAL/redo logs and any other files that require low latency writes. The pg_test_fsync tool is bundled with standard Postgres packages, so no extra installation is needed. You don’t actually have to use Postgres as your database, this tool’s output is universally valuable for any workload requiring fast writes.
Databases, Performance, Testing, PostgreSQL
40 points by mfiguiere 31 days ago | 16 comments
Amazon Aurora DSQL is now generally available (amazon.com)
Today, we’re announcing the general availability of Amazon Aurora DSQL, the fastest serverless distributed SQL database with virtually unlimited scale, the highest availability, and zero infrastructure management for always available applications.
Databases, Serverless Computing
17 points by EwanToo 31 days ago | 1 comments
DuckLake: SQL as a Lakehouse Format (duckdb.org)
TL;DR: DuckLake simplifies lakehouses by using a standard SQL database for all metadata, instead of complex file-based systems, while still storing data in open formats like Parquet. This makes it more reliable, faster, and easier to manage.
Databases, Data Warehousing, Lakehouses, SQL
32 points by andreasha 31 days ago | 1 comments
Just make it scale: An Aurora DSQL story (allthingsdistributed.com)
At re:Invent we announced Aurora DSQL, and since then I’ve had many conversations with builders about what this means for database engineering.
Databases, Scaling, Aurora DSQL, Cloud Computing
134 points by cebert 31 days ago | 40 comments
LumoSQL (lumosql.org)
LumoSQL is a modification (not a fork) of the SQLite embedded data storage library, which is among the most-deployed software. We are currently in Phase II of the project.
Databases, Software, Open Source
253 points by smartmic 31 days ago | 86 comments
LiveStore: State management based on reactive SQLite and built-in sync engine (livestore.dev)
LiveStore is a next-generation state management framework based on reactive SQLite and git-inspired syncing (via event-sourcing).
State Management, Mobile Development, Databases, SQLite, Reactive Programming
156 points by akoenig 31 days ago | 43 comments
Show HN: PgDog – Shard Postgres without extensions (github.com/pgdogdev)
PgDog is a transaction pooler and logical replication manager that can shard PostgreSQL. Written in Rust, PgDog is fast, secure and can manage hundreds of databases and hundreds of thousands of connections.
Databases, Open Source, PostgreSQL, Rust
307 points by levkk 32 days ago | 80 comments
Fast, Simple and Open Firebase Alternative: TrailBase (github.com/trailbaseio)
Overhaul list API filters to allow for nested, complex expressions. The query parameters changed making this a breaking change. Users will need to update their client libraries.
Databases, Open Source, API, Breaking Changes
70 points by trailbase-alt 33 days ago | 21 comments
rqlite turns 10: Lessons from a decade building Distributed Systems (philipotoole.com)
rqlite is a lightweight, open-source, distributed relational database written in Go, which uses SQLite as its storage engine and Raft for consensus.
Distributed Systems, Databases, Open Source, SQLite
9 points by otoolep 35 days ago | 0 comments
Big Problems From Big IN lists with Ruby on Rails and PostgreSQL (andyatkinson.com)
If you’ve created web apps with relational databases and ORMs like Active Record (part of Ruby on Rails), you’ve probably experienced database performance problems after a certain size of data and query volume.
PostgreSQL, Databases, Performance, Web Development
7 points by Ocha 35 days ago | 0 comments
Making Postgres Distributed with FoundationDB (fabianlindfors.se)
Turning the revered Postgres into a distributed database is a tall order but not a new idea.
Databases, Postgres, Distributed Systems
45 points by emptysea 35 days ago | 17 comments
CRDTs #2: Turtles All the Way Down (jhellerstein.github.io)
Modern distributed systems often seem to rest on an stack of turtles. For every guarantee we make, we seem to rely on a lower-layer assumption. Eventually we're left wondering: what is at the bottom?
Distributed Systems, Computer Science, Databases, CRDTs
67 points by pfarago 36 days ago | 2 comments
DuckDB 1.3.0 (duckdb.org)
TL;DR: The DuckDB team is happy to announce that today we're releasing DuckDB version 1.3.0, codenamed “Ossivalis”.
New Releases, Software, Databases
7 points by friendly_deer 36 days ago | 0 comments
IDE for PostgreSQL in VS Code from Microsoft (microsoft.com)
We are excited to announce the public preview of the brand-new PostgreSQL extension for Visual Studio Code (VS Code), designed to simplify PostgreSQL database management and development workflows.
PostgreSQL, Databases, Development Tools, Microsoft
6 points by tosh 36 days ago | 0 comments
Short alphanumeric pseudo random identifiers in Postgres (andyatkinson.com)
In this post, we’ll cover a way to generate short, alphanumeric, pseudo random identifiers using native Postgres tactics.
Databases, Postgres, Programming
4 points by speckx 36 days ago | 0 comments
Show HN: SQLite JavaScript - extend your database with JavaScript (github.com/sqliteai)
SQLite-JS is a powerful extension that brings JavaScript capabilities to SQLite.
Databases, JavaScript, SQLite
199 points by marcobambini 36 days ago | 57 comments
Complexities of Distributed SQL (vegasecurity.com)
Query planners are a cool piece of software that exists in every database or SQL engine out there.
Databases, SQL, Query Planners
12 points by Asaf51 36 days ago | 1 comments
Obsidian Bases (obsidian.md)
Introducing Bases, a new core plugin that lets you turn any set of notes into a powerful database. With Bases you can organize everything from projects to travel plans, reading lists, and more.
Note-Taking, Databases, Productivity Tools, Obsidian
49 points by Brajeshwar 36 days ago | 13 comments
AIST Dance Video Database (ongaaccel.jp)
AIST Dance Video Database (AIST Dance DB) is a shared database containing original street dance videos with copyright-cleared dance music.
Dance, Databases, Video, Music
3 points by Tomte 37 days ago | 0 comments
Oracle Database TNS vulnerability could leak data to further attacks (scworld.com)
A vulnerability in Oracle database communications could potentially allow an unauthenticated user to access system memory contents that may include sensitive information that could be used for further attacks.
Security, Oracle, Databases, Vulnerabilities
4 points by Bender 37 days ago | 0 comments
Show HN: BemiDB – Open-source data warehouse with zero-ETL (bemidb.com)
Cut months of pipeline work. Automatically connect any data source and query with psql.
Data Warehouses, Open Source, Databases, SQL, ETL
13 points by exAspArk 37 days ago | 2 comments
DuckDB 1.3.0 (duckdb.org)
TL;DR: The DuckDB team is happy to announce that today we're releasing DuckDB version 1.3.0, codenamed “Ossivalis”.
New Releases, Databases, Software
12 points by tanelpoder 37 days ago | 0 comments
Announcing a new IDE for PostgreSQL in VS Code (microsoft.com)
We are excited to announce the public preview of the brand-new PostgreSQL extension for Visual Studio Code (VS Code), designed to simplify PostgreSQL database management and development workflows.
Databases, VS Code, PostgreSQL, Development Tools
12 points by coffeemug 37 days ago | 4 comments
Litestream: Revamped (fly.io)
Litestream is an open-source tool that makes it possible to run many kinds of full-stack applications on top of SQLite by making them reliably recoverable from object storage. This is a post about the biggest change we’ve made to it since I launched it.
Open Source, Databases, Software, Cloud Computing
452 points by usrme 38 days ago | 99 comments
The Lost Decade of Small Data? (duckdb.org)
TL;DR: We benchmark DuckDB on a 2012 MacBook Pro to decide: did we lose a decade chasing distributed architectures for data analytics?
Data Analytics, Databases, Performance, Big Data, Cloud Computing
3 points by oli200110 38 days ago | 0 comments
UUIDv7 Comes to PostgreSQL 18 (thenile.dev)
Databases, PostgreSQL, New Releases
10 points by code_reader 38 days ago | 0 comments
Clojure: SQLite C API with project Panama and Coffi (andersmurphy.com)
In this post I'll go over using coffi to build a Clojure SQLite wrapper.
Clojure, SQLite, Programming Languages, Databases, Project Panama
10 points by andersmurphy 38 days ago | 2 comments
Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse (fiveonefour.com)
Deploying a Moose application with all its dependencies can be challenging and time-consuming. You need to properly configure multiple services, ensure they communicate with each other, and manage their lifecycle.
Docker, Microservices, Cloud Computing, DevOps, Databases
50 points by Callicles 39 days ago | 15 comments
Airport for DuckDB (query.farm)
The Airport extension brings Arrow Flight support to DuckDB, enabling DuckDB to query, modify, and store data via Arrow Flight servers. A DuckDB extension is a plugin that expands DuckDB’s core functionality by adding new capabilities.
Databases, DuckDB, Arrow Flight, Extensions
141 points by jonbaer 39 days ago | 28 comments
SQL OFFSET is worse than keyset pagination (use-the-index-luke.com)
After implementing a pipelined top-N query to retrieve the first page efficiently, you will often also need another query to fetch the next pages. The resulting challenge is that it has to skip the rows from the previous pages.
Databases, Performance Optimization, SQL
7 points by fanf2 40 days ago | 0 comments