Hacker News with Generative AI: PostgreSQL

PostgreSQL Lands Self-Join Elimination Optimization (phoronix.com)
More than seven years in the making, merged yesterday for PostgreSQL is a self-join elimination "SJE" feature as a performance optimization for some queries.

Databases, PostgreSQL, Performance Optimization

3 points by ksec 1 day ago | 0 comments

Representing Graphs in PostgreSQL (richard-towers.com)
Let’s say we’ve got some graph-like data, such as a social network.

Databases, PostgreSQL, Graphs

190 points by gsky 3 days ago | 76 comments

PgAssistant: OSS tool to help devs understand and optimize PG performance (github.com/nexsol-technologies)
PgAssistant is an open-source tool designed to help developers understand and optimize their PostgreSQL database performance.

PostgreSQL, Open Source, Database Optimization, Developer Tools, Performance Optimization

252 points by justinclift 8 days ago | 54 comments

Microsoft open sources PostgreSQL extensions (theregister.com)
Analysis When Microsoft rolled out an open source extension stack for PostgreSQL to handle document-style data, it wasn't just taking aim at MongoDB – the dominant NoSQL player – but also blurring the lines between relational and non-relational databases, according to one expert.

Open Source, Databases, PostgreSQL, Microsoft

161 points by beardyw 9 days ago | 80 comments

PostgreSQL Best Practices (speakdatascience.com)
PostgreSQL (Postgres) is one of the most powerful and popular relational database management systems available today. Whether you’re a database administrator, developer, or DevOps engineer, following best practices ensures optimal performance, security, and maintainability of your database systems.

Databases, PostgreSQL, Best Practices, Data Management

72 points by lemonwaterlime 11 days ago | 45 comments

Scaling with PostgreSQL without boiling the ocean (shayon.dev)
“Postgres was great when we started but now that our service is being used heavily we are running into a lot of ‘weird’ issues”

Databases, PostgreSQL, Performance, Scaling

40 points by plaur782 11 days ago | 14 comments

Solving Postgres' Search Limitations (paradedb.com)
We recently completed one of our biggest engineering bets to date: migrating pg_search, a Postgres extension for full text search and analytics, to Postgres' block storage system. In doing so, pg_search is the first-ever extension1 to port an external file format to Postgres block storage.

Databases, PostgreSQL, Search, Open Source, Performance

7 points by philippemnoel 13 days ago | 0 comments

A New Postgres Block Storage Layout for Full Text Search (paradedb.com)

Database, PostgreSQL

13 points by craigkerstiens 18 days ago | 1 comments

A Rust procedural language handler for PostgreSQL (github.com/tcdi)
PL/Rust is a loadable procedural language that enables writing PostgreSQL functions in the Rust programming language.

Rust, PostgreSQL, Programming Languages, Databases

120 points by dgroshev 21 days ago | 21 comments

Doubling Down on Postgres Compatibility: YugabyteDB Levels Up with PG15 Features (yugabyte.com)
The latest release of YugabyteDB delivers 15 key PostgreSQL 15 features, providing an industry-first zero-downtime PostgreSQL upgrade and downgrade experience, giving customers a truly cloud-native PostgreSQL solution.

Databases, PostgreSQL, Cloud Computing, Open Source

12 points by 3littlefish 21 days ago | 1 comments

Mathesar – an intutive spreadsheet-like interface to Postgres data (github.com/mathesar-foundation)
Mathesar is an open source application that makes working with PostgreSQL databases both simple and powerful.

Open Source, Databases, PostgreSQL, User Interface, Data Analysis

323 points by gjvc 22 days ago | 80 comments

Microsoft builds open source document database on PostgreSQL, suggests FerretDB (theregister.com)
Microsoft has launched a document database platform constructed on a relational PostgreSQL back end.

Microsoft, PostgreSQL, Open Source, Databases, Document Databases

27 points by aleksi 24 days ago | 1 comments

DocumentDB: Open-Source Announcement (microsoft.com)
We are excited to announce the official release of DocumentDB—an open-source document database platform and the engine powering the vCore-based Azure Cosmos DB for MongoDB, built on PostgreSQL.

Open Source, Databases, Microsoft, Azure, PostgreSQL

6 points by Hixon10 27 days ago | 1 comments

DocumentDB: BSON data type CRUD in PostgreSQL (github.com/microsoft)
DocumentDB offers a native implementation of document-oriented NoSQL database, enabling seamless CRUD operations on BSON data types within a PostgreSQL framework.

NoSQL Databases, PostgreSQL, BSON, Data Types, CRUD

31 points by krishadi 28 days ago | 5 comments

Supercharge vector search with ColBERT rerank in PostgreSQL (vectorchord.ai)
Traditional vector search methods typically employ sentence embeddings to locate similar content. However, generating sentence embeddings through pooling token embeddings can potentially sacrifice fine-grained details present at the token level. ColBERT overcomes this by representing text as token-level multi-vectors rather than a single, aggregated vector. This approach, leveraging contextual late interaction at the token level, allows ColBERT to retain more nuanced information and improve search accuracy compared to methods relying solely on sentence embeddings.

Vector Search, PostgreSQL, Information Retrieval, AI

72 points by gaocegege 28 days ago | 14 comments

Microsoft/documentdb: DocumentDB – NoSQL document database in Postgres (github.com/microsoft)
DocumentDB offers a native implementation of document-oriented NoSQL database, enabling seamless CRUD operations on BSON data types within a PostgreSQL framework.

NoSQL, Databases, PostgreSQL, Open Source, Microsoft

13 points by craigkerstiens 28 days ago | 0 comments

DocumentDB: Open-Source Announcement (microsoft.com)
We are excited to announce the official release of DocumentDB—an open-source document database platform and the engine powering the vCore-based Azure Cosmos DB for MongoDB, built on PostgreSQL.

Open Source, Databases, Microsoft, PostgreSQL

11 points by aleksi 28 days ago | 0 comments

PostgreSQL is the Database Management System of the Year 2024 (db-engines.com)
DB-Engines is today announcing that PostgreSQL is our DBMS of the Year for the second year in a row, winning for the fifth time overall after also being top-ranked in 2017, 2018, 2019, and 2023. Second in the rankings was Snowflake, followed by Microsoft in third place. PostgreSQL has emerged as the most popular database management system over the past year, outpacing all other 423 monitored systems.

Databases, Awards, PostgreSQL

263 points by plaur782 37 days ago | 106 comments

PostgreSQL Anonymizer (readthedocs.io)
PostgreSQL Anonymizer is an extension to mask or replace personally identifiable information (PII) or commercially sensitive data from a Postgres database.

Data Privacy, PostgreSQL, Databases, Security

289 points by chynkm 37 days ago | 51 comments

Apache AGE: Graph Database for PostgreSQL (apache.org)

Databases, PostgreSQL, Graph Databases

4 points by wslh 40 days ago | 0 comments

PostgreSQL Support for Certificate Transparency Logs Now Available (transparency.dev)
Certificate Transparency logs can now leverage PostgreSQL’s reliability and performance, giving log operators additional storage choice and flexibility.

PostgreSQL, Security, Databases, Certificate Transparency

57 points by tracymiranda 44 days ago | 21 comments

Back to basics: Why we chose long-polling over websockets (inferable.ai)
Like many teams building real-time systems with Node.js and TypeScript, we've been exploring ways to handle real-time updates at scale. Our system handles hundreds of worker nodes constantly polling our PostgreSQL-backed control plane for new jobs (tool calls issued by agents), while agents themselves continuously pull for execution and chat state updates. What started as an exploration into WebSockets led us to a surprisingly effective "old-school" solution: HTTP long polling with Postgres.

Real-time Systems, Node.js, TypeScript, PostgreSQL, WebSockets

258 points by lunarcave 47 days ago | 163 comments

Show HN: Postgres-SQLite: SQLite as first-class types in Postgres (github.com/michelp)
postgres-sqlite is a PostgreSQL extension that introduces SQLite databases as a first-class data type within PostgreSQL.

Databases, PostgreSQL, SQLite, Extensions

15 points by michelpp 47 days ago | 2 comments

Using watermarks to coordinate change data capture in Postgres (sequinstream.com)
In change data capture, consistency is paramount. A single missing or duplicate message can cascade into time-consuming bugs and erode trust in your entire system. The moment you find a record missing in the destination, you have to wonder: is this the only one? How many others are there?

Databases, Data Management, PostgreSQL

102 points by misonic 49 days ago | 0 comments

PostgreSQL Meets ScyllaDB's Lightning Speed and Monstrous Scalability (medium.com)
PostgreSQL’s inability to handle our growing write-intensive workloads and real-time demands made it clear that a change was necessary.

Databases, Performance, Scalability, PostgreSQL, ScyllaDB

7 points by sebg 56 days ago | 2 comments

Show HN: Apache Cloudberry – Open-source Massively Parallel Processing database (github.com/apache)
Apache Cloudberry (Incubating), created by the original developers of Greenplum Database, is one advanced and mature open-source Massively Parallel Processing (MPP) database, which evolves from the open-source version of the Pivotal Greenplum Database®️ but features a newer PostgreSQL kernel and more advanced enterprise capabilities.

Open Source, Databases, PostgreSQL

35 points by djhu9 63 days ago | 7 comments

Amazon explains absence of familiar features in 'PostgreSQL compatible' Aurora (devclass.com)
At re:Invent in Las Vegas, Amazon previewed Aurora DSQL – a distributed SQL database manager with fast reads and writes, and declared that it was PostgreSQL compatible. Yet there are missing features including foreign keys, views, triggers, sequences, extensions … and much more.

Databases, PostgreSQL, Cloud Computing, Open Source

12 points by rbanffy 71 days ago | 1 comments

Pgroll – Zero-downtime, reversible, schema changes for PostgreSQL (new website) (pgroll.com)

PostgreSQL, Databases, Database Management, DevOps, Zero-Downtime

262 points by todsacerdoti 71 days ago | 52 comments

How to use Postgres for everything (github.com/Olshansk)
How to reduce complexity and move faster? Just Postgres for everything.

Databases, PostgreSQL, Software Development

289 points by Olshansky 76 days ago | 170 comments

VectorChord: Store 400k Vectors for $1 in PostgreSQL (pgvecto.rs)
We’re pleased to announce our new vector search extension for PostgreSQL, providing a highly cost-effective way to manage large vectors. Using VectorChord, you can achieve a QPS of 131 with 0.95 precision on 100 million 768-dimensional vectors for the top 10 queries. This setup costs only $250 monthly and can be hosted on a single machine.

Database, Vector Search, PostgreSQL, Open Source, Cost-Effective

156 points by gaocegege 78 days ago | 42 comments