Hacker News with Generative AI: Object Storage

Bauplan – Git-for-data pipelines on object storage (bauplanlabs.com)
Bauplan is a Pythonic data platform that provides functions as a service for large-scale data pipelines and git-for-data over S3 data lakes.

Data Pipelines, Python, Object Storage, Git, Cloud Storage

83 points by barabbababoon 10 days ago | 45 comments

Colossus for Rapid Storage (cloud.google.com)
As an object storage service, Google Cloud Storage is popular for its simplicity and scale, a big part of which is due to the stateless REST protocols that you can use to read and write data. But with the rise of AI and as more customers look to run data-intensive workloads, two major obstacles to using object storage are its higher latency and lack of file-oriented semantics.

Cloud Computing, Object Storage, Google Cloud, AI, Data Storage

244 points by alobrah 16 days ago | 117 comments

Hetzner: S3-compatible Object Storage is here (hetzner.com)
Object Storage is the S3-compatible storage solution that grows with your data requirements - highly available, secure and flexible.

Cloud Storage, S3, Hetzner, Object Storage

5 points by coffeeri 128 days ago | 0 comments

Hetzner Object Storage (hetzner.com)
Object Storage is the S3 compatible storage solution that grows with your data requirements - highly available, secure and flexible.

Cloud Storage, Data Storage, Hetzner, Object Storage

11 points by matteocontrini 144 days ago | 7 comments

Amazon S3 Adds Put-If-Match (Compare-and-Swap) (amazon.com)
Amazon S3 can now perform conditional writes that evaluate if an object is unmodified before updating it.

Cloud Computing, Object Storage, Data Storage, Security

524 points by Sirupsen 151 days ago | 160 comments

AIStor: The Most Powerful Version of MinIO (min.io)
Today we announced the launch of AIStor, a new release which represents our singular focus on building the world’s finest object store for AI/ML workloads.

AI, Object Storage, AI/ML, Cloud Storage, Open Source

12 points by klauspost 164 days ago | 5 comments

Jepsen: Bufstream 0.1 (jepsen.io)
Bufstream is a Kafka-compatible streaming system which stores records directly in an object storage service like S3. We found three safety and two liveness issues in Bufstream, including stuck consumers and producers, spurious zero offsets, and the loss of acknowledged writes in healthy clusters. These problems were resolved by version 0.1.3.

Distributed Systems, Streaming, Kafka, Object Storage, Bug Fixes

224 points by aphyr 165 days ago | 85 comments

Retrieval powered by object storage: AMA (ycombinator.com)
Chroma now has a fully-distributed and serverless version backed by object-storage (also Apache 2.0).

Retrieval, Object Storage, Serverless, Open Source

15 points by jeffchuber 198 days ago | 7 comments

SlateDB – An embedded database built on object storage (slatedb.io)
Unlike traditional LSM-tree storage engines, SlateDB writes data to object storage to provide bottomless storage capacity, high durability, and easy replication.

Databases, Object Storage, Software, Data Storage

162 points by notamy 206 days ago | 55 comments

Hetzner to Announce Managed Kubernetes and Object Storage on 19 September (twitter.com)

Cloud Computing, Kubernetes, Object Storage

6 points by matteocontrini 226 days ago | 1 comments

Show HN: SlateDB – An embedded storage engine built on object storage (github.com/slatedb)