Garage: Open-Source Distributed Object Storage
S3 compatibility and API debates
- Many projects, including Garage, implement an S3-compatible API to reuse tooling and client libraries.
- Some argue S3 is a “bad” interface (limited filesystem-like features, verbose, high-latency) and don’t see why it should be cloned.
- Others counter that S3’s simplicity, early arrival, price, and vast ecosystem outweigh UI/API shortcomings; compatibility is highly valuable.
- Debate over whether S3 really lacks metadata and structure; some point out paths, custom headers, and S3 Express improvements.
Object storage vs. filesystems
- Several comments stress that implementing a fully featured distributed filesystem (POSIX semantics, directories, atomic renames, locks, multiple writers) is far harder than an object store.
- Object stores relax consistency and update-in-place guarantees, making them easier to scale and better suited to large blobs, snapshots, and VM images, not interactive editing workloads.
Garage’s design goals and motivation
- Aimed at S3-compatible distributed object storage for unreliable, heterogeneous, consumer-grade nodes (e.g., home servers, second-hand machines).
- Designed around eventual consistency and “Dynamo-like” ideas; some parts of the layout system are formally proven.
- Paired (RAID1-like) replication across locations is a deliberate, conservative design choice, not a limitation oversight.
- Not positioned as a high-performance, feature-rich “enterprise” object store; more for self-hosting and small collectives.
Authentication and AWS SigV4
- Some users find SigV4 cumbersome for simple use cases and would prefer basic-header-style API keys or anonymous access.
- Counterpoint: S3 compatibility is a goal, and minimal SigV4 client implementations exist, though some still see them as unnecessary bloat.
- Concerns raised about server-side handling of long-lived secrets with SigV4.
Comparisons and alternatives
- Garage is compared to MinIO, SeaweedFS, Ceph, OpenStack Swift, Tahoe-LAFS, IPFS-based systems, Perkeep, lakeFS, and others.
- One operator reports significant performance and reliability gains (especially with many small files and replication) after migrating a multi-petabyte workload from MinIO to Garage.
- MinIO and Ceph are seen as more “enterprise-oriented” with richer feature sets; Garage prioritizes simplicity and different hardware assumptions.
Content-addressed and coordination-free storage
- Multiple comments desire an “S3 for immutable blobs” with content addressing (e.g., BLAKE3 hashes), CRDT/coordination-free semantics, and QUIC/HTTP/3.
- Various prior and related systems are mentioned, but many are seen as complex, over-scoped, or not clearly “production-grade.”