4 Commits (59829658391d020c30c46d89f616d754032cf7db)

Author	SHA1	Message	Date
Klaus Post	a982baff27	ListObjects Metadata Caching (#10648) ... Design: https://gist.github.com/klauspost/025c09b48ed4a1293c917cecfabdf21c Gist of improvements: * Cross-server caching and listing will use the same data across servers and requests. * Lists can be arbitrarily resumed at a constant speed. * Metadata for all files scanned is stored for streaming retrieval. * The existing bloom filters controlled by the crawler is used for validating caches. * Concurrent requests for the same data (or parts of it) will not spawn additional walkers. * Listing a subdirectory of an existing recursive cache will use the cache. * All listing operations are fully streamable so the number of objects in a bucket no longer dictates the amount of memory. * Listings can be handled by any server within the cluster. * Caches are cleaned up when out of date or superseded by a more recent one.	4 years ago
Harshavardhana	ad726b49b4	rename zones to serverSets to avoid terminology conflict (#10679) ... we are bringing in availability zones, we should avoid zones as per server expansion concept.	4 years ago
Klaus Post	493c714663	Remove erasureSets and erasureObjects from ObjectLayer (#10442)	4 years ago
Harshavardhana	4915433bd2	Support bucket versioning (#9377) ... - Implement a new xl.json 2.0.0 format to support, this moves the entire marshaling logic to POSIX layer, top layer always consumes a common FileInfo construct which simplifies the metadata reads. - Implement list object versions - Migrate to siphash from crchash for new deployments for object placements. Fixes #2111	5 years ago