minio

Commit Graph

Author	SHA1	Message	Date
Klaus Post	bf3a97d3aa	S3 Select: Concurrent LINES delimited json parsing (#8610 ) The speedup is ~5x on a 6 core CPU	5 years ago
Krishna Srinivas	3b67f629a4	Retry peer notification of events (#8621 )	5 years ago
poornas	3c30e4503d	Cache only the range requested for range GETs (#8599 )	5 years ago
poornas	8390bc26db	Fix cache hit metrics. (#8617 )	5 years ago
Nitish Tiwari	24ad59316d	Use atomic.Uint64 for gateway metrics count instead of mutex (#8615 )	5 years ago
poornas	be0c8b1ec0	Add support for missing Cache-Control directives (#8619 ) no-cache, only-if-cached and no-store directives are being enforced in this PR.	5 years ago
Harshavardhana	476111968a	Update help messages with new wording (#8616 ) Final update to all messages across sub-systems after final review, the only change here is that NATS now has TLS and TLSSkipVerify to be consistent for all other notification targets.	5 years ago
Klaus Post	f1e2e1cc9e	S3 Select: Mismatched types don't match (#8608 ) When comparing for equality, if types cannot be matched, they don't match.	5 years ago
Harshavardhana	97deba2a7c	GetKVS should add new keys automatically, preserve order (#8612 )	5 years ago
Nitish Tiwari	3df7285c3c	Add Support for Cache and S3 related metrics in Prometheus endpoint (#8591 ) This PR adds support below metrics - Cache Hit Count - Cache Miss Count - Data served from Cache (in Bytes) - Bytes received from AWS S3 - Bytes sent to AWS S3 - Number of requests sent to AWS S3 Fixes #8549	5 years ago
Aleksandr Petruhin	d2dc964cb5	Support TLS auth for Kafka notification target (#8609 )	5 years ago
Harshavardhana	d8e3de0cae	Ensure comment is always a valid key (#8604 ) Also fix LDAP leaky connection	5 years ago
Harshavardhana	c9940d8c3f	Final changes to config sub-system (#8600 ) - Introduces changes such as certain types of errors that can be ignored or which need to go into safe mode. - Update help text as per the review	5 years ago
Harshavardhana	794eb54da8	Export command prints turned-off sub-sys as comments (#8594 ) This PR also tries to - Preserve the order of keys printed in export command - Fix cache to be enabled with _STATE env to keep backward compatibility	5 years ago
Harshavardhana	2ab8d5e47f	Enable build verification with race (#8583 )	5 years ago
Clemens Wolff	947bc8c7d3	Update Azure Gateway to azure-storage-blob SDK (#8537 ) The azure-sdk-for-go/storage package has been in maintenance- only mode since February 2018 (see [1]) and will be deprecated in the future.	5 years ago
Harshavardhana	5d3d57c12a	Start using error wrapping with fmt.Errorf (#8588 ) Use fatih/errwrap to fix all the code to use error wrapping with fmt.Errorf()	5 years ago
Harshavardhana	0bfd20a8e3	Add client_id support for OpenID (#8579 ) - One click OpenID authorization on Login page - Add client_id help, config keys etc Thanks to @egorkaru @ihostage for the original work and testing.	5 years ago
Klaus Post	db3dbcce3a	Print goroutines when shutdown hangs (#8574 )	5 years ago
Harshavardhana	b21835f195	Honor DurationSeconds properly for WebIdentity (#8581 ) Also cleanup code to add various constants for verbatim strings across the code base. Fixes #8482	5 years ago
Klaus Post	c7844fb1fb	posix: cache disk ID for a short while (#8564 ) `posix.getDiskID()` takes up to 30% of all CPU due to the `os.Stat` call on `GET` calls. Before: ``` Operation: GET - Concurrency: 12 Average: 1333.97 MB/s, 1365.99 obj/s, 1365.98 ops ended/s (4m59.975s) * First Byte: Average: 7.801487ms, Median: 7.9974ms, Best: 1.9822ms, Worst: 110.0021ms Aggregated, split into 299 x 1s time segments: * Fastest: 1453.50 MB/s, 1488.38 obj/s, 1492.00 ops ended/s (1s) * 50% Median: 1360.47 MB/s, 1393.12 obj/s, 1393.00 ops ended/s (1s) * Slowest: 978.68 MB/s, 1002.17 obj/s, 1004.00 ops ended/s (1s) ``` After: ``` Operation: GET - Concurrency: 12 * Average: 1706.07 MB/s, 1747.02 obj/s, 1747.01 ops ended/s (4m59.985s) * First Byte: Average: 5.797886ms, Median: 5.9959ms, Best: 996.3µs, Worst: 84.0007ms Aggregated, split into 299 x 1s time segments: * Fastest: 1830.03 MB/s, 1873.96 obj/s, 1872.00 ops ended/s (1s) * 50% Median: 1735.04 MB/s, 1776.68 obj/s, 1776.00 ops ended/s (1s) * Slowest: 994.94 MB/s, 1018.82 obj/s, 1018.00 ops ended/s (1s) ``` TLDR; `os.Stat` is not free.	5 years ago
Harshavardhana	2ff8132e2d	Fix the regression introduced in #8580	5 years ago
Harshavardhana	30e80d0a86	Add ReadFrom,WriteTo helpers for server config (#8580 )	5 years ago
Klaus Post	87443af49e	Cache Windows mount point info (#8572 ) It seems like every upload creates a new StorageInfo object. This makes it very sensitive to slow code paths. A particular slow function is `IsLikelyMountPoint` on Windows since `windows.GetVolumePathName` is slow. We cache the result of this operation. Before: ``` Operation: PUT - Concurrency: 12 * Average: 70.46 MB/s, 70.46 obj/s, 70.46 ops ended/s (59.58s) Aggregated, split into 59 x 1s time segments: * Fastest: 77.67 MB/s, 77.67 obj/s, 79.00 ops ended/s (1s) * 50% Median: 70.84 MB/s, 70.84 obj/s, 70.00 ops ended/s (1s) * Slowest: 61.51 MB/s, 61.51 obj/s, 61.00 ops ended/s (1s) ``` After: ``` Operation: PUT - Concurrency: 12 * Average: 166.80 MB/s, 166.80 obj/s, 166.74 ops ended/s (59.8s) Aggregated, split into 59 x 1s time segments: * Fastest: 183.83 MB/s, 183.83 obj/s, 186.00 ops ended/s (1s) * 50% Median: 167.47 MB/s, 167.47 obj/s, 166.00 ops ended/s (1s) * Slowest: 139.30 MB/s, 139.30 obj/s, 141.00 ops ended/s (1s) ```	5 years ago
Harshavardhana	5d65428b29	Handle localhost distributed setups properly (#8577 ) Fixes an issue reported by @klauspost and @vadmeste This PR also allows users to expand their clusters from single node XL deployment to distributed mode.	5 years ago
Harshavardhana	78eb3b78bb	Repurpose Get/SetConfig as import/export support (#8578 )	5 years ago
Harshavardhana	720442b1a2	Add lock expiry handler to expire state locks (#8562 )	5 years ago
Harshavardhana	e542084c37	Add etcd path prefix for all IAM assets (#8569 ) Currently, we use the top-level prefix "config/" for all our IAM assets, instead of to provide tenant-level separation bring 'path_prefix' to namespace the access properly. Fixes #8567	5 years ago
poornas	f931fc7bfb	Fix retention enforcement in Compliance mode (#8556 ) In compliance mode, the retention date can be extended with governance bypass permissions	5 years ago
Harshavardhana	0a56e33ce1	Preserve client sent config appropriately (#8566 )	5 years ago
Harshavardhana	c3771df641	Add bootstrap REST handler for verifying server config (#8550 )	5 years ago
Klaus Post	890b493a2e	Use random file name for write check (#8563 ) Since there may be multiple writes going on concurrently Use a random file name for the write check to avoid collisions.	5 years ago
Bruce Wang	fb708b6b64	minimum Go version 1.13 (#8561 )	5 years ago
Harshavardhana	f96e902f63	Do not rely on quorum for StorageInfo() (#8557 ) StorageInfo() call is supposed to give each server/disk information independently, rely on this appropriately so that `mc admin info server` gets correct information all the time.	5 years ago
Sergey Morgunov	06bd1e582a	Log in with OIDC not work with MINIO_DOMAIN (#8558 ) (#8559 )	5 years ago
Harshavardhana	fb43d64dc3	Fix healing on multiple zones (#8555 ) It is expected in zone healing underlying callers should return appropriate errors	5 years ago
Harshavardhana	fd0fa4e5c5	Add NTP retention time (#8548 )	5 years ago
Harshavardhana	4e9de58675	Avoid pointer based copy, instead use Clone() (#8547 ) This PR adds functional test to test expanded cluster syntax.	5 years ago
Harshavardhana	9565641b9b	Enhance ListObjectsV2 API to return UserDefined metadata (#8539 )	5 years ago
poornas	4da68cfcfc	Handle indexes correctly in DeleteMultipleObjectsHandler (#8544 ) Regression from #8509 which changes objectsToDelete entry from a list to map. This will cause index out of range panic if object is not selected for delete.	5 years ago
poornas	a9b87c0a16	Fix typo in event name (#8545 )	5 years ago
Harshavardhana	5ac4b517c9	Order all keys in config (#8541 ) New changes - return default values when sub-sys is not configured. - state is hidden parameter now - remove worm mode to be saved in config	5 years ago
poornas	ca96560d56	Add object retention at the per object (#8528 ) level - this PR builds on #8120 which added PutBucketObjectLockConfiguration and GetBucketObjectLockConfiguration APIS This PR implements PutObjectRetention, GetObjectRetention API and enhances PUT and GET API operations to display governance metadata if permissions allow.	5 years ago
Nitish Tiwari	cc1a84b62e	Fix heal result item output to properly count drives and sets (#8543 )	5 years ago
Harshavardhana	8392d2f510	Preserve same deploymentID on all zones (#8542 )	5 years ago
Harshavardhana	347b29d059	Implement bucket expansion (#8509 )	5 years ago
Harshavardhana	3a34d98db8	Initialize local nsLocker for gateway instances (#8540 )	5 years ago
Harshavardhana	7cdb67680e	Add help with order of keys (#8535 )	5 years ago
poornas	929951fd49	Add support for multiple admins (#8487 ) Also define IAM policies for administering MinIO server	5 years ago
Harshavardhana	13a3d17321	Do not add comments after migration (#8530 ) Also filter out empty comments from being printed.	5 years ago

... 5 6 7 8 9 ...

6506 Commits (6b984410d566c7032133f797a679e485d8b80eda) All Branches Search

6506 Commits (6b984410d566c7032133f797a679e485d8b80eda)

All Branches