minio

History

Harshavardhana 6f6a2214fc Add rate limiter for S3 API layer (#9196 ) - total number of S3 API calls per server - maximum wait duration for any S3 API call This implementation is primarily meant for situations where HDDs are not capable enough to handle the incoming workload and there is no way to throttle the client. This feature allows MinIO server to throttle itself such that we do not overwhelm the HDDs.		5 years ago
..
config	Add rate limiter for S3 API layer (#9196 )	5 years ago
crypto	Add custom policy claim name (#8764 )	5 years ago
gateway	Add response header timeouts (#9170 )	5 years ago
http	fix: Send x-amz-mp-parts-count for multiparted objects (#9116 )	5 years ago
jwt	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
logger	fix: admin console logger changes to log.Info	5 years ago
rest	jwt: Simplify JWT parsing (#8802 )	5 years ago
acl-handlers.go	acl: Support PUT calls with success for 'private' ACL's (#9000 )	5 years ago
admin-handlers-config-kv.go	fix: remove extra newline from GetConfig() output (#8678 )	5 years ago
admin-handlers-users.go	honor the credentials of user admin for encrypt/decrypt (#9194 )	5 years ago
admin-handlers.go	Add response header timeouts (#9170 )	5 years ago
admin-handlers_test.go	Remove partName, partETag requirement (#9044 )	5 years ago
admin-heal-ops.go	heal: Pass scan mode to HealObjects to deep scan full quorum objects (#9159 )	5 years ago
admin-router.go	Add service account type in IAM (#9029 )	5 years ago
admin-server-info.go	Use user CAs in checkEndpoint() call (#8911 )	5 years ago
api-datatypes.go	Add object retention at the per object (#8528 )	5 years ago
api-errors.go	Add rate limiter for S3 API layer (#9196 )	5 years ago
api-errors_test.go	Move etcd, logger, crypto into their own packages (#8366 )	5 years ago
api-headers.go	fix: Send x-amz-mp-parts-count for multiparted objects (#9116 )	5 years ago
api-headers_test.go	…
api-resources.go	listV2: Continuation and NextContinuation tokens are encoded with base64 (#8337 )	5 years ago
api-resources_test.go	Increase maximum 1000 List keys to 10000 (#8444 )	5 years ago
api-response.go	Add Support for Cache and S3 related metrics in Prometheus endpoint (#8591 )	5 years ago
api-response_test.go	…
api-router.go	Add rate limiter for S3 API layer (#9196 )	5 years ago
api-utils.go	…
api-utils_test.go	…
auth-handler.go	sa: Allow empty policy to indicate parent user's policy is inherited (#9185 )	5 years ago
auth-handler_test.go	Add support for multiple admins (#8487 )	5 years ago
background-heal-ops.go	Add rate limiter for S3 API layer (#9196 )	5 years ago
background-newdisks-heal-ops.go	fix: various optimizations, idiomatic changes (#9179 )	5 years ago
benchmark-utils_test.go	…
bitrot-streaming.go	admin/heal: Fix deep healing to heal objects under more conditions (#8321 )	5 years ago
bitrot-whole.go	…
bitrot.go	…
bitrot_test.go	…
bootstrap-peer-server.go	Add rate limiter for S3 API layer (#9196 )	5 years ago
bucket-encryption-handlers.go	acl: Support PUT calls with success for 'private' ACL's (#9000 )	5 years ago
bucket-encryption.go	Add support for bucket encryption feature (#8890 )	5 years ago
bucket-encryption_test.go	Add support for bucket encryption feature (#8890 )	5 years ago
bucket-handlers-listobjects.go	Rename pkg/{tagging,lifecycle} to pkg/bucket sub-directory (#8892 )	5 years ago
bucket-handlers.go	Avoid unnecessary allocations for XML parsing (#9017 )	5 years ago
bucket-handlers_test.go	Implement bucket expansion (#8509 )	5 years ago
bucket-lifecycle-handler.go	acl: Support PUT calls with success for 'private' ACL's (#9000 )	5 years ago
bucket-notification-handlers.go	Fix Retention, ObjectLock, LegalHold struct namespaces correctly. (#8909 )	5 years ago
bucket-policy-handlers.go	Rename pkg/{tagging,lifecycle} to pkg/bucket sub-directory (#8892 )	5 years ago
bucket-policy-handlers_test.go	Rename pkg/{tagging,lifecycle} to pkg/bucket sub-directory (#8892 )	5 years ago
build-constants.go	…
common-main.go	Add service account type in IAM (#9029 )	5 years ago
config-common.go	…
config-current.go	Support multiple LDAP OU's, smAccountName support (#9139 )	5 years ago
config-current_test.go	Avoid pointer based copy, instead use Clone() (#8547 )	5 years ago
config-dir.go	…
config-encrypted.go	Add service account type in IAM (#9029 )	5 years ago
config-encrypted_test.go	Config migration should handle plain-text (#8506 )	5 years ago
config-migrate.go	Start using error wrapping with fmt.Errorf (#8588 )	5 years ago
config-migrate_test.go	Order all keys in config (#8541 )	5 years ago
config-versions.go	Migrate config to KV data format (#8392 )	5 years ago
config.go	Initialize only one retry timer for all sub-systems (#8913 )	5 years ago
consolelogger.go	fix: admin console logger changes to log.Info	5 years ago
copy-part-range.go	…
copy-part-range_test.go	…
crossdomain-xml-handler.go	…
crossdomain-xml-handler_test.go	…
daily-lifecycle-ops.go	Add rate limiter for S3 API layer (#9196 )	5 years ago
data-usage-cache.go	fix: data usage crawler env handling, usage-cache.bin location (#9163 )	5 years ago
data-usage-cache_gen.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
data-usage-cache_gen_test.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
data-usage.go	fix: various optimizations, idiomatic changes (#9179 )	5 years ago
data-usage_test.go	fix: data usage crawler env handling, usage-cache.bin location (#9163 )	5 years ago
disk-cache-backend.go	fix: various optimizations, idiomatic changes (#9179 )	5 years ago
disk-cache-stats.go	Add Support for Cache and S3 related metrics in Prometheus endpoint (#8591 )	5 years ago
disk-cache-utils.go	Add cache eviction low and high watermarks (#8958 )	5 years ago
disk-cache-utils_test.go	Add cache eviction low and high watermarks (#8958 )	5 years ago
disk-cache.go	fix: various optimizations, idiomatic changes (#9179 )	5 years ago
disk-cache_test.go	fix: deprecate TestDiskCache test from unit tests (#9187 )	5 years ago
dummy-data-generator_test.go	…
dummy-handlers.go	Rename pkg/{tagging,lifecycle} to pkg/bucket sub-directory (#8892 )	5 years ago
dynamic-timeouts.go	…
dynamic-timeouts_test.go	…
encryption-v1.go	Add encryption buffer (#8626 )	5 years ago
encryption-v1_test.go	Remove partName, partETag requirement (#9044 )	5 years ago
endpoint-ellipses.go	fix: allow set drive count of proper divisible values (#9101 )	5 years ago
endpoint-ellipses_test.go	fix: allow set drive count of proper divisible values (#9101 )	5 years ago
endpoint.go	Add rate limiter for S3 API layer (#9196 )	5 years ago
endpoint_test.go	Validate XL sets on format (#8779 )	5 years ago
erasure-decode.go	…
erasure-decode_test.go	…
erasure-encode.go	…
erasure-encode_test.go	Validate XL sets on format (#8779 )	5 years ago
erasure-heal.go	…
erasure-heal_test.go	…
erasure-utils.go	…
erasure.go	…
erasure_test.go	…
etcd.go	Start using error wrapping with fmt.Errorf (#8588 )	5 years ago
fallocate.go	…
fallocate_linux.go	…
fallocate_linux_test.go	…
fastwalk.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
format-disk-cache.go	Use jsoniter whenever applicable instead of encoding/json (#8766 )	5 years ago
format-disk-cache_test.go	Return appropriate errors API versions changes across REST APIs (#8480 )	5 years ago
format-fs.go	Avoid double for loops in notification init (#8691 )	5 years ago
format-fs_test.go	Return appropriate errors API versions changes across REST APIs (#8480 )	5 years ago
format-meta.go	Fix writing 'format.json' and make it atomic (#8296 )	5 years ago
format-xl.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
format-xl_test.go	xl: All nodes create meta volumes in its local disks (#8786 )	5 years ago
fs-v1-helpers.go	xl: Implement posix.DeletePrefixes to enhance delete perf (#9100 )	5 years ago
fs-v1-helpers_test.go	…
fs-v1-metadata.go	Add ObjectTagging Support (#8754 )	5 years ago
fs-v1-metadata_test.go	…
fs-v1-multipart.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
fs-v1-multipart_test.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
fs-v1-rwpool.go	…
fs-v1-rwpool_test.go	…
fs-v1.go	fix: data usage crawler env handling, usage-cache.bin location (#9163 )	5 years ago
fs-v1_test.go	heal: Pass scan mode to HealObjects to deep scan full quorum objects (#9159 )	5 years ago
gateway-common.go	fix: erroneous high value for gateway received bytes metrics (#8978 )	5 years ago
gateway-common_test.go	…
gateway-env.go	…
gateway-interface.go	Return appropriate errors API versions changes across REST APIs (#8480 )	5 years ago
gateway-main.go	fix: various optimizations, idiomatic changes (#9179 )	5 years ago
gateway-main_test.go	…
gateway-metrics.go	fix: erroneous high value for gateway received bytes metrics (#8978 )	5 years ago
gateway-startup-msg.go	Bring in safe mode support (#8478 )	5 years ago
gateway-startup-msg_test.go	…
gateway-unsupported.go	heal: Pass scan mode to HealObjects to deep scan full quorum objects (#9159 )	5 years ago
generic-handlers.go	fix: various optimizations, idiomatic changes (#9179 )	5 years ago
generic-handlers_test.go	Migrate config to KV data format (#8392 )	5 years ago
global-heal.go	fix: various optimizations, idiomatic changes (#9179 )	5 years ago
globals.go	info: Initialize boot time early so uptime will always be correct (#9154 )	5 years ago
handler-utils.go	Add rate limiter for S3 API layer (#9196 )	5 years ago
handler-utils_test.go	Migrate config to KV data format (#8392 )	5 years ago
hasher.go	…
healthcheck-handler.go	metrics: Use StorageInfo() instead to have consistent info (#9006 )	5 years ago
healthcheck-router.go	…
http-stats.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
http-tracer.go	accessKeyId missing should return appropriate error in AssumeRole (#9048 )	5 years ago
http-traffic-recorder.go	simplify recordAPIStats wrapper for ResponseWriters (#9034 )	5 years ago
httprange.go	Cache only the range requested for range GETs (#8599 )	5 years ago
httprange_test.go	…
iam-etcd-store.go	Add service account type in IAM (#9029 )	5 years ago
iam-object-store.go	Add rate limiter for S3 API layer (#9196 )	5 years ago
iam.go	sa: Allow empty policy to indicate parent user's policy is inherited (#9185 )	5 years ago
jwt.go	allow rolling upgrades, remove same MinIO version requirement (#9033 )	5 years ago
jwt_test.go	jwt: Simplify JWT parsing (#8802 )	5 years ago
leak-detect_test.go	…
lifecycle.go	Add support for bucket encryption feature (#8890 )	5 years ago
local-locker.go	fix: Speed up multi-object delete by taking bulk locks (#8974 )	5 years ago
lock-rest-client.go	Add a generic Walk()'er to list a bucket, optinally prefix (#9026 )	5 years ago
lock-rest-client_test.go	Support MinIO to be deployed on more than 32 nodes (#8492 )	5 years ago
lock-rest-server-common.go	fix: Speed up multi-object delete by taking bulk locks (#8974 )	5 years ago
lock-rest-server-common_test.go	jwt: Simplify JWT parsing (#8802 )	5 years ago
lock-rest-server.go	fix: various optimizations, idiomatic changes (#9179 )	5 years ago
main.go	print version with proper indentation (#9047 )	5 years ago
merge-walk-pool.go	…
merge-walk-pool_test.go	…
metrics-router.go	Add prometheus auth-type to turn-off authentication (#8356 )	5 years ago
metrics.go	metrics: Use StorageInfo() instead to have consistent info (#9006 )	5 years ago
namespace-lock.go	fix: Speed up multi-object delete by taking bulk locks (#8974 )	5 years ago
namespace-lock_test.go	fix: Speed up multi-object delete by taking bulk locks (#8974 )	5 years ago
naughty-disk_test.go	fix: implement splunk specific listObjects when delimiter=guidSplunk (#9186 )	5 years ago
net.go	fix: replica set deployment for multi tenants (#8673 )	5 years ago
net_test.go	Handle localhost distributed setups properly (#8577 )	5 years ago
notification.go	fix: various optimizations, idiomatic changes (#9179 )	5 years ago
object-api-common.go	xl: Implement posix.DeletePrefixes to enhance delete perf (#9100 )	5 years ago
object-api-datatypes.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
object-api-deleteobject_test.go	…
object-api-errors.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
object-api-getobject_test.go	…
object-api-getobjectinfo_test.go	…
object-api-input-checks.go	Add a generic Walk()'er to list a bucket, optinally prefix (#9026 )	5 years ago
object-api-interface.go	heal: Pass scan mode to HealObjects to deep scan full quorum objects (#9159 )	5 years ago
object-api-listobjects_test.go	non-empty dirs should not be listed as objects (#9129 )	5 years ago
object-api-multipart_test.go	fix routing issue for esoteric characters in gorilla/mux (#8967 )	5 years ago
object-api-putobject_test.go	…
object-api-utils.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
object-api-utils_test.go	fix routing issue for esoteric characters in gorilla/mux (#8967 )	5 years ago
object-handlers-common.go	…
object-handlers-common_test.go	…
object-handlers.go	Add response header timeouts (#9170 )	5 years ago
object-handlers_test.go	Move storageclass config handling into cmd/config/storageclass (#8360 )	5 years ago
object-lock.go	fix: avoid double ListBuckets() loading object lock (#9031 )	5 years ago
object_api_suite_test.go	…
os-reliable.go	Start using error wrapping with fmt.Errorf (#8588 )	5 years ago
os-reliable_test.go	…
peer-rest-client-target.go	New Admin Info (#8497 )	5 years ago
peer-rest-client.go	Add rate limiter for S3 API layer (#9196 )	5 years ago
peer-rest-common.go	fix: various optimizations, idiomatic changes (#9179 )	5 years ago
peer-rest-server.go	fix: various optimizations, idiomatic changes (#9179 )	5 years ago
policy.go	Initialize only one retry timer for all sub-systems (#8913 )	5 years ago
policy_test.go	Rename pkg/{tagging,lifecycle} to pkg/bucket sub-directory (#8892 )	5 years ago
posix-dirent_fileino.go	…
posix-dirent_ino.go	…
posix-dirent_namelen_bsd.go	…
posix-dirent_namelen_linux.go	…
posix-diskid-check.go	fix: implement splunk specific listObjects when delimiter=guidSplunk (#9186 )	5 years ago
posix-errors.go	fix: Avoid double usage calculation on every restart (#8856 )	5 years ago
posix-errors_test.go	…
posix-list-dir_other.go	…
posix-list-dir_test.go	Use errgroups instead of sync.WaitGroup as needed (#8354 )	5 years ago
posix-list-dir_unix.go	fix: Avoid double usage calculation on every restart (#8856 )	5 years ago
posix-list-dir_windows.go	…
posix.go	fix: implement splunk specific listObjects when delimiter=guidSplunk (#9186 )	5 years ago
posix_test.go	posix: Do not take disk offline on I/O errors (#8836 )	5 years ago
posix_unix_test.go	…
posix_windows_test.go	…
post-policy_test.go	Migrate config to KV data format (#8392 )	5 years ago
postpolicyform.go	Remove unusued params and functions (#8399 )	5 years ago
postpolicyform_test.go	…
prepare-storage.go	fix: log only catastrophic errors in prepare storage (#9189 )	5 years ago
retry.go	…
retry_test.go	…
routers.go	fix routing issue for esoteric characters in gorilla/mux (#8967 )	5 years ago
server-main.go	Add rate limiter for S3 API layer (#9196 )	5 years ago
server-main_test.go	Implement bucket expansion (#8509 )	5 years ago
server-rlimit.go	…
server-startup-msg.go	Fix storage info message on startup (#9177 )	5 years ago
server-startup-msg_test.go	Handle localhost distributed setups properly (#8577 )	5 years ago
server_test.go	acl: Support PUT calls with success for 'private' ACL's (#9000 )	5 years ago
service.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
setup-type.go	Allow proper setCount SLAs across zones (#8752 )	5 years ago
signals.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
signature-v2.go	Migrate config to KV data format (#8392 )	5 years ago
signature-v2_test.go	Migrate config to KV data format (#8392 )	5 years ago
signature-v4-parser.go	fix: sts to return appropriate errors (#9161 )	5 years ago
signature-v4-parser_test.go	fix: sts to return appropriate errors (#9161 )	5 years ago
signature-v4-utils.go	Migrate config to KV data format (#8392 )	5 years ago
signature-v4-utils_test.go	Rename iam/validator -> iam/openid and add tests (#8340 )	5 years ago
signature-v4.go	fix: support pre-sign signature for STS tokens (#8826 )	5 years ago
signature-v4_test.go	Migrate config to KV data format (#8392 )	5 years ago
storage-datatypes.go	Add a generic Walk()'er to list a bucket, optinally prefix (#9026 )	5 years ago
storage-errors.go	rest/storage: Remove racy LastError usage (#8817 )	5 years ago
storage-interface.go	fix: implement splunk specific listObjects when delimiter=guidSplunk (#9186 )	5 years ago
storage-rest-client.go	fix: implement splunk specific listObjects when delimiter=guidSplunk (#9186 )	5 years ago
storage-rest-common.go	fix: implement splunk specific listObjects when delimiter=guidSplunk (#9186 )	5 years ago
storage-rest-server.go	fix: implement splunk specific listObjects when delimiter=guidSplunk (#9186 )	5 years ago
storage-rest_test.go	Handle localhost distributed setups properly (#8577 )	5 years ago
streaming-signature-v4.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
streaming-signature-v4_test.go	…
sts-datatypes.go	…
sts-errors.go	fix: sts to return appropriate errors (#9161 )	5 years ago
sts-handlers.go	sa: Allow empty policy to indicate parent user's policy is inherited (#9185 )	5 years ago
test-utils_test.go	Add rate limiter for S3 API layer (#9196 )	5 years ago
tree-walk-pool.go	Fix recursive deep scan of buckets (#8900 )	5 years ago
tree-walk-pool_test.go	…
tree-walk.go	non-empty dirs should not be listed as objects (#9129 )	5 years ago
tree-walk_test.go	non-empty dirs should not be listed as objects (#9129 )	5 years ago
typed-errors.go	fix return proper error for OperationTimedout (#9117 )	5 years ago
update-notifier.go	Refactor config and split them in packages (#8351 )	5 years ago
update-notifier_test.go	Refactor config and split them in packages (#8351 )	5 years ago
update.go	fix: replica set deployment for multi tenants (#8673 )	5 years ago
update_test.go	fix: doc notifications formatting issues (#8661 )	5 years ago
utils.go	sa: Allow empty policy to indicate parent user's policy is inherited (#9185 )	5 years ago
utils_test.go	fix: Avoid double usage calculation on every restart (#8856 )	5 years ago
version_test.go	…
web-handler-context.go	Migrate config to KV data format (#8392 )	5 years ago
web-handler-context_test.go	…
web-handlers.go	Add response header timeouts (#9170 )	5 years ago
web-handlers_test.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
web-router.go	Bring in safe mode support (#8478 )	5 years ago
xl-sets.go	fix: implement splunk specific listObjects when delimiter=guidSplunk (#9186 )	5 years ago
xl-sets_test.go	log formatting only the first time (#8846 )	5 years ago
xl-v1-bucket.go	Add support for bucket encryption feature (#8890 )	5 years ago
xl-v1-common.go	Migrate config to KV data format (#8392 )	5 years ago
xl-v1-common_test.go	Implement bucket expansion (#8509 )	5 years ago
xl-v1-errors.go	…
xl-v1-healing-common.go	Remove partName, partETag requirement (#9044 )	5 years ago
xl-v1-healing-common_test.go	Remove partName, partETag requirement (#9044 )	5 years ago
xl-v1-healing.go	heal: Pass scan mode to HealObjects to deep scan full quorum objects (#9159 )	5 years ago
xl-v1-healing_test.go	heal: Pass scan mode to HealObjects to deep scan full quorum objects (#9159 )	5 years ago
xl-v1-list-objects-heal.go	heal: Pass scan mode to HealObjects to deep scan full quorum objects (#9159 )	5 years ago
xl-v1-list-objects.go	xl: Tree walking should not quit when one disk returns empty (#9160 )	5 years ago
xl-v1-metadata.go	Remove partName, partETag requirement (#9044 )	5 years ago
xl-v1-metadata_test.go	Remove partName, partETag requirement (#9044 )	5 years ago
xl-v1-multipart.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
xl-v1-multipart_test.go	re-implement data usage crawler to be more efficient (#9075 )	5 years ago
xl-v1-object.go	xl: Implement posix.DeletePrefixes to enhance delete perf (#9100 )	5 years ago
xl-v1-object_test.go	heal: Pass scan mode to HealObjects to deep scan full quorum objects (#9159 )	5 years ago
xl-v1-utils.go	Use jsoniter whenever applicable instead of encoding/json (#8766 )	5 years ago
xl-v1-utils_test.go	Remove partName, partETag requirement (#9044 )	5 years ago
xl-v1.go	fix: data usage crawler env handling, usage-cache.bin location (#9163 )	5 years ago
xl-zones.go	fix: implement splunk specific listObjects when delimiter=guidSplunk (#9186 )	5 years ago