941fed8e4a
s3Select: call Close on error to release the read lock ( #7830 )
5 years ago
55092bede1
add timestamp compare support ( #7832 )
5 years ago
90a3b830f4
fix typo and the string representation of the time.Time value ( #7831 )
5 years ago
23b9df0694
Fix s3select TRIM function's nil pointer dereference bug ( #7817 )
5 years ago
3022f60561
Stop duplicate entry in Notification.xml ( #7690 )
...
fixes #7671
6 years ago
1af6e8cb72
Add support for session policies in STS APIs ( #7747 )
...
This PR adds support for adding session policies
for further restrictions on STS credentials, useful
in situations when applications want to generate
creds for multiple interested parties with different
set of policy restrictions.
This session policy is not mandatory, but optional.
Fixes #7732
6 years ago
299ef9b188
Trace: Replace function name with API prefix ( #7794 )
...
This change is required for `Admin Trace`
6 years ago
99bf4d0c42
[sec] Match ${aws:username} exactly instead of prefix match ( #7791 )
...
This PR fixes a security issue where an IAM user based
on his policy is granted more privileges than restricted
by the users IAM policy.
This is due to an issue of prefix based Matcher() function
which was incorrectly matching prefix based on resource
prefixes instead of exact match.
6 years ago
002a205c9c
Fix OPA result response handling ( #7763 )
...
Also update the document with updated rego policy
and updated OPA agent REST API.
This PR is to fix a regression caused by PR #7637
6 years ago
97090aa16c
Add admin API to send trace notifications to registered ( #7128 )
...
Remove current functionality to log trace to file
using MINIO_HTTP_TRACE env, and replace it with
mc admin trace command on mc client.
6 years ago
a19cf063b5
Fixes for multiplatform dev and testing from forks ( #7734 )
...
Add support for correct dependency URLs on all platforms
only build mountinfo.go on linux
make testfile path relative to support fork work
6 years ago
ff7799452b
Fix build failure due to nats project migration
6 years ago
d16a409943
Ignore srvRecords from domain level entries ( #7742 )
...
Fixes #7741
6 years ago
2c0b3cadfc
Update go mod with sem versions of our libraries ( #7687 )
6 years ago
763fce909b
Enable event persistence in kafka ( #7633 )
6 years ago
7906f464fd
Skip non-bucket dns entry ( #7699 )
...
Fixes #7697
6 years ago
39b3e4f9b3
Avoid using io.ReadFull() for WriteAll and CreateFile ( #7676 )
...
With these changes we are now able to peak performances
for all Write() operations across disks HDD and NVMe.
Also adds readahead for disk reads, which also increases
performance for reads by 3x.
6 years ago
c4c79f61ce
Notification: Changes to persistent event store ( #7658 )
...
This patch includes the following changes in event store interface
- Removes memory store. We will not persist events in memory anymore, if `queueDir` is not set.
- Orders the events before replaying to the broker.
6 years ago
502456db91
Accept simpler response from OPA ( #7637 )
6 years ago
ac3b59645e
Add API retry functionality in mc admin ( #7602 )
6 years ago
72929ec05b
Turn off md5sum optionally if content-md5 is not set ( #7609 )
...
This PR also brings --compat option to run MinIO in strict
S3 compatibility mode, MinIO by default will now try to run
high performance mode.
6 years ago
998f01fadc
Support IPv6 hosts for postgres connections ( #7168 )
...
Fixes #7145
6 years ago
ae002aa724
Deprecate updating admin credentials using API calls ( #7570 )
...
Root credentials are not allowed to change in all of our
distributed setup deployments, this PR simply removes
that behavior.
6 years ago
a3ec71bc28
Use O_DIRECT while writing to disk ( #7479 )
...
- Use O_DIRECT while writing to disk
- Remove MINIO_DRIVE_SYNC option
6 years ago
4c048963dc
etcd: Handle create buckets with common prefixes properly ( #7556 )
...
common prefixes in bucket name if already created
are disallowed when etcd is configured due to the
prefix matching issue. Make sure that when we look
for bucket we are only interested in exact bucket
name not the prefix.
6 years ago
47ca411163
Enhance the event store interface to support channeling ( #7343 )
...
- Avoids code duplication across the other targets. By having a
centralized function call.
- Reduce the room for race.
6 years ago
5ecac91a55
Replace Minio refs in docs with MinIO and links ( #7494 )
6 years ago
0188009c7e
Expose total and available disk space ( #7453 )
6 years ago
b1b1d77893
Set S3 Select record message length to 128KiB ( #7475 )
...
- Previously this limit was a little more than 1MiB, and it broke
compatibility with AWS SDK Java causing a buffer overflow error.
6 years ago
dd1d69ab5c
fix mysql config for native password authentication ( #7436 )
...
fixes #7430
6 years ago
8a77a298f2
Add deploymentID to ServerInfo ( #7372 )
6 years ago
3d29ab4059
Rewrite if-else chains to switch statements ( #7382 )
6 years ago
facbd653ba
Add normal/deep type of heal scanning ( #7251 )
...
Healing scan used to read all objects parts to check for bitrot
checksum. This commit will add a quicker way of healing scan
by only checking if parts are actually present in disks or not.
6 years ago
91d85a0d53
Fix stale locks held by SelectParquet API ( #7364 )
...
Vendorize upstream parquet-go to fix this issue.
6 years ago
7079abc931
Implement HealObjects API to simplify healing ( #7351 )
6 years ago
285c09fe6b
Support buckets with '.' with etcd+coreDNS ( #7353 )
...
Fixes #7340
6 years ago
e463386921
Add JSON Path expression evaluation support ( #7315 )
...
- Includes support for FROM clause JSON path
6 years ago
b296b3cf8b
Skip non-bucket dns entry in federated bucket list ( #7339 )
6 years ago
f4879ed96d
Use jstream to serialize records to JSON format in S3Select ( #7318 )
...
- Also, switch to jstream to generate internal record representation
from CSV/JSON readers
- This fixes a bug in which JSON output objects have their keys
reversed from the order they are specified in the Select columns.
- Also includes a fix for tests.
6 years ago
12eb71828b
Fix posix tests for SimpleCI ( #7328 )
6 years ago
c3ca954684
Implement AssumeRole API for Minio users ( #7267 )
...
For actual API reference read here
https://docs.aws.amazon.com/STS/latest/APIReference/API_AssumeRole.html
Documentation is added and updated as well at docs/sts/assume-role.md
Fixes #6381
6 years ago
5e69a107d8
Support detecting mountpoints correctly ( #7288 )
...
Currently windows support was relying on Symlink as
a way to detect a drive, this doesn't work in latest
Windows 2016, fix this to use a proper mechanism by
using win32 APIs.
Additionally also add support for detecting bind mounts
on Linux.
6 years ago
78d116c487
Event persistence for MQTT ( #7268 )
...
- The events will be persisted in queueStore if `queueDir` is set.
- Else, if queueDir is not set events persist in memory.
The events are replayed back when the mqtt broker is back online.
6 years ago
2520e535a0
Allow lazyQuotes for certain types of CSV ( #7278 )
...
Set lazyQuotes to true, to allow a quote to appear
in an unquote field and a non-doubled quote may
appear in a quoted field.
6 years ago
7923b83953
Support multiple-domains in MINIO_DOMAIN ( #7274 )
...
Fixes #7173
6 years ago
80a351633f
Update vendorized bcicen/jstream ( #7257 )
...
- Includes an error handling fix that is waiting to be merged upstream
- Uses order-preserving (un)marshalling for JSON objects.
6 years ago
8a405cab2f
COUNT() function in select should return an int ( #7243 )
6 years ago
df35d7db9d
Introduce staticcheck for stricter builds ( #7035 )
6 years ago
ee5b3622a5
Evaluate where clause in aggregation queries ( #7235 )
6 years ago
13c3b8afe2
Update Redis client used for bucket notifications ( #7213 )
...
Current Redis client used https://github.com/garyburd/redigo/
has been archived and further development is done at
https://github.com/gomodule/redigo
This commit updates the client library accordingly.
Fixes #6392
6 years ago
Yao Zongyou