1b92c5136b
Append "-1" to etag when it is not MD5 ( #4641 )
...
* gateway-azure: append "-1" to ETag so that clients do not interpret it as MD5. fixes #4537 . Added unit tests.
8 years ago
cc8a8cb877
posix: Check for min disk space and inodes ( #4618 )
...
This is needed such that we don't start or
allow writing to a posix disk which doesn't
have minimum total disk space available.
One part fix for #4617
8 years ago
f5ce685aa1
Remove dead unused errs and constants. ( #4627 )
8 years ago
c83055500d
fs: Fail CompleteMultipartUpload if partSize < 5M unless it is last part ( #4642 )
...
fixes #4625
8 years ago
b0fbddc051
fix confusing code for http.Header handling ( #4623 )
...
Fixed header-to-metadat extraction. The extractMetadataFromHeader function should return an error if the http.Header contains a non-canonicalized key. The reason is that the keys can be manually set (through a map access) which can lead to ugly bugs.
Also fixed header-to-metadata extraction. Return a InternalError if a non-canonicalized key is found in a http.Header. Also log the error.
8 years ago
4e0c08e9c5
ListenBucketNotification should set proper MIME type. ( #4621 )
...
This is needed to avoid proxies buffering the connection
this is also a HTTP standard way to handle this situation
where server is sending back events in asynchronously.
For more details read https://goo.gl/RCML9f
Fixes - https://github.com/minio/minio-go/issues/731
8 years ago
e91e9e8a38
GCS ListObjectV2 honours continuationToken ( #4608 )
8 years ago
53e7fdc847
create subcomposed objects if total parts are > 32 ( #4593 )
8 years ago
1af331c05c
Remove unnecessary newline at beginning of server output ( #4600 )
8 years ago
0e5b9c7fe4
Adds 'gcs not ready for production' msg ( #4604 )
8 years ago
c88dca984d
web: Encode path in presigned GET urls ( #4596 )
...
When the browser asks for a GET presigned url, this latter is not
encoded and can be confusing when the user copies-pastes it somewhere,
especially when the path contains a space.
8 years ago
1054f9cbf0
fix: Remove adverb from erasure coded startup message. ( #4594 )
8 years ago
7bd1f44491
Add support for helm package info in useragent ( #4592 )
8 years ago
eaa41e4086
gcs: Check if the given project id argument exists ( #4583 )
...
Using GCS resource manager API, check if the provided
project id is already created and associated to the current
user account.
8 years ago
6b70f429ed
gateway/azure: Parse error responses for anonymous requests ( #4543 )
...
fixes #4481
8 years ago
0a6e9a1834
gateway-gcs: cleanup minio.sys.temp before deleting the bucket ( #4582 )
...
fixes #4560
fixes #4569
8 years ago
15b65a8342
Added AnonListObjectsV2 support to GCS ( #4584 )
8 years ago
8b7df7da37
api: No need to set x-amz-bucket-region if region is empty. ( #4586 )
8 years ago
237c8af5ef
Improve GCS gateway example instruction ( #4587 )
8 years ago
ff036c171f
gateway-gcs: double quotes should be striped from ETag ( #4590 )
8 years ago
a3b085300d
gcs: Add missing AnonListObjectsV2
8 years ago
46897b1100
Name return values to prevent the need (and unnecessary code bloat) ( #4576 )
...
This is done to explicitly instantiate objects for every return statement.
8 years ago
cec8b238f3
sign: StreamingSign should use region from client. ( #4577 )
...
This is a fix to make streaming signature to behave
the same as regular signature and presigned signature.
Fixes https://github.com/minio/minio-go/issues/718
8 years ago
13ab8e17e2
gateway-gcs: use minio.sys.temp/multipart/v1 as url base ( #4562 )
8 years ago
146bc3e638
Add MINIO_REGION to server help message ( #4558 )
...
* Add e.g for setting MINIO_REGION env variable
* Add MINIO_REGION to region table
8 years ago
0543d45fb3
fix: OwnerID in response should be 64 character in length. ( #4554 )
...
Rather than sending a custom "minio" string, we can
change this to `sha256('arn:aws:iam::minio:user/admin')`.
Fixes #4553
8 years ago
fe426944ea
Fix GCS help message ( #4570 )
8 years ago
c1a6ca0c33
Fix spelling of function name to `startLockMaintenance` ( #4561 )
8 years ago
5a78266821
gateway/gcs: Complete minio browser support for gcs. ( #4552 )
...
Fixes #4460
8 years ago
3928c1e14c
gateway/gcs: Change in multipart backend format ( #4455 )
8 years ago
a86c2e2ce1
xl/fs: Return InvalidPart{} error for part ETag mismatch. ( #4541 )
...
Fixes #4539
8 years ago
e99244be02
xl: prepare storage should Abort properly. ( #4542 )
...
Current state-machine didn't honor a situation
which can arise when there is a combination of
- formatted
- unformatted
- corrupted
disks - this combination invariably goes into a
mode where all servers are waiting perpetually
forever thinking we will get quorum in future.
At this point there is a distant possibility of
ever getting a quorum since we don't even have
quorum number of disks offline.
We should exit and print a proper message per disk
to indicate what went wrong and what was detected
by the server.
Refer #4477
8 years ago
58833711e0
Added ListObjectsV2 and ListObjectsV2 Anon support to Gateway S3 and Azure. ( #4547 )
8 years ago
f99f218999
Add support for reading and saving config on Gateway. ( #4463 )
...
This is also a first step towards supporting bucket
notification for gateway.
8 years ago
4fb5fc72d7
GCS gateway allows apps to supply their own marker ( #4495 )
...
Most s3 compatible apps use object keys returned in listing as
marker. This change allows this behaviour with gateway-gcs too.
8 years ago
d86973dcca
Allow bucket creation in different regions, closes #4287 and #4241
...
* I needed to remove the region check from PutBucketHandler
8 years ago
8085ba4494
Filter out internal object prefix during listing ( #4435 )
...
We use ZZZZ-Minio/ prefix internally in our GCS gateway which should be
filtered out in the response to ListObjects.
8 years ago
9bd0eb1a9e
Set default ETag value if vendor returns empty md5 string ( #4409 )
...
The ETag is constructed from md5 atttribute of object attributes
returned by the vendor's Composer. The md5 attribute comes back
as nil for large uploads. Instead the CRC32C should be used.
Refer to https://cloud.google.com/storage/docs/hashes-etags
Fixes #4397
8 years ago
e4e0abfc05
fix: Check project id before starting gateway ( #4412 )
8 years ago
12b2fc894b
Remove profile option for gcs from gateway help message ( #4421 )
8 years ago
2aa76e7407
Change md5Sum to etag ( #4399 )
8 years ago
0dab038858
Cleanup and update the PR with the master branch.
8 years ago
a76556ec1b
Map only default region us-east-1 to gcs us region
8 years ago
91c7bb65c5
gateway/gcs: send proper error responses for Get/SetBucket policies. ( #4338 )
...
Fixes #4323
8 years ago
5d602034ea
gateway: Use default params when no args provided ( #4315 )
...
For S3 & Azure, use default parameters when no arguments (endpoint) are
provided. This also avoids a crash.
8 years ago
b829ec4a6b
Fixes https://github.com/minio/minio/issues/4320 ( #4332 )
...
- Add description for error ErrBucketAlreadyExists
8 years ago
9c50a9f567
Fix ListObjectParts to list properly all parts - closes #4322
8 years ago
52122c0309
Fix uploadIDMarker handling.
8 years ago
3b9d313c87
Fix issue with AbortMultipartUpload, closes #4322
8 years ago
bfff251e2a
Fix issue with UNSIGNED payloads.
...
Additionally also fixes escaping slashes in
temporary multipart names
8 years ago
Krishna Srinivas