f248089523
api: Implement bucket notification. ( #2271 )
...
* Implement basic S3 notifications through queues
Supports multiple queues and three basic queue types:
1. NilQueue -- messages don't get sent anywhere
2. LogQueue -- messages get logged
3. AmqpQueue -- messages are sent to an AMQP queue
* api: Implement bucket notification.
Supports two different queue types
- AMQP
- ElasticSearch.
* Add support for redis
8 years ago
f85d94288d
api: extract http headers with some supported header list. ( #2268 )
8 years ago
0add96f655
fs: Save metadata for objects in minioMetaBucket directory. ( #2251 )
8 years ago
c1e953b368
api: Set content-encoding properly if set. ( #2245 )
...
Additionally don't set content-type if not present, golang http
server automaticaly handles this and sets it automatically.
8 years ago
5cc9e4e214
fs/XL: Return IncompleteBody{} error for short writes ( #2228 )
8 years ago
27a5b61f40
tree-walk: optimize tree walk such that leaf detection of entries is delayed till the entry is sent on the treeWalkResult channel. ( #2220 )
8 years ago
5cd629adca
XL/fs: DeleteVol should not return error cleaning multipart dir for errVolumeNotFound ( #2188 )
8 years ago
126865e8df
XL/bucket: Remove bucket should cleanup incomplete uploads as well. ( #2173 )
...
This behavior is in accordance with S3.
Fixes #2170
8 years ago
ae80f8ca35
ObjectLayer/GetObject: Should return the right error value. Fix done in FS and XL. ( #2133 )
...
fixes #2117
8 years ago
ec35330ebb
XL/fs: GetObject should validate all its inputs. ( #2142 )
...
Fixes #2141
Fixes #2139
8 years ago
5ec7734d88
FS: Check offset is within object size in GetObject() ( #2123 )
...
Fixes #2118
8 years ago
ddf3245677
xl/fs: offset and length cannot be negative. ( #2121 )
...
Fixes #2119
8 years ago
44ae7a037b
fix: allocate buffer to required size than readSizeV1 ( #2095 )
...
Refer #2077
8 years ago
8a028a9efb
handler/PUT: Handle signature verification through a custom reader. ( #2066 )
...
Change brings in a new signVerifyReader which provides a io.Reader
compatible reader, additionally implements Verify() function.
Verify() function validates the signature present in the incoming
request. This approach is choosen to avoid complexities involved
in using io.Pipe().
Thanks to Krishna for his inputs on this.
Fixes #2058
Fixes #2054
Fixes #2087
8 years ago
0540863663
fix: use readSizeV1 wherever applicable. ( #2093 )
8 years ago
7a8b8cd0a1
tree-walk: unify FS and XL tree-walk with functional approach. ( #2027 )
8 years ago
52b55afce0
FS: check whether disk format is FS or not. ( #2083 )
...
Fixes #2060
8 years ago
d64c3fd464
posix: Return errDiskNotWritable during disk initialization. ( #2048 )
...
It can happen that minio server might not have
writable permissions on the export paths command line.
Fixes #2035
8 years ago
0e3907072c
XL/fs: Initialize export paths supplied on command line ( #2020 )
...
Fixes #2013
8 years ago
42286cba70
XL: Implement new ReadAll API for files which are read in single call. ( #1974 )
...
Add a unit test as well.
8 years ago
ed2fdd90b0
fs: Fix GetObject failure to read large blocks. ( #1982 )
...
Add relevant test cases as well for verifying this
part of the codebase.
Fixes #1979
8 years ago
a3a310cde8
Moved tree-walk-fs to use tree-walk-pool ( #1978 )
8 years ago
e8990e42c2
XL: Make allocations simpler avoid redundant allocs. ( #1961 )
...
- Reduce 10MiB buffers for loopy calls to use 128KiB.
- start using 128KiB buffer where needed.
8 years ago
50d25ca94a
XL: Change AppendFile() to return only error ( #1932 )
...
AppendFile ensures that it appends the entire buffer. Returns
an error otherwise, this patch removes the necessity for the
caller to look for 'n' return on short writes.
Ref #1893
8 years ago
f51d34cedd
Do not guess content-type for objects with no extension ( #1918 )
8 years ago
e2743d05e8
FS: remove .minio directory if .minio/multipart is empty. ( #1899 )
...
fixes #1886
8 years ago
afc3102488
Adding format.json during FS initialization ( #1896 )
8 years ago
1b9db9ee6c
FS/PutObject: Read() data should be handled even in case of EOF. ( #1864 )
...
Fixes #1710
8 years ago
de21126f7e
XL: Re-align the code again.
8 years ago
445dc22118
XL: Cleanup and add more comments. ( #1807 )
8 years ago
a4a0ea605b
XL: Fix GetObject erasure decode issues. ( #1793 )
8 years ago
5e8de786b3
XL: Truly use unique id's in temp directory. ( #1790 )
...
This also helps in avoiding cleaning up directories after.
Additionally this patch also fixes the problem of Range offsets.
8 years ago
feb337098d
XL: bring in new storage API. ( #1780 )
...
Fixes #1771
8 years ago
ba8bdec077
XL: ListObjects should not list when delimiter and prefix are '/'. ( #1777 )
8 years ago
6dc8323684
FS/ListMultipart: Fix FS list-multipart to work for unit test cases.
8 years ago
34e9ad24aa
XL: Introduce new API StorageInfo. ( #1770 )
...
This is necessary for calculating the total storage
capacity from object layer. This value is also needed for
browser UI.
Buckets used to carry this information, this patch
deprecates this feature.
8 years ago
293d246f95
XL/FS: Rewrite in new format.
8 years ago
4bc923e63b
XL/fs: Optimize calling isBucketExist() ( #1656 )
...
* posix: Avoid using getAllVolumeInfo() in getVolumeDir()
This is necessary compromise to avoid significant slowness this
causes under load. The compromise is also substantial in a way
so that to avoid penalizing common cases v/s special cases.
For buckets with Caps on Unixes, we filter buckets based on the
latest anyways, so this is completely acceptable.
* XL/fs: Change the usage of verification of existance of buckets.
Optimize calling isBucketExists, it is not needed for all call
paths. isBucketExist should be called only for calls which use
temporary volume location for operations, for the rest rely on
the errors returned on their original call path.
Remove usage of filtering as well across all volume names.
8 years ago
8099396ff0
xl/putObject: Should take care of the situation if an object already exists at the location. ( #1606 )
...
Fixes #1598 #1594 #1595
8 years ago
a56d5ef415
xl/fs: isFunctions should only return boolean. ( #1525 )
...
log the unrecognize errors.
8 years ago
751fa972f5
xl/fs: Multipart re-org introduce "uploads.json" ( #1505 )
...
Fixes #1457
8 years ago
48d3be36da
XL/ListObjects: Fix ordering issue during listing if the files were uploaded as multipart uploads. ( #1498 ) ( #1506 )
...
i.e if two files "tmp" and "tmp.1" are uploaded as multipart we would list ""tmp.1"" before ""tmp"" as "tmp.1/" < "tmp/"
8 years ago
ca097de96c
xl/fs: Add initObjectLayer function. ( #1494 )
...
Fixes #1493
8 years ago
247e835d7b
object: move go-routine listing from posix to objectLayer. ( #1491 )
8 years ago
46680788f9
xl/fs: cleanup '/.minio/tmp' directory on each initialization. ( #1490 )
8 years ago
afd59c45dc
xl/fs: Move few functions into common code. ( #1453 )
...
- PutObject()
- PutObjectPart()
- NewMultipartUpload()
- AbortMultipartUpload()
Implementations across both FS and XL object layer
share common implementation.
9 years ago
10a010c1ad
xl/fs: Object layer - keep common functions into single place. ( #1423 )
9 years ago
4e34e03dd4
xl/fs: Split object layer into interface. ( #1415 )
9 years ago
Harshavardhana