182109f0de
xl: Heal `format.json` properly on fresh disks.
8 years ago
ba2ba328da
server: Fixes for various conditions
...
- Fix distributed branch to be able to run FS version.
- Fix distributed branch to be able to run XL local disks.
- Ignore initialization failures of notification and bucket
policies, the codepath should load whatever is possible.
8 years ago
b4e4846e9f
PutObject: object layer now returns ObjectInfo instead of md5sum to avoid extra GetObjectInfo call. ( #2599 )
...
From the S3 layer after PutObject we were calling GetObjectInfo for bucket notification. This can
be avoided if PutObjectInfo returns ObjectInfo.
fixes #2567
8 years ago
9358ee011b
logging: Print stack trace in case of errors.
...
fixes #1827
8 years ago
0513b3ed07
Add Heal Disk Metadata RPC API + tests ( #2556 )
8 years ago
339425fd52
server: Fetch StorageInfo() from underlying disks transparently. ( #2549 )
...
Fixes #2511
8 years ago
51e337228e
Avoid hiding disk errors in some cases in FS Shutdown ( #2668 )
8 years ago
3aa0574c6b
FS/multipart: Append the parts to a file as and when the parts arrive. ( #2513 )
8 years ago
bccf549463
server: Move all the top level files into cmd folder. ( #2490 )
...
This change brings a change which was done for the 'mc'
package to allow for clean repo and have a cleaner
github drop in experience.
8 years ago
810dcbf34b
fs: ListObjects should populate ETag properly if fs.json is available. ( #2480 )
...
Fixes #2470
8 years ago
e2498edb45
contoller: Implement controlled healing and trigger ( #2381 )
...
This patch introduces new command line 'control'
- minio control
TO manage minio server connecting through GoRPC API frontend.
- minio control heal
Is implemented for healing objects.
8 years ago
f2bffe6086
fs/delete-object: fs.json filepath was incorrect. ( #2448 )
8 years ago
bb8a425d49
When updating the meta file, write to temp file first and then rename to the actual location.
...
This prevents appending the metadata to the metadata-file when a file is reuploaded.
8 years ago
5526ac13d2
Protect shutdown callbacks lists with a mutex ( #2432 )
8 years ago
d28fb5fe23
Add a generic registerShutdown function for graceful exit ( #2344 )
...
* Add a generic registerShutdown function for graceful exit
* Add shutdown callback test case
8 years ago
064c51162d
api: Add new ListenBucketNotificationHandler. ( #2336 )
...
This API is precursor before implementing `minio lambda` and `mc` continous replication.
This new api is an extention to BucketNofication APIs.
// Request
```
GET /bucket?notificationARN=arn:minio:lambda:us-east-1:10:minio HTTP/1.1
...
...
```
// Response
```
{"Records": ...}
...
...
...
{"Records": ...}
```
8 years ago
cf9ba7b88f
tests: Add missing unit test for posix.ReadFile. ( #2319 )
8 years ago
7e5a78985d
tests: Using listObjects clean up remaining tree walk go routines. ( #2278 )
...
* fs: Set nextMarker independent of it having a slash or not.
* tests: Using listObjects clean up remaining tree walk go routines.
* tests: Use slices to hold data instead of enumerating test cases by hand
... also fixed numbering of test cases.
8 years ago
f248089523
api: Implement bucket notification. ( #2271 )
...
* Implement basic S3 notifications through queues
Supports multiple queues and three basic queue types:
1. NilQueue -- messages don't get sent anywhere
2. LogQueue -- messages get logged
3. AmqpQueue -- messages are sent to an AMQP queue
* api: Implement bucket notification.
Supports two different queue types
- AMQP
- ElasticSearch.
* Add support for redis
8 years ago
f85d94288d
api: extract http headers with some supported header list. ( #2268 )
8 years ago
0add96f655
fs: Save metadata for objects in minioMetaBucket directory. ( #2251 )
8 years ago
c1e953b368
api: Set content-encoding properly if set. ( #2245 )
...
Additionally don't set content-type if not present, golang http
server automaticaly handles this and sets it automatically.
8 years ago
5cc9e4e214
fs/XL: Return IncompleteBody{} error for short writes ( #2228 )
8 years ago
27a5b61f40
tree-walk: optimize tree walk such that leaf detection of entries is delayed till the entry is sent on the treeWalkResult channel. ( #2220 )
8 years ago
5cd629adca
XL/fs: DeleteVol should not return error cleaning multipart dir for errVolumeNotFound ( #2188 )
8 years ago
126865e8df
XL/bucket: Remove bucket should cleanup incomplete uploads as well. ( #2173 )
...
This behavior is in accordance with S3.
Fixes #2170
8 years ago
ae80f8ca35
ObjectLayer/GetObject: Should return the right error value. Fix done in FS and XL. ( #2133 )
...
fixes #2117
8 years ago
ec35330ebb
XL/fs: GetObject should validate all its inputs. ( #2142 )
...
Fixes #2141
Fixes #2139
8 years ago
5ec7734d88
FS: Check offset is within object size in GetObject() ( #2123 )
...
Fixes #2118
8 years ago
ddf3245677
xl/fs: offset and length cannot be negative. ( #2121 )
...
Fixes #2119
8 years ago
44ae7a037b
fix: allocate buffer to required size than readSizeV1 ( #2095 )
...
Refer #2077
8 years ago
8a028a9efb
handler/PUT: Handle signature verification through a custom reader. ( #2066 )
...
Change brings in a new signVerifyReader which provides a io.Reader
compatible reader, additionally implements Verify() function.
Verify() function validates the signature present in the incoming
request. This approach is choosen to avoid complexities involved
in using io.Pipe().
Thanks to Krishna for his inputs on this.
Fixes #2058
Fixes #2054
Fixes #2087
8 years ago
0540863663
fix: use readSizeV1 wherever applicable. ( #2093 )
8 years ago
7a8b8cd0a1
tree-walk: unify FS and XL tree-walk with functional approach. ( #2027 )
8 years ago
52b55afce0
FS: check whether disk format is FS or not. ( #2083 )
...
Fixes #2060
8 years ago
d64c3fd464
posix: Return errDiskNotWritable during disk initialization. ( #2048 )
...
It can happen that minio server might not have
writable permissions on the export paths command line.
Fixes #2035
8 years ago
0e3907072c
XL/fs: Initialize export paths supplied on command line ( #2020 )
...
Fixes #2013
9 years ago
42286cba70
XL: Implement new ReadAll API for files which are read in single call. ( #1974 )
...
Add a unit test as well.
9 years ago
ed2fdd90b0
fs: Fix GetObject failure to read large blocks. ( #1982 )
...
Add relevant test cases as well for verifying this
part of the codebase.
Fixes #1979
9 years ago
a3a310cde8
Moved tree-walk-fs to use tree-walk-pool ( #1978 )
9 years ago
e8990e42c2
XL: Make allocations simpler avoid redundant allocs. ( #1961 )
...
- Reduce 10MiB buffers for loopy calls to use 128KiB.
- start using 128KiB buffer where needed.
9 years ago
50d25ca94a
XL: Change AppendFile() to return only error ( #1932 )
...
AppendFile ensures that it appends the entire buffer. Returns
an error otherwise, this patch removes the necessity for the
caller to look for 'n' return on short writes.
Ref #1893
9 years ago
f51d34cedd
Do not guess content-type for objects with no extension ( #1918 )
9 years ago
e2743d05e8
FS: remove .minio directory if .minio/multipart is empty. ( #1899 )
...
fixes #1886
9 years ago
afc3102488
Adding format.json during FS initialization ( #1896 )
9 years ago
1b9db9ee6c
FS/PutObject: Read() data should be handled even in case of EOF. ( #1864 )
...
Fixes #1710
9 years ago
de21126f7e
XL: Re-align the code again.
9 years ago
445dc22118
XL: Cleanup and add more comments. ( #1807 )
9 years ago
a4a0ea605b
XL: Fix GetObject erasure decode issues. ( #1793 )
9 years ago
5e8de786b3
XL: Truly use unique id's in temp directory. ( #1790 )
...
This also helps in avoiding cleaning up directories after.
Additionally this patch also fixes the problem of Range offsets.
9 years ago
Harshavardhana