karthic rao
ee8605e333
Make bucket failure fix with high concurrent load ( #1630 )
8 years ago
karthic rao
e4958f9757
Removing regexp check and adding string based check, regexp check was unnecessary here ( #1627 )
8 years ago
Harshavardhana
b62774d32f
storage/xl: Return errVolumeAccessDenied if disks cannot be accessed. ( #1621 )
...
Fixes #1614
8 years ago
koolhead17
d6e0f3ab33
added awscli commands & minor typo fix. ( #1578 )
8 years ago
Bala FA
3ff0a56e62
XL: Ignore errDiskNotFound in certain situations ( #1610 )
...
When a disk is removed while an operation is going on
(eg. single/multipart put object, list/multipart list objects etc),
its required to ignore errDiskNotFound error and continue the
operation.
Fixes #1552
8 years ago
Harshavardhana
50431e91a6
erasure: Handle failed disks so that we initialize properly if they are missing. ( #1607 )
...
Fixes #1592
Fixes #1579
8 years ago
Harshavardhana
d4745c7d6a
object: PutObjectHandler should set the md5Sum properly. ( #1604 )
...
Additionally add a test case as well for validating for us
to reply BadDigest properly.
Fixes #1603
8 years ago
Bala FA
adbcafefad
xl/CreateFile: handle errFileNameTooLong error properly ( #1523 )
...
When errFileNameTooLong error is returned from posix, xl.CreateFile()
treats the error specially by returning the same error immediately.
Fixes #1501
8 years ago
Harshavardhana
86e5d71519
erasure: MakeVol, DeleteVol and StatVol should hold locks. ( #1597 )
...
Since there is a good amount of overlap, each code has to lock
properly for the operation they are going to perform.
- MakeVol create vols in a routine on all disks, hold locks.
- DeleteVol delete vols in a routine on all disks, hold locks.
- StatVol stat vols in a routine on all disks, hold locks.
Fixes #1588
8 years ago
Harshavardhana
72748d2073
erasure: healVolume err should be different from shadowed version. ( #1590 )
...
Multiple go-routines updating the same shadowed variable can
cause a data race, avoid it by using its own err variable.
Fixes #1589
8 years ago
Harshavardhana
49141eb3e4
http: Remove minhttp package and use standard Golang http. ( #1587 )
...
The functionality provided by minhttp will be implemented
cleanly through our own APIs. Since we are not going to
send SIGUSR2 and manage configuration in that manner, it
doesn't make sense to use minhttp.
Fixes #1586
8 years ago
Harshavardhana
d1fa1d9352
Remove binary files from previous commit.
8 years ago
karthic rao
26e2c4bf4d
Replacing fastsha256 with crypto/sha256 package from golang standard package ( #1584 )
8 years ago
Krishna Srinivas
b044336329
XL/GetObject: If the offset does not fall in the first "dataBlock" it gives incorrect data. ( #1583 )
...
Fixes #1582
8 years ago
Krishna Srinivas
e99cb05516
XL/GetObject: offset should be reset to 0 after reading first part. ( #1580 ) ( #1581 )
8 years ago
Krishna Srinivas
409e09c1e5
XL/Selfheal: skip reading from disk if ReadFile had returned error. ( #1575 )
8 years ago
Krishna Srinivas
c314a98c1a
XL/list: fix panic on list when a disk is down. ( #1562 )
8 years ago
Harshavardhana
5f0ca64346
erasure: listOnlineDisks should return errFileNotFound for errReadQuorum. ( #1573 )
...
Fixes #1571
8 years ago
Harshavardhana
0db3218d5d
xl: getPartsMetadata fetch parts and decode in go-routine. ( #1569 )
...
Ref #1516
8 years ago
Harshavardhana
eec41c369c
posix: Return diskNotFound error rather than errVolumeNotFound ( #1568 )
...
Fixes #1559
8 years ago
Harshavardhana
b66c3bf35e
server: Enable server profiling as needed. ( #1565 )
8 years ago
Harshavardhana
f733120d3d
xl: CompleteMultipartUpload make sure to delete uploads.json ( #1539 )
...
Fixes #1537
Ref #1540 - for missing functionality in this patch.
8 years ago
Krishna Srinivas
6627388dc3
posix: remove dead code related to posix reserved suffixes. ( #1555 )
8 years ago
Harshavardhana
9d41414fb5
posix: reserved files should be filtered out at posix not object layer. ( #1554 )
8 years ago
Harshavardhana
722abe2d0f
xl/fs: pathJoin now takes variadic inputs. ( #1550 )
...
Retains slash for the last element.
Fixes #1546
8 years ago
Krishna Srinivas
04a5b25929
Multipart: Minimum part size limit does not apply to the last part during CompleteMultipartUpload. ( #1518 ) ( #1538 )
8 years ago
Harshavardhana
90ea494338
erasure: waitCloser should implement CloseWithError. ( #1543 )
...
This is needed so that the other end of the pipe receives
and error, cleanups temporary files.
8 years ago
Harshavardhana
a8fdd04e62
erasure: ReadFile should honor proper offsets. ( #1542 )
...
Fixes #1535
8 years ago
Harshavardhana
76c511c9fe
api: Extend S3 errors with Minio errors. ( #1533 )
...
Fixes #1530
8 years ago
Krishna Srinivas
75320f70d0
multipart: reject part upload if size is less than 5MB. ( #1518 )
8 years ago
Krishna Srinivas
88e1c04259
XL/ListDir: break out of loop if list on one disk is a success. ( #1534 )
8 years ago
Krishna Srinivas
a205aca6d2
init: Cleanup .minio/tmp directories recursively. Also takes care of cleaning up of parts directory during abortMultipartUpload. ( #1532 )
8 years ago
Harshavardhana
3f51dd4fd4
xl: CompleteMultipartUpload should rename files in a routine. ( #1527 )
...
This solves the client timeout while renaming 9000+ parts.
Fixes #1526
8 years ago
Harshavardhana
56b7df90e1
xl/fs: ListObjectParts should set nextPartNumberMarker properly. ( #1528 )
...
For list requests on parts more than 1000, would lead to an infinite
loop.
Fixes #1522
8 years ago
Harshavardhana
a56d5ef415
xl/fs: isFunctions should only return boolean. ( #1525 )
...
log the unrecognize errors.
8 years ago
Harshavardhana
937d68202d
server: Deadcode removal. ( #1517 )
8 years ago
Harshavardhana
bf563afb80
xl: DeleteObject regression over errChannel. ( #1521 )
...
DeleteObject would hang indefinitely - fix it.
8 years ago
Harshavardhana
091c1e8456
copyObject: No need to verify md5sum. ( #1520 )
...
Multipart objects are kept in non hex md5sum format.
This format doesn't comply with hex, so decoding
would fail invariably.
This is not necessary to validate and its not expected
error during a CopyObject operation.
Fixes #1519
8 years ago
Harshavardhana
751fa972f5
xl/fs: Multipart re-org introduce "uploads.json" ( #1505 )
...
Fixes #1457
8 years ago
Harshavardhana
434423de89
xl: Move format detection inside xl objects. ( #1515 )
...
Fixes #1449
8 years ago
Harshavardhana
a20ccb1e83
server: Print proper endpoint, along with https if configured. ( #1514 )
...
Fixes #1492
8 years ago
Harshavardhana
0625c050e6
xl/tests: Enable server handler tests over XL. ( #1512 )
...
Fixes #1513
8 years ago
Harshavardhana
0b74f5624e
xl: Fix how we deal with read offsets at erasure layer. ( #1511 )
...
Requires skipping necessary parts of dataBlocks during
decoding phase and requires us to properly skip the
entries as needed.
Thanks to Karthic for reproducing this important issue.
Fixes #1503
8 years ago
Krishna Srinivas
c06b9abc15
bucket-handlers: do not unescape marker as gorilla layer would have already done it. ( #1495 ) ( #1510 )
8 years ago
Krishna Srinivas
a5d31d4254
XL/ListObjects: use string.TrimSuffix instead of Trim. ( #1498 ) ( #1509 )
8 years ago
karthic rao
20ca65c793
Cleanup: mispell fixes
8 years ago
karthic rao
0b4bbe6d9e
Adding XL Object layer validation for existing unit tests of single node ( #1499 )
...
object layer.
Adding isBucketExist check for GetObjectInfo in the XL layer.
8 years ago
Krishna Srinivas
48d3be36da
XL/ListObjects: Fix ordering issue during listing if the files were uploaded as multipart uploads. ( #1498 ) ( #1506 )
...
i.e if two files "tmp" and "tmp.1" are uploaded as multipart we would list ""tmp.1"" before ""tmp"" as "tmp.1/" < "tmp/"
8 years ago
Harshavardhana
5133ea50bd
xl/fs: Make i/o operations atomic. ( #1496 )
8 years ago
Harshavardhana
17868ccd7f
handlers: overhaul entire writErrorResponse, simplify. ( #1472 )
8 years ago