Krishna Srinivas
8099396ff0
xl/putObject: Should take care of the situation if an object already exists at the location. ( #1606 )
...
Fixes #1598 #1594 #1595
9 years ago
Harshavardhana
f733120d3d
xl: CompleteMultipartUpload make sure to delete uploads.json ( #1539 )
...
Fixes #1537
Ref #1540 - for missing functionality in this patch.
9 years ago
Krishna Srinivas
04a5b25929
Multipart: Minimum part size limit does not apply to the last part during CompleteMultipartUpload. ( #1518 ) ( #1538 )
9 years ago
Krishna Srinivas
75320f70d0
multipart: reject part upload if size is less than 5MB. ( #1518 )
9 years ago
Harshavardhana
3f51dd4fd4
xl: CompleteMultipartUpload should rename files in a routine. ( #1527 )
...
This solves the client timeout while renaming 9000+ parts.
Fixes #1526
9 years ago
Harshavardhana
56b7df90e1
xl/fs: ListObjectParts should set nextPartNumberMarker properly. ( #1528 )
...
For list requests on parts more than 1000, would lead to an infinite
loop.
Fixes #1522
9 years ago
Harshavardhana
a56d5ef415
xl/fs: isFunctions should only return boolean. ( #1525 )
...
log the unrecognize errors.
9 years ago
Harshavardhana
751fa972f5
xl/fs: Multipart re-org introduce "uploads.json" ( #1505 )
...
Fixes #1457
9 years ago
Krishna Srinivas
48d3be36da
XL/ListObjects: Fix ordering issue during listing if the files were uploaded as multipart uploads. ( #1498 ) ( #1506 )
...
i.e if two files "tmp" and "tmp.1" are uploaded as multipart we would list ""tmp.1"" before ""tmp"" as "tmp.1/" < "tmp/"
9 years ago
Harshavardhana
5133ea50bd
xl/fs: Make i/o operations atomic. ( #1496 )
9 years ago
Krishna Srinivas
247e835d7b
object: move go-routine listing from posix to objectLayer. ( #1491 )
9 years ago
Harshavardhana
6988ed9257
xl/getObjectInfo: Returns back proper size, modTime and md5Sum. ( #1479 )
...
Fixes #1469
9 years ago
Harshavardhana
d0e854afb7
xl/fs: Bring in ".minio/tmp" directory support. ( #1464 )
...
All transactions happen through this directory inside ".minio/temp".
Adding this allows us to remove any temporary files which were not
committed before.
Fixes #1462
Fixes #1444
9 years ago
Harshavardhana
afd59c45dc
xl/fs: Move few functions into common code. ( #1453 )
...
- PutObject()
- PutObjectPart()
- NewMultipartUpload()
- AbortMultipartUpload()
Implementations across both FS and XL object layer
share common implementation.
9 years ago
Harshavardhana
7caa82f32f
xl/fs: Rename minioMetaVolume to minioMetaBucket. ( #1442 )
9 years ago
Krishna Srinivas
286de4de2c
XL - fixes mostly related to multipart listing. ( #1441 )
...
* XL/Multipart: Use json.NewDecoder to decode read stream.
* XL/Multipart: fix recursive and non-recursive listing.
* XL/Multipart: Create object part with md5sum later using RenameFile.
* XL/Multipart: ListObjectParts should list parts in order.
previously: uploadID.10.md5sum < uploadID.2.md5sum
fix : uploadID.00010.md5sum > uploadID.00002.md5sum
* XL/Multipart: Keep the size of each part in the multipart metadata file to avoid stats on the parts.
* XL/Multipart: fix listing bug which was showing size of the multipart uploaded objects as 0.
9 years ago
Krishna Srinivas
0c27d8e5b1
XL/Multipart: maintain the parts info in multipart.json after complete-multipart-upload. ( #1436 )
9 years ago
Harshavardhana
10a010c1ad
xl/fs: Object layer - keep common functions into single place. ( #1423 )
9 years ago
Harshavardhana
4e34e03dd4
xl/fs: Split object layer into interface. ( #1415 )
9 years ago
Krishna Srinivas
7066ce5160
XL/Multipart: rename the parts instead of concatenating. ( #1416 )
9 years ago
karthic rao
1813e9c070
Cleanup - Comments and readability fixes ( #1386 )
9 years ago
Harshavardhana
b51bef85e6
objectapi: ListMultipart now lists more than 1000 entries in non-recursive. ( #1397 )
...
Having keyMarker with "/" is a valid marker.
Fixes #1394
9 years ago
Krishna Srinivas
d0e5470050
ListMultipart fixes ( #1392 )
...
* ListMultipart: listLeafEntries() - return earlier if a directory is found.
* ListMultipart: do listLeafEntries() only for directories.
9 years ago
Harshavardhana
90987df9b4
objectapi: Simplify ListMultipart combine recursive and non-recursive. ( #1390 )
...
Fixes #1365
9 years ago
Harshavardhana
57f35c2bcc
xl: Introduce new blocking writer to make CreateFile atomic. ( #1362 )
...
Creates a new write closer that must be released
by the read consumer. This is necessary so that
while commiting the underlying writers in erasure
coding we need to make sure we reply success only if
we have committed to disk.
This in turn also fixes plethora of bugs related to
subsequent PutObject() races with namespace locking.
This patch also enables most of the tests, other than
ListObjects paging which has some issues still.
Fixes #1358 , #1360
9 years ago
Harshavardhana
91588209fa
obj: Object api handle all errors in common location. ( #1343 )
9 years ago
Harshavardhana
141a44bfbf
xl: Fix ReadFile to keep the order always for reading the data back. ( #1339 )
...
Also fixes a stackoverflow bug in namespace locking.
9 years ago
Harshavardhana
a98a7fb1ad
Implement XL layer - preliminary work.
9 years ago
karthic rao
6e372f83b4
Tests: object api multipart tests and bug fixes.
9 years ago
Harshavardhana
1284ecc6f2
api: Fix verification of checkLeafDirectory. ( #1347 )
...
This fixes a problem where leaf directory has more than 1000
entries, also resulting in listing issues, leading to an infinite
loop.
Fixes #1334
9 years ago
Harshavardhana
e0f8fed011
object: handle Error responses and handle errDiskFull. ( #1331 )
9 years ago
Harshavardhana
be002ac01e
fs/object: Fix issues from review comments.
9 years ago
Krishna Srinivas
149c6ca094
listMultipart: bugfixes. ( #1318 )
9 years ago
Harshavardhana
8457af5708
fs: Add proper volume and path validation.
9 years ago
Krishna Srinivas
caa35f68fa
listMultipart: implement support for marker. ( #1313 )
9 years ago
Krishna Srinivas
01a439f95b
refactor: add multipart code to the object layer.
9 years ago