Krishnan Parthasarathi
c87f259820
Remove parts that are missing in CompleteMultipartUpload ( #1786 )
...
* Remove parts that are missing in CompleteMultipartUpload
* Moved isUploadIDExists under proper namespace locks
* Moved code that deletes part files to a function
9 years ago
karthic rao
7278b90fe1
Adding defer to the lock ( #1785 )
9 years ago
Krishna Srinivas
41a5b3908b
XL/ListParts: take the size from xl.json instead of backend file size as it will be different. ( #1781 )
...
Fixes #1779
9 years ago
Krishna Srinivas
3fb0b5e455
XL/Multipart: check existance upload uploadID after lock. ( #1778 )
...
Fixes #1767
9 years ago
Harshavardhana
ba8bdec077
XL: ListObjects should not list when delimiter and prefix are '/'. ( #1777 )
9 years ago
Harshavardhana
27cc8a6529
erasure: read only dataBlocks if we have enough. ( #1776 )
...
Reconstruct with parity blocks if we don't have enough data blocks.
9 years ago
Krishnan Parthasarathi
302ec27fa2
Fixed race during parallel PutObjectPart requests ( #1775 )
...
The race is between two parallel PutObjectPart requests updating partsInfo in xl.json.
Previously, it was being updated under a RLock().
9 years ago
Krishnan Parthasarathi
5f679d9d1e
Rename back multipart objects if read/write Quorum was unavailable ( #1773 )
9 years ago
Bala FA
51bb613fdf
pkg/safe: remove temporary file on failure ( #1774 )
9 years ago
Harshavardhana
d65101a8c8
XL: Implement strided erasure distribution. ( #1772 )
...
Strided erasure distribution uses a new randomized
block distribution for each Put operation. This
information is captured inside `xl.json` for subsequent
Get operations.
9 years ago
Krishna Srinivas
6dc8323684
FS/ListMultipart: Fix FS list-multipart to work for unit test cases.
9 years ago
Krishna Srinivas
616a257bfa
XL/Multipart: isMultipartUpload() checks for presence of uploads.json on a random disk.
9 years ago
Krishna Srinivas
3487b3c095
Multipart: Disable FS tests and certain test cases for list-incomplete-uploads.
9 years ago
Karthic Rao
1f51af6f37
Listmultipart tests.
9 years ago
Krishna Srinivas
b1e2b7dea2
Fix list-incomplete uploads for XL.
9 years ago
Harshavardhana
34e9ad24aa
XL: Introduce new API StorageInfo. ( #1770 )
...
This is necessary for calculating the total storage
capacity from object layer. This value is also needed for
browser UI.
Buckets used to carry this information, this patch
deprecates this feature.
9 years ago
Harshavardhana
b2293c2bf4
XL: Rename, cleanup and add more comments. ( #1769 )
...
- xl-v1-bucket.go - removes a whole bunch of code.
- {xl-v1,fs-v1}-metadata.go - add a lot of comments and rename functions
appropriately.
9 years ago
Harshavardhana
553fdb9211
XL: Bring in support for object versions written during writeQuorum. ( #1762 )
...
Erasure is initialized as needed depending on the quorum and onlineDisks.
This way we can manage the quorum at the object layer.
9 years ago
Harshavardhana
cae4782973
XL: explicit deleteObject is not needed after rename failure. ( #1760 )
...
Reason is renameObject() does deleteObject() upon writeQuorum
failure if not keeps the successfully renamed parts if we have
reached readQuorum.
9 years ago
Krishnan Parthasarathi
3550660163
Return error for empty parts in multipartupload complete ( #1758 )
9 years ago
Harshavardhana
a4771265cf
XL: Abortmultipart should update `uploads.json` properly. ( #1757 )
9 years ago
Harshavardhana
a9e778f460
XL/fs: initObjectLayer should cleanup tmpMetaPrefix in parallel. ( #1752 )
...
Fixes #1747
9 years ago
Harshavardhana
ee6645f421
XL: Add additional PartNumber variable as part of `xl.json` ( #1750 )
...
This is needed for verification of incoming parts and to
support variadic part uploads. Which should be sorted
properly.
Fixes #1740
9 years ago
Harshavardhana
a97230dd56
XL/erasure: Reset dataBlocks to reduce the memory usage. ( #1749 )
...
Fixes #1748
9 years ago
Harshavardhana
1e393c6c5b
XL: Add new metadata for checksum. ( #1743 )
9 years ago
Krishna Srinivas
b38b9fea79
XL/erasure: fix for skipping 0 padding. ( #1737 )
...
Fixes #1736
9 years ago
Krishna Srinivas
6d84e84b3c
XL/mutltipart: fix partnumber to partname association. ( #1739 )
...
Fixes #1738
9 years ago
Harshavardhana
a00a5c6e7e
XL: Multipart update uploads.json properly. ( #1741 )
9 years ago
Harshavardhana
ed43d5e02b
No need to delete file inside erasure code ( #1732 )
9 years ago
Harshavardhana
293d246f95
XL/FS: Rewrite in new format.
9 years ago
Anand Babu (AB) Periasamy
63c65b4635
filter GOPATH from stack trace ( #1755 )
9 years ago
Harshavardhana
64b0976e1b
Remove probe and tasker. ( #1733 )
...
Fixes #1717
9 years ago
Aakash Muttineni
b48b2e7f7c
Part ID check ( #1730 )
...
* Added check in PutObjectPartHandler to make sure part ID does not exceed 10000. ErrInvalidMaxParts written to response if part ID exceeds the maximum value.
9 years ago
Krishnan Parthasarathi
584813e214
Used MINIO_PROFILE_DIR for saving profile information of a minio server ( #1722 )
...
To specify the directory where profiling information should be saved
```
export MINIO_PROFILE_DIR=/path/to/profile/dir
```
By default, profiling information would be saved in a directory created
using ioutil.TempDir, which would be displayed in stdout on starting the
minio server.
9 years ago
Krishnan Parthasarathi
3a980eac1a
Fix shadowing of err variable ( #1718 )
9 years ago
Harshavardhana
5a4b074ca0
XL: PutObject incorrectly returned after deleting multipart object. ( #1715 )
...
Fixes #1714
9 years ago
Harshavardhana
f76d975304
xl: StatVol and ListVols should handle cases when disks are missing. ( #1703 )
...
Remove unnecessary code, handle cases of missing disk.
9 years ago
Harshavardhana
6015a7a3cd
Add mention-bot config
9 years ago
Krishna Srinivas
b83b87a7f6
XL/Incompleteuploads: list should save the tree-walk go routine to the map if eof is not reached. ( #1695 )
9 years ago
Krishna Srinivas
5b95f097d4
multipart: listing does not skip uploadIDmarker. ( #1708 )
...
Fixes #1706
9 years ago
Harshavardhana
e4240aa58f
XL/objects: Initialize format.json outside of erasure. ( #1640 )
...
Fixes #1636
New format now generates a UUID and includes it along with
the order of disks. So that UUID is the real order of disks
and on command line user is able to specify disks in any order.
This pre-dominantly solves our dilemma.
```
{
"format" : "xl",
"xl" : {
"version" : "1",
"disk": "00e4cf06-5bf5-4bb5-b885-4b2fff4a7959",
"jbod" : [
"00e4cf06-5bf5-4bb5-b885-4b2fff4a7959",
....
"c47d2608-5067-4ed7-b1e4-fb81bdbb549f",
"a543293e-99f1-4310-b540-1e450878e844",
"18f97cbe-529a-456a-b6d4-0feacf64534d"
]
},
"version" : "1"
}
```
9 years ago
Andreas Linz
f5dfa895a5
Exit with error code if minio server fails to start ( #1704 )
...
This commit replaces the call to `errorIf` with `fatalIf`, so that the
minio server exits with an non-zero exit status if something fails, e.g.
the port was already openend by another process.
9 years ago
Harshavardhana
50c328ff19
XL: RenameFile should rename and cleanup on writeQuorum. ( #1702 )
...
Fixes #1683
9 years ago
Anand Babu (AB) Periasamy
b8405ca172
simplify profiler cleanup
9 years ago
Harshavardhana
f6d9e73548
posix: Do not lowercase names, return as is. Object layer will filter them out. ( #1699 )
9 years ago
Harshavardhana
7ae5470395
XL: simplify isMultipartObject not need to handle unknown errors. ( #1686 )
...
Unknown errors are just logged with errorIf.
9 years ago
Harshavardhana
9fdb69563d
handler: CopyObject should save metadata. ( #1698 )
...
- Content-Type
- Content-Encoding
- ETag
Fixes #1682
9 years ago
Harshavardhana
00d0558131
XL: Enable tests for content-type for Head and Get
...
Fixes #1674
9 years ago
Bala.FA
13e4618309
XL/fs: Return saved content-type during GetObject
...
Fixes #1674
9 years ago
Krishnan Parthasarathi
2f05aacbf2
Stop profiling on exit of main goroutine ( #1670 )
...
* Stop profiling on exit of main goroutine
Previously, profiling was stopped since Stop() method was called on exit of cli.BeforeFunc.
This lead to profiling to be stopped prematurely.
* Moved profiling switch statement to a separate func
9 years ago