Krishna Srinivas
17dd1c19df
cleanup: refactor common code between FS and XL listDirFactory. ( #3639 )
8 years ago
Bala FA
0f2e493c9a
Use isErrIgnored() function wherever applicable. ( #3343 )
8 years ago
Anis Elleuch
7a549096de
XL and FS use different tree walk ignored errors ( #2707 )
8 years ago
Krishna Srinivas
9358ee011b
logging: Print stack trace in case of errors.
...
fixes #1827
8 years ago
Harshavardhana
bccf549463
server: Move all the top level files into cmd folder. ( #2490 )
...
This change brings a change which was done for the 'mc'
package to allow for clean repo and have a cleaner
github drop in experience.
8 years ago
Krishna Srinivas
27a5b61f40
tree-walk: optimize tree walk such that leaf detection of entries is delayed till the entry is sent on the treeWalkResult channel. ( #2220 )
8 years ago
Harshavardhana
ca1b1921c4
XL: Implement ignore errors. ( #2136 )
...
Each metadata ops have a list of errors which can be
ignored, this is essentially needed when
- disks are not found
- disks are found but cannot be accessed (permission denied)
- disks are there but fresh disks were added
This is needed since we don't have healing code in place where
it would have healed the fresh disks added.
Fixes #2072
9 years ago
Krishna Srinivas
7a8b8cd0a1
tree-walk: unify FS and XL tree-walk with functional approach. ( #2027 )
9 years ago
Bala FA
61598ed02f
posix: return errFaultyDisk on I/O errors. ( #1885 )
...
When I/O error is occured more than allowed limit, posix returns
errFaultyDisk.
Fixes #1884
9 years ago
Krishna Srinivas
acc393ba8b
XL/tree-walk: Added comments, changed variable names and structure fields to improve code readability. ( #1856 )
9 years ago
Krishna Srinivas
002c5bf7dd
XL: Treewalk handle all the race conditions and blocking channels.
9 years ago
Harshavardhana
1cf1532ca3
XL: Implement ListObjects channel and pool management.
9 years ago
Harshavardhana
82fd907933
XL/PutObject: Handle all pending cases of DiskNotFound.
9 years ago
Harshavardhana
fb95c1fad3
XL: Bring in some modularity into format verification and healing. ( #1832 )
9 years ago
Harshavardhana
ae311aa53b
XL: Cleanup, comments and all the updated functions. ( #1830 )
9 years ago
Harshavardhana
445dc22118
XL: Cleanup and add more comments. ( #1807 )
9 years ago
Harshavardhana
d65101a8c8
XL: Implement strided erasure distribution. ( #1772 )
...
Strided erasure distribution uses a new randomized
block distribution for each Put operation. This
information is captured inside `xl.json` for subsequent
Get operations.
9 years ago
Krishna Srinivas
b1e2b7dea2
Fix list-incomplete uploads for XL.
9 years ago
Harshavardhana
b2293c2bf4
XL: Rename, cleanup and add more comments. ( #1769 )
...
- xl-v1-bucket.go - removes a whole bunch of code.
- {xl-v1,fs-v1}-metadata.go - add a lot of comments and rename functions
appropriately.
9 years ago
Harshavardhana
1e393c6c5b
XL: Add new metadata for checksum. ( #1743 )
9 years ago
Harshavardhana
293d246f95
XL/FS: Rewrite in new format.
9 years ago
Harshavardhana
7ae5470395
XL: simplify isMultipartObject not need to handle unknown errors. ( #1686 )
...
Unknown errors are just logged with errorIf.
9 years ago
Harshavardhana
9472299308
logging: Log only for unhandled errors, remove all the debug logging. ( #1652 )
...
This patch brings in the removal of debug logging altogether, instead
we bring in the functionality of being able to trace the errors properly
pointing back to the origination of the problem.
To enable tracing you need to enable "MINIO_TRACE" set to "1" or "true"
environment variable which would print back traces whenever there is an
error which is unhandled or at the handler layer.
By default this tracing is turned off and only user level logging is
provided.
9 years ago
Harshavardhana
9d41414fb5
posix: reserved files should be filtered out at posix not object layer. ( #1554 )
9 years ago
Harshavardhana
751fa972f5
xl/fs: Multipart re-org introduce "uploads.json" ( #1505 )
...
Fixes #1457
9 years ago
Krishna Srinivas
a5d31d4254
XL/ListObjects: use string.TrimSuffix instead of Trim. ( #1498 ) ( #1509 )
9 years ago
Krishna Srinivas
48d3be36da
XL/ListObjects: Fix ordering issue during listing if the files were uploaded as multipart uploads. ( #1498 ) ( #1506 )
...
i.e if two files "tmp" and "tmp.1" are uploaded as multipart we would list ""tmp.1"" before ""tmp"" as "tmp.1/" < "tmp/"
9 years ago
Krishna Srinivas
247e835d7b
object: move go-routine listing from posix to objectLayer. ( #1491 )
9 years ago