00c697393a
Merge pull request #1381 from minio/xl-layer
...
Implement XL layer
9 years ago
55032ffdf9
xl: Simplify blockingWriter and its usage. ( #1373 )
...
This removes odd races since we don't need to
track errors and avoids locking. All we need
is a Wait() and Done() waitgroup.
9 years ago
8bce699dae
xl: Add logging. ( #1372 )
9 years ago
57f35c2bcc
xl: Introduce new blocking writer to make CreateFile atomic. ( #1362 )
...
Creates a new write closer that must be released
by the read consumer. This is necessary so that
while commiting the underlying writers in erasure
coding we need to make sure we reply success only if
we have committed to disk.
This in turn also fixes plethora of bugs related to
subsequent PutObject() races with namespace locking.
This patch also enables most of the tests, other than
ListObjects paging which has some issues still.
Fixes #1358 , #1360
9 years ago
cab6805f09
xl: Enable a subset of tests for XL branch. ( #1359 )
9 years ago
8c85815106
xl: refactor functions to xl-v1-common.go xl-v1-utils.go. ( #1357 )
9 years ago
becc814531
Xl layer selfheal quorum2
...
* xl/selfheal: selfheal based on read quorum on GET
* xl: getReadableDisks() also returns whether self-heal is needed so that this info can be used by ReadFile/SelfHeal/StatFile.
* xl: trigger selfheal from StatFile.
9 years ago
9bd9441107
xl: Simplify reading metadata and add a new fileMetadata type. ( #1346 )
9 years ago
f3784d1087
xl: Handle read quorum for StatVol, ListVols
9 years ago
91588209fa
obj: Object api handle all errors in common location. ( #1343 )
9 years ago
5c33b68318
xl: code refactor, cleanup ReadFile and CreateFile.
9 years ago
45b3d3e21f
xl: add quorum support for create file
9 years ago
141a44bfbf
xl: Fix ReadFile to keep the order always for reading the data back. ( #1339 )
...
Also fixes a stackoverflow bug in namespace locking.
9 years ago
c7bf471c9e
list/xl: Fix the way marker is handled in leafDirectory verification.
9 years ago
c302875774
selfheal: implement self-heal. Heals the missing parts. ( #1335 )
9 years ago
b76f3f1d62
xl: Add more fixes and cleanup.
...
Simplify cleanup of temporary files during createFile operations.
9 years ago
ada0f82b9a
xl: add quorum support for read file and name space locking. ( #1333 )
9 years ago
a98a7fb1ad
Implement XL layer - preliminary work.
9 years ago
bf8a9702a4
tests: Fix a bug in TestObjectAPIIsUploadIDExists. ( #1375 )
...
The following code crashes when upload ID does not
exist, since we are setting err == nil when we find
err == errFileNotFound.
```
if e == nil {
t.Fatal(e.Error())
```
Fix it.
9 years ago
6e372f83b4
Tests: object api multipart tests and bug fixes.
9 years ago
e9fba04b36
logging: Enable logging across storage fs layer. ( #1367 )
...
Adds log.Debugf at all the layer - fixes #1074
9 years ago
d63d17012d
tests: Add API suite tests back for object api. ( #1352 )
9 years ago
444d1f8a65
miniobrowser: Vendorize to new changes in miniobrowser.
9 years ago
560c3bd153
Adding return statement after error response in the lastest commit to verify location constraint ( #1348 )
9 years ago
4cf73caf02
api: Add diskInfo as part of StatVol and ListVols. ( #1349 )
...
It is the bucket and volumes which needs to have this
value rather than the DiskInfo API itself. Eventually
this can be extended to show disk usage per
Buckets/Volumes whenever we have that functionality.
For now since buckets/volumes are thinly provisioned
this is the right approach.
9 years ago
1284ecc6f2
api: Fix verification of checkLeafDirectory. ( #1347 )
...
This fixes a problem where leaf directory has more than 1000
entries, also resulting in listing issues, leading to an infinite
loop.
Fixes #1334
9 years ago
cb1116725b
api: verify Location constraint for make bucket. ( #1342 )
9 years ago
c3d0a3d51e
Update README.md
...
Our community contributor bought this to our attention so we have to add region as well in s3cmd config file.
9 years ago
e0f8fed011
object: handle Error responses and handle errDiskFull. ( #1331 )
9 years ago
6bc17a3aea
server: Attempt to increase max open files. ( #1328 )
9 years ago
ff9a6b00cc
isContainerized should look for /.dockerenv not /.dockerinit
...
Signed-off-by: Dave Henderson <dhenderson@gmail.com>
9 years ago
af907a35a9
add environment var to explicitly indicate containerized and allow running as root ( #1327 )
9 years ago
b47d722d8e
fs: Fix filtering out valid paths from previous #1321 fix ( #1323 )
...
Fixes #1324
9 years ago
33633fd15d
fs: Filter out valid paths and volnames. ( #1321 )
9 years ago
b2ec7da9f9
Merge pull request #1314 from minio/split-fs
...
Split fs code into storage layer and object layer.
9 years ago
be002ac01e
fs/object: Fix issues from review comments.
9 years ago
149c6ca094
listMultipart: bugfixes. ( #1318 )
9 years ago
8457af5708
fs: Add proper volume and path validation.
9 years ago
caa35f68fa
listMultipart: implement support for marker. ( #1313 )
9 years ago
30b0b4deba
storage/server/client: Enable storage server, enable client storage.
9 years ago
01a439f95b
refactor: add multipart code to the object layer.
9 years ago
3c48537f20
refactor: refactor code to separate fs into object-layer and fs layer. ( #1305 )
9 years ago
188bb92d8a
bucket-policy parset tests, and bug fixes ( #1317 )
9 years ago
6b3fc03701
docker: Update docker document
9 years ago
8112291d43
Add FreeBSD binary link and make a release
9 years ago
93666827f4
release: Add freebsd/amd64 build and remove zip, tgz. ( #1316 )
9 years ago
ac30bef72a
Revised Docker.md ( #1311 )
9 years ago
bea6f33b08
backend/fs: remove timer channel from scanMultipartDir() ( #1310 )
...
Previously scanMultipartDir() returns object info channel and timer
channel where timer channel is used to check whether object info
channel is alive or not. This causes a race condition that timeout
may occur while object info channel in use.
This patch fixes the issue by removing timer channel and uses object
info channel directly where each object info has End bool field
indicates whether received object info is end or not.
9 years ago
9fb1c79456
Improved Docker examples ( #1308 )
...
- Fixed a bug in the persistent docker command ("server" in place of "export")
- Added example of how to set consistent keys with ephemeral data, particularly useful for testing.
9 years ago
6b5699b15f
config: console logging should be enabled by default. ( #1307 )
9 years ago
Harshavardhana