Harshavardhana
45b59b8456
Probe revamped to provide for a new WrappedError struct to wrap probes as error interface
...
This convenience was necessary to be used for golang library functions like io.Copy and io.Pipe
where we shouldn't be writing proxies and alternatives returning *probe.Error
This change also brings more changes across code base for clear separation regarding where an error
interface should be passed encapsulating *probe.Error and where it should be used as is.
9 years ago
Harshavardhana
d09fd8b0a1
Migrate from iodine to probe
9 years ago
Krishna Srinivas
ee4432bc40
rename disk.OpenFile to Open which will do os.Open (which will be read-only). disk.OpenFile will do os.OpenFile (which can be rw, append)
9 years ago
Krishna Srinivas
fdd2c22fa5
Do go fmt on bucket.go
9 years ago
Krishna Srinivas
ae8089c9b6
when signature is not available there is no need to compute sha256
9 years ago
Harshavardhana
e082f26e10
Improving EncoderStream to return error only upon non io.EOF.
...
io.EOF is okay since io.ReadFull will not have read any bytes at all.
Also making error channel receive only for go routine.
9 years ago
Krishna Srinivas
bcfaa12a4d
Encoder now directly reads from the object stream. Using split.Stream() was causing lot of redundant memory operations.
9 years ago
Harshavardhana
63c9cf0c4b
Move from Minimalist Object Storage to Minio Cloud Storage
9 years ago
Harshavardhana
43c908d5b9
ListObjects now considers multipart objects, also move to upstream check.v1
10 years ago
Harshavardhana
c1da10a207
Donut multipart support no get, listobjects() support yet
10 years ago
Harshavardhana
e37c5315ec
Live multiple disk removal works properly
10 years ago
Harshavardhana
e1e4908515
Wire up sha512 matching inside donut along with md5sum
10 years ago
Harshavardhana
e885259584
Handle removal of disks - getObject() now reads if disks are missing underneath, add initial stub healing code
10 years ago
Harshavardhana
634f70f3b0
WriteObject() encoded data in go routine, fix another multipart issue
10 years ago
Harshavardhana
29838bb851
Cleanup temporary writers upon errors during putObject(), all metadata() write operations
10 years ago
Harshavardhana
15dd0df187
Support signature v4 at rest
10 years ago
Harshavardhana
d1deda3a96
Add API tests for both donut on disk and donut cache
10 years ago
Harshavardhana
3622fbc87d
Across donut, split, nimble some code cleanup
10 years ago
Harshavardhana
bbb89b5776
Add multi-thread protection and also allow atomic file creates, rename upon Close()
10 years ago
Harshavardhana
14844f48dd
Make donut do everything as an atomic operation, this avoids all the deadlocks and races
10 years ago
Harshavardhana
30fc14e703
Restructure codebase move crypto, checksum to top-level, move ``split`` into donut, move crypto/keys into api/auth
10 years ago
Harshavardhana
8a4e7bcdcf
Add full API tests, move storage/donut to donut, add disk tests as well
10 years ago
Harshavardhana
7c37e9d06a
Make donut fully integrated back into API handlers
10 years ago
Harshavardhana
38a6ce36e5
Remove slow AppendUniq code, rolling through over a slice is in-efficient
...
Remove it and use map instead
10 years ago
Harshavardhana
335c7827eb
More donut, cache, api cleanup
10 years ago
Harshavardhana
d07d0c670a
Return back proper errors in writeObjectData(), rename few functions
10 years ago
Harshavardhana
10c807f233
Put object on successful write returns full metadata, to avoid subsequent GetObjectMetadata() calls in driver
10 years ago
Harshavardhana
6921328b93
Avoid frivolous GetObjectMetadata() calls at driver level, return back all the information in donut ListObjects()
10 years ago
Harshavardhana
45a7eab804
An attempt to bring in memory layer into donut driver
10 years ago
Harshavardhana
f3c25bcfc4
Keeping the lexical order same add optimizations, provide a comprehensive response from ListObjects()
10 years ago
Harshavardhana
ae66ae42c4
Rename functions for their purpose
10 years ago
Harshavardhana
9a4680475f
Object metadata was wrongly misconstrued to be mutable, handle it
10 years ago
Harshavardhana
3aa6d90c5e
Avoid racy maps, read from disk on success return quickly. Many more optimizations
10 years ago
Harshavardhana
68974918ac
Donut moves to typed metadata, removing the necessity for strconv, parsing and string converstions
10 years ago
Harshavardhana
767d3743ee
Add new metadata definitions and use them
10 years ago
Harshavardhana
fb9adb5524
Donut cleanup another set
...
- Make sure to close all readers
- Fix errors in api_testsuite c.Assert(err, IsNil) should be done right after each function call
10 years ago
Harshavardhana
eec66f195a
Take all the ListObjects into bucket handlers
...
Earlier the listing would wait for all the objects to be processed
this is essentially very time consuming considering even for 100,000
files.
10 years ago
Harshavardhana
45e9d25931
Remove more bloated code - simplify
10 years ago
Harshavardhana
82dcbf262d
Add simple locking for donut API for now - fixes #671
10 years ago
Harshavardhana
03b4d3b308
Go vet fixes for donut
10 years ago
Harshavardhana
57a2b53178
Removing further bloated code simplifying
10 years ago
Harshavardhana
a2c205ff2e
Use external package disk for donut.
10 years ago
Harshavardhana
1682c748ac
Remove unnecessary interfaces from donut, cleanup
10 years ago
Harshavardhana
2fd52ca284
Add missing strongly typed errors for Donut
10 years ago
Harshavardhana
641f07cecf
Use filepath everywhere instead of path.{} functions for portability - fixes #656
10 years ago
Harshavardhana
8d06504068
Change all minio-io path to minio
10 years ago
Harshavardhana
38155e86ac
iodine is part of minio now
10 years ago
Harshavardhana
7fd1cc073c
Add everything back into one project hood, still missing iodine
10 years ago
Frederick F. Kautz IV
6241c9880b
Moving object storage drivers back to minio
10 years ago
Harshavardhana
ec39155089
Update minio-io/donut, minio-io/objectdriver
10 years ago