Frederick F. Kautz IV
d57e9d6c18
Adding sys. as reserved in erasureWriter
10 years ago
Frederick F. Kautz IV
b2f47ef446
Switching content hashing from sha512 to md5
10 years ago
Frederick F. Kautz IV
b2c3172095
Adding sha512 support for pre-encoded data and verification on decode
10 years ago
Frederick F. Kautz IV
eb8005cc65
Reading correct block size in erasure coded data
10 years ago
Harshavardhana
3929135c34
Make sure we use O_EXCL with O_CREATE to make sure we don't trip over existing file
10 years ago
Harshavardhana
2fa9320df2
De-couple donut into smaller files, useful for ease in external integration
10 years ago
Frederick F. Kautz IV
55f3659bb3
Removing log tracers
10 years ago
Frederick F. Kautz IV
03f51eac29
Adding list objects to donut
10 years ago
Harshavardhana
4b9fbd3b3a
DonutfileWriter should return value of file.Close()
10 years ago
Frederick F. Kautz IV
ced6edc9fe
Minor change, removing unnecessary commented method
10 years ago
Frederick F. Kautz IV
99cf484488
Adding GetObjectMetadata to donut
10 years ago
Frederick F. Kautz IV
703af6c3ce
Removing gob from donut driver
10 years ago
Harshavardhana
95affcb119
Fix build issues for new DonutDriver()
10 years ago
Frederick F. Kautz IV
933d44c656
New donut driver with local file encoding
10 years ago
Frederick F. Kautz IV
2c69433588
Adding interfaces for donut driver
10 years ago
Frederick F. Kautz IV
348c4d9a88
Removing old donut format
10 years ago
Frederick F. Kautz IV
2f4b92eb8d
Minor refactor to prepare for file version of donut
10 years ago
Harshavardhana
f7fd526b28
Cosmetic changes
10 years ago
Frederick F. Kautz IV
94fe03cfc1
More refactoring to meet new donut spec
10 years ago
Frederick F. Kautz IV
24d5018037
Rename StoreBucket to CreateBucket
10 years ago
Frederick F. Kautz IV
8c6aa45458
Adding copyright
10 years ago
Frederick F. Kautz IV
7971b66e60
Adding object donut type
10 years ago
Harshavardhana
41653774fc
Simplify fs codebase, split them into separate files and more commenting
10 years ago
Harshavardhana
9e89af0e3c
Remove redundant uint32
10 years ago
Frederick F. Kautz IV
679c6ace3a
Fragment reader implemented
10 years ago
Frederick F. Kautz IV
ca1a4b616c
Adding read header for erasure
10 years ago
Frederick F. Kautz IV
00381c887a
Adding erasure package to wrap versioned erasure. Ensures we always write latest version.
10 years ago
Harshavardhana
d992bccd9a
Move pkg/storage/erasure to pkg/encoding/erasure - and other cleanups
10 years ago
Frederick F. Kautz IV
856e0100c0
Erasure layer now writes using new technique
10 years ago
Harshavardhana
e5af8a3f5d
Further fixes -
...
- All test files have been renamed to their respective <package>_test name,
this is done in accordance with
- https://github.com/golang/go/wiki/CodeReviewComments#import-dot
imports are largely used in testing, but to avoid namespace collision
and circular dependencies
- Never use _* in package names other than "_test" change fragment_v1 to expose
fragment just like 'gopkg.in/check.v1'
10 years ago
Harshavardhana
c00d1461b9
Golint cleanup from top level
10 years ago
Frederick F. Kautz IV
1186c47603
Fragment now implements new version
10 years ago
Frederick F. Kautz IV
665af44c70
Renaming donut packages to match layout
10 years ago
Harshavardhana
3a3c8645fc
Update comments across the codebase
10 years ago
Harshavardhana
c3ad0906e0
Add deadcode code which recursivley goes into all directories and verifies dangling variables.
10 years ago
Frederick F. Kautz IV
6f300c9ef0
Adding test at byte level
10 years ago
Frederick F. Kautz IV
0b08312ddd
Specifying more exact types for data
10 years ago
Harshavardhana
9f43659135
Add tests, add NewHeader() for populating Header and ValidateHeader()
10 years ago
Frederick F. Kautz IV
7414dc9b75
Adding data writer
10 years ago
Frederick F. Kautz IV
be12a6b3d9
Changing K and M in data.go to match new datatype in erasure package
10 years ago
Frederick F. Kautz IV
bb0441917c
Making changes to data based on discussion
10 years ago
Harshavardhana
2f04a1299e
Avoid allocating 1gig memory, avoid such mistakes
10 years ago
Frederick F. Kautz IV
2916b1278e
Adding data.go, does nothing for now.
10 years ago
Frederick F. Kautz IV
b4ef522a9b
Donut frame is now its own package
10 years ago
Frederick F. Kautz IV
6c2428833a
Renaming Write to WriteFrame
10 years ago
Harshavardhana
6b397844b9
Add donut benchmark for 64MB, 128MB, 256MB, 512MB
...
Current average values
~~~
> minio/pkg/storage/donut/v1 *> go test -bench .
OK: 2 passed
PASS
BenchmarkDonut64M 5 266249634 ns/op 252.05 MB/s
BenchmarkDonut128M 3 436507394 ns/op 307.48 MB/s
BenchmarkDonut256M 2 836116359 ns/op 321.05 MB/s
BenchmarkDonut512M 1 1676738951 ns/op 320.19 MB/s
ok github.com/minio-io/minio/pkg/storage/donut/v1 8.430s
> minio/pkg/storage/donut/v1 *>
~~~
10 years ago
Harshavardhana
65f22083ca
donut_gen works with new Donut Frame
10 years ago
Frederick F. Kautz IV
ddc7cf835e
Donut now tests amount written should match expected amount to write
10 years ago
Frederick F. Kautz IV
d3d1205eb1
Updating comment describing data type
10 years ago
Frederick F. Kautz IV
58a04ee831
New donut frame implemented
10 years ago