ab5ea997ab
Make erasure Encode and Decode atomic to avoid races
9 years ago
d5ce2f6944
Make erasure matrix type not optional choose automatically
...
Remove option of providing Technique and handling errors based on that
choose a matrix type automatically based on number of data blocks.
INTEL recommends on using cauchy for consistent invertible matrices,
while vandermonde is faster we should default to cauchy for large
data blocks.
9 years ago
c8de5bad2f
Implement presigned policy
9 years ago
cd52d7a11c
Fix Linux/Mac OS X erasure decoding failure with new Golang version 1.5.1
...
Fixes #871
9 years ago
e082f26e10
Improving EncoderStream to return error only upon non io.EOF.
...
io.EOF is okay since io.ReadFull will not have read any bytes at all.
Also making error channel receive only for go routine.
10 years ago
bcfaa12a4d
Encoder now directly reads from the object stream. Using split.Stream() was causing lot of redundant memory operations.
10 years ago
63c9cf0c4b
Move from Minimalist Object Storage to Minio Cloud Storage
10 years ago
03b4d3b308
Go vet fixes for donut
10 years ago
7fd1cc073c
Add everything back into one project hood, still missing iodine
10 years ago
92f408af5d
Add erasure to godep
10 years ago
b748cf359a
More simplification to erasure also add two more test functions
10 years ago
b44d2100db
cache decode matrix tables and matrix
10 years ago
bd39768de2
janitor duty on erasure-decode
10 years ago
e1f4ed4650
Comment exported functions GetEncodedBlocksLen, GetEncodedBlockLen
10 years ago
2cbd15b690
Golint fixes
10 years ago
653ea50a59
Erasure technique is now uint8, handle it appropriately
10 years ago
fa9b1f341b
erasure encode janitor duty
10 years ago
b8e9834faa
Rename parms as --> params for brevity and misc cleanup
10 years ago
b9b0b35edf
removed private k and m and some more cleanups
10 years ago
3a76229551
encoded size function is now public + some janitor duty
10 years ago
2b0b5f014a
Update license header Mini should be Minimalist really
10 years ago
e27ba44d94
Remove minio_calc_chunk_size() C code to write one in Golang
10 years ago
d992bccd9a
Move pkg/storage/erasure to pkg/encoding/erasure - and other cleanups
10 years ago
c3ad0906e0
Add deadcode code which recursivley goes into all directories and verifies dangling variables.
10 years ago
b77c62e25d
Make K,M to be uint8 and Technique becomes its own type
10 years ago
f4b5519451
Update erasure documentation
10 years ago
fab954f13f
Run govet and fix
10 years ago
2547163cb2
Add erasure package in its full form v1.0
10 years ago
f3a27169fc
Avoid 'clang' optimization, keep it -O0
10 years ago
432275e966
Full restructure in accordance with
...
- pkg/{subsystem}/{package} style
- modify Makefile to reflect the new style,
consolidate various entries
- add a dummy ``main.go`` at top level
10 years ago
0e4a26e3b4
Add Diskattrmap, Scsiattrmap for probed scsi devices
...
Additional changes
- Use ``iota`` for constants
- Remove unncessary C header files
- ``new-cmd`` now depends on codegangsta cli
10 years ago
6b36b5c551
A full restructure
10 years ago
803c35ee90
Storage erasure encoding info at StorageEntry and also store CRC at blockheader
10 years ago
7314b5e37d
Fixes #71 - some crazy races inside erasure and simplify the code
...
- This change also brings in changing 'unsigned char' to 'uint8_t'
for brevity
10 years ago
0c4dd8f5fa
Avoid linux to be hard dependency on build
10 years ago
4d7c1e3b68
Decoding bug fixes #42
10 years ago
96e42a8443
Adding initial documentation to erasure package
10 years ago
3da8e53ab8
Exposing NewEncoder since GetEncoder is no longer around
10 years ago
17a23876a2
Rename NewEncoder-->newEncoder
10 years ago
922e6bac0b
Erasure restructuring
10 years ago
9ef1ef5c8c
Removing LRU from erasure package
10 years ago
f1fcd3be06
Make sure to use SIMD Alignment with 32
10 years ago
3cefaf5ad8
Restructure directory, add 'pkgs' folder now
10 years ago
6592ef3bd2
Make use of LRU and higher order erasure functions
10 years ago
1a6b9ccfc8
Fixing isal compile from root, workaround for https://code.google.com/p/go/issues/detail?id=7891
10 years ago
6a6dac8365
erasure: Coding blocks during encoding were garbage, fixes #21
10 years ago
1e7515a7df
Add erasure coding and decoding using Intel Storage Acceleration library
...
- move contrib/erasure --> contrib/isal
- bring in low level 'isal' package for Go for exposing C functions
- Implement Erasure 'encoding'
Supports - Reed Solomon Codes, Cauchy Codes
- Implement Erasure 'decoding'
Supports - Reed Solomon Codes, Cauchy Codes
- Renames Minios -> Minio at all the references
10 years ago
Harshavardhana