d9e7cadacf
Update reed+solomon ( #9562 )
...
Only create encoder when strictly needed.
5 years ago
d3f9f8be88
golint: fix redundant code logic ( #7842 )
...
Signed-off-by: Lei Liu <liul.stone@gmail.com>
6 years ago
c113d4e49c
Posix CreateFile should work for compressed lengths ( #7584 )
6 years ago
5ecac91a55
Replace Minio refs in docs with MinIO and links ( #7494 )
6 years ago
8e0910ab3e
Fix build issues on BSDs in pkg/cpu ( #7116 )
...
Also add a cross compile script to test always cross
compilation for some well known platforms and architectures
, we support out of box compilation of these platforms even
if we don't make an official release build.
This script is to avoid regressions in this area when we
add platform dependent code.
6 years ago
98c950aacd
Streaming bitrot verification support ( #7004 )
6 years ago
52f6d5aafc
Rename of structs and methods ( #6230 )
...
Rename of ErasureStorage to Erasure (and rename of related variables and methods)
6 years ago
ce02ab613d
Simplify erasure code by separating bitrot from erasure code ( #5959 )
6 years ago
f8a3fd0c2a
Create logger package and rename errorIf to LogIf ( #5678 )
...
Removing message from error logging
Replace errors.Trace with LogIf
7 years ago
c0721164be
Automatically set goroutines based on shardSize ( #5346 )
...
Update reedsolomon library to enable feature to automatically
set number of go-routines based on the input shard size,
since shard size is sort of a constant in Minio for
objects > 10MiB (default blocksize)
klauspost reported around 15-20% improvement in performance
numbers on older systems such as AVX and SSE3
```
name old speed new speed delta
Encode10x2x10000-8 5.45GB/s ± 1% 6.22GB/s ± 1% +14.20% (p=0.000 n=9+9)
Encode100x20x10000-8 1.44GB/s ± 1% 1.64GB/s ± 1% +13.77% (p=0.000 n=10+10)
Encode17x3x1M-8 10.0GB/s ± 5% 12.0GB/s ± 1% +19.88% (p=0.000 n=10+10)
Encode10x4x16M-8 7.81GB/s ± 5% 8.56GB/s ± 5% +9.58% (p=0.000 n=10+9)
Encode5x2x1M-8 15.3GB/s ± 2% 19.6GB/s ± 2% +28.57% (p=0.000 n=9+10)
Encode10x2x1M-8 12.2GB/s ± 5% 15.0GB/s ± 5% +22.45% (p=0.000 n=10+10)
Encode10x4x1M-8 7.84GB/s ± 1% 9.03GB/s ± 1% +15.19% (p=0.000 n=9+9)
Encode50x20x1M-8 1.73GB/s ± 4% 2.09GB/s ± 4% +20.59% (p=0.000 n=10+9)
Encode17x3x16M-8 10.6GB/s ± 1% 11.7GB/s ± 4% +10.12% (p=0.000 n=8+10)
```
7 years ago
8efa82126b
Convert errors tracer into a separate package ( #5221 )
7 years ago
85fcee1919
erasure: simplify XL backend operations ( #4649 ) ( #4758 )
...
This change provides new implementations of the XL backend operations:
- create file
- read file
- heal file
Further this change adds table based tests for all three operations.
This affects also the bitrot algorithm integration. Algorithms are now
integrated in an idiomatic way (like crypto.Hash).
Fixes #4696
Fixes #4649
Fixes #4359
7 years ago
Klaus Post