98c950aacd
Streaming bitrot verification support ( #7004 )
6 years ago
52f6d5aafc
Rename of structs and methods ( #6230 )
...
Rename of ErasureStorage to Erasure (and rename of related variables and methods)
6 years ago
ce02ab613d
Simplify erasure code by separating bitrot from erasure code ( #5959 )
6 years ago
f8a3fd0c2a
Create logger package and rename errorIf to LogIf ( #5678 )
...
Removing message from error logging
Replace errors.Trace with LogIf
7 years ago
c0721164be
Automatically set goroutines based on shardSize ( #5346 )
...
Update reedsolomon library to enable feature to automatically
set number of go-routines based on the input shard size,
since shard size is sort of a constant in Minio for
objects > 10MiB (default blocksize)
klauspost reported around 15-20% improvement in performance
numbers on older systems such as AVX and SSE3
```
name old speed new speed delta
Encode10x2x10000-8 5.45GB/s ± 1% 6.22GB/s ± 1% +14.20% (p=0.000 n=9+9)
Encode100x20x10000-8 1.44GB/s ± 1% 1.64GB/s ± 1% +13.77% (p=0.000 n=10+10)
Encode17x3x1M-8 10.0GB/s ± 5% 12.0GB/s ± 1% +19.88% (p=0.000 n=10+10)
Encode10x4x16M-8 7.81GB/s ± 5% 8.56GB/s ± 5% +9.58% (p=0.000 n=10+9)
Encode5x2x1M-8 15.3GB/s ± 2% 19.6GB/s ± 2% +28.57% (p=0.000 n=9+10)
Encode10x2x1M-8 12.2GB/s ± 5% 15.0GB/s ± 5% +22.45% (p=0.000 n=10+10)
Encode10x4x1M-8 7.84GB/s ± 1% 9.03GB/s ± 1% +15.19% (p=0.000 n=9+9)
Encode50x20x1M-8 1.73GB/s ± 4% 2.09GB/s ± 4% +20.59% (p=0.000 n=10+9)
Encode17x3x16M-8 10.6GB/s ± 1% 11.7GB/s ± 4% +10.12% (p=0.000 n=8+10)
```
7 years ago
4c9fae90ff
Optimize healObject by eliminating extra data passes ( #4949 )
7 years ago
3c0d3f7510
Fix bug in ErasureStorage.HealFile ( #4913 )
7 years ago
85fcee1919
erasure: simplify XL backend operations ( #4649 ) ( #4758 )
...
This change provides new implementations of the XL backend operations:
- create file
- read file
- heal file
Further this change adds table based tests for all three operations.
This affects also the bitrot algorithm integration. Algorithms are now
integrated in an idiomatic way (like crypto.Hash).
Fixes #4696
Fixes #4649
Fixes #4359
7 years ago
af8071c86a
xl: Fix rare freeze after many disk/network errors ( #4438 )
...
xl.storageDisks is sometimes passed to some low-level XL functions. Some disks in
xl.storageDisks are set to nil when they encounter some errors. This means all
elements in xl.storageDisks will be nil after some time which lead to an unusable XL.
8 years ago
e9394dc22d
xl PutObject: Split object into parts ( #3651 )
...
For faster time-to-first-byte when we try to download a big object
8 years ago
825000bc34
Use humanize constants for KiB, MiB and GiB units. ( #3322 )
8 years ago
1ce339abeb
Fixing ineffssaign errors ( #2608 )
8 years ago
bccf549463
server: Move all the top level files into cmd folder. ( #2490 )
...
This change brings a change which was done for the 'mc'
package to allow for clean repo and have a cleaner
github drop in experience.
8 years ago
e2498edb45
contoller: Implement controlled healing and trigger ( #2381 )
...
This patch introduces new command line 'control'
- minio control
TO manage minio server connecting through GoRPC API frontend.
- minio control heal
Is implemented for healing objects.
8 years ago
Krishna Srinivas