0148237e22
Refactor checksum code, and add Objectname hashing per uploaded objects
...
Add placeholder sha256, sha512 implementations from Intel with AVX, AVX2
and SSE4.1 extensions - with some boilerplate Go code.
10 years ago
99478c524a
Add license header
10 years ago
71c774f99b
Update documentation for crc32c, cpu
10 years ago
20d46a1977
Provide new pkgs/utils for generic functions
10 years ago
fc50291cac
fsStorage should use appendStorage with offsets
...
- also takes in 'blockSize' cli option.
- robustness fixes
10 years ago
0a0e1111cd
Add list() object support for erasure and append storage drivers
...
- Reply back objects with their protectionlevel and md5sum
- // TODO hash value
- Calculate md5sum after "storeBlocks()", to make sure data is committed
10 years ago
235949eafe
Build fixes after moving to go1.4
10 years ago
0bd2b8516e
Build fix, fixing without a PR
10 years ago
e15edbf393
Implement simple encoded storage in gateway
10 years ago
a0ec21975d
Calculate md5sum for each object
10 years ago
1166557da1
Add crc checks for Object Get()
10 years ago
803c35ee90
Storage erasure encoding info at StorageEntry and also store CRC at blockheader
10 years ago
c0724b38b9
Ignore io.EOF for gob decoding
10 years ago
568ca4e1bc
erasure encoded demo
10 years ago
19da9760b3
ObjectStorage refactor to take io.Reader instead of []byte
10 years ago
cae9b288b0
Adding List(path) to object storage definition and accompanying definition to fs
10 years ago
e670608226
Fixing build
10 years ago
f6a5b61b00
Make get/put more robust
...
- init folder if not present already in 'get()' call
- put.go was referencing wrong args - fix it
- if no OBJECTNAME is specified during 'get' - grab a
list of files under "~/.minio"
- Provide new API GetList() for ObjectStorage struct
10 years ago
43680cd7b6
Add sha1 - AVX2 supported fast implementation, with some crc32c cleanup
10 years ago
1d7b3866cb
Adding append storage driver
10 years ago
af8eb7a55d
Removing printlns from test code
10 years ago
0cf80e075e
Refactoring file storage driver to fsstorage
10 years ago
e71998c584
CPU tests now actually test properly on linux and return bool instead of int
10 years ago
7314b5e37d
Fixes #71 - some crazy races inside erasure and simplify the code
...
- This change also brings in changing 'unsigned char' to 'uint8_t'
for brevity
10 years ago
e414d5f67b
Remove cpufeatures C code, since pkgs/crc32c/cpu should be used instead
10 years ago
9a5003dd25
Provide JoinFilesWithPrefix case with Gochannel
10 years ago
5abcaf4d58
Adding more unit tests to strbyteconv. Fixes #69 .
10 years ago
0c4dd8f5fa
Avoid linux to be hard dependency on build
10 years ago
fb34c5290c
Fast CRC implementations ported from Intel's efforts
...
Provides fast CRC32C with PCLMULQDQ instructions in Golang
The white papers on CRC32C calculations with PCLMULQDQ instruction can be
downloaded from:
http://www.intel.com/content/dam/www/public/us/en/documents/white-papers/crc-iscsi-polynomial-crc32-instruction-paper.pdf
http://www.intel.com/content/dam/www/public/us/en/documents/white-papers/fast-crc-computation-paper.pdf
10 years ago
3a6cac8ada
Remove unnecessary C code and use everything from Golang
10 years ago
89587e1391
Adding file splitter and streaming byte chunker
10 years ago
6e4583ef1d
Build restructure top level
10 years ago
a4676211cf
Enable cover profile and test for split and strbyteconv
10 years ago
67e9a27b34
Enable way to split files at input bytes
10 years ago
ad5b4b52e8
strbyteconv -
...
- StringToBytes()
- BytesToString()
10 years ago
fa1a13a8bf
Cleanup makefile
10 years ago
7e79721452
No caps for stdint
10 years ago
4d7c1e3b68
Decoding bug fixes #42
10 years ago
96e42a8443
Adding initial documentation to erasure package
10 years ago
3da8e53ab8
Exposing NewEncoder since GetEncoder is no longer around
10 years ago
03beef3afc
Moving gateway and storage driver to packages
10 years ago
17a23876a2
Rename NewEncoder-->newEncoder
10 years ago
922e6bac0b
Erasure restructuring
10 years ago
9ef1ef5c8c
Removing LRU from erasure package
10 years ago
f1fcd3be06
Make sure to use SIMD Alignment with 32
10 years ago
3cefaf5ad8
Restructure directory, add 'pkgs' folder now
10 years ago
Harshavardhana