Frederick F. Kautz IV
14dec50fef
Switching execpipe output to io.Reader
10 years ago
Harshavardhana
6e6f07c58b
Add simple ExecPipe() to be used with filesystem format work
10 years ago
Harshavardhana
5268a62166
Add minio-cli stub generator
10 years ago
Harshavardhana
e5953acf4b
Add linux scsi disk detection and attribute mapping
10 years ago
Frederick F. Kautz IV
c02fa65b0f
Split's SplitStream now creates and returns a read only channel.
10 years ago
Frederick F. Kautz IV
d73c57cff9
Split's JoinStream now creates and returns a read only channel
10 years ago
Harshavardhana
98119707fb
Move wrappers at pkgs/minio back to cmd/minio - as their usage is limited
10 years ago
Harshavardhana
3ec5c2fb8f
Implement commands
...
Commands implemented
$ minio put <objectname> <file>
$ minio encode <objectname>
$ minio get <objectname>
$ minio list
TODO :
$ minio init
$ minio verify
...
...
10 years ago
Frederick F. Kautz IV
5efc0d54f8
storage.ObjectStorage List() is now List(objectPath string)
10 years ago
Frederick F. Kautz IV
05baa6d9a2
Removing fsstorage
10 years ago
Frederick F. Kautz IV
d7e5e0df4f
Removing unneeded comment from storage.ObjectStorage
10 years ago
Frederick F. Kautz IV
dd7cd11c9c
ObjectDescription is now more exact, only exposes necessary details.
10 years ago
Harshavardhana
2552ae450d
Remove stale sha1 dir
10 years ago
Harshavardhana
0148237e22
Refactor checksum code, and add Objectname hashing per uploaded objects
...
Add placeholder sha256, sha512 implementations from Intel with AVX, AVX2
and SSE4.1 extensions - with some boilerplate Go code.
10 years ago
Harshavardhana
99478c524a
Add license header
10 years ago
Harshavardhana
71c774f99b
Update documentation for crc32c, cpu
10 years ago
Harshavardhana
20d46a1977
Provide new pkgs/utils for generic functions
10 years ago
Harshavardhana
fc50291cac
fsStorage should use appendStorage with offsets
...
- also takes in 'blockSize' cli option.
- robustness fixes
10 years ago
Harshavardhana
0a0e1111cd
Add list() object support for erasure and append storage drivers
...
- Reply back objects with their protectionlevel and md5sum
- // TODO hash value
- Calculate md5sum after "storeBlocks()", to make sure data is committed
10 years ago
Harshavardhana
235949eafe
Build fixes after moving to go1.4
10 years ago
Harshavardhana
0bd2b8516e
Build fix, fixing without a PR
10 years ago
Harshavardhana
e15edbf393
Implement simple encoded storage in gateway
10 years ago
Harshavardhana
a0ec21975d
Calculate md5sum for each object
10 years ago
Harshavardhana
1166557da1
Add crc checks for Object Get()
10 years ago
Harshavardhana
803c35ee90
Storage erasure encoding info at StorageEntry and also store CRC at blockheader
10 years ago
Harshavardhana
c0724b38b9
Ignore io.EOF for gob decoding
10 years ago
Frederick F. Kautz IV
568ca4e1bc
erasure encoded demo
10 years ago
Frederick F. Kautz IV
19da9760b3
ObjectStorage refactor to take io.Reader instead of []byte
10 years ago
Frederick F. Kautz IV
cae9b288b0
Adding List(path) to object storage definition and accompanying definition to fs
10 years ago
Frederick F. Kautz IV
e670608226
Fixing build
10 years ago
Harshavardhana
f6a5b61b00
Make get/put more robust
...
- init folder if not present already in 'get()' call
- put.go was referencing wrong args - fix it
- if no OBJECTNAME is specified during 'get' - grab a
list of files under "~/.minio"
- Provide new API GetList() for ObjectStorage struct
10 years ago
Harshavardhana
43680cd7b6
Add sha1 - AVX2 supported fast implementation, with some crc32c cleanup
10 years ago
Frederick F. Kautz IV
1d7b3866cb
Adding append storage driver
10 years ago
Frederick F. Kautz IV
af8eb7a55d
Removing printlns from test code
10 years ago
Frederick F. Kautz IV
0cf80e075e
Refactoring file storage driver to fsstorage
10 years ago
Frederick F. Kautz IV
e71998c584
CPU tests now actually test properly on linux and return bool instead of int
10 years ago
Harshavardhana
7314b5e37d
Fixes #71 - some crazy races inside erasure and simplify the code
...
- This change also brings in changing 'unsigned char' to 'uint8_t'
for brevity
10 years ago
Harshavardhana
e414d5f67b
Remove cpufeatures C code, since pkgs/crc32c/cpu should be used instead
10 years ago
Harshavardhana
9a5003dd25
Provide JoinFilesWithPrefix case with Gochannel
10 years ago
Frederick F. Kautz IV
5abcaf4d58
Adding more unit tests to strbyteconv. Fixes #69 .
10 years ago
Harshavardhana
0c4dd8f5fa
Avoid linux to be hard dependency on build
10 years ago
Harshavardhana
fb34c5290c
Fast CRC implementations ported from Intel's efforts
...
Provides fast CRC32C with PCLMULQDQ instructions in Golang
The white papers on CRC32C calculations with PCLMULQDQ instruction can be
downloaded from:
http://www.intel.com/content/dam/www/public/us/en/documents/white-papers/crc-iscsi-polynomial-crc32-instruction-paper.pdf
http://www.intel.com/content/dam/www/public/us/en/documents/white-papers/fast-crc-computation-paper.pdf
10 years ago
Harshavardhana
3a6cac8ada
Remove unnecessary C code and use everything from Golang
10 years ago
Frederick F. Kautz IV
89587e1391
Adding file splitter and streaming byte chunker
10 years ago
Harshavardhana
6e4583ef1d
Build restructure top level
10 years ago
Harshavardhana
a4676211cf
Enable cover profile and test for split and strbyteconv
10 years ago
Harshavardhana
67e9a27b34
Enable way to split files at input bytes
10 years ago
Harshavardhana
ad5b4b52e8
strbyteconv -
...
- StringToBytes()
- BytesToString()
10 years ago
Harshavardhana
fa1a13a8bf
Cleanup makefile
10 years ago
Harshavardhana
7e79721452
No caps for stdint
10 years ago