Anand Babu (AB) Periasamy
d9c9634138
removed custom Assert
10 years ago
Frederick F. Kautz IV
6f300c9ef0
Adding test at byte level
10 years ago
Anand Babu (AB) Periasamy
177121868b
removed HomeDir
10 years ago
Frederick F. Kautz IV
0b08312ddd
Specifying more exact types for data
10 years ago
Harshavardhana
9f43659135
Add tests, add NewHeader() for populating Header and ValidateHeader()
10 years ago
Frederick F. Kautz IV
7414dc9b75
Adding data writer
10 years ago
Harshavardhana
eb9a4a83ac
Move AppendUstr(), AppendUint() into helpers
10 years ago
Frederick F. Kautz IV
be12a6b3d9
Changing K and M in data.go to match new datatype in erasure package
10 years ago
Harshavardhana
b77c62e25d
Make K,M to be uint8 and Technique becomes its own type
10 years ago
Frederick F. Kautz IV
bb0441917c
Making changes to data based on discussion
10 years ago
Harshavardhana
2f04a1299e
Avoid allocating 1gig memory, avoid such mistakes
10 years ago
Frederick F. Kautz IV
2916b1278e
Adding data.go, does nothing for now.
10 years ago
Frederick F. Kautz IV
b4ef522a9b
Donut frame is now its own package
10 years ago
Frederick F. Kautz IV
6c2428833a
Renaming Write to WriteFrame
10 years ago
Harshavardhana
6b397844b9
Add donut benchmark for 64MB, 128MB, 256MB, 512MB
...
Current average values
~~~
> minio/pkg/storage/donut/v1 *> go test -bench .
OK: 2 passed
PASS
BenchmarkDonut64M 5 266249634 ns/op 252.05 MB/s
BenchmarkDonut128M 3 436507394 ns/op 307.48 MB/s
BenchmarkDonut256M 2 836116359 ns/op 321.05 MB/s
BenchmarkDonut512M 1 1676738951 ns/op 320.19 MB/s
ok github.com/minio-io/minio/pkg/storage/donut/v1 8.430s
> minio/pkg/storage/donut/v1 *>
~~~
10 years ago
Harshavardhana
65f22083ca
donut_gen works with new Donut Frame
10 years ago
Frederick F. Kautz IV
ddc7cf835e
Donut now tests amount written should match expected amount to write
10 years ago
Frederick F. Kautz IV
d3d1205eb1
Updating comment describing data type
10 years ago
Frederick F. Kautz IV
58a04ee831
New donut frame implemented
10 years ago
Anand Babu (AB) Periasamy
317a1141c0
removed unitconv
10 years ago
Frederick F. Kautz IV
90cd8b7b47
Adding streaming sha512
10 years ago
Harshavardhana
7feca3f0d1
Add 1MB block benchmarks
10 years ago
Harshavardhana
0c2d58bc6d
Implement proper delimiter and prefix handling
...
With this change Minio server now responds with, delimited
'object names' in conjunction with prefix filtering
~~~
<ListBucketResult>
<Name>example-bucket</Name>
<Prefix></Prefix>
<Marker></Marker>
<MaxKeys>1000</MaxKeys>
<Delimiter>/</Delimiter>
<IsTruncated>false</IsTruncated>
<Contents>
<Key>sample.html</Key>
<LastModified>2011-02-26T01:56:20.000Z</LastModified>
<ETag>example-bucket#sample.html</ETag>
<Size>142863</Size>
<Owner>
<ID>minio</ID>
<DisplayName>minio</DisplayName>
</Owner>
<StorageClass>STANDARD</StorageClass>
</Contents>
<CommonPrefixes>
<Prefix>photos/</Prefix>
</CommonPrefixes>
</ListBucketResult>
~~~
~~~
<ListBucketResult>
<Name>example-bucket</Name>
<Prefix>photos/2006/</Prefix>
<Marker></Marker>
<MaxKeys>1000</MaxKeys>
<Delimiter>/</Delimiter>
<IsTruncated>false</IsTruncated>
<CommonPrefixes>
<Prefix>photos/2006/feb/</Prefix>
</CommonPrefixes>
<CommonPrefixes>
<Prefix>photos/2006/jan/</Prefix>
</CommonPrefixes>
</ListBucketResult>
~~~
10 years ago
Harshavardhana
d5e5a3b3e6
Use validString
10 years ago
Harshavardhana
6ebb48b4ea
Add object name validation
10 years ago
Harshavardhana
9acb1f728c
Sort list of objects
10 years ago
Harshavardhana
53669a0854
Implement delimiter, path prefix
10 years ago
Harshavardhana
3f8b3462e6
Remove donut_gen binary and update crc32c function
10 years ago
Harshavardhana
8ce9b84b69
Crc32c re-implementation with Convenience functions
...
- Sum32([]byte) --> uint32
- Sum(io.Reader) --> uint32, error
10 years ago
Frederick F. Kautz IV
1f7a3c13a5
Adding comparison for footer's INIM
10 years ago
Frederick F. Kautz IV
2ca62f13a5
Moving donut_gen to its own dir and renaming it as donut_gen_v1
10 years ago
Frederick F. Kautz IV
be768d01a2
Seek to beginning for tempbuffer
10 years ago
Frederick F. Kautz IV
5c52da6ebe
Adding crc32c to write
10 years ago
Harshavardhana
a9aaff0ee0
Remove HTTP server timeouts write and read.
...
Implement it later with a proper timer thread. Large file
transfers from 'mc' fail with i/o timeout without this change.
10 years ago
Frederick F. Kautz IV
ef442289da
Making donut use io.ReadWriteSeek instead of io.Writer
10 years ago
Harshavardhana
5e1e5ad786
More updates on documentation
10 years ago
Harshavardhana
b7868d23ac
Update minioapi documentation
10 years ago
Harshavardhana
f4b5519451
Update erasure documentation
10 years ago
Anand Babu (AB) Periasamy
de41e465c8
move httpserver under server
10 years ago
Harshavardhana
51e80eaa6d
Add domain and subdomain support for MinioAPI
...
This change brings in domain and subdomain support
- ./minio --domain "yourminiodomain.com"
This change brings in a much needed feature by keeping
bucketnames as part of your 'DNS' name.
All your existing applications can be migrated off from s3 to
Minio without little to no modifications.
NOTE: Setting up DNS for your `buckets` is out of scope of this feature
10 years ago
Harshavardhana
a92c6cb2b2
Purge tiedot wrapper
10 years ago
Harshavardhana
49a714d1a4
Add license header for Minio modifications, improvements for sha1,sha256,sha512 implementations
...
Also bring in SSE3 optimized public domain implementation of SHA1 from Intel ``FIPS PUB 180-1``
10 years ago
Harshavardhana
12cff1be58
Implement sha1 as intel optimized set
10 years ago
Anis Elleuch
1d4d7ff274
Add missing asm instruction to correct sha256 calculation in avx mode
10 years ago
Anis Elleuch
e89271b8f5
Use Intel optimized code (ssse3, avx, avx2) to calculate sha256
10 years ago
Harshavardhana
3151f9b6c3
Add proper entries for GobHeader, Data copy.
...
This commit also adds 'donut_gen.go' for generating sample donut file
10 years ago
Frederick F. Kautz IV
8129d8fd0b
Writing data out with error handling
10 years ago
Frederick F. Kautz IV
98ddbd840e
Moving donut code to v1 in donut package
10 years ago
Frederick F. Kautz IV
9833647fb7
Fixing magic number for INIM
10 years ago
Anand Babu (AB) Periasamy
ec36a598c9
Magic as numbers are faster to encode and compare
10 years ago