Frederick F. Kautz IV
bb0441917c
Making changes to data based on discussion
10 years ago
Harshavardhana
2f04a1299e
Avoid allocating 1gig memory, avoid such mistakes
10 years ago
Frederick F. Kautz IV
2916b1278e
Adding data.go, does nothing for now.
10 years ago
Frederick F. Kautz IV
b4ef522a9b
Donut frame is now its own package
10 years ago
Frederick F. Kautz IV
6c2428833a
Renaming Write to WriteFrame
10 years ago
Harshavardhana
6b397844b9
Add donut benchmark for 64MB, 128MB, 256MB, 512MB
...
Current average values
~~~
> minio/pkg/storage/donut/v1 *> go test -bench .
OK: 2 passed
PASS
BenchmarkDonut64M 5 266249634 ns/op 252.05 MB/s
BenchmarkDonut128M 3 436507394 ns/op 307.48 MB/s
BenchmarkDonut256M 2 836116359 ns/op 321.05 MB/s
BenchmarkDonut512M 1 1676738951 ns/op 320.19 MB/s
ok github.com/minio-io/minio/pkg/storage/donut/v1 8.430s
> minio/pkg/storage/donut/v1 *>
~~~
10 years ago
Harshavardhana
65f22083ca
donut_gen works with new Donut Frame
10 years ago
Frederick F. Kautz IV
ddc7cf835e
Donut now tests amount written should match expected amount to write
10 years ago
Frederick F. Kautz IV
d3d1205eb1
Updating comment describing data type
10 years ago
Frederick F. Kautz IV
58a04ee831
New donut frame implemented
10 years ago
Harshavardhana
0c2d58bc6d
Implement proper delimiter and prefix handling
...
With this change Minio server now responds with, delimited
'object names' in conjunction with prefix filtering
~~~
<ListBucketResult>
<Name>example-bucket</Name>
<Prefix></Prefix>
<Marker></Marker>
<MaxKeys>1000</MaxKeys>
<Delimiter>/</Delimiter>
<IsTruncated>false</IsTruncated>
<Contents>
<Key>sample.html</Key>
<LastModified>2011-02-26T01:56:20.000Z</LastModified>
<ETag>example-bucket#sample.html</ETag>
<Size>142863</Size>
<Owner>
<ID>minio</ID>
<DisplayName>minio</DisplayName>
</Owner>
<StorageClass>STANDARD</StorageClass>
</Contents>
<CommonPrefixes>
<Prefix>photos/</Prefix>
</CommonPrefixes>
</ListBucketResult>
~~~
~~~
<ListBucketResult>
<Name>example-bucket</Name>
<Prefix>photos/2006/</Prefix>
<Marker></Marker>
<MaxKeys>1000</MaxKeys>
<Delimiter>/</Delimiter>
<IsTruncated>false</IsTruncated>
<CommonPrefixes>
<Prefix>photos/2006/feb/</Prefix>
</CommonPrefixes>
<CommonPrefixes>
<Prefix>photos/2006/jan/</Prefix>
</CommonPrefixes>
</ListBucketResult>
~~~
10 years ago
Harshavardhana
d5e5a3b3e6
Use validString
10 years ago
Harshavardhana
6ebb48b4ea
Add object name validation
10 years ago
Harshavardhana
53669a0854
Implement delimiter, path prefix
10 years ago
Harshavardhana
3f8b3462e6
Remove donut_gen binary and update crc32c function
10 years ago
Frederick F. Kautz IV
1f7a3c13a5
Adding comparison for footer's INIM
10 years ago
Frederick F. Kautz IV
2ca62f13a5
Moving donut_gen to its own dir and renaming it as donut_gen_v1
10 years ago
Frederick F. Kautz IV
be768d01a2
Seek to beginning for tempbuffer
10 years ago
Frederick F. Kautz IV
5c52da6ebe
Adding crc32c to write
10 years ago
Frederick F. Kautz IV
ef442289da
Making donut use io.ReadWriteSeek instead of io.Writer
10 years ago
Harshavardhana
f4b5519451
Update erasure documentation
10 years ago
Harshavardhana
51e80eaa6d
Add domain and subdomain support for MinioAPI
...
This change brings in domain and subdomain support
- ./minio --domain "yourminiodomain.com"
This change brings in a much needed feature by keeping
bucketnames as part of your 'DNS' name.
All your existing applications can be migrated off from s3 to
Minio without little to no modifications.
NOTE: Setting up DNS for your `buckets` is out of scope of this feature
10 years ago
Harshavardhana
3151f9b6c3
Add proper entries for GobHeader, Data copy.
...
This commit also adds 'donut_gen.go' for generating sample donut file
10 years ago
Frederick F. Kautz IV
8129d8fd0b
Writing data out with error handling
10 years ago
Frederick F. Kautz IV
98ddbd840e
Moving donut code to v1 in donut package
10 years ago
Frederick F. Kautz IV
9833647fb7
Fixing magic number for INIM
10 years ago
Anand Babu (AB) Periasamy
ec36a598c9
Magic as numbers are faster to encode and compare
10 years ago
Harshavardhana
c4f0aad9b5
Add donut tests, just for verification
10 years ago
Frederick F. Kautz IV
f7f34d08e8
Donut structure refined
10 years ago
Anand Babu (AB) Periasamy
9e304b53de
donut spec v1 prototype
10 years ago
Harshavardhana
fab954f13f
Run govet and fix
10 years ago
Frederick F. Kautz IV
05ac09bf69
Adding header version
10 years ago
Harshavardhana
a3e5121f7b
Make channels more aware of errors and shutdown on error - some cleanup
10 years ago
Frederick F. Kautz IV
fe9a5c14a0
Adding scaffolding for writing donut
10 years ago
Harshavardhana
f04beab7c2
Skip policy files
10 years ago
Harshavardhana
eeae64935e
Implement bucket policy handler and with galore of cleanup
10 years ago
Harshavardhana
966cdd4f05
Reply in xml from validate and ignore handlers
10 years ago
Harshavardhana
ac4f07906c
Implement S3 Style ErrorCodes and Response
...
This patchset also brings in lot of cleanup in terms of minioapi codebase
10 years ago
Harshavardhana
680848bdcb
Add license header
10 years ago
Frederick F. Kautz IV
288bc3fcc7
Adding content type to backend storage drivers
10 years ago
Frederick F. Kautz IV
7152712f34
Accessing dir as object should return ObjectNotFound
10 years ago
Frederick F. Kautz IV
a092b44cf1
Adding test to ensure list objects returns an error for non existant buckets to match previous bug fix and fix for inmemory
10 years ago
Harshavardhana
5d197dd063
Reply back errors properly
10 years ago
Frederick F. Kautz IV
54026dbc78
Setting order when retrieving buckets
10 years ago
Frederick F. Kautz IV
7ca87e06aa
Adding list bucket tests and fixing inmemory behavior.
10 years ago
Harshavardhana
82baccb8bf
Prefix if empty skip it before IsValidBucket
10 years ago
Frederick F. Kautz IV
ca7b1a7fc6
Fix build
10 years ago
Harshavardhana
2ccecd3f32
Add list buckets for 'fs'
10 years ago
Frederick F. Kautz IV
5daa408e2c
Creating subdirectories in fs now works
10 years ago
Frederick F. Kautz IV
044dc9af80
Adding more tests, including ordering of objects in prefix
10 years ago