ec9b20a94f
Adding stubes for new single disk driver
10 years ago
41653774fc
Simplify fs codebase, split them into separate files and more commenting
10 years ago
01e98eb326
Make BucketPolicy strictly typed
10 years ago
8866b2cc5f
Add delimiter and prefix tests, also add inmemory to support delimiters
10 years ago
7a01db8005
Strict checks for delimiter and prefix if absent or present
10 years ago
9e89af0e3c
Remove redundant uint32
10 years ago
f8e2b75e23
Get object metadata needs to filter based of Prefix when delimiter is specified
10 years ago
679c6ace3a
Fragment reader implemented
10 years ago
4751ed0e30
Add MD5 support for fsStorage, also re-purpose GetObjectMetadata for ListObjects
10 years ago
ca1a4b616c
Adding read header for erasure
10 years ago
00381c887a
Adding erasure package to wrap versioned erasure. Ensures we always write latest version.
10 years ago
d992bccd9a
Move pkg/storage/erasure to pkg/encoding/erasure - and other cleanups
10 years ago
856e0100c0
Erasure layer now writes using new technique
10 years ago
e5af8a3f5d
Further fixes -
...
- All test files have been renamed to their respective <package>_test name,
this is done in accordance with
- https://github.com/golang/go/wiki/CodeReviewComments#import-dot
imports are largely used in testing, but to avoid namespace collision
and circular dependencies
- Never use _* in package names other than "_test" change fragment_v1 to expose
fragment just like 'gopkg.in/check.v1'
10 years ago
c00d1461b9
Golint cleanup from top level
10 years ago
540723d7ae
Golint cleanup pkg/api
10 years ago
76e601b26b
Golint cleanup pkg/storage
10 years ago
1186c47603
Fragment now implements new version
10 years ago
665af44c70
Renaming donut packages to match layout
10 years ago
f2e238199b
Handle individual objects too
10 years ago
e400e85639
Add proper path prefix to be delimited
10 years ago
cc46475c86
Pathprefix is filtered out properly and delimited as well
10 years ago
3a3c8645fc
Update comments across the codebase
10 years ago
137584d658
Add comments
10 years ago
c3ad0906e0
Add deadcode code which recursivley goes into all directories and verifies dangling variables.
10 years ago
32f8c17174
Renaming AppendUstr to AppendUniqStr
10 years ago
6f300c9ef0
Adding test at byte level
10 years ago
0b08312ddd
Specifying more exact types for data
10 years ago
9f43659135
Add tests, add NewHeader() for populating Header and ValidateHeader()
10 years ago
7414dc9b75
Adding data writer
10 years ago
eb9a4a83ac
Move AppendUstr(), AppendUint() into helpers
10 years ago
be12a6b3d9
Changing K and M in data.go to match new datatype in erasure package
10 years ago
b77c62e25d
Make K,M to be uint8 and Technique becomes its own type
10 years ago
bb0441917c
Making changes to data based on discussion
10 years ago
2f04a1299e
Avoid allocating 1gig memory, avoid such mistakes
10 years ago
2916b1278e
Adding data.go, does nothing for now.
10 years ago
b4ef522a9b
Donut frame is now its own package
10 years ago
6c2428833a
Renaming Write to WriteFrame
10 years ago
6b397844b9
Add donut benchmark for 64MB, 128MB, 256MB, 512MB
...
Current average values
~~~
> minio/pkg/storage/donut/v1 *> go test -bench .
OK: 2 passed
PASS
BenchmarkDonut64M 5 266249634 ns/op 252.05 MB/s
BenchmarkDonut128M 3 436507394 ns/op 307.48 MB/s
BenchmarkDonut256M 2 836116359 ns/op 321.05 MB/s
BenchmarkDonut512M 1 1676738951 ns/op 320.19 MB/s
ok github.com/minio-io/minio/pkg/storage/donut/v1 8.430s
> minio/pkg/storage/donut/v1 *>
~~~
10 years ago
65f22083ca
donut_gen works with new Donut Frame
10 years ago
ddc7cf835e
Donut now tests amount written should match expected amount to write
10 years ago
d3d1205eb1
Updating comment describing data type
10 years ago
58a04ee831
New donut frame implemented
10 years ago
0c2d58bc6d
Implement proper delimiter and prefix handling
...
With this change Minio server now responds with, delimited
'object names' in conjunction with prefix filtering
~~~
<ListBucketResult>
<Name>example-bucket</Name>
<Prefix></Prefix>
<Marker></Marker>
<MaxKeys>1000</MaxKeys>
<Delimiter>/</Delimiter>
<IsTruncated>false</IsTruncated>
<Contents>
<Key>sample.html</Key>
<LastModified>2011-02-26T01:56:20.000Z</LastModified>
<ETag>example-bucket#sample.html</ETag>
<Size>142863</Size>
<Owner>
<ID>minio</ID>
<DisplayName>minio</DisplayName>
</Owner>
<StorageClass>STANDARD</StorageClass>
</Contents>
<CommonPrefixes>
<Prefix>photos/</Prefix>
</CommonPrefixes>
</ListBucketResult>
~~~
~~~
<ListBucketResult>
<Name>example-bucket</Name>
<Prefix>photos/2006/</Prefix>
<Marker></Marker>
<MaxKeys>1000</MaxKeys>
<Delimiter>/</Delimiter>
<IsTruncated>false</IsTruncated>
<CommonPrefixes>
<Prefix>photos/2006/feb/</Prefix>
</CommonPrefixes>
<CommonPrefixes>
<Prefix>photos/2006/jan/</Prefix>
</CommonPrefixes>
</ListBucketResult>
~~~
10 years ago
d5e5a3b3e6
Use validString
10 years ago
6ebb48b4ea
Add object name validation
10 years ago
53669a0854
Implement delimiter, path prefix
10 years ago
3f8b3462e6
Remove donut_gen binary and update crc32c function
10 years ago
1f7a3c13a5
Adding comparison for footer's INIM
10 years ago
2ca62f13a5
Moving donut_gen to its own dir and renaming it as donut_gen_v1
10 years ago
Frederick F. Kautz IV