097f70a3c5
Enable filesystem for API tests, this patch also implements ListMultipartUploads()
10 years ago
bfb9209689
Skip files and weird directories from listBuckets(), allowing this so that minio fs mode can be used as ftp service
10 years ago
d86ba5f336
Implement multipart support
...
- implemented NewMultipartUpload()
- implemented CreateObjectPart()
- implemented ListObjectParts()
- implemented AbortMultipartUpload()
- implemented CompleteMultipartUpload()
10 years ago
a91e519692
Make caching a package trove, and use it inside memory driver
10 years ago
7e5a26f42c
Protect the exported method Delete()
10 years ago
0cc63706bb
Resurrect back fileystem driver
10 years ago
d360d0fec3
Forbid the upload of files bigger than the memory backend capacity
10 years ago
ad60b97d52
Fix some donut TODO's regarding bucket created date
10 years ago
3d61ba5930
Fix duplicate map allocation
10 years ago
e4c0d574dc
Update totalnumber of multiparts inside CreateObjectPart(), also introduce support for UploadIDMarker and Prefix for listMultipartUploads
10 years ago
5c5761ae16
Remove unnecessary GetObjectMetadata prefix argument
10 years ago
6275238a47
For multiparts use its own cache avoids deadlocks during object expiration
...
Using same object cache as regular objects for multiparts causes deadlocks during object expiration routine.
As a side affect this also fixes the bug of listing multiparts during regular 'listing' of objects.
10 years ago
c41ebf7535
Fixing a race in NewMultipartUpload() session for simultaneous requests, observed at play.minio.io
10 years ago
8fb427a892
Add more tests for multipart now in driver api_testsuite
10 years ago
1bd94ec6ab
An attempt to implement ListMultipartUploads()
10 years ago
82b043005a
Avoid one last memory copy
10 years ago
8d06504068
Change all minio-io path to minio
10 years ago
b48b7f51ef
Use convenience functions for url.Values over looping through keys, fix a bug in listObjectParts()
10 years ago
14b5828505
Handle partNumberMarker with listObjectParts now and other fixes
10 years ago
cf559fa48e
Limiting upload id size
10 years ago
058604aa21
Adding tests and fixes for multipart uploads uncovered from tests
10 years ago
8860aa0c8c
Implement AbortMultipart
10 years ago
18c7f620cc
Add listparts support
10 years ago
01b474fca3
Move expiration code into its own and add ticker select case
10 years ago
23a545673d
Verify incoming md5sum for invidual parts in complete multipart request and some simplification of the code
...
Add two new functions for session cleanup
10 years ago
616241a2c1
Re-enable bucket deletion, this time with uploadID sitting there
10 years ago
2ea10c798b
Implement proper errors for Multipart
10 years ago
82c3656f79
Reply back CompleteMultipartUploadResult properly with final ETag computed
...
- Now s3 libraries and also objectstorage-go work properly
10 years ago
f050d5e974
Adding multipart support
10 years ago
ed71c28c37
Fixing panic in intelligent, attempted to delete nonexistent key
10 years ago
6d3d92694f
Add Marker support for donut, also add a testing code
10 years ago
75028c2ad1
Add lexicographic Marker/NextMarker support for recursive listing of objects.
...
Also update times when an object is accessed logic
10 years ago
193a6606db
Fix a potential race between ExpireObjects() and Set() over items map
10 years ago
ed1259d6f0
Deprecate LRU use just map[string]interface{} and call it intelligent 'cache'
10 years ago
63edb1e9a0
Nullify list memory to nil as we remove the element
10 years ago
d63064b8af
Optimize memory usage in GetPartialObject() for memory driver
10 years ago
c8f31d97a8
Modify LRU further to add object expiration
10 years ago
670f997b07
Bring blockingWriter from client and use it here
10 years ago
d0df548eb5
Use new LRU inside memory driver
10 years ago
f7caef2d26
Change CreateObject() to take size argument from content-length
10 years ago
c342ce1588
New LRU based on GroupCache which keeps track of memory rather than entries
10 years ago
3cf045fd1b
Deleting key from lastAccessedObjects on eviction
10 years ago
9ec8925f1c
Rename IsValidObject() to IsValidObjectName()
10 years ago
33ecba8e49
Reimagining memory settings cli input
10 years ago
25c268ac88
Attempt to fix memory lock on Get preventing write
10 years ago
8e3d48bf35
Use UTC() everywhere
...
ref - https://github.com/golang/go/issues/1988 , no standard function to set timeZone
10 years ago
94e24f1a05
Disable eviction on 0 expiration time
10 years ago
8e2f7f9493
Wrapping functions that require gc so that references are released before running
10 years ago
d815e6adfd
Changes to CreateObject() now returns back md5 along with any error
...
- This change is necessary to avoid the racy calls to GetObjectMetadata()
- This change is also necessary since one has to reply back md5sum with
PUT object response header
10 years ago
f8a16dd22b
Memory now evicts bucket if no more objects in memory struct
...
- To avoid race in expiration while accessing memory driver structs with
in two competing write locks. Use lru Len() instead to know exact length
to schedule for eviction.
- squash both bucket and object structs, instead use a separate map to keep
mutable info of lastAccessTime which can be independently used inside the
expiration routine.
10 years ago
Harshavardhana