You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Harshavardhana ede4dd0f9c server: update command should check for 3s from 1ms. (#2175) 9 years ago
.github Created ISSUE_TEMPLATE with basic information 9 years ago
buildscripts filter GOPATH from stack trace (#1755) 9 years ago
dist/linux-systemd implemented systemd script (#2167) 9 years ago
docs XL/PutObject: Add single putObject and multipart caching. (#2115) 9 years ago
pkg XL/PutObject: Add single putObject and multipart caching. (#2115) 9 years ago
vendor vendor: Bring new updates from blake2b-simd repo. (#2094) 9 years ago
.gitignore Remove binary files from previous commit. 9 years ago
.mailmap Update AB's duplicate email address 9 years ago
.mention-bot Add mention-bot config 9 years ago
.travis.yml XL/metadata: use new hashOrder algorithm for newXLMeta. (#2147) 9 years ago
AWS-SDK-GO.md doc: Cleanup aws-sdk-go.md 9 years ago
CONTRIBUTING.md Minor changes to CONTIRBUTING.md instructions (#1403) 9 years ago
Caddy.md Update Caddy.md 9 years ago
Docker.md docker: Update docker document 9 years ago
Dockerfile New Dockerfile for building & running minio inside Docker (inc. autobuild support) (#1473) (#1485) 9 years ago
FreeBSD.md docs: FreeBSD minio source intructions (#1421) 9 years ago
INSTALLGO.md INSTALLGO.md mentions Go 1.5+ for OS X (#1936) 9 years ago
LICENSE Initial commit 10 years ago
MAINTAINERS.md build: Add release builds, now generated with 'make release' 9 years ago
Makefile docker: Remove unneeded docker files and makefile tags. 9 years ago
NOTICE Fix typo 9 years ago
README.md Add erasure code. 9 years ago
access-key.go logging: Log only for unhandled errors, remove all the debug logging. (#1652) 9 years ago
accesslog-handler.go logging: Log only for unhandled errors, remove all the debug logging. (#1652) 9 years ago
api-datatypes.go api: verify Location constraint for make bucket. (#1342) 9 years ago
api-errors.go Added specific error for InvalidObjectName (#2157) 9 years ago
api-headers.go XL/fs: GetObject should validate all its inputs. (#2142) 9 years ago
api-headers_test.go handlers: Cleanup time handlers helpers. 9 years ago
api-resources.go server: Remove deadcode/deprecated code. (#2088) 9 years ago
api-response-multipart.go API: add writePartTooSmallErrorResponse to extend standard error responses. (#2005) 9 years ago
api-response.go Send XML header before the first of whitespace chars (#2046) 9 years ago
api-router.go URL Encode X-Amz-Copy-Source as per the spec (#2114) 9 years ago
appveyor.yml server: Remove deadcode/deprecated code. (#2088) 9 years ago
auth-handler.go handler/PUT: Handle signature verification through a custom reader. (#2066) 9 years ago
benchmark-utils_test.go benchmarks: add parallel benchmarks for PutObject/GetObject. (#2159) 9 years ago
bucket-handlers.go List Objects version 2. (#1815) 9 years ago
bucket-policy-handlers.go fix: use readSizeV1 wherever applicable. (#2093) 9 years ago
bucket-policy-handlers_test.go tests: Move signature calculation in separate function. (#2160) 9 years ago
bucket-policy-parser.go api/bucket-policy: Add unit tests for more coverage, fixes couple of bugs. (#2055) 9 years ago
bucket-policy-parser_test.go api/bucket-policy: Add unit tests for more coverage, fixes couple of bugs. (#2055) 9 years ago
bucket-policy.go server: Deadcode removal. (#1517) 9 years ago
build-constants.go filter GOPATH from stack trace (#1755) 9 years ago
certs.go getCertsPath should use getConfigPath instead of defaulting to users homedir. (#2039) 9 years ago
commands.go logging: Log only for unhandled errors, remove all the debug logging. (#1652) 9 years ago
config-migrate.go posix: Support UNC paths on windows. (#1887) 9 years ago
config-old.go quick/config: No need to use Data() with type assertion. (#1480) 9 years ago
config-v4.go quick/config: No need to use Data() with type assertion. (#1480) 9 years ago
config.go logging: Log only for unhandled errors, remove all the debug logging. (#1652) 9 years ago
damerau-levenshtein.go xl: Moved to minio/minio - fixes #1112 9 years ago
erasure-createfile.go handler/PUT: Handle signature verification through a custom reader. (#2066) 9 years ago
erasure-readfile.go xl/fs: offset and length cannot be negative. (#2121) 9 years ago
erasure-readfile_test.go tests: Fix erasure-readfile test formatting. 9 years ago
erasure-utils.go xl/fs: offset and length cannot be negative. (#2121) 9 years ago
erasure_test.go XL: Change minimum disks supported to 6 now. (#2023) 9 years ago
format-config-v1.go server: Implement --ignore-disks for ignoring disks from healing. (#2158) 9 years ago
format-config-v1_test.go XL/format: Fix a bug in checkDisksConsistency. (#1894) 9 years ago
fs-v1-errors.go FS: check whether disk format is FS or not. (#2083) 9 years ago
fs-v1-metadata.go FS: check whether disk format is FS or not. (#2083) 9 years ago
fs-v1-multipart-common.go XL: Relax write quorum further to N/2 + 1. (#2018) 9 years ago
fs-v1-multipart.go XL: Implement ignore errors. (#2136) 9 years ago
fs-v1.go ObjectLayer/GetObject: Should return the right error value. Fix done in FS and XL. (#2133) 9 years ago
fs-v1_test.go server: Implement --ignore-disks for ignoring disks from healing. (#2158) 9 years ago
generic-handlers.go handlers/generic: Remove support for 'x-minio-date' (#2064) 9 years ago
globals.go XL/PutObject: Add single putObject and multipart caching. (#2115) 9 years ago
handler-utils.go Cleanup: Moving IsValidLocationContraint to handler utils 9 years ago
handler-utils_test.go Cleanup: Moving IsValidLocationContraint to handler utils 9 years ago
httprange.go placing the http range error in objct-api-errors. (#2150) 9 years ago
httprange_test.go XL/fs: GetObject should validate all its inputs. (#2142) 9 years ago
logger-console-hook.go logging: Log only for unhandled errors, remove all the debug logging. (#1652) 9 years ago
logger-file-hook.go posix: Mkdir() and OpenFile() should honor umask. (#1972) 9 years ago
logger-syslog-hook_nix.go logging: Log only for unhandled errors, remove all the debug logging. (#1652) 9 years ago
logger-syslog-hook_windows.go logging: Log only for unhandled errors, remove all the debug logging. (#1652) 9 years ago
logger.go filter GOPATH from stack trace (#1755) 9 years ago
logger_test.go logging: Log only for unhandled errors, remove all the debug logging. (#1652) 9 years ago
main.go server: Remove deadcode/deprecated code. (#2088) 9 years ago
main_test.go Migrate this project to minio micro services code 9 years ago
namespace-lock.go XL/PutObject: Add single putObject and multipart caching. (#2115) 9 years ago
namespace-lock_test.go tests: Remove racey failedDisks behavior in RenameObject tests. (#2138) 9 years ago
notifier.go server: terminal width should fallback to 80x25. (#1895) 9 years ago
object-api-getobject_test.go benchmarks: add parallel benchmarks for PutObject/GetObject. (#2159) 9 years ago
object-api-getobjectinfo_test.go organizing the benchmarks in the right test files (#2154) 9 years ago
object-api-listobjects_test.go Object layer tests revamp for individual execution (#2134) 9 years ago
object-api-multipart_test.go organizing the benchmarks in the right test files (#2154) 9 years ago
object-api-putobject_test.go benchmarks: add parallel benchmarks for PutObject/GetObject. (#2159) 9 years ago
object-common.go server: Implement --ignore-disks for ignoring disks from healing. (#2158) 9 years ago
object-datatypes.go docs: Add comments for each data types. (#1881) 9 years ago
object-errors.go placing the http range error in objct-api-errors. (#2150) 9 years ago
object-handlers-common.go API/CopyObject: If-None-Match should return Precondition failed. (#2164) 9 years ago
object-handlers.go API/CopyObject: If-None-Match should return Precondition failed. (#2164) 9 years ago
object-interface.go XL: bring in new storage API. (#1780) 9 years ago
object-multipart-common.go XL: Relax write quorum further to N/2 + 1. (#2018) 9 years ago
object-utils.go XL: bring in new storage API. (#1780) 9 years ago
object-utils_test.go Validation: Reject object names with trailing "/". (#1619) 9 years ago
object_api_suite_test.go Object layer tests revamp for individual execution (#2134) 9 years ago
posix-dirent-fileno.go xl/fs: Split object layer into interface. (#1415) 9 years ago
posix-dirent-ino.go xl/fs: Split object layer into interface. (#1415) 9 years ago
posix-list-dir-nix.go logging: Log only for unhandled errors, remove all the debug logging. (#1652) 9 years ago
posix-list-dir-others.go posix: Re-do tests for readDir(). (#1996) 9 years ago
posix-list-dir_test.go posix: Re-do tests for readDir(). (#1996) 9 years ago
posix-prepare-path.go posix: Support UNC paths on windows. (#1887) 9 years ago
posix-utils_common.go posix: Support UNC paths on windows. (#1887) 9 years ago
posix-utils_nix.go XL: allow meta bucket name appended with tmp meta prefix. (#2007) 9 years ago
posix-utils_nix_test.go posix: Mkdir() and OpenFile() should honor umask. (#1972) 9 years ago
posix-utils_test.go XL: allow meta bucket name appended with tmp meta prefix. (#2007) 9 years ago
posix-utils_windows.go posix-utils: fix path handling in windows. (#2053) 9 years ago
posix-utils_windows_test.go tests: add unit test for posix functions. (#2037) 9 years ago
posix.go posix: ReadAll should handle the case when parent is not a dir. (#2163) 9 years ago
posix_test.go posix: ReadAll should handle the case when parent is not a dir. (#2163) 9 years ago
rate-limit-handler.go server: Add connection rate limiter for server. (#1977) 9 years ago
routers.go server: Implement --ignore-disks for ignoring disks from healing. (#2158) 9 years ago
rpc-client.go Misspell warnings fix (#2001) 9 years ago
rpc-server-datatypes.go XL: Implement new ReadAll API for files which are read in single call. (#1974) 9 years ago
rpc-server.go XL: Implement new ReadAll API for files which are read in single call. (#1974) 9 years ago
runtime-checks.go main: minio --help should print regardless of root. (#1985) 9 years ago
server-main.go server: Implement --ignore-disks for ignoring disks from healing. (#2158) 9 years ago
server-rlimit-nix.go server: Set rLimit properly to the max. (#1676) 9 years ago
server-rlimit-win.go server: Attempt to increase max open files. (#1328) 9 years ago
server_test.go tests: Move signature calculation in separate function. (#2160) 9 years ago
server_utils_test.go xl/tests: Enable server handler tests over XL. (#1512) 9 years ago
signals.go FS: remove .minio directory if .minio/multipart is empty. (#1899) 9 years ago
signature-jwt.go xl/fs: Split object layer into interface. (#1415) 9 years ago
signature-v4-parser.go error: Signature errors should be returned with APIErrorCode. 9 years ago
signature-v4-postpolicyform.go fs: Handle cases of PutObject for an existing prefix. (#1478) 9 years ago
signature-v4-utils.go tests: Move signature calculation in separate function. (#2160) 9 years ago
signature-v4.go tests: Move signature calculation in separate function. (#2160) 9 years ago
signature-v4_test.go tests: Add urlEncode tests. (#2078) 9 years ago
signature-verify-reader.go handler/PUT: Handle signature verification through a custom reader. (#2066) 9 years ago
storage-datatypes.go docs: Add comments for each data types. (#1881) 9 years ago
storage-errors.go posix: Return errDiskNotWritable during disk initialization. (#2048) 9 years ago
storage-interface.go XL: Implement new ReadAll API for files which are read in single call. (#1974) 9 years ago
strconv-bytes.go XL: GetObject caching implemented for XL. (#2017) 9 years ago
strconv-bytes_test.go XL: GetObject caching implemented for XL. (#2017) 9 years ago
test-utils_test.go server: Implement --ignore-disks for ignoring disks from healing. (#2158) 9 years ago
tree-walk-pool.go XL/tree-walk: Added comments, changed variable names and structure fields to improve code readability. (#1856) 9 years ago
tree-walk-pool_test.go Added unit-tests for treeWalkPool (#1969) 9 years ago
tree-walk.go XL: Implement ignore errors. (#2136) 9 years ago
tree-walk_test.go tree-walk: unify FS and XL tree-walk with functional approach. (#2027) 9 years ago
trie.go Add trie to verify wrong inputs, and provide meaningful messages 9 years ago
typed-errors.go handler/PUT: Handle signature verification through a custom reader. (#2066) 9 years ago
update-main.go server: update command should check for 3s from 1ms. (#2175) 9 years ago
utils.go Part ID check (#1730) 9 years ago
version-main.go console: Fix console color printing on windows. 9 years ago
version_test.go Move all server and controller packages into top-level 9 years ago
web-handlers.go handler/PUT: Handle signature verification through a custom reader. (#2066) 9 years ago
web-router.go xl/fs: Split object layer into interface. (#1415) 9 years ago
xl-v1-bucket.go XL: Implement ignore errors. (#2136) 9 years ago
xl-v1-common.go Use new algorithm to get fixed random order of disks (#2147) 9 years ago
xl-v1-errors.go server: Remove deadcode/deprecated code. (#2088) 9 years ago
xl-v1-healing.go XL: Handle quorum situations properly for write operations. (#1986) 9 years ago
xl-v1-list-objects.go tree-walk: unify FS and XL tree-walk with functional approach. (#2027) 9 years ago
xl-v1-metadata.go posix: ReadAll should handle the case when parent is not a dir. (#2163) 9 years ago
xl-v1-metadata_test.go tests: improve unit tests for xl-v1-metadata. (#2172) 9 years ago
xl-v1-multipart-common.go XL: Implement ignore errors. (#2136) 9 years ago
xl-v1-multipart.go XL/PutObject: Add single putObject and multipart caching. (#2115) 9 years ago
xl-v1-object.go ObjectLayer/GetObject: Should return the right error value. Fix done in FS and XL. (#2133) 9 years ago
xl-v1-object_test.go tests: Remove racey failedDisks behavior in RenameObject tests. (#2138) 9 years ago
xl-v1-utils.go Added specific error for InvalidObjectName (#2157) 9 years ago
xl-v1-utils_test.go ObjectLayer/GetObject: Should return the right error value. Fix done in FS and XL. (#2133) 9 years ago
xl-v1.go server: Implement --ignore-disks for ignoring disks from healing. (#2158) 9 years ago
xl-v1_test.go server: Implement --ignore-disks for ignoring disks from healing. (#2158) 9 years ago

README.md

Minio Gitter

Minio is an object storage server compatible with Amazon S3 and licensed under Apache license 2.0.

Description

Minio is an open source object storage server released under Apache License V2. It is compatible with Amazon S3 cloud storage service. Minio follows a minimalist design philosophy. Minio is light enough to be bundled with the application stack. It sits on the side of NodeJS, Redis, MySQL and the likes. Unlike databases, Minio stores objects such as photos, videos, log files, backups, container / VM images and so on. Minio is best suited for storing blobs of information ranging from KBs to 5 TBs each. In a simplistic sense, it is like a FTP server with a simple get / put API over HTTP.

Minio currently implements two backends

  • Filesystem (FS) - is available and ready for general purpose use.
  • ErasureCoded (XL) - is available, but it is not ready for general purpose use.

Minio Client

Minio Client (mc) provides a modern alternative to Unix commands like ls, cat, cp, sync, and diff. It supports POSIX compatible filesystems and Amazon S3 compatible cloud storage systems. It is entirely written in Golang.

Amazon S3 Compatible Client Libraries

Install Build StatusBuild status

GNU/Linux

Download minio for:

$ chmod +x minio
$ ./minio --help

OS X

Download minio from https://dl.minio.io/server/minio/release/darwin-amd64/minio

$ chmod 755 minio
$ ./minio --help

Microsoft Windows

Download minio for:

C:\Users\Username\Downloads> minio.exe --help

FreeBSD

Download minio from https://dl.minio.io/server/minio/release/freebsd-amd64/minio

$ chmod 755 minio
$ ./minio --help

Read more here on How to configure Minio on FreeBSD with ZFS backend.

Docker container

Download minio for docker.

$ docker pull minio/minio

Read more here on How to configure data volume containers for Minio?

Source

NOTE: Source installation is intended for only developers and advanced users. For general use, please download official releases from https://minio.io/downloads.

If you do not have a working Golang environment, please follow Install Golang.

$ go get -d github.com/minio/minio
$ cd $GOPATH/src/github.com/minio/minio
$ make

How to use Minio?

Start minio server.

$ minio server ~/Photos

AccessKey: WLGDGYAQYIGI833EV05A  SecretKey: BYvgJM101sHngl2uzjXS/OBF/aMxAN06JrJ3qJlF  Region: us-east-1

Minio Object Storage:
    http://127.0.0.1:9000
    http://10.1.10.177:9000

Minio Browser:
    http://127.0.0.1:9000
    http://10.1.10.177:9000

To configure Minio Client:
    $ wget https://dl.minio.io/client/mc/release/darwin-amd64/mc
    $ chmod 755 mc
    $ ./mc config host add myminio http://localhost:9000 WLGDGYAQYIGI833EV05A BYvgJM101sHngl2uzjXS/OBF/aMxAN06JrJ3qJlF

How to use AWS CLI with Minio?

This section assumes that you have already installed aws-cli, if not please visit https://aws.amazon.com/cli/

To configure aws-cli, type aws configure and follow below steps.

$ aws configure
AWS Access Key ID [None]: YOUR_ACCESS_KEY_HERE
AWS Secret Access Key [None]: YOUR_SECRET_KEY_HERE
Default region name [None]: us-east-1
Default output format [None]: ENTER

Additionally enable aws-cli to use AWS Signature Version '4' for Minio server.

$ aws configure set default.s3.signature_version s3v4

To list your buckets.

$ aws --endpoint-url http://localhost:9000 s3 ls
2016-03-27 02:06:30 deebucket
2016-03-28 21:53:49 guestbucket
2016-03-29 13:34:34 mbtest
2016-03-26 22:01:36 mybucket
2016-03-26 15:37:02 testbucket

To list contents inside bucket.

$ aws --endpoint-url http://localhost:9000 s3 ls s3://mybucket
2016-03-30 00:26:53      69297 argparse-1.2.1.tar.gz
2016-03-30 00:35:37      67250 simplejson-3.3.0.tar.gz

To make a bucket.

$ aws --endpoint-url http://localhost:9000 s3 mb s3://mybucket
make_bucket: s3://mybucket/

To add an object to a bucket.

$ aws --endpoint-url http://localhost:9000 s3 cp simplejson-3.3.0.tar.gz s3://mybucket
upload: ./simplejson-3.3.0.tar.gz to s3://mybucket/simplejson-3.3.0.tar.gz

Delete an object from a bucket.

$ aws --endpoint-url http://localhost:9000 s3 rm s3://mybucket/argparse-1.2.1.tar.gzdelete: s3://mybucket/argparse-1.2.1.tar.gz

Remove a bucket.

$ aws --endpoint-url http://localhost:9000 s3 rb s3://mybucket
remove_bucket: s3://mybucket/

How to use AWS SDK with Minio?

Please follow the documentation here - Using aws-sdk-go with Minio server

How to use s3cmd with Minio?

This section assumes that you have already installed s3cmd, if not please visit http://s3tools.org/s3cmd

Edit the following fields in your s3cmd configuration file ~/.s3cfg .

host_base = localhost:9000
host_bucket = localhost:9000
access_key = YOUR_ACCESS_KEY_HERE
secret_key = YOUR_SECRET_KEY_HERE
signature_v2 = False
bucket_location = us-east-1

To make a bucket.

$ s3cmd mb s3://mybucket
Bucket 's3://mybucket/' created

To copy an object to bucket.

$ s3cmd put newfile s3://testbucket
upload: 'newfile' -> 's3://testbucket/newfile'  

To copy an object to local system.

$ s3cmd get s3://testbucket/newfile
download: 's3://testbucket/newfile' -> './newfile'

To sync local file/directory to a bucket.

$ s3cmd sync newdemo s3://testbucket
upload: 'newdemo/newdemofile.txt' -> 's3://testbucket/newdemo/newdemofile.txt'

To sync bucket or object with local filesystem.

$ s3cmd sync  s3://otherbucket otherlocalbucket
download: 's3://otherbucket/cat.jpg' -> 'otherlocalbucket/cat.jpg'

To list buckets.

$ s3cmd ls s3://
2015-12-09 16:12  s3://testbbucket

To list contents inside bucket.

$ s3cmd ls s3://testbucket/
                       DIR   s3://testbucket/test/
2015-12-09 16:05    138504   s3://testbucket/newfile

Delete an object from bucket.

$ s3cmd del s3://testbucket/newfile
delete: 's3://testbucket/newfile'

Delete a bucket.

$ s3cmd rb s3://testbucket
Bucket 's3://testbucket/' removed

Contribute to Minio Project

Please follow Minio Contributor's Guide

Jobs

If you think in Lisp or Haskell and hack in go, you would blend right in. Send your github link to callhome@minio.io.