minio

History

Harshavardhana 7e1661f4fa Performance improvements to SELECT API on certain query operations (#6752 ) This improves the performance of certain queries dramatically, such as 'count()' etc. Without this PR ``` ~ time mc select --query "select count() from S3Object" myminio/sjm-airlines/star2000.csv.gz 2173762 real 0m42.464s user 0m0.071s sys 0m0.010s ``` With this PR ``` ~ time mc select --query "select count(*) from S3Object" myminio/sjm-airlines/star2000.csv.gz 2173762 real 0m17.603s user 0m0.093s sys 0m0.008s ``` Almost a 250% improvement in performance. This PR avoids a lot of type conversions and instead relies on raw sequences of data and interprets them lazily. ``` benchcmp old new benchmark old ns/op new ns/op delta BenchmarkSQLAggregate_100K-4 551213 259782 -52.87% BenchmarkSQLAggregate_1M-4 6981901985 2432413729 -65.16% BenchmarkSQLAggregate_2M-4 13511978488 4536903552 -66.42% BenchmarkSQLAggregate_10M-4 68427084908 23266283336 -66.00% benchmark old allocs new allocs delta BenchmarkSQLAggregate_100K-4 2366 485 -79.50% BenchmarkSQLAggregate_1M-4 47455492 21462860 -54.77% BenchmarkSQLAggregate_2M-4 95163637 43110771 -54.70% BenchmarkSQLAggregate_10M-4 476959550 216906510 -54.52% benchmark old bytes new bytes delta BenchmarkSQLAggregate_100K-4 1233079 1086024 -11.93% BenchmarkSQLAggregate_1M-4 2607984120 557038536 -78.64% BenchmarkSQLAggregate_2M-4 5254103616 1128149168 -78.53% BenchmarkSQLAggregate_10M-4 26443524872 5722715992 -78.36% ```		6 years ago
..
Azure	…
aliyun/aliyun-oss-go-sdk/oss	…
beorn7/perks	Introduce new unauthenticated endpoint /metric (#5723 ) (#5829 )	7 years ago
cheggaaa/pb	…
coredns/coredns	Bring etcd support for bucket DNS federation	7 years ago
coreos	Update federation target to etcd/clientv3 (#6119 )	7 years ago
davecgh/go-spew	…
dgrijalva/jwt-go	…
djherbis/atime	…
dustin/go-humanize	…
eapache	…
eclipse/paho.mqtt.golang	…
elazarl/go-bindata-assetfs	…
fatih	…
garyburd/redigo	…
go-ini/ini	…
go-sql-driver/mysql	…
gogo/protobuf	…
golang	Add object compression support (#6292 )	6 years ago
googleapis/gax-go	…
gorilla	add some security HTTP headers (#5814 )	7 years ago
grpc-ecosystem/go-grpc-middleware	Update federation target to etcd/clientv3 (#6119 )	7 years ago
hashicorp	Removed unused vendored dependencies (#6520 )	6 years ago
howeyc/gopass	…
inconshreveable/go-update	…
joyent/triton-go	…
klauspost	Performance improvements by re-using record buffer (#6622 )	6 years ago
lib/pq	Register postgre driver in pkg/event/target (#6689 )	6 years ago
mattn	…
matttproud/golang_protobuf_extensions	Introduce new unauthenticated endpoint /metric (#5723 ) (#5829 )	7 years ago
miekg/dns	Bring etcd support for bucket DNS federation	7 years ago
minio	Add ObjectOptions to ObjectLayer calls (#6382 )	6 years ago
mitchellh	Add support for SSE-S3 server side encryption with vault (#6192 )	6 years ago
nats-io	…
nsqio/go-nsq	feature: added nsq as broker for events (#6740 )	6 years ago
pkg	Add Profiler Admin API (#6463 )	6 years ago
prometheus	Enhancements in Minio Prometheus exporter (#5848 )	7 years ago
rjeczalik/notify	Build fix for go1.11rc1 (#6354 )	6 years ago
rs	…
ryanuber/go-glob	Add support for SSE-S3 server side encryption with vault (#6192 )	6 years ago
satori/uuid	…
segmentio/go-prompt	…
skyrings/skyring-common	…
streadway/amqp	…
tidwall	Performance improvements to SELECT API on certain query operations (#6752 )	6 years ago
valyala/tcplisten	Use new listener which implements enhanced tcp features (#6289 )	6 years ago
xwb1989/sqlparser	S3 Select API Support for CSV (#6127 )	6 years ago