minio

Commit Graph

Author	SHA1	Message	Date
Aditya Manthramurthy	fd4e15c116	Flush the records staging buffer periodically (#7193 ) - Staging buffer is flushed every 500ms. In cases where the result records are slowly generated (e.g. when a where condition matches very few records), this change causes the server to send results even though the staging buffer is not full. - Refactor messageWriter code to use simpler channel based co-ordination instead of atomic variables.	6 years ago
Aditya Manthramurthy	91c839ad28	Use a buffer to collect SQL Select result rows (#7158 ) Batching records into a single SQL Select message in the response leads to significant speed up as the message header overhead is made negligible. This change leads to a speed up of 3-5x for queries that select many small records.	6 years ago
Bala FA	b0deea27df	Refactor s3select to support parquet. (#7023 ) Also handle pretty formatted JSON documents.	6 years ago

Author

SHA1

Message

Date

Aditya Manthramurthy

fd4e15c116

Flush the records staging buffer periodically (#7193 )

- Staging buffer is flushed every 500ms. In cases where the result
  records are slowly generated (e.g. when a where condition
  matches very few records), this change causes the server to send
  results even though the staging buffer is not full.

- Refactor messageWriter code to use simpler channel based
  co-ordination instead of atomic variables.

6 years ago

Aditya Manthramurthy

91c839ad28

Use a buffer to collect SQL Select result rows (#7158 )

Batching records into a single SQL Select message in the response
leads to significant speed up as the message header overhead is made
negligible.

This change leads to a speed up of 3-5x for queries that select many
small records.

6 years ago

Bala FA

b0deea27df

Refactor s3select to support parquet. (#7023 )

Also handle pretty formatted JSON documents.

6 years ago

3 Commits (f75f707ff4ad828a22c58b68eddb04278aee0fe7)