7c37e9d06a
Make donut fully integrated back into API handlers
9 years ago
12bde7df30
Add simple Ticket Master which pro-actively sends messages on proceedChannel
...
Handlers are going to wait on proceedChannel, this the initial step towards
providing priority for different set of API operations
9 years ago
5cfb05465e
Add cache, donut tests separately - fix behavior differences
...
Remove priority queue, implement it using a simpler channels
9 years ago
ebe61d99d9
Use cache Append() for saving objects in memory, GetObject() caches un-cached entries while reading
9 years ago
bce93c1b3a
Integrate cache with donut, add tests
9 years ago
0533abf6a8
Make priority queue lambda function return error over a channel
9 years ago
38a6ce36e5
Remove slow AppendUniq code, rolling through over a slice is in-efficient
...
Remove it and use map instead
9 years ago
84810162f5
Add simple Version and GetSysInfo services
9 years ago
14ec42d646
Add initial implementation of priority queue, uses container/heap
9 years ago
eb5aa19dfa
Remove custom Config, will use quick Config instead for user access keys
9 years ago
701c3e5242
Add new RPC helpers wrapping over regular rpc packages, add middleware chaining ability
9 years ago
188785a886
Add and remove dependencies
9 years ago
4addf7a996
Restructure API handlers, add JSON RPC simple HelloService right now.
9 years ago
335c7827eb
More donut, cache, api cleanup
9 years ago
dc0df3dc0e
Breakaway from driver model, move cache into donut
9 years ago
72572d6c71
Remove some api server code bringing in new cleanup
9 years ago
c2031ca066
Add server and control command
9 years ago
101784bc44
Merge pull request #695 from fkautz/pr_out_fixing_api_definitions
9 years ago
cfbc169034
Fixing API definitions
9 years ago
1d31c76dd6
Merge pull request #694 from harshavardhana/pr_out_move_memory_code_out_add_it_as_layer_on_top_of_existing_cache_code_wip
9 years ago
8f61d6b6be
Move memory code out, add it as layer on top of existing donut code
...
Just like how http.Handlers can be overlayed on top of each other
with each implementing ServeHTTP().
drivers.Driver can be overlayed on top of each other in similar manner
which would implement the drivers.Driver interface.
API <----> cache <----> donut <----> donut(format)
9 years ago
fe3c618cc7
Merge pull request #693 from harshavardhana/pr_out_add_dummy_driver_for_community_to_submit_new_drivers
9 years ago
ab6e16bb41
Add dummy driver for community to submit new drivers
9 years ago
12de98fb62
Rename memory driver as cache
9 years ago
2571342451
Filesystem goes the high road *again*
9 years ago
c4c67581dc
Merge pull request #692 from harshavardhana/pr_out_isvalidbucket_is_sufficient_we_don_t_need_to_verify_for_
9 years ago
f74d6138da
IsValidBucket() is sufficient we don't need to verify for "."
9 years ago
b5a5861c8f
Merge pull request #691 from harshavardhana/pr_out_handle_couple_of_cases_of_oom_conditions_move_caching_to_getobject_rather_than_putobject_
...
Handle couple of cases of OOM conditions, move caching to GetObject() rather than PutObject()
9 years ago
3109909355
Handle couple of cases of OOM conditions, move caching to GetObject() rather than PutObject()
9 years ago
d07d0c670a
Return back proper errors in writeObjectData(), rename few functions
9 years ago
be816145a9
Merge pull request #690 from harshavardhana/pr_out_put_object_on_successful_write_returns_full_metadata_to_avoid_subsequent_getobjectmetadata_calls_in_driver
9 years ago
10c807f233
Put object on successful write returns full metadata, to avoid subsequent GetObjectMetadata() calls in driver
9 years ago
6921328b93
Avoid frivolous GetObjectMetadata() calls at driver level, return back all the information in donut ListObjects()
9 years ago
f05ad062ee
Merge pull request #689 from harshavardhana/pr_out_expand_http_server_struct_to_store_more_values
9 years ago
d8f7896a43
Expand http server struct to store more values
9 years ago
63f9647c80
Merge pull request #688 from harshavardhana/pr_out_use_errorchannels_only_for_services_not_for_drivers_reduce_them_to_use_simple_functions
9 years ago
42c0287943
Use errorChannels only for services not for drivers, reduce them to use simple functions
9 years ago
b2bf90afbd
Merge pull request #687 from harshavardhana/pr_out_move_to_set_not_append_due_to_large_memory_reference_copy
9 years ago
91e5f648cb
Move to Set() not Append() due to large memory reference copy
9 years ago
22abe1b397
Merge pull request #686 from harshavardhana/pr_out_add_free_method_for_proxyreader_to_aggressively_de_allocate_read_data_to_handle_certain_out_of_memory_conditions
...
Add free() method for proxyReader to aggressively de-allocate Read data, to handle certain out of memory conditions
9 years ago
ac4d8fe478
Add free() method for proxyReader to aggressively de-allocate Read data, to handle certain out of memory conditions
...
There are still some more out there
9 years ago
a4d20d1e75
Merge pull request #685 from harshavardhana/pr_out_add_append_method_to_trove_cache_for_appending_data_to_an_existing_key
...
Add Append() method to trove cache for appending data to an existing key
9 years ago
05f8654e3d
Add Append() method to trove cache for appending data to an existing key
...
This largely avoids a large buffer copy which would accumulate inside proxyReader{}
This patch also implements "initialize()" function to init and populate data
on all the existing buckets, avoiding the redundant ListBuckets() invoked by
every API call.
9 years ago
762aae7c32
Merge pull request #684 from harshavardhana/pr_out_make_sure_to_populate_on_disk_data_into_memory_upon_first_api_requests
9 years ago
367772b988
Make sure to populate on disk data into memory upon first API requests
9 years ago
350e6eb5bb
Merge pull request #683 from harshavardhana/pr_out_add_proper_command_paramters_for_donut
9 years ago
07a6aafc94
Add proper command paramters for donut
9 years ago
c65969077d
Merge pull request #682 from harshavardhana/pr_out_an_attempt_to_bring_in_memory_layer_into_donut_driver
9 years ago
45a7eab804
An attempt to bring in memory layer into donut driver
9 years ago
7ab16b5b83
Merge pull request #681 from harshavardhana/pr_out_keeping_the_lexical_order_same_add_optimizations_provide_a_comprehensive_response_from_listobjects_
...
Keeping the lexical order same add optimizations, provide a comprehensive response from ListObjects()
9 years ago
Harshavardhana