[ARVADOS] updated: b9b1b04f50fbc0b8539c641662bed152c94165ea
Git user
git at public.curoverse.com
Wed Jun 15 10:53:04 EDT 2016
Summary of changes:
services/keep-balance/balance.go | 2 +-
services/keep-balance/usage.go | 13 +++++++++++++
2 files changed, 14 insertions(+), 1 deletion(-)
via b9b1b04f50fbc0b8539c641662bed152c94165ea (commit)
via a41e0fdc1a84f1cda78626ed81f6da4aa299937c (commit)
from 177b3b66c3e876a5e1665e6067309fb15cabdf83 (commit)
Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.
commit b9b1b04f50fbc0b8539c641662bed152c94165ea
Author: Tom Clegg <tom at curoverse.com>
Date: Wed Jun 15 10:53:01 2016 -0400
9395: Explain CollectionBatchSize and CollectionBuffers in -help message.
diff --git a/services/keep-balance/usage.go b/services/keep-balance/usage.go
index 2273f3a..b521c65 100644
--- a/services/keep-balance/usage.go
+++ b/services/keep-balance/usage.go
@@ -73,6 +73,19 @@ Committing:
Use the -commit-pull and -commit-trash flags to implement the
computed changes.
+Tuning resource usage:
+
+ CollectionBatchSize limits the number of collections retrieved per
+ API transaction. If this is zero or omitted, page size is
+ determined by the API server's own page size limits (see
+ max_items_per_response and max_index_database_read configs).
+
+ CollectionBuffers sets the size of an internal queue of
+ collections. Higher values use more memory, and improve throughput
+ by allowing keep-balance to fetch the next page of collections
+ while the current page is still being processed. If this is zero
+ or omitted, pages are processed serially.
+
Limitations:
keep-balance does not attempt to discover whether committed pull
commit a41e0fdc1a84f1cda78626ed81f6da4aa299937c
Author: Tom Clegg <tom at curoverse.com>
Date: Wed Jun 15 10:39:40 2016 -0400
9395: Amend 177b3b6 - actually use bufs
diff --git a/services/keep-balance/balance.go b/services/keep-balance/balance.go
index b53d1fd..2d1a59e 100644
--- a/services/keep-balance/balance.go
+++ b/services/keep-balance/balance.go
@@ -225,7 +225,7 @@ func (bal *Balancer) GetCurrentState(c *arvados.Client, pageSize, bufs int) erro
// collQ buffers incoming collections so we can start fetching
// the next page without waiting for the current page to
// finish processing.
- collQ := make(chan arvados.Collection, 1000)
+ collQ := make(chan arvados.Collection, bufs)
// Start a goroutine to process collections. (We could use a
// worker pool here, but even with a single worker we already
-----------------------------------------------------------------------
hooks/post-receive
--
More information about the arvados-commits
mailing list