[ARVADOS] updated: b9b1b04f50fbc0b8539c641662bed152c94165ea

Git user git at public.curoverse.com
Wed Jun 15 10:53:04 EDT 2016


Summary of changes:
 services/keep-balance/balance.go |  2 +-
 services/keep-balance/usage.go   | 13 +++++++++++++
 2 files changed, 14 insertions(+), 1 deletion(-)

       via  b9b1b04f50fbc0b8539c641662bed152c94165ea (commit)
       via  a41e0fdc1a84f1cda78626ed81f6da4aa299937c (commit)
      from  177b3b66c3e876a5e1665e6067309fb15cabdf83 (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.


commit b9b1b04f50fbc0b8539c641662bed152c94165ea
Author: Tom Clegg <tom at curoverse.com>
Date:   Wed Jun 15 10:53:01 2016 -0400

    9395: Explain CollectionBatchSize and CollectionBuffers in -help message.

diff --git a/services/keep-balance/usage.go b/services/keep-balance/usage.go
index 2273f3a..b521c65 100644
--- a/services/keep-balance/usage.go
+++ b/services/keep-balance/usage.go
@@ -73,6 +73,19 @@ Committing:
     Use the -commit-pull and -commit-trash flags to implement the
     computed changes.
 
+Tuning resource usage:
+
+    CollectionBatchSize limits the number of collections retrieved per
+    API transaction. If this is zero or omitted, page size is
+    determined by the API server's own page size limits (see
+    max_items_per_response and max_index_database_read configs).
+
+    CollectionBuffers sets the size of an internal queue of
+    collections. Higher values use more memory, and improve throughput
+    by allowing keep-balance to fetch the next page of collections
+    while the current page is still being processed. If this is zero
+    or omitted, pages are processed serially.
+
 Limitations:
 
     keep-balance does not attempt to discover whether committed pull

commit a41e0fdc1a84f1cda78626ed81f6da4aa299937c
Author: Tom Clegg <tom at curoverse.com>
Date:   Wed Jun 15 10:39:40 2016 -0400

    9395: Amend 177b3b6 - actually use bufs

diff --git a/services/keep-balance/balance.go b/services/keep-balance/balance.go
index b53d1fd..2d1a59e 100644
--- a/services/keep-balance/balance.go
+++ b/services/keep-balance/balance.go
@@ -225,7 +225,7 @@ func (bal *Balancer) GetCurrentState(c *arvados.Client, pageSize, bufs int) erro
 	// collQ buffers incoming collections so we can start fetching
 	// the next page without waiting for the current page to
 	// finish processing.
-	collQ := make(chan arvados.Collection, 1000)
+	collQ := make(chan arvados.Collection, bufs)
 
 	// Start a goroutine to process collections. (We could use a
 	// worker pool here, but even with a single worker we already

-----------------------------------------------------------------------


hooks/post-receive
-- 




More information about the arvados-commits mailing list