[arvados] Triggering Keep garbage collection

[Peter Amstutz]

Hi George,

The garbage collection service is called "keep-balance" and is located
at arvados/services/keep-balance.  It is responsible for both deleting
unreferenced blocks and rebalancing blocks among storage servers.

Unfortunately it doesn't seems to be properly documented.  It replaces
an older implementation called "data manager".

Thanks,
Peter


On Mon, Feb 13, 2017 at 2:35 PM, George Chlipala <gchlip2 at uic.edu> wrote:
> Is there any information about tuning/configuring garbage collection for the
> keep data manager?  Or is garbage collection not yet implemented?
>
>
> George Chlipala, Ph.D.
> Senior Research Specialist
> Research Resources Center
> University of Illinois at Chicago
>
> phone: 312-413-1700
> email: gchlip2 at uic.edu
>
> On Thu, Jan 26, 2017 at 11:57 AM, George Chlipala <gchlip2 at uic.edu> wrote:
>>
>> Is a way to trigger the keep data manager to perform garbage collection or
>> if it is possible to know/modify the garbage collection cycle?
>>
>> We were performing a deletion test from within arvados to see if the keep
>> would delete blocks that are no longer used.  We had uploaded new data and
>> saw that the disk usage for the keep store had increased by 8GB.  However,
>> when we deleted the collection from the arvados workbench, we did not see
>> the disk usage decrease by the same amount.  Between the adding and deletion
>> we did not upload any additional data that might reference the new blocks as
>> well, so I would expect that the keep store should release that space.
>>
>> Any help in this matter would be greatly appreciated.
>>
>> Thanks!
>>
>> George Chlipala, Ph.D.
>> Senior Research Specialist
>> Research Resources Center
>> University of Illinois at Chicago
>>
>> phone: 312-413-1700
>> email: gchlip2 at uic.edu
>
>
>
> _______________________________________________
> arvados mailing list
> arvados at arvados.org
> http://lists.arvados.org/mailman/listinfo/arvados
>