[arvados] Triggering Keep garbage collection

[George Chlipala]

Peter -

Thanks for the information!

Is there a recommended user to use for the API token?



George Chlipala, Ph.D.
Senior Research Specialist
Research Resources Center
University of Illinois at Chicago

phone: 312-413-1700
email: gchlip2 at uic.edu

On Mon, Feb 13, 2017 at 1:45 PM, Peter Amstutz <peter.amstutz at curoverse.com>
wrote:

> Hi George,
>
> The garbage collection service is called "keep-balance" and is located
> at arvados/services/keep-balance.  It is responsible for both deleting
> unreferenced blocks and rebalancing blocks among storage servers.
>
> Unfortunately it doesn't seems to be properly documented.  It replaces
> an older implementation called "data manager".
>
> Thanks,
> Peter
>
>
> On Mon, Feb 13, 2017 at 2:35 PM, George Chlipala <gchlip2 at uic.edu> wrote:
> > Is there any information about tuning/configuring garbage collection for
> the
> > keep data manager?  Or is garbage collection not yet implemented?
> >
> >
> > George Chlipala, Ph.D.
> > Senior Research Specialist
> > Research Resources Center
> > University of Illinois at Chicago
> >
> > phone: 312-413-1700
> > email: gchlip2 at uic.edu
> >
> > On Thu, Jan 26, 2017 at 11:57 AM, George Chlipala <gchlip2 at uic.edu>
> wrote:
> >>
> >> Is a way to trigger the keep data manager to perform garbage collection
> or
> >> if it is possible to know/modify the garbage collection cycle?
> >>
> >> We were performing a deletion test from within arvados to see if the
> keep
> >> would delete blocks that are no longer used.  We had uploaded new data
> and
> >> saw that the disk usage for the keep store had increased by 8GB.
> However,
> >> when we deleted the collection from the arvados workbench, we did not
> see
> >> the disk usage decrease by the same amount.  Between the adding and
> deletion
> >> we did not upload any additional data that might reference the new
> blocks as
> >> well, so I would expect that the keep store should release that space.
> >>
> >> Any help in this matter would be greatly appreciated.
> >>
> >> Thanks!
> >>
> >> George Chlipala, Ph.D.
> >> Senior Research Specialist
> >> Research Resources Center
> >> University of Illinois at Chicago
> >>
> >> phone: 312-413-1700
> >> email: gchlip2 at uic.edu
> >
> >
> >
> > _______________________________________________
> > arvados mailing list
> > arvados at arvados.org
> > http://lists.arvados.org/mailman/listinfo/arvados
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.arvados.org/pipermail/arvados/attachments/20170213/6eb69894/attachment.html>