[arvados] Arvados 2.4.0 released

[peter.amstutz at curii.com]

Hello ,

The Arvados team is pleased to announce Arvados 2.4.0. This is a major
upgrade, with many new features as well as bugfixes. We recommend that new
and existing installations of 2.3.3
<https://www-dev.arvados.org/release-notes/2.3.3> or earlier upgrade to
2.4.0. See Upgrading Arvados
<https://doc.arvados.org/v2.4/admin/upgrading.html> for upgrade
instructions.
New Features <https://www-dev.arvados.org/release-notes/2.4.0/#new-features>
NVIDIA
CUDA GPU support
<https://www-dev.arvados.org/release-notes/2.4.0/#nvidia-cuda-gpu-support>

Arvados now supports running compute containers with access to NVIDA CUDA
GPUs. Once GPU instance dispatch has been configured (as described in
the support
for NVIDIA CUDA GPUs
<https://doc.arvados.org/v2.4/admin/upgrading.html#v2_4_0_nivida>) GPUs can
be requested using the cwltool:CUDARequirement
<https://doc.arvados.org/v2.4/user/cwl/cwl-extensions.html#CUDARequirement>
CWL extension.
Crunch-run colocated Keepstore
<https://www-dev.arvados.org/release-notes/2.4.0/#crunch-run-colocated-keepstore>

Arvados now supports running a dynamic instance of Keepstore on the same
node as the compute container. This should result in better performance and
scaling, as read and write requests for Keep blocks no longer need to be
routed through separate dedicated Keepstore nodes but instead will be
communicate with the underlying storage system (e.g. S3 or NFS) directly.
See dedicated keepstore process for each container
<https://doc.arvados.org/v2.4/admin/upgrading.html#v2_4_0_keepstore> for
details.
Frozen Projects
<https://www-dev.arvados.org/release-notes/2.4.0/#frozen-projects>

It is now possible to freeze a project
<https://doc.arvados.org/v2.4/api/methods/groups.html> to disallow any
modifications to a project or anything contained within it. This is
currently only available through the API, Workbench support for frozen
projects will be added in the near future.
Groups now visible to all users by default
<https://www-dev.arvados.org/release-notes/2.4.0/#groups-now-visible-to-all-users-by-default>

Groups are now visible to all users by default. This makes it possible to
share a project with a group of which you are not a member. The previous
behavior (only able to share with groups whom you are also a member) can be
configured by setting Users.RoleGroupsVisibleToAll: false.
New API for manipulating collection contents
<https://www-dev.arvados.org/release-notes/2.4.0/#new-api-for-manipulating-collection-contents>

The Collection create and update APIs now support a replace_files
<https://doc.arvados.org/v2.4/api/methods/collections.html#replace_files>
parameter which enables efficiently copying individual files and directory
trees from other collections, and copying/renaming/deleting items within an
existing collection, with a single API transaction.
Improved arv-mount and arv-get performance
<https://www-dev.arvados.org/release-notes/2.4.0/#improved-arv-mount-and-arv-get-performance>

Software using the Arvados Python SDK, including arv-mount and arv-get, are
now likely to see 2-3x improved download performance as a result of
improvements to the pre-fetch feature of the SDK, enabling parallel block
downloads by default.
Improved support for preemptible instances
<https://www-dev.arvados.org/release-notes/2.4.0/#improved-support-for-preemptible-instances>

Users can now control the use of preemptible (spot) instances at the level
of individual workflows
<https://doc.arvados.org/v2.4/user/cwl/cwl-run-options.html#preemptible>
or workflow
steps
<https://doc.arvados.org/v2.4/user/cwl/cwl-extensions.html#UsePreemptible>.
Preemptible instance types are also easier to configure
<https://doc.arvados.org/v2.4/admin/spot-instances.html>.
Improved support for metadata vocabularies
<https://www-dev.arvados.org/release-notes/2.4.0/#improved-support-for-metadata-vocabularies>

The Arvados Python SDK now supports client-side translation between metadata
vocabulary <https://doc.arvados.org/v2.4/admin/metadata-vocabulary.html>
terms and human-readable labels and aliases. Examples can be found in the code
cookbook. <https://doc.arvados.org/v2.4/sdk/python/cookbook.html>

The arvados-server config-check command now provides improved error
messages if the vocabulary contains problems (such as ambigious/conflicting
aliases for terms).
Improved virtual machine management interface in Workbench 2
<https://www-dev.arvados.org/release-notes/2.4.0/#improved-virtual-machine-management-interface-in-workbench-2>

Workbench 2 now features an improved admin management interface for virtual
machines (arvados-managed shell nodes) that makes it easy to add, edit,
list, and remove shell accounts on each shell node.
New group management interface in Workbench 2
<https://www-dev.arvados.org/release-notes/2.4.0/#new-group-management-interface-in-workbench-2>

Workbench 2 now features a new “Groups” management interface enabling users
to

   - create, list, and delete user groups on the Arvados instance
   - add, list, and remove members of permission groups
   - list, edit, and remove permissions granted to a group

Improved user management interface in Workbench 2
<https://www-dev.arvados.org/release-notes/2.4.0/#improved-user-management-interface-in-workbench-2>

Workbench 2 now features improved User management, including the ability to
see and edit what groups an individual user belongs to.
Bug fixes <https://www-dev.arvados.org/release-notes/2.4.0/#bug-fixes>

#18865 <https://dev.arvados.org/issues/18865>

Non-admin users can now correctly manage permission links on objects that
are not users or groups.


Thanks,

The Arvados Team
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.arvados.org/pipermail/arvados/attachments/20220408/5606b7c6/attachment.html>