[ARVADOS] created: 2.3.0
Git user
git at public.arvados.org
Wed Oct 27 13:53:05 UTC 2021
at 506708711d7c7fbe041a1d063d85ce0136662d9d (tag)
tagging 067a68b5e9dfa1c7d5e68fd64553e0ced89cad36 (commit)
replaces 2.1.0
tagged by Peter Amstutz
on Wed Oct 27 09:49:30 2021 -0400
Arvados 2.3.0
Major Features
--------------
* Initial LSF support
This new release adds support for dispatching containers to Spectrum
LSF clusters, allowing the integration of Arvados to additional HPC
environments.
For more information please check our documentation page.
* Initial Singularity support
This major release adds initial support for running containers with the Singularity Runtime.
We’ve tested this version against Singularity 3.7.4. For more information please check the documentation.
* Improved Storage Classes support
This release features expanded support for storage classes. Storage
classes enable clients to control which storage backend volumes are
used to store data associated with each collection. This makes it
possible to manage heterogenous storage with different
performance/price/capacity/robustness characteristics.
Arvados applications now support uploading data directly to specific
storage classes. This is described in the the user guide. If a storage
class is not specified, it will use the default storage classes
assigned by the administrator.
Keepstore services now parallelize data write operations when a data
block is assigned to multiple storage classes. The administrator can
also prioritize which storage classes are preferred for read
operations. Please refer to the admin documentation for more
information.
Improvements
------------
* Workbench2 Webshell
Workbench2 now integrates the browser-based shell node access on its
own instead of redirecting to the older Workbench1. This includes
support for session auto-logout.
* Workbench2 collection’s file browser
The new collection file browser allows navigating through more
significant collections faster by loading partial file listings on
demand instead of requesting the entire collection at once. This is
most noticeable on collections with many directories and/or files.
* Group-sync tool improvements
This release’s group syncing tool arvados-sync-groups allows case insensitive username matching as described on the admin guide.
* Collection manifest handling
Collection manifest signing performance and caching are notably
improved. This will be most noticeable when dealing with really big
data collections.
Other changes
-------------
* Workbench2 fixes
The pagination display now works correctly when showing empty
tables. Upload speed indication is now fixed showing MB/s instead of
KB/s.
* Data access fixes
WebDAV caching fix improves performance on huge collections. Fixed
occasional mount point deadlock bugs in the PySDK FUSE
driver (arv-mount).
* Deprecated database indexes
Removed deprecated full text search database indexes. These were
unused and sometimes interfered with creating collections with very
large numbers of files and directories.
* Error reporting fixes
Request-ID propagation fixes improve error traceability and
debugging. Keepproxy spurious 413 error fix avoids future debugging
confusion.
* Python SDK fixes
Fixed the socket read timeout issues on collection create
calls. Upgraded python-rsa dependency to address the security advisory
CVE-2020-13757. Upgraded ruamel.yaml & google-api-python-client
dependencies that were causing issues to some users.
* Misc fixes
Cached user records handling in a satellite cluster auto-resolves
username collisions. Removed unused users#update_uuid endpoint. Fixed
container locking issue & improved logging on dispatcher.
Javier Bértoli (125):
feat(salt): start salt install documentation
fix(salt): temporal fix for database setup issue
fix(salt): choose repo
feat(docs): salt install documentation
feat(provision): example configurations in salt
feat(provision): better testing config and documentation
docs(provision): document initial URL
docs(salt): some minor fixes in the Salt-based installation documentation.
Merge branch '16471-install-using-salt' into master
fix(crunch-dispatch-local): add missing service file
feat(crunch-dispatch-local): add crunch-run dependency
Merge branch '16996-add-dispatch-local-service-file' into master
feat(centos): use centos-provided python3
Merge branch '17047-centos-remove-rh-python-dependencies' into master
Fix salt-install and test scripts
fix(docker): formula upgraded
fix(test): wrong variable comparison
Merge branch '17150-system-root-token'
Merge branch 'pvanheus-fix_cluster_test' from github.com/pvanheus:fix_cluster_test
fix(docs): broken link
fix(provision): Add a CA and sign certificates with it
fix(provision): Document CA certificate purpose and installation
fix(provision): pin formulas' versions
fix(provision): add port to workbench2 nginx's stanza
fix(provision): pin arvados-formula
fix(provision): update arvados-formula's version
Merge branch '17177-use-newly-created-ca'
Update the provision script to use the new arvados-formula
Merge branch '17218-update-apt-repos'
fix(tools): remove compute-images scripts' unused parameters
Merge branch '17338-clean-compute-images-scripts'
Documentation: Explain that the canonical salt installer is hosted in Arvados' github account
feat(provision): allow to install individual roles
feat(provision): manage setup params from local file
feat(provision): refactor to add other setup examples
feat(provision): refactor to add other setup examples
feat(provision): check the cluster name provided is exactly 5 chars long
feat(provision): refactor to manage different infrastructure configurations
fix(provision): refactor single host architectures
fix(provision): add missing postgres dependency for arvados-api-server
fix(provision): check salt-call is installed
fix(provision): remove deprecated parameter
fix(provision): add only specific pillars for each role
fix(provision): make the salt-call binary check compatible with sh
fix(provision): add missing roles sections
refactor(provision): naming consistency
fix(compute-images): wait for apt/dpkg locks to be released
fix(compute-images): upgrade python-arvados-fuse to py3
fix(compute-images): remove unneeded code
Merge branch '17435-compute-images-changes'
fix(compute-images): make resolver setting optional
fix(compute-images): add resolver variable to json files
fix(compute-images): fix sed invokation
Merge branch '17438-compute-images-script-fixes'
fix(provision): force user to properly set cluster & domain parameters
fix(compute-images): wait for apt/dpkg locks to be released
fix(compute-images): upgrade python-arvados-fuse to py3
fix(compute-images): remove unneeded code
fix(compute-images): make resolver setting optional
fix(compute-images): add resolver variable to json files
fix(compute-images): fix sed invokation
fix(fpm,packaging): add arvados-api-server's postgresql-client dependency
Merge branch '17352-arvados-api-server-dependency'
fix(provision): improve single host installation and documentation
fix(provision): add multi hosts installation examples
docs(provision): add salt usage with roles in multi-host
fix(provision): use nginx-formula PR branch until changes are merged
feat(provision): add local.params example for multi-host
fix(provision): temp fix for nginx formula issue with snippets
fix(provision): use uniform database parameters across examples
chore(provision): set postgresql cidr in single host examples
fix(provision): run hosts/snakeoil states before nginx so it does not fail on missing deps
refactor(provision): use uniform database parameters across examples
chore(provision): ignore some files in git
refactor(provision): delete parameters moved to config files
feat(provision): add some checks before run
docs(provision): explain options in config examples
chore(provision): enable both examples in vagrant
refactor(provision): add host entries in single host multiple hostnames
docs(provision): improve the documentation in the examples
refactor(provision): add snakeoil certs in single host multiple hostnames
docs(provision): improve the documentation in the examples
fix(provision): default to using the master branch of arvados-formula
feat(provision): pin arvados version to latest stable
Merge branch '17246-salt-install-improvements'
fix(provision): remove unneeded vagantfile
Merge branch '17570-remove-extra-example-agrantfile'
fix(provision): don't install docker-compose
fix(provision): prevent bash globbing issues with empty dirs
Merge branch '17606-file-globbing-issues'
feat(provision): use LE wildcard cert for *.collections
Merge branch '17604-change-collections-urls'
feat(provision): add AWS credentials for letsencrypt
17603: Enable webshell role pillars in provision script
17603: Reorder example IPs so they match the documentation
17603: Separate shell's IP from webshell's
17605: allow to use a IAM user for letsencrypt
17603: Webshell is just a nginx vhost
17605: Inverse logic
17605: Wildcard needs to be quoted in yaml
17605: Update LE collections requirement in nginx
Merge branch '17605-letsencrypt-credentials-for-route53'
Merge branch '17603-nginx-webshell-vhost-fix'
feat(provision): moved the arvados-formula to Arvados.org
Merge branch '17743-use-git-arvados-org-for-provision'
17823: change references back to saltstack-formulas' nginx formula
Merge branch '17823-use-saltstack-formulas-nginx-formula'
17812: Organize and extend installation documentation
Merge branch '17812-provisioning-documentation-improvement'
17821: Add a parameter to provision.sh to dump the configuration
Merge branch '17821-provision-dump-config-parameter'
17535: Modify provision script to run on Centos
Some more Centos required tweaks to the provision script.
The user's `api_client_authorization` token can't be obtained using filters
Adapt the provision scripts to manage Centos 7 too
Don't force the ruby version in the examples
Fix nginx_passenger parameters for Centos-7 and Ubuntu-18.04
Make Saltstack fail on first error
Disable SELinux on Centos-7 platform
Merge branch '17535-test-provision-jenkins'
18248: edit provision's snakeoil cert for ubuntu-18.04
18248: enable debug for cwl-runner in tests
18248: Ensure the OS-provided postgres packages are used in Debian's family
18248: update comment addressing review suggestions
Merge branch '18248-fix-ubuntu-18.04-testing'
Lucas Di Pentima (200):
16718: Adds 'include_old_versions' param to groups#content.
16471: Includes saltstack quick start section on install guide.
16981: Fixes error reporting when failing to create a remote group.
16718: Merge branch 'master' into 16718-group-contents-collection-versions
Merge branch '16981-sync-group-report-fix'. Refs #16981
16718: Adds tests for new param on groups#content.
16471: Formatting fixes.
16718: Merge branch 'master' into 16718-group-contents-collection-versions
Merge branch '16718-group-contents-collection-versions'. Refs #16718
16750: Avoids using params on requests to make it compatible with federation.
17152: Fixes old collection versions' modified_at handling and test.
17152: Publishes the arvbox WebDAV download port.
17152: Adds migration to fix collection versions' modified_at timestamps.
Merge branch '17152-collection-versions-fixes'
17152: Updates API revision number.
17152: Updates collection tests to reflect the new behavior.
17152: Changes preserve_version semantics, updates related documentation.
17152: Avoids creating audit logs when only 'preserve_version' is updated.
17152: Moves conditional preserve_version disabling to collection's controller.
17152: Improves modified_at conditional update check.
Merge branch '17152-collection-preserve-version-changes'
17118: Changes the way exception raising is done on PySDK's KeepWriterThread.
Merge branch '17118-arvput-fix'
16981: Extracts test federation building code to the arvadostest package.
Fixes a couple of typos on the documentation. No issue #.
16981: Adds federation test on sync-groups.
16981: Removes config loader code to fix import cycle.
16981: Removes the import cycle issue by moving code to lib/boot.
17109: Adds notes about Keep-web Same-Site restrictions.
Merge branch '16981-logincluster-sync-groups-tests'
17109: Explains how keep-web handles requests with tokens in the URL.
17109: Fixes typo.
Merge branch '17109-keepweb-urls-samesite-doc'
17256: Makes arvados-server install to ask for node v10.x
17256: Changes required nodejs version on package building scripts.
Merge branch '17256-nodejs-dependency-update'
16736: Enhances tests about login issued tokens.
16736: Adds API.MaxTokenLifetime config knob.
16736: Limit token's expires_at depending on the cluster config and user type.
16736: Fixes typo.
16736: Updates arvados-login-sync to support expiring tokens.
16736: Replaces Time.now with db_current_time on token expiration handling code.
16736: Simplifies conditionals.
16736: Adds tests to confirm expires_at gets properly set on runtime tokens.
17295: Adds tests exposing the bug.
17295: Adds cluster ID validation on the config file.
Merge branch '16736-max-token-lifetime'
Merge branch '17295-configured-cluster-ids-validation'
16736: Enhances tests about login issued tokens.
16736: Adds API.MaxTokenLifetime config knob.
16736: Limit token's expires_at depending on the cluster config and user type.
16736: Fixes typo.
16736: Updates arvados-login-sync to support expiring tokens.
16736: Replaces Time.now with db_current_time on token expiration handling code.
16736: Simplifies conditionals.
16736: Adds tests to confirm expires_at gets properly set on runtime tokens.
17295: Adds tests exposing the bug.
17295: Adds cluster ID validation on the config file.
17476: Updates rails related gems.
Merge branch '17476-railsapi-security-updates'
16159: Expires token after logout (WIP)
Merge branch 'master' into 16159-token-expiration-on-logout
16159: Makes test login form to autofocus on username field.
16159: Attempts to expire the user's token getting it from the context. (WIP)
16159: Validates token uuid & secret before expiring.
17508: Exposes bug with a test.
17508: Fixes arv-keepdocker bug.
17508: Fixes unit test.
Merge branch '17508-arvkeepdocker-fix'
16159: Adds error logging on token expiration failure. Fixes SQL query.
16159: Pass token to expire to controller on logout.
16159: Expires tokens on logout on different login controllers.
16159: Adds tests checking token expiration at logout.
16159: Merge branch 'master' into 16159-token-expiration-on-logout
Merge branch '16159-token-expiration-on-logout'
17522: Exposes bug through test. Also fixes help message.
17522: Fixes bug, corrects updated test's assertion.
Merge branch '17522-arvput-stdin-transcode-fix'
17171: Exposes bug with a test.
17171: Fixes the bug by removing the default timeout value.
17171: Merge branch 'master' into 17171-pysdk-timeout-fix
17171: Sets default timeout on arvados.api() to 10 seconds.
Merge branch '17171-pysdk-timeout-fix'
17465: Adds storage classes support to PySDK put().
17711: Upgrades nokogiri on railsAPI & workbench1
Merge branch '17711-nokogiri-upgrade'
17738: Fixes the issue by strip!()ing a mutable version of OS_VERSION.
Merge branch '17738-frozen-string-error'
17465: Adds storage classes tracking and old cluster support.
17465: Adds tests for class storage support.
17465: Adds KeepClient storage classes support to Collection class.
17465: Adds tests confirming KeepClient storage support on Collection.
17465: Synchronizes storage classes data between Collection & BlockManager.
17465: Collection.save() adds storage_classes_desired when set on instance.
17465: Don't repeat warnings when storage classes aren't supported.
17465: Fixed tests and made the suite less noisy.
17351: Adds support for storage classes while writing blocks to Keep.
Merge branch '17465-pysdk-storage-classes-support'
17799: Upgrades API & Workbench rails to 5.2.6
Merge branch '17799-rails-upgrade-5.2.6'
Merge branch '17351-arvput-keepclient-storage-support'
17800: Exposes bug on test.
17800: Fixes bug.
17800: Improves help message. Shows warnings when ignoring given paths.
17800: Avoids saving a new empty collection.
Merge branch '17800-arvput-no-follow-links'
17389: Adds X-Keep-Storage-Classes-Confirmed header to responses on success.
17572: Adds documentation related to storage classes.
17572: Adds support for storage classes on new collections.
17572: Adds tests.
17572: Fixes failing test.
17572: Merge branch 'master' into 17572-arvmount-storage-classes
17389: Adds clarifying comment.
Merge branch '17389-keepproxy-storage-classes-confirmed'
Merge branch '17572-arvmount-storage-classes'
17833: Catches KeepWriteError exceptions to avoid displaying stacktraces.
Merge branch '17833-arvput-cleaner-errors'
17782: Updates nodejs to v12, as required by workbench2.
Merge branch '17782-nodejs-update' into main
17913: Upgrades 'addressable' gem to 2.8.0
Merge branch '17913-addressable-upgrade' into main. Closes #17913
17573: Exposes storage classes for every configured volume.
17573: Adds test storage classes to arvados-server test mode.
Merge branch '17573-export-storage-classes' into main. Refs #17573
17830: Adds test exposing incorrect X-Request-Id format on railsAPI.
17830: Customizes ActionDispatch::RequestId middleware to our needs.
17830: Adds controller tests exposing the X-Request-Id header propagation bug.
17830: Sets up X-Request-Id if not provided by client. Adds it to the response.
17830: Copies request's X-Request-Id header to response. Moves tests.
16665: Exposes bug through updated test.
16665: Wraps error type to be able to differentiate it in a case switch.
16665: Fixes tests.
17388: Adds storage classes support to arv-copy.
Merge branch '17388-arvcopy-storage-classes' into main. Closes #17388
Merge branch '16665-keepproxy-spurious-413-status' into main. Closes #16665
17830: Adds test cases & fixes one more issue.
17830: Moves header setting code to cover more use cases.
Merge branch '17830-reqid-header-propagation-fix' into main. Closes #17830
17936: Adds --batch argument to arv-put, updates test.
17936: Adds --batch implementation, making the new test pass.
17936: Updates arv-keepdocker to call arv-put with --batch argument.
Merge branch '17936-arvput-batch-mode' into main. Closes #17936.
18005: Exposes the bug by simulating a keep-balance run a making a new version.
18005: Fixes the bug.
Merge branch '18005-collection-versioning-regression' into main. Closes #18004
18004: Adds test exposing the race condition.
15430: Removes support for the '@@' full text search operator.
15430: Updates wb1 test so that it exercises the ilike operator instead of @@
15430: Fixes updated wb1 test that was migrated from using '@@' to 'ilike'.
15430: Drops FTS indexes, removes unneeded test.
15430: Adds an upgrade note warning that @@ won't work anymore.
17948: First working implementation (WIP)
17948: Optimizes tool to stop adding data to a big enough manifest.
17948: Fixes conditional.
17948: Splits adjectives & nouns list into multiple lines.
17948: Adds arguments to allow specifying how many subdirs to create.
17948: Adds info to error messaging.
18004: Fixes a couple of race condition bugs related to caching remote users.
15430: Improves upgrade notes.
Merge branch '15430-fts-operator-removal' into main. Closes #15430
Merge branch '18004-cached-token-race-condition' into main. Closes #18004
Merge branch '17948-test-collection-tool' into main. Closes #17948
17696: KeepClient uses default storage classes when none is required explicitly
17696: Updates docstring on arvados.Collection class.
17696: Updates API documentation adding storage_classes_* fields.
Merge branch '17696-pysdk-default-storage-class' into main. Refs #17696
17696: Adds ArvadosClient.ClusterConfig() to get the exported cluster's config.
17696: Adds default storage classes config loading to KeepClient, with tests.
17696: Moves default storage classes loading to keepclient.New().
17696: Updates tests to check for backwards compatibility.
Merge branch '17696-gosdk-default-storage-class' into main. Closes #17696
18076: Adds test exposing the issue.
18076: Fixes the bug, expands the test with additional checks.
18076: Improves test.
Merge branch '18076-stale-cached-users-handling' into main. Closes #18076
18094: Updates documentation, adding an upgrade note.
18094: Removes update_uuid from GoSDK & controller.
18094: Removes update_uuid code & tests from railsAPI.
18094: Removes update_uuid from the R SDK.
18076: Expands test case exposing a related issue with users with a repository.
18076: Fixes the bug by assigning a different (and random) username.
Merge branch '18076-user-cache-with-repository' into main. Closes #18076
Merge branch '18094-update-uuid-endpoint-removal' into main. Closes #18094
17989: Adds test exposing the problem.
17989: Passes the given timeout value to api_from_config()
17989: Reduces the manifest size limit so that it doesn't fail on extreme cases
Merge branch '17989-pysdk-timeout' into main. Refs #17989
17989: Reverts default PySDK timeout to 5 minutes. Updates test.
Merge branch '17989-revert-pysdk-default-timeout' into main. Closes #17989
18126: Unpins python-rsa since python2 support is no longer needed.
Merge branch '18126-unpin-python-rsa' into main. Closes #18126
18097: Accept '-case-insensitive' flag on sync-groups. Adds test.
18097: Adds logic for the "-case-insensitive" flag. Makes new test pass.
18097: Adds more tests.
Merge branch '18097-sync-groups-case-insensitive' into main. Closes #18097
18051: Adds SignManifest benchmarking test.
Fixes the 'branchname' variable setting used on salt doc pages. Refs #18130
18097: Updates arvados-sync-groups doc page.
Merge branch '18097-sync-groups-doc' into main. Refs #18097
Pin arvados 2.3.0 version in provision.sh. Refs #18130
Michael R. Crusoe (2):
SSLHandshakeError is Python 2 only refs #17008
Link to the coding standards
Nico Cesar (21):
17014: controller handles container requests
addressing https://dev.arvados.org/issues/17014#note-41
Merge branch '17014-controller-container-requests-take3'
Doc update: Arvados 2.1 is not compatible with cgroups V2.
Merge branch '17271-doc-cgroupv2'
Changed 'api' -> 'API in runtime_constraints
fixed test for 17299
doc: clarification about proxy flag
Merge branch '16974-remote-clusters-and-activate-users-doc-take2'
Merge branch '17299-uppercase-api'
Changed 'api' -> 'API in runtime_constraints
fixed test for 17299
Added note about /bin/false as UNIX login
Merge branch '17312-doc-PAM-nologin'
Added note about /bin/false as UNIX login
17530: Added check if API host is missing
Merge branch '17530-arvados-client-fastfail-take2'
SSO deprecation in documentation
Merge branch '17651-sso-deprecated'
OIDC given name / family name fields support
Merge branch '17748-extra-claims-take2'
Peter Amstutz (295):
16982: OS packages build as ~devN, Python and Ruby use .devN
Fix heading for "upgrading" no issue #
Merge branch '16982-tilde-devN' refs #16982
Separate inline/download keep-web ports refs #16812
Add WebDAV and S3 API documentation
Collection$create returns (vector of) ArvadosFile object
17010: Redesign "Re-run..." button to choose project to run in
17010: When running workflow from workbench, enable reuse by default
17010: Fix debug comment
17010: Fix tests
17010: Fix tests. Tests check that --enable-reuse is set
17010: Don't double up --enable-reuse
17010: Use !! instead of (? true : false)
Merge branch '17010-re-run-workflow' refs #17010
17040: Swap the order of where clauses in the readable_by query
17040: Refactor trash check
17040: Get user_uuids and embed them as a constant in the main query
17040: Cache results of User.group_permissions
17040: RefreshTrashedGroups migration, clear_permissions calls forget_cached_group_perms
17040: Update structure.sql
Merge branch '17040-slow-query' refs #17040
17090: Use EXCLUSIVE lock for permission updates
17090: Migration to refresh_permissions
Merge branch '17090-exclusive-lock' refs #17090
17022: Start work on user activity reporting script
17022: Produce user activity report from the audit logs
17022: Specify time period in days on command line.
17022: Python packaging for arv-user-activity
17022: Make this a fully packaged tool.
17022: Fix packaging
17015: Ensure that containers belong to this cluster
Merge branch '17015-cds-correct-containers' refs #17015
17154: Make sure most current user record is loaded.
17154: Copy updates on federated users to local cluster
16774: Keep-web errors include messages
17154: Add comment. Use strings.HasPrefix
Merge branch '17154-wb-profile' refs #17154
16774: Fix tests. Use encoder for xml error response.
16774: text/plain response uses crlf. Tests check error codes.
17022: Improve output. Added documentation page.
17022: Add test cases for keyset_list_all
17022: Add example usage of keyset_list_all to code cookbook.
17072: Bump cwltool version for unbound 'result' fix
17072: Fix imports. Use task_queue from cwltool.
17072: Increase default submit thread concurrency to 4
17072: Fix for added args on cwltool.docker.get_image
Merge branch '16774-keep-web-errors' refs #16774
17022: Update install docs & fix Marc's email.
Merge branch '17022-user-activity-report' refs #17022
Merge branch '17072-update-cwltool' refs #17072
17224: Fix to have multiple clients connected to separate clusters
17224: Provide alternate credentials to use for creating user tokens
Merge branch '17225-ruby-sdk' refs #17225
17224: Document LoginCluster configuration for login-sync
Merge branch '17224-login-sync' refs #17224
17267: Don't immediately fail if an extension schema is missing
17267: Add integration test for broken link in $schemas
Merge branch '17267-broken-schema-links' refs #17267
17286: Log clickable URL to container request in workbench
17286: URL to final output collection
17286: Tweak output if neither workbench2 or workbench1 is defined
Merge branch '17286-print-urls' refs #17286
Add missing file closes #17281
17293: Update trash_at/deleted_at even on MarshalManifest error
Merge branch '17293-save-logs' refs #17293
17165: Add rake task to copy from arvados-vscode-cwl-training
Update from upstream
17165: Adjust some titles
17165: Update training after going back over it step-by-step
17165: Update vscode training doc
17165: Sync up again
Merge branch '17165-vscode-training-doc' refs #17165
Add missing images refs #17165
Put the missing images in the right place refs #17165
Update vscode training page no issue #
Update cwltool for bug fixes. refs #17213
17165: Add rake task to copy from arvados-vscode-cwl-training
Update from upstream
17165: Adjust some titles
17165: Update training after going back over it step-by-step
17165: Update vscode training doc
17165: Sync up again
Add missing images refs #17165
Put the missing images in the right place refs #17165
Update vscode training page no issue #
Update cwltool for bug fixes. refs #17213
17462: Bump cwltool for scandeps bugfix
17462: Fix fetch_text() signature
17462: Fix tests
Merge branch '17462-default-secondaryfiles' refs #17462
Fix regression refs #17462
17462: Add integration test to confirm fix
Merge branch '17462-secondaryfiles-regression' refs #17462
17521: Add tests, refs #10380 and refs #17521
17521: Use normpath to clean up the path segment.
Merge branch '17521-dot-slash-glob' refs #17521
17598: Handle comparison URLs with :80 or :443
17598: stripDefaultPort behavior, error message when !credentialsOK
Merge branch '17598-keep-web-url' refs #17598
17598: Also use lowercase for URL host comparison
Merge branch '17598-keep-web-url-case' refs #17598
17449: Expand the "token expiration" admin page
17449: Clarifications and edits.
Merge branch '17449-gxp-docs' refs #17449
17589: Ensure that 'group contents' requests are routed correctly
17589: Use more efficient & stable keyset paging.
17589: Disallow offset with group contents count=none
17589: when count=none and offset=0 don't do unnecessary row counts
Merge branch '17589-contents-count-none' refs #17589
Fix integration test closes #17673
17499: Support username/password login on workbench1
17499: Add logo so default WelcomePageHTML works
17499: Adjust formatting. improve error reporting.
17499: Adjust the default welcome page text used by wb1/wb2
17499: Rewrite javascript to pass phantomJS tests
17499: Fixing tests WIP
17499: Fix tests
Merge branch '17499-wb-login-form' refs #17499
17677: Document the "authenticate" endpoint
Merge branch '17677-authenticate-endpoint' refs #17677
Update "supported distributions" table no issue #
Fix case statement for selection of wb1 login UI, refs #17499
17702: Federated lists supports cluster_id parameter
17702: Move check for ClusterID into splitListRequest
Merge branch '17702-wb1-bypass-fed' refs #17702
17703: master branch provision.sh is development install
17703: Salt install docs point to versioned branches to get the scripts.
17703: Be more explicit about package version.
Merge branch '17703-provision-version' refs #17703
17722: Adjust token expiry behavior
17722: Update tests for adjusted MaxTokenLifetime behavior
17722: Tweak tests to be clearer about new behavior
Merge branch '17722-adjust-token-expiry' refs #17722
Need to export ARVADOS_BUILDING_ so arvados_version.py sees them.
Tweak version-at-commit.sh for interim releases (X.Y.Z.A)
17762: Add uuid-dev package
17464: Start by writing the documentation page
17464: Fix config entry
17464: Add upload/download permission checks and logging
17464: Log collection uuid for FileSystem requests
17464: Fix shadowed "sess" variable
17464: Permission/logging testing WIP
17464: Reset database after upload tests
17464: Refactor tests and check that log events are posted
17464: Add upload/download logging and permissions to keepproxy
17464: Fix test.
17464: Activity report lists upload/download events
17464: Update config variables & docs from feedback
17464: Clean up tests
17464: Add tests for paths by /users/ and by PDH
17464: Don't deny or log GET on directories.
17464: Replace cache with LRU cache
17464: Update exported config
17464: Add note about special case involving sharing links
17464: Fix typo in exported config
17464: Unknown user gets "User" permission check instead of failure
17464: keep-web handles cases where user is unknown
17801: Handle glob capture of keep URI with a trailing slash
17464: MakeRESTRouter returns erro instead of panicking
17333: Add check for valid project uuid, with test
Merge branch '17333-cwl-check-project-uuid' refs #17333
17828: Remove bootsnap, which just seems to cause trouble
Merge branch '17801-runtime-outdir' refs #17801
Merge branch '17828-remove-bootsnap' refs #17828
17829: Remove omniauth
17829: Update tests to use 'controller' provider
17829: Fix test
17829: Remove SSO from config, controller, and tests
17829: Remove more SSO-related configuration
17829: Remove additional references to SSO and omniauth
17829: Fix test
17829: Fix test
Merge branch '17829-remove-omniauth' refs #17829
17395: Add output_storage_classes to container and container_request
17395: Add OutputStorageClasses support to crunch-run
17395: Add tests. Don't include storage classes in full text search
17395: Update documentation. Add an additional test.
17464: Couple of doc fixes
Merge branch '17464-download-activity' refs #17464
17395: Update docs for newer storage classes behavior.
17395: Add missing migration file
Merge branch '17395-container-output-storage-class' into main
17858: Add test to reproduce bug
17858: Integration test passes
17858: Add ExpressionTool to classes checked for ids when visiting
17858: Tweak logic to avoid KeyError
Merge branch '17858-cwl-exprtool-defaults' into main refs #17858
Put the default arvados-cwl-runner --thread-count back down to 1.
17879: Default --thread-count=0, upgrade schema-salad
17879: Add test that acr doesn't fail on sbg fields
Merge branch '17879-update-schema-salad' into main refs #17879
Add missing link to "restricting-upload-download" to doc refs #17464
Pin networkx to avoid new version that pulls in scipy/numpy
arvbox uses react-scripts, refs #17782
Fix "wrong bundler" error starting API server in arvbox
Add ARVADOS_BRANCH and WORKBENCH2_BRANCH to arvbox
arvbox docs include a docker image tag
Don't pull arvbox checkouts after clone
Fix "wrong bundler" error starting API server in arvbox
Add ARVADOS_BRANCH and WORKBENCH2_BRANCH to arvbox
arvbox docs include a docker image tag
Don't pull arvbox checkouts after clone
17816: Add --runtime-engine to crunch-dispatch-local and crunch-dispatch-slurm
17816: Make singularity-in-arvbox work
17816: Fix tests
17816: crunch-dispatch-local uses cluster config.
17816: Set the current working directory in the singularity container
17816: Sort bind mounts on singularity command line
Merge branch '17816-singularity-cwd' into main refs #17816
17813: Singularity image caching wip
17813: Upload .sif file to cache project & read it from keep
17813: Handle setting $HOME as a special case
Make singularity suid in arvbox, crunch-dispatch-local runs as user
17813: Fix tests
17813: Change default value of runtime_auth_scopes to []
17813: Refactor singularity image loading / caching / conversion
17813: continue refactor & fix tests
17813: Fix tests
17813: Handle case where the cache collection update fails
17952: Remove links to obsolete "nodes" and "keep disks"
17952: Remove tests for presence of nodes / disks menu item
Merge branch '17952-no-nodes-link' into main closes #17952
17984: validation accepts user uuid in --project-uuid
17984: Improve error reporting a bit
17984: Fix tests
Merge branch '17984-cwl-project-uuid-users' into main
17390: setting intermediate/final storage classes WIP
17390: Use cluster-configured default
17390: Add unit tests for storage classes
17390: Update arvados-cwl-runner docs
17390: Document arv:OutputStorageClass extension
Merge branch '17390-cwl-storage-classes' into main
17983: Fix writable fuse deadlock
Merge branch '17983-fuse-unlock-relock' into main refs #17983
arvbox ensures workbench2 development server doesn't run with HTTPS
17755: Add ensure_unique_name to avoid collisions on creating cache collection
17755: Fix os.Stat
Merge branch '17755-singularity-race' into main refs #17755
Need to match the regex again
18078: Reacquire llfuse lock before populating collection directory
14018: Setting process properties WIP
14018: Setting process properties WIP
18078: Fix tests
Merge branch '18078-reacquire-fuse-lock' into main refs #18078
14018: Add arv:ProcessProperties to all the extension schemas.
14018: Add ProcessProperties to documentation
18024: Add a note about snap packages
17960: Update arv-copy documentation about copying projects
Releases have default version of arvbox to pull
Merge branch '18024-no-docker-snap' into main
17960: Fix example uuid.
Merge branch '17960-arv-copy-projects-doc' into main refs #17960
14018: Add missing file. Remove debug print()
Merge branch '14018-acr-set-container-properties' into main
18002: Updating Python dependencies WIP
18002: Fixes for cwltool update
18002: Remove obsolete extras_require for Python 2
Merge branch '18002-update-python-deps' into main refs #18002
Change upper version bound for ruamel.yaml to <0.18
Revert "Change upper version bound for ruamel.yaml to <0.18"
Adjust version pins on google-auth and ruamel.yaml
18164: Add test for listing permission links
18164: Improve permission query for links
Merge branch '18164-link-perm-read' refs #18164
Add Workbench to arvbox status, no issue #
18238: Update cwltool and schema-salad deps
18238: Add required container_engine parameter to builder
18238: Make backwards compatible when StorageClasses is not in config
18238: Check API version before using output_storage_classes
18238: Fix API revision check
18238: Arvbox Singularity / Docker updates wip
18238: Update tests to use newer arvados/jobs image
18238: Make sure to pull default image
Merge branch '18238-update-cwltool' refs #18238
Fix CWL tests refs #18238
Add Workbench to arvbox status, no issue #
18238: Update cwltool and schema-salad deps
18238: Add required container_engine parameter to builder
18238: Make backwards compatible when StorageClasses is not in config
18238: Check API version before using output_storage_classes
18238: Fix API revision check
18238: Update tests to use newer arvados/jobs image
18238: Make sure to pull default image
Fix CWL tests refs #18238
Fix setting HOME on singularity. Fix a-c-r secondaryFiles.
Merge branch '18238-containers-in-arvbox' refs #18238
18238: Another try at Singularity $HOME fix
Merge branch '18238-singularity-home' refs #18238
Remove the failing pre-build (--only-deps) step for crunch
arvbox fix, keepstore is part of arvados-server now
Fix CWL tests mixed_version_v10_wf and command_input_file_expression
Use docker inspect instead of iterating over images list
18260: Update cwltool for fix for integration test 35
18260: Update when we're going to actually run the workflow
Merge branch '18260-update-cwltool' refs #18260
Peter van Heusden (2):
Fix salt-install's crunch-dispatch-local config and tests
Fix hardcoded initial user name and email
Stephen Smith (2):
15159: Export TrustAllContent for use in wb2
Merge branch '15159-export-trustallcontent' into main. Closes #15159
Tom Clegg (467):
16306: Add automatic install page.
16306: Add "install -type package" and "buildpackage".
16306: Sync bundler version to services/api/Gemfile.lock.
16306: Packaging dev cycle, type=production support in lib/boot.
16306: Show logprefix like 'passenger at railsapi'
16306: Add hostname as subjectAltName.
16306: Option to start shell in docker-boot.sh.
16306: Fixup nginx in arvados-boot production mode.
16306: Include wwwtmp dir in package.
16306: Fix nginx port probe.
16306: Set Workbench1 secret key.
16306: Add "ping" health check to keep-balance.
16306: Update gem command line option spelling.
16306: Add --os argument to package build scripts.
16306: Merge branch 'master'
16669: Move fake OIDC provider to arvadostest pkg.
16669: Accept OIDC access token in lieu of arvados api token.
16669: Give LoginCluster a chance to validate bare (non-v2) tokens.
16669: Accept OIDC access token in RailsAPI auth.
16669: Set expiry time when inserting new access token record.
16669: Fix nil pointer dereference.
16669: Fix use of timestamp in local timezone.
16669: Test access tokens in federation scenario.
16669: Fix access token cache panic.
16669: Fix pass-through of cached remote token.
16669: Fix test.
Merge branch '16669-oidc-access-token'
17111: Deselect unsigned_manifest_text by default in groups#contents.
Merge branch '17111-deselect-unsigned-manifest'
17106: Accept v2 token with / replaced by _ as s3 access/secret key.
17106: Test S3 with modified v2 token issued by LoginCluster.
17106: Skip s3cmd test if s3cmd not installed.
17106: Clean up test.
17106: Improve handling of bare tokens issued by remote clusters.
17106: Comment on stored_secret behavior.
17106: Update docs.
17009: Support accessing S3 with virtual hosted-style URLs.
17009: Mention S3 considerations in keep-web install doc.
Merge branch '17009-s3-bucket-vhost'
17106: Recommend using full tokens for S3 access.
17106: Allow use of URL-encoded token as S3 access/secret key.
17106: Fix key unescape: don't convert + to space.
17106: Add examples to S3 auth instructions.
Merge branch '17106-s3-fed-token'
17009: Fix bucket-level ops using virtual host-style requests.
Update error regexp in test case.
17161: Improve SystemRootToken docs.
17009: Test virtual host-style S3 requests.
17009: Fix s3 ListObjects endpoint with vhost-style requests.
Fix tests.
Merge branch '17009-s3-vhost-list'
Warn about missing/short secrets. Delete Rails session key.
17199: Avoid returning same port twice from find_available_port().
Merge branch '17161-doc-system-root-token'
17151: Merge branch 'master'
17202: Bypass 303-with-token on cross-origin requests.
17202: Use explicit SameSite=Lax for 303-with-cookie.
Merge branch '17199-available-port-race'
17202: Test avoiding redirect for cross-origin inline images.
Merge branch '17202-no-redir-crossorigin'
17208: Use normalized path to compute signatures.
17208: Merge branch 'master'
17208: Add test case.
17208: Update test for s3cmd's new console output.
Merge branch '17208-s3-signature-double-slash'
16360: Don't bypass autofillConfig in production mode.
16306: Fix Nginx not starting when running as non-root.
16306: Comment why rm instead of exclude. Delete go tools, too.
16306: Monkeypatch fpm bug.
16306: Remove some unneeded deps from prod/pkg.
16306: Move nginx temp dirs into a subdir.
16306: Merge branch 'master'
16306: Add -eatmydata flag.
16306: Use tmpfs to speed up package building.
16306: Add health check endpoint to dispatcher.
16306: Circumvent Rails redirect-to-https in workbench health check.
16306: Fix permission issues.
16306: Remove more unneeded files from package.
16306: Fix env var ordering.
16306: Comment out Workbench2 so health check succeeds.
17175: Fix logging label for setuidgid-wrapped procs.
17175: Wait for seedDatabase before starting railsapi.
Merge branch '17151-system-token-validation'
16306: Rename arvados-dev buildpackage -> arvados-package build
16306: Refactor docker scripts into arvados-package command.
16306: Fix inability to shutdown passenger processes.
16306: Exit 0 when startup-then-shutdown goes as planned.
16306: Remove daemontools dependency.
Merge branch '17175-boot-fail-rake-seed'
16306: Command usage help.
17170: Add "arvados-client shell" subcommand and backend support.
17170: Specify login username. Improve logging.
17170: Use TLS for controller->crunch-run traffic.
17170: Fixup gateway auth secret.
17170: Test controller->crunch-run tunnel.
17170: Fix dial when API host var is host:port.
17170: Test arvados-client shell command.
17170: Allow shell only if this user submitted all associated CRs.
17170: Dry up close-connection-on-error.
17170: Don't reuse transport that might have http2 enabled.
17170: Improve error messages.
17170: "arvados-client shell" accepts container request UUID.
17170: Fixup error display.
17170: Fix closing pty/tty when nil.
17170: Merge branch 'master'
17170: Fix -help output.
17170: Check container is readable before checking write permission.
17170: Improve error messages.
17170: Use exec() to eliminate intermediate arvados-client process.
17170: Add missing method to APIStub.
17170: Drop gateway_address from searchable columns.
16306: Merge branch 'master'
16306: Use cwd as default source tree.
16306: Update tests.
16306: Remove old bash scripts.
17170: Fix crash when http transport uses default nil transport.
16306: Fixup test.
16306: Hide "easy install" option from the install docs.
17170: Merge branch 'master'
17170: Improve error message for unrecognizable target UUID.
16306: Merge branch 'master'
17170: Allow admin users to run commands in any container.
17170: Re-word comment, document ...-Login-Username header.
16306: Remove obsolete RailsSessionSecretToken config.
16306: Merge branch 'master'
16306: Fix runPassenger HOME env in non-production case.
16669: Fix cache bug.
16669: Test oidcTokenAuthorizer cache.
17170: Add config keys to enable shell access for users/admins.
17170: Add interactive_session_started flag to containers.
17170: Attempt tunnel setup before exec()ing ssh client.
17170: Add new Nginx configs to upgrade notes.
Merge branch '16669-oidc-access-token'
17170: Test OpenSSH client -> shell gateway -> docker exec.
17170: More helpful message if ARVADOS_* env vars are not set.
17170: Return more helpful error if APIHost is not set.
16306: Accept -package-version arg to testinstall.
17170: Merge branch 'master'
16306: Update to Ruby 2.7.2.
16306: Exclude {rails}/config/environments from package.
16306: Add note about dpkg-scanpackages.
16306: Add package metadata.
16306: Print PASS line when testinstall succeeds.
16306: Don't generate Packages.gz until/unless testing the package.
16306: Merge branch 'master'
Merge branch '16306-arvados-easy-install'
17170: Merge branch 'master'
17170: Improve error messages and command help text.
17170: Update test.
17335: Configurable auth params for OIDC and Google.
17212: Propagate -listen-host to postgresql and passenger.
Merge branch '17212-fix-port-conflicts'
Merge branch '17170-container-shell'
Merge branch '17335-oidc-auth-params'
Fix panic when OIDC provider returns no name claim.
17384: Respect CrunchRunCommand and CrunchRunArgumentsList in a-d-c.
Merge branch '17384-crunch-run-configs'
17398: Skip gateway server if dispatcher does not send desired addr.
Merge branch '17398-no-ctr-gateway'
16745: Keep a SiteFileSystem alive for multiple read requests.
16745: Prune enough sessions to reach size limit, not all.
16745: Don't store nil in an atomic.Value (panic).
16745: Handle GetBucketLocation API.
16745: Reject unsupported APIs instead of mishandling.
16745: Rename session cache size metric.
16745: Update test.
Merge branch '16745-keep-web-cache'
16669: Accept OIDC access token in federated requests.
Merge branch '16669-oidc-access-token-fed'
Fix panic when OIDC provider returns no name claim.
17384: Respect CrunchRunCommand and CrunchRunArgumentsList in a-d-c.
17398: Skip gateway server if dispatcher does not send desired addr.
16745: Keep a SiteFileSystem alive for multiple read requests.
16745: Prune enough sessions to reach size limit, not all.
16745: Don't store nil in an atomic.Value (panic).
16745: Handle GetBucketLocation API.
16745: Reject unsupported APIs instead of mishandling.
16745: Rename session cache size metric.
16745: Update test.
16669: Accept OIDC access token in federated requests.
17353: Don't show config-dump warnings for empty config.
Merge branch '17353-install-warnings'
Add test cases for special chars in filename.
13382: Report storage class(es) in headers after successful write.
13382: Use caller-specified storage classes when writing.
13382: Test storage class failure cases.
13382: Rename putResult -> putProgress.
Merge branch '13382-write-to-storage-class'
17392: Ensure requested storage classes are satisfied on write.
16159: Provide a localdb transaction for federation tests.
17392: Test satisfying storage classes via multiple servers.
Merge branch '17392-go-write-to-storage-class'
17531: Remove ForceLegacyAPI14 config flag.
17529: Return RequestLimitExceeded as a RateLimitError.
17346: Don't try to rebalance the zero-length data block.
Merge branch '17531-remove-forcelegacyapi14-config'
17529: Heed MaxCloudOpsPerSecond when calling SetTags.
17529: Catch rate limit errors from DescribeInstances, too.
17529: Update comment.
17528: Don't load config when doing assets:precompile in postinst.
17528: Remove bin/yarn from Rails projects.
17528: Fix assets:precompile @ build time, skip at install time.
17528: Set ready=0 if config is incomplete/missing during install.
Merge branch '17529-ec2-rate-limit'
17529: Heed MaxCloudOpsPerSecond in Instances() and returned insts.
Merge branch '17529-listinstances-rate-limit'
17346: Add test case.
17566: Use configured MaxRequestSize.
17566: Allow large request bodies in integration tests.
17566: Don't bypass controller in SDK integration tests.
17437: Don't copy incoming Content-Length header when proxying.
Merge branch '17437-drop-content-length-header'
Merge branch '17528-install-warnings'
17204: Fix misleading log message on 304 Not Modified response.
17343: Add option to boot without workbench1 to speed up tests.
Merge branch '17346-keep-balance-empty-block'
Merge branch '17204-not-modified'
Merge branch '17566-max-request-size'
17507: Support ListObjectsV2 API.
17507: Fix calling Child() without lock.
17284: Redact RailsAPI host:port in error messages.
Merge branch '17343-workbench1-optional'
Merge branch '17507-listobjectsv2'
16997: Test map key order in check/dump. Fix duplicate warnings.
16997: Use go-yaml fork to avoid key-sorting bug.
Merge branch '17284-redact-railsapi-host'
Merge branch '16997-sort-config-for-diff'
17610: Check scopes when using a remote token.
17284: Fix missing "/" in error message.
Merge branch '17284-redact-railsapi-host'
Update tests for go 1.16.
Don't ask nginx to log to stderr when using setuid.
Merge branch '17610-remote-token-scopes'
17587: Don't reject federated query with large limit param.
Fix "docker port" usage.
17587: Comment SetUpTest calls.
Merge branch '17587-workbench-federated-query'
Fix test regexp.
17590: Rename S3 volume config keys to match AWS terms.
17650: Fix test order dependency.
Merge branch '17650-fix-cwl-tests'
17590: Merge branch 'master'
17590: Improve log messages when old AWS config keys are used.
17590: Fix spelling of S3 driver name.
17590: Error out if both old+new S3 credential configs are provided.
17590: Add upgrade note about changed config keys.
Merge branch '17590-ec2-config-keys'
17657: Allow ssh port forwarding to container ports.
17657: Test port forwarding using OpenSSH client.
17657: Improve test failure messages.
Merge branch '17657-ssh-port-forward'
17296: Disentangle docker-specific code, add singularity option.
17296: Add RUntimeConfig to exported config.
17296: Add crunch-run integration test.
17296: Don't use /var/lib/arvados/tmp as a cache dir for tests.
17296: Enable memory limit for test.
17296: Use https cache.
17296: Fix docker tests running twice.
17680: Document accepting OIDC access tokens.
17680: Add OIDC access token section to "tokens" page.
Merge branch '17680-oidctoken-doc'
17682: Fix stutter in "arvados-client shell" output.
17708: Test skipping non-regular file in output dir.
17704: Check scope before accepting OIDC access tokens.
17704: Enable OIDC access tokens for tests.
17704: Split access token scope config into 2 keys.
17719: Fix incorrect cache update.
Merge branch '17719-keep-web-pdh-cache'
Merge branch '17704-check-token-scope'
17296: Document changed handling of unusual image collections.
17296: Log when/why gateway server is disabled.
17296: Skip integration tests if docker is not installed.
17296: Merge branch 'master'
17296: Avoid memory-limiting feature in tests.
17296: Fix panic in teardown of skipped test.
Merge branch '17682-fix-stutter'
Remove old Go installation when upgrading.
17296: Merge branch 'master'
Merge branch '17296-singularity'
Remove duplicate rm.
17609: Add diagnostics command.
17609: Add webshell test.
17609: Refactor tests to add some structure.
17609: Fix limit args to work with older API.
17609: Use timeout on all http requests.
17609: Improve log text alignment.
17609: Add "run container" test.
17609: Improve output formatting.
17609: Behave better when project creation fails.
17609: Tweak messages.
17705: Add dispatchcloud architecture page.
17705: Mention IdleBehavior tag name.
17705: Link install page to arch page.
17774: Ignore addition of zero/default values to mounts when frozen.
17774: Test runtime_constraints and scheduling_parameters, too.
17774: Add non-empty mounts to test fixtures.
Merge branch '17774-fix-cancel-cr'
17609: Remove duplicate NoPrefixFormatter.
17609: Remove extra newlines.
17609: Merge branch 'master'
17609: Make costanalyzer logging a bit less verbose.
17803: Warn when config keys are ignored due to case mismatch.
17803: Ensure keys with mismatched case don't get used.
17810: Fix S3 signature verification.
17803: Fix unnecessarily convoluted test case.
17803: Note todo's.
Merge branch '17803-config-key-case-warning'
Merge branch '17810-s3-escape-non-unreserved-chars'
17464: Add DebugLocksPanicMode and fix some missing locks.
Merge branch '17609-diagnostics-cmd'
17464: Fix auto-enable DebugLocksPanicMode.
17756: Add lsf dispatcher.
17756: Rewrite lsfqueue "wait for next update".
17756: Add checkLsfQueueForOrphans.
17756: Build arvados-dispatch-lsf package.
17756: Add DispatchLSF to health aggregator test setup.
17756: Fix tests to accommodate sudo and added bjobs args.
17853: Fix map write when only RLock held.
17705: Improve InstanceSetID wording, update link to mgmt API docs.
17756: Add arvados-dispatch-lsf install doc page.
Merge branch '17853-fix-write-with-rlock' into main
17756: Merge branch 'main'
Merge branch '17705-adc-arch-doc'
17394: Propagate storage classes when writing data via collectionfs.
17394: Test BlockWrite storage classes precedence.
17394: Use BlockWrite interface in crunch-run.
17394: Update callback name.
17394: Check by_id dir obeys storage classes.
17816: Close stdin/stdout/stderr from main instead of executor.
17816: Add test.
Merge branch '17394-collectionfs-storage-class' into main
17756: Review feedback.
17756: Move "no suitable instance type" reporting to dispatch lib.
17756: Note that bsub sudo user must exist on worker nodes.
17756: Fix test.
17574: Update replication_confirmed fields after keep-balance run.
17813: Error out if sif cache collection cannot be created.
Merge branch '17813-docker-to-singularity' into main
17574: Get collections directly from DB instead of controller.
17574: Add -update-confirmed-fields=false option.
17574: Speed up manifest parsing.
17574: add -pprof flag to service commands.
17574: Add BalanceUpdateLimit config, fix tests.
17574: Process collections in a worker pool.
17574: Batch updates into transactions, skip when unchanged.
17574: Update install/upgrade docs wrt PostgreSQL access.
17574: Fix wait on empty channel.
17574: Update test.
17574: Fix misleading errors after reaching update limit.
Merge branch '17756-dispatch-lsf' into main
17574: Fix map write when only RLock held.
Fix map write when only RLock held.
17574: Confirm storage classes as [] when replication is 0.
17574: Merge branch 'main'
Merge branch '17574-storage-classes-confirmed' into main
17967: Add StorageClasses config section.
17967: Read from volumes with high-priority storage classes first.
17967: Use StorageClasses.*.Default instead of ["default"].
17726: Add singularity doc page.
17967: Update tests.
17967: Update storage classes docs.
17726: Link singularity install docs. Add dispatch-lsf mention.
17726: More detail about singularity/docker differences.
17967: Link to config doc page from conf file and upgrade notes.
17967: Test new behavior for default storage_classes_desired.
17967: Update generated config.
Merge branch '17967-storage-classes-config' into main
17726: Add Singularity info to user docs.
Merge branch '17726-singularity-doc' into main
17698: Do concurrent writes when multiple volumes are needed.
17698: Fix AllWritable panic when no volumes are writable.
17698: Rename newPutResult to match new putProgress type name.
17698: Update PutBlock comment.
17698: Add comment to clarify locking.
17698: Test "no writable volumes" case.
17698: Merge branch 'main' into 17698-keepstore-concurrent-writes
17994: Allow filtering on storage_classes_desired/confirmed fields.
Merge branch '17698-keepstore-concurrent-writes'
17994: Support filtering by element/key presence in jsonb columns.
17994: Update comment.
17217: Sign manifests in controller instead of RailsAPI.
17217: Remove crufty test util funcs.
17217: Update tests, remove unused code.
17217: Add signatures test for groups/contents.
17994: Accept a few very specific expressions as filters.
17994: Document filtering by comparing two attributes.
17994: Document new filtering capabilities.
17217: Skip signatures when BlobSigning=false.
17217: Test signature expiry times.
17217: Update RailsAPI tests to not expect signatures.
17217: Sign locators in CollectionCreate and Update.
Merge branch '17994-filter-by-storage-classes' into main
Merge branch '17217-collection-signatures' into main
17995: Rephrase filter expression docs.
17995: Merge branch 'main'
Fix misleading log message.
Update default bsub arguments to save stdout/stderr in /tmp.
Update test to accept non-empty default BsubArgumentsList.
17995: Accept boolean expressions as strings without ["...",=,true].
17995: Merge branch 'main'
17995: Fix merge error.
18027: Fix crash when reporting error during --unmount.
18027: Kill arv-mount directly if arv-mount --unmount cannot run.
18102: Fix double-unlock in scheduler.
18102: Fix flapping lock/unlock.
18102: Avoid spamming logs in case of version mismatch.
18102: Improve logging.
18021: Sort mounts to fix flaky test.
Merge branch '18021-sort-mounts'
17857: Fix bsub args so containers can use multiple CPU cores.
Merge branch '18027-unmount-fuse'
18027: Change default boot probe to `systemctl is-system-running`.
Merge branch '18102-max-dispatch-attempts'
Merge branch '17995-filter-by-comparing-attrs'
Merge branch '17857-lsf-cpus'
18051: Add manifest-parsing / fs-building benchmark.
18051: Speed up manifest parsing with bytes.Split.
18051: Optimizations for collections with millions of files.
Merge branch '18027-boot-probe-command' into main
18122: Accept "select" param in get/update/delete calls.
18051: Fix premature ejection from WebDAV collection cache.
18051: Add logging capability to webdav cache.
18051: Add debug logging for webdav cache.
18051: Remove unused MaxPermissionEntries config.
18122: Update API docs.
18122: Update "distinct" docs (default is false) and tidy up code.
18122: Update test.
18122: Don't fail on PDH mismatch when manifest_text is missing.
18122: Fix "get collection by pdh" when manifest_text is unselected.
Merge branch '18051-collectionfs'
18122: Fix stutter in docs.
18122: Add descriptions for select params in discovery doc.
18122: Clarify select param behavior in "get collection by pdh" API.
18051: Reduce string operations/allocs in blob signing.
Merge branch '18051-webdav-cache'
Merge branch '18122-select-param'
17749: Support PrefixLength in new S3 driver.
17749: Support PrefixLength in old S3 driver.
17749: Document PrefixLength config.
Merge branch '18051-blob-signing'
8363: Report arv-mount error messages as runtime_status warnings.
8363: Update tests.
8363: Fix spelling of errorDetail and warningDetail in docs.
8363: Save matching arv-mount log line in warningDetail.
18098: Mention runtime engine (e.g., docker) in crunch-run log.
13697: Set Rails database timeout to API.RequestTimeout config.
Merge branch '18098-log-runtime-engine'
Merge branch '8363-fuse-warnings'
Merge branch '17749-s3-prefixes'
13697: Cancel request context after API.RequestTimeout.
13697: Remove HandlerWithContext.
13697: Do not apply RequestTimeout to hijacked connections.
18184: Install singularity 3.7.4 for dev/test.
13967: Add guard comment re timing out large uploads.
Merge branch '13697-database-timeout'
Merge branch '18184-singularity-374'
Update go build tags to go1.17.1 gofmt.
Update installer and images to Go 1.17.1.
17779: Include request ID in exception messages.
17779: Fix misleading "error processing manifest" after IO errors.
17779: Fix invalid manifest throwing IOError instead of SyntaxError.
17830: Add test for logging request ID.
18216: Move keepstore into arvados-server binary.
17830: Add test for logging request ID.
Merge branch '17779-request-id-in-exception'
Merge branch '18216-arvados-server-keepstore'
18286: Document requirement to add Services.DispatchLSF section.
Ward Vandewege (395):
16106: add Azure spot instance support.
16922: disable the postgres pager in the rails postinst script.
16992: Merge branch 'master' into 16992-disable-pg-pager
Merge branch '16992-disable-pg-pager' into master
Fix whitespace in build/run-library.sh
Bugfix: fix detection of already generated Python deb/rpm packages.
When calculating the version of our Go and Rails deb/rpm packages, take
Fix arvados-cwl-conformance-tests.
Update new cluster checklist to reflect the deprecation of the SSO
16471: fix a few typos.
16471: refactor documentation to reflect different Salt-based
Make run-build-docker-images.sh a little smarter, allow building just
Make run-build-docker-images.sh a little smarter, allow building just
Fix author e-mail addresses in our gemspecs.
16930: remove local 'latest' tag before pushing.
Merge branch '16930-tagging' into master
Fix more golint warnings.
Fix more golint warnings.
17044: remove Debian "stretch" from the build infrastructure. Update
17044: implement review comments (part 1).
17044: implement review comments (part 2): update cwl tests to use
Merge branch '17044-remove-debian-stretch' into master
documentation: Mention distribution packages on the "Install the Slurm
build: Remove remaining references to the SSO server packages.
17047: bugfixes, and add an entry to the upgrade notes about the
16950: a few cleanups for our container request fixtures: attach a real
16950: add the costanalyzer to arvados-client.
Fix more golint warnings.
16950: add tests for the costanalyzer.
Fix more golint warnings.
17086: build packages for Ubuntu 20.04, Focal Fossa.
Fix require path in the 'script/rails' script for api server.
17086: Merge branch 'master' into 17086-add-focal-fossa
Merge branch '17086-add-focal-fossa' into master
Fix more golint warnings.
16306: shut up bundle warnings about /var/www
16306: really exclude /var/lib/arvados/go from the package, cf.
16306: Make sure that the non-passenger nginx process runs as the
16306: in cmd/arvados-dev/docker-build-install.sh, make sure nginx is
16306: switch to shared ruby libraries.
16306: shrink package size by removing unused cache and .git directories
16950: changes after review.
Fix more golint warnings.
16950: more changes after review.
16950: refactor caching; use ~/.cache/arvados/costanalyzer for that
Fix more golint warnings.
Fix more golint warnings.
17012: when calculating the version of our Python packages, take the
17012: remove old gittaggers.py files.
17012: update calculation of python version number in run-library.sh
17012: switch calculate_python_sdk_cwl_package_versions() to use the
Merge branch 'master' into 17012-fix-python-version-calculation
Merge branch '17012-fix-python-version-calculation' into master
16950: make specifying of the output directory mandatory (remove
16950: switch to os.UserHomeDir(), and send all output to stderr.
Merge branch 'master' into 16950-add-costanalyzer
Merge branch '16950-add-costanalyzer' into master
Remove one more python2 remnant. This is a fix for the
Fix more golint warnings.
Move the handle_python_package() function from run-library.sh to
Now that calculate_python_sdk_cwl_package_versions returns python-style
Remove now-unneeded code from sdk/cwl/test_with_arvbox.sh, add comment
Update error checking in run-build-docker-jobs-image.sh
Fix OS package iteration number in run-build-docker-jobs-image.sh
Make run-build-packages-python-and-ruby.sh say so when it decides to
Documentation cleanups.
Fix more golint warnings.
Fix more golint warnings.
Fix more golint warnings.
Fix more golint warnings.
Fix more golint warnings - update crunchrun tests.
Now that our k8s helm charts retain state, update the documentation
Clarify token details for the arv-user-activity tool.
Upgrade script/create_superuser_token.rb in the api server codebase to
17187: costanalyzer: add support for collection uuids.
17187: costanalyzer: allow specifying multiple comma-separated uuids via
17187: costanalyzer: print the total from the aggregate cost accounting
17187: implement review feedback:
17187: Merge branch 'master' into 17187-costanalyzer-updates
Merge branch '17187-costanalyzer-updates'
Fix ineffassign warning.
Costanalyzer bugfix: when a collection uuid is supplied, write the csv
Fix more golint warnings.
Fix more golint warnings.
Fix a few more golint warnings.
Fix another golint warning.
Fix a few more golint warnings.
Fix a few staticcheck warnings.
We've made a change in the structure of our apt repositories.
Merge branch '17218-repository-update'
Fix detection of packages that were already built.
Fix arvados-src package version generation.
We now publish packages for Ubuntu Focal (20.04), and have stopped
Fix typos in the documentation.
16106: Merge branch 'master' into 16106-azure-spot-instance-support
Documentation: fix typos.
16106: update Azure preemptible node code after real world testing. Add
16106: address review comments.
16106: Merge branch 'master' into 16106-azure-spot-instance-support
Merge branch '16106-azure-spot-instance-support'
Documentation: make the arvados-dispatch-cloud installation instructions
17222: add overview documentation for the components of Keep.
17215: add IAM role support to arvados-dispatch-cloud on EC2.
17222: implement review feedback.
Merge branch 'master' into 17222-doc-add-keep-components-overview
Merge branch '17222-doc-add-keep-components-overview'
17215: Merge branch 'master' into 17215-aws-roles-a-d-c
Merge branch '17215-aws-roles-a-d-c'
Make sure that our Python 3 based packages conflict with the older
Fix ineffassign warning.
Documentation: the Arvados SSO server is deprecated, it is not the
Documentation: reflect the current state of anonymous token generation.
17245: documenation: re-add a modified version of our Slurm
17245: documentation: remove unlinked pages.
17255: Document the "can_login" permission link in the API section.
Fix golint warning.
Fix tests after yesterday's golint warning fix.
17245: Merge branch 'master' into 17245-slurm-install-docs
Merge branch '17245-slurm-install-docs'
17255: Merge branch 'master' into 17255-document-can_login-permission
Merge branch '17255-document-can_login-permission'
Fix broken documentation links.
Documentation: add a default base_url to the Rakefile to simplify
17249: make costanalyzer report preemptible status of the instance in
17340: arvados-dispatch-cloud should take the Containers.ReserveExtraRAM
Merge branch '17340-a-d-c-respects-ReserveExtraRAM'
The configuration parameter is MaxKeepBlobBuffers, not MaxBuffers.
17249: Merge branch 'master' into 17249-costanalyzer-preemptible
Merge branch '17249-costanalyzer-preemptible'
Documentation: fix grammar.
17355: keepstore should take the volume's AccessViaHosts ReadOnly flag
Merge branch '17355-report-volume-ReadOnly-correctly'
17119: First take: add groups endpoints to controller.
Documentation: include the cluster id namespace explanation on the
17119: tweaks for groups endpoints.
17119: remove the default project_class again on the group model, it is
17119: fix options and response type of the groups/shared and
Documentation: fix typo.
17119: make the controller group/contents endpoint conform more
Documentation: fix typos.
17119: merge SharedGroupList into GroupList, which now gets an
17119: merge SharedOptions into ListOptions, which now gets an extra
17119: rename ContentsOptions to GroupContentsOptions.
17119: rename alternate EndpointGroupContents, add comment.
17119: drop the 'Kind' fields from the structs, autogenerate them instead.
17119: fix field type on legacy objects.
17119: make customFileSystem use the group contents endpoint.
17119: make arvados_fuse.fusedir.ProjectDirectory use the group contents endpoint.
When a compute node comes up, we run `mkfs.xfs` on a newly encrypted
Fix a few more golint warnings.
17119: make controller understand filter groups.
17119: add second test, simplify code by switching to the generic
17119: implement review feedback.
17119: one more fix based on review feedback.
17119: Merge branch 'master' into 17119-virtual-folder-from-query
Merge branch '17119-virtual-folder-from-query'
17119: Merge branch 'master' into 17119-use-group-contents
Merge branch '17119-use-group-contents'
Documentation: fix copy/paste error in keep-web installation
17119: controller should export the include_old_versions flag on group
Merge branch '17119-controller-bugfix'
17119: add filter validation for filter groups. Add a test for the
17119: add documentation.
17119: add filter group support to arv-mount.
17119: add (rudimentary) filter group support to workbench.
17119: implement review feedback.
17119: one more fix based on review feedback.
17355: keepstore should take the volume's AccessViaHosts ReadOnly flag
Documentation: include the cluster id namespace explanation on the
Documentation: fix typo.
Documentation: fix typos.
When a compute node comes up, we run `mkfs.xfs` on a newly encrypted
Fix a few more golint warnings.
Documentation: fix copy/paste error in keep-web installation
17119: controller should export the include_old_versions flag on group
17119: Make arv-mount work with the new filter groups code. Also in
17119: further documentation updates.
10458: add some basic documentation for crunchstat-summary.
10458: implement review feedback.
Merge branch '10458-document-crunchstat-summary'
17119: the home project should include filter groups.
17119: address review feedback.
Add license file to the git.arvados.org/arvados.git/sdk/go/arvados
In git.arvados.org/arvados.git/sdk/go/arvados, change the name of the
Add license file to all the git.arvados.org/arvados.git/sdk/go module
Formatting change in cc-by-sa-3.0.txt to make the license text
Append the full license text for Apache 2.0, AGPL v3 and CC-BY-SA 3.0 to
Revert "Add license file to all the git.arvados.org/arvados.git/sdk/go
Revert "In git.arvados.org/arvados.git/sdk/go/arvados, change the name
Revert "Add license file to the
17119: add missing GroupTrash endpoint.
Change the license of 2 files in the Go SDK to Apache 2, they were
17119: add missing fields to GroupContentsOptions.
17119: when the count: none option is supplied, the itemsAvailable field
17495: document the deduplication report. Fix example invocation in the
17495: fix typo.
17495: Merge branch 'master' into 17495-document-dedup-report
Merge branch '17495-document-dedup-report'
17119: implement review feedback.
17119: fix tests.
Update mimemagic gem version to 0.3.6, the previous version (0.3.5) was
Update mimemagic gem version to 0.3.6, the previous version (0.3.5) was
17119: bugfix: when "count: none" is specified, the group/contents
17119: bugfix: the group/contents endpoint should do the right thing
Update mimemagic gem version to 0.3.8, the previous version (0.3.6) was
Update mimemagic gem version to 0.3.8, the previous version (0.3.6) was
The latest version of the mimemagic gem has a new dependency on the
Fix centos7 api server package test.
Due to the mimemagic gem changes, shared-mime-info is now a build
Fix golint warning.
Fix golint warning (incorrect function name in comment).
Add a comment at the top of the documentation Rakefile about generating
17503: the deduplication report tool should not require the Arvados
17119: more changes after review feedback.
17119: one more change after review feedback.
17119: Merge branch 'master' into 17119-add-filter-groups
Merge branch '17119-add-filter-groups'
17503: implement review feedback.
17503: Merge branch 'master' into 17503-fix-deduplication-report-paper-cuts
Merge branch '17503-fix-deduplication-report-paper-cuts'
Fix deduplication report test.
Simplify code a bit.
Fix golint warning.
17498: add a note about the python 3 package names in the upgrade guide.
17498: Build metapackages to ease the migration from python 2 to
17498: address review comments.
Merge branch '17498-python3-migration-metapackages'
Do not pin arvados-login-sync on an ancient version of the arvados gem.
The sks-keyservers network is dying. Update our documentation to use
Bump the Go version to 1.16.3
Our python3 packages should be marked as 'Replaces:' for the old python
Update `arvados-server install` to use go 1.16.3
The upgrade to go 1.16.3 requires a `go mod tidy` to make the build
17651: Wording tweak on the SSO authentication flow page.
Fix typo in a comment on the configuration reference.
Mention the 'Rendezvous' parameter on Keepstore's InternalURLs, for
17678: add documentation for the `arvados-client costanalyzer` command.
17668: basic documentation for the new container shell feature.
17668: A few more tweaks after review feedback.
17668: one more tweak to the firewall rule description for this feature.
17668: Merge branch 'master' into 17668-doc-container-shell-access
Merge branch '17668-doc-container-shell-access'
17678: implement review feedback.
17678: Merge branch 'master' into 17678-costanalyzer-doc
Merge branch '17678-costanalyzer-doc'
A few more doc tweaks.
Change the default for Collections.WebDAVCache.MaxBlockEntries from 4 to
17706: when a container request has no container associated (e.g. when
17708: when crunch-run encounters an unsupported file type while copying
Merge branch '17708-crunch-run-unsupported-file-types'
17717: add a timestamp range mode to the costanalyzer. Be more tolerant
When building compute node images, print the version of packer used.
17738: remove the monkey patch of the OS_VERSION constant from the
Merge branch '17738-remove-constant-modification'
17738: Make our arvados-api and arvados-workbench Gemfiles use the arvados
Merge branch '17738-pin-gemfiles-to-2.1.4'
Make our arvados-api and arvados-workbench Gemfiles use the arvados
Fix building of metapackages for Ubuntu 18.04 and Ubuntu 20.04.
17757: On our compute node images, Docker should not start by default;
17757: Merge branch 'master' into 17757-bootprobe-race
Merge branch '17757-bootprobe-race'
Tweak upgrading doc page to reflect the release of 2.2.0.
17717: address review comments.
17717: address further review comments: remove unused code and refactor
17706: Merge branch 'master' into 17706-costanalyzer-uncommitted-container-requests
Merge branch '17706-costanalyzer-uncommitted-container-requests'
Remove leftover dead link from the ToC in the 'Set up a shell node'
17717: more changes post review: remove unneeded debug print, switch
17717: Merge branch 'master' into 17717-costanalyzer-date-mode
Merge branch '17717-costanalyzer-date-mode'
17776: Basic throttling for VcpuLimitExceeded, MaxSpotInstanceCountExceeded,
17778: update docs.
17755: add the singularity-container to the compute node image.
17776: address review comments.
17755: Bump up to singularity 3.7.4.
The bleeding edge branch in the arvados-formula repository is now called
17776: Merge branch 'master' into 17776-more-throttling
Merge branch '17776-more-throttling'
17841: add container duration to the totals in the csv files. Reduce
17841: address review comments.
17778: Merge branch 'master' into 17778-doc-update
Merge branch '17778-doc-update'
The bleeding edge branch for arvados-workbench2 is now called 'main'.
The bleeding edge branch is now called 'main'.
Fix arv-git-httpd tests.
Fix keepproxy tests.
Fix api server tests.
17841: update documentation
17841: Merge branch 'main' into 17841-add-duration
Merge branch '17841-add-duration'
Fix arvbox demo image build.
17863: update to using bundler 2.2.19 everywhere.
Fix typos in the documentation.
Add some more clarifications to the doc page about restricting uploads
Another doc tweak.
17962: Bump the version of lib/pq to 1.10.2
17962: Merge branch 'main' into 17962-bump-lib-pq
Merge branch '17962-bump-lib-pq'
17863: further cleanup in our rails postinst scripts and documentation:
17863: Merge branch 'main' into 17863-bundler-update
Merge branch '17863-bundler-update'
17755: Merge branch 'main' into 17755-add-singularity-to-compute-image
Fix typo in documentation.
17903: use more distribution-agnostic commands to add/remove a user
17903: Merge branch 'main' into 17903-login-sync-centos7
Merge branch '17903-login-sync-centos7'
Fix the example AWS InstanceTypes for the installer, none of these node
17949: add support for Debian Bullseye in our build scripts. Remove some
Merge branch '17949-add-bullseye'
Debian 11 (bullseye) will be a supported distribution in the next major
More cleanup, remove references to Ubuntu 16.04 (xenial) which is no
Add extra validation of our package version format in the build scripts,
17591: be more explicit about the required TLS certificates and DNS
Update the package repositories page, we now have Debian 11 (bullseye)
17591: address review feedback.
Merge branch 'main' into 17591-doc-improvement
Merge branch '17591-doc-improvement'
Singularity requires squashfs-tools to build images.
18001: add Users/UserNotifierEmailBcc configuration option, which is the
17985: fix binstub for cwltool in our arvados-cwl-runner package.
Merge branch '17985-cwltool-binstub'
17947: the Arvados python3-* CentOS packages should conflict with the
17947: Merge branch 'main' into 17947-centos7-package-conflict
Merge branch '17947-centos7-package-conflict'
18013: the db:check_long_lived_tokens and db:fix_long_lived_tokens rake
18013: address review feedback.
18013: Merge branch 'main' into 18013-token-rake-task-fix
Merge branch '18013-token-rake-task-fix'
18001: address review comments.
18001: Merge branch 'main' into 18001-add-UserNotifierEmailBcc
Merge branch '18001-add-UserNotifierEmailBcc'
17755: Merge branch 'main' into 17755-add-singularity-to-compute-image
Fix whitespace.
17755: Merge branch 'main' into 17755-add-singularity-to-compute-image
Merge branch '17755-add-singularity-to-compute-image'
18112: Ubuntu 18.04 comes with bundler version 1.16.1, which doesn't handle our
18112: add a note to the upgrade log.
18112: Merge branch 'main' into 18112-ubuntu1804-bundler-fix
Merge branch '18112-ubuntu1804-bundler-fix'
17770: while throttled, do not log that instances are being created when
Merge branch '17770-fix-logging-while-throttled'
Fix typo.
Remove -x from the salt install provision script.
We now have the auto-redirect behavior on https://arvadosapi.com/
Update a few remaining Jenkins references to ci.arvados.org.
Update a few more old domain references.
Update (unused?) scopes in our discovery doc to have arvados.org URLs.
Add an example to the Python cookbook, "Delete a file from an existing
The request_id passing was moved to Rails middleware as part of #17830.
18003: add 'contains' and 'exists' to the permitted operators for filter
Merge branch '17830-fix-rails-request_id-logging'
18003: Merge branch 'main' into 18003-support-exists-contains-in-filter-groups
Merge branch '18003-support-exists-contains-in-filter-groups'
18245: Update the "Ruby and Bundler" installation page:
Merge branch '18245-bundler-doc-update'
18253: documentation updates around the Arvados GPG package signing key.
Update the godoc path for keep-web in our documentation.
18253: Merge branch 'main' into 18253-doc-gpg-key-updates
Merge branch '18253-doc-gpg-key-updates'
The request_id passing was moved to Rails middleware as part of #17830.
18245: Update the "Ruby and Bundler" installation page:
18247: fix arvados gem dependency on the faraday gem
18253: documentation updates around the Arvados GPG package signing key.
Update the godoc path for keep-web in our documentation.
18247: Merge branch 'main' into 18247-faraday-version
18247: Merge branch 'main' into 18247-faraday-version
Merge branch '18247-faraday-version'
We support Singularity 3.7.4.
Remove the 'experimental' label in our config reference from things that
18113: change MaxCloudOpsPerSecond and MaxConcurrentInstanceCreateOps
18113: Merge branch 'main' into 18113-change-cloudops-defaults
Merge branch '18113-change-cloudops-defaults'
18258: set the SINGULARITY_CACHEDIR to a path underneath our temporary
18258: add missing error check on os.Mkdir
18258: also handle SINGULARITY_TMPDIR
Merge branch '18258-set-singularity-cachedir'
The minimum supported version of Python is 3.6
18259: mention `mksquashfs mem` config setting in singularity.conf
Merge branch '18259-singularity-doc'
Remove long dead `run` and `pipeline` subcommands from the `arv`
Documentation: silence the curl command to get our Arvados package signing key.
18259: documentation: add more detail about Singularity.
Merge branch '18259-doc-architecture-singularity'
Documentation: when starting the Arvados k8s helm chart on GKE, do not
18289: only pass the --allow-other argument to arv-mount when the
18289: documentation: singularity refinements.
18289: Documentation changes to reflect we support both Slurm and LSF.
18289: Address review comments (documentation).
18289: add support to set `mksquashfs mem` for Singularity in our
18288: when running the db:check_long_lived_tokens and
18288: when storing the anonymous user token, make sure to clear the
18281: make arvados-login-sync smart enough to replace expired tokens.
18281: Rephrase the help text for --force-rotate option.
18290: LSF: make the bsub arguments completely configurable.
18290: address review comments.
-----------------------------------------------------------------------
hooks/post-receive
--
More information about the arvados-commits
mailing list