[ARVADOS] created: 2.2.1
Git user
git at public.arvados.org
Mon Jul 12 21:08:46 UTC 2021
at 3e55f20e48f50c9220af1359e5563f0df2940b36 (tag)
tagging dd9afa05c8cafc6a4db9627efd47714634386c1a (commit)
replaces 2.1.0
tagged by Peter Amstutz
on Mon Jul 12 17:07:55 2021 -0400
Add tag for 2.2.1 release
refs #17877
Javier Bértoli (105):
feat(salt): start salt install documentation
fix(salt): temporal fix for database setup issue
fix(salt): choose repo
feat(docs): salt install documentation
feat(provision): example configurations in salt
feat(provision): better testing config and documentation
docs(provision): document initial URL
docs(salt): some minor fixes in the Salt-based installation documentation.
Merge branch '16471-install-using-salt' into master
fix(crunch-dispatch-local): add missing service file
feat(crunch-dispatch-local): add crunch-run dependency
Merge branch '16996-add-dispatch-local-service-file' into master
feat(centos): use centos-provided python3
Merge branch '17047-centos-remove-rh-python-dependencies' into master
Fix salt-install and test scripts
fix(docker): formula upgraded
fix(test): wrong variable comparison
Merge branch '17150-system-root-token'
Merge branch 'pvanheus-fix_cluster_test' from github.com/pvanheus:fix_cluster_test
fix(docs): broken link
fix(provision): Add a CA and sign certificates with it
fix(provision): Document CA certificate purpose and installation
fix(provision): pin formulas' versions
fix(provision): add port to workbench2 nginx's stanza
fix(provision): pin arvados-formula
fix(provision): update arvados-formula's version
Merge branch '17177-use-newly-created-ca'
Update the provision script to use the new arvados-formula
Merge branch '17218-update-apt-repos'
fix(tools): remove compute-images scripts' unused parameters
Merge branch '17338-clean-compute-images-scripts'
Documentation: Explain that the canonical salt installer is hosted in Arvados' github account
feat(provision): allow to install individual roles
feat(provision): manage setup params from local file
feat(provision): refactor to add other setup examples
feat(provision): refactor to add other setup examples
feat(provision): check the cluster name provided is exactly 5 chars long
feat(provision): refactor to manage different infrastructure configurations
fix(provision): refactor single host architectures
fix(provision): add missing postgres dependency for arvados-api-server
fix(provision): check salt-call is installed
fix(provision): remove deprecated parameter
fix(provision): add only specific pillars for each role
fix(provision): make the salt-call binary check compatible with sh
fix(provision): add missing roles sections
refactor(provision): naming consistency
fix(compute-images): wait for apt/dpkg locks to be released
fix(compute-images): upgrade python-arvados-fuse to py3
fix(compute-images): remove unneeded code
Merge branch '17435-compute-images-changes'
fix(compute-images): make resolver setting optional
fix(compute-images): add resolver variable to json files
fix(compute-images): fix sed invokation
Merge branch '17438-compute-images-script-fixes'
fix(provision): force user to properly set cluster & domain parameters
fix(compute-images): wait for apt/dpkg locks to be released
fix(compute-images): upgrade python-arvados-fuse to py3
fix(compute-images): remove unneeded code
fix(compute-images): make resolver setting optional
fix(compute-images): add resolver variable to json files
fix(compute-images): fix sed invokation
fix(fpm,packaging): add arvados-api-server's postgresql-client dependency
Merge branch '17352-arvados-api-server-dependency'
fix(provision): improve single host installation and documentation
fix(provision): add multi hosts installation examples
docs(provision): add salt usage with roles in multi-host
fix(provision): use nginx-formula PR branch until changes are merged
feat(provision): add local.params example for multi-host
fix(provision): temp fix for nginx formula issue with snippets
fix(provision): use uniform database parameters across examples
chore(provision): set postgresql cidr in single host examples
fix(provision): run hosts/snakeoil states before nginx so it does not fail on missing deps
refactor(provision): use uniform database parameters across examples
chore(provision): ignore some files in git
refactor(provision): delete parameters moved to config files
feat(provision): add some checks before run
docs(provision): explain options in config examples
chore(provision): enable both examples in vagrant
refactor(provision): add host entries in single host multiple hostnames
docs(provision): improve the documentation in the examples
refactor(provision): add snakeoil certs in single host multiple hostnames
docs(provision): improve the documentation in the examples
fix(provision): default to using the master branch of arvados-formula
feat(provision): pin arvados version to latest stable
Merge branch '17246-salt-install-improvements'
fix(provision): remove unneeded vagantfile
Merge branch '17570-remove-extra-example-agrantfile'
fix(provision): don't install docker-compose
fix(provision): prevent bash globbing issues with empty dirs
Merge branch '17606-file-globbing-issues'
feat(provision): use LE wildcard cert for *.collections
Merge branch '17604-change-collections-urls'
feat(provision): add AWS credentials for letsencrypt
17603: Enable webshell role pillars in provision script
17603: Reorder example IPs so they match the documentation
17603: Separate shell's IP from webshell's
17605: allow to use a IAM user for letsencrypt
17603: Webshell is just a nginx vhost
17605: Inverse logic
17605: Wildcard needs to be quoted in yaml
17605: Update LE collections requirement in nginx
Merge branch '17605-letsencrypt-credentials-for-route53'
Merge branch '17603-nginx-webshell-vhost-fix'
feat(provision): moved the arvados-formula to Arvados.org
Merge branch '17743-use-git-arvados-org-for-provision'
Lucas Di Pentima (92):
16718: Adds 'include_old_versions' param to groups#content.
16471: Includes saltstack quick start section on install guide.
16981: Fixes error reporting when failing to create a remote group.
16718: Merge branch 'master' into 16718-group-contents-collection-versions
Merge branch '16981-sync-group-report-fix'. Refs #16981
16718: Adds tests for new param on groups#content.
16471: Formatting fixes.
16718: Merge branch 'master' into 16718-group-contents-collection-versions
Merge branch '16718-group-contents-collection-versions'. Refs #16718
16750: Avoids using params on requests to make it compatible with federation.
17152: Fixes old collection versions' modified_at handling and test.
17152: Publishes the arvbox WebDAV download port.
17152: Adds migration to fix collection versions' modified_at timestamps.
Merge branch '17152-collection-versions-fixes'
17152: Updates API revision number.
17152: Updates collection tests to reflect the new behavior.
17152: Changes preserve_version semantics, updates related documentation.
17152: Avoids creating audit logs when only 'preserve_version' is updated.
17152: Moves conditional preserve_version disabling to collection's controller.
17152: Improves modified_at conditional update check.
Merge branch '17152-collection-preserve-version-changes'
17118: Changes the way exception raising is done on PySDK's KeepWriterThread.
Merge branch '17118-arvput-fix'
16981: Extracts test federation building code to the arvadostest package.
Fixes a couple of typos on the documentation. No issue #.
16981: Adds federation test on sync-groups.
16981: Removes config loader code to fix import cycle.
16981: Removes the import cycle issue by moving code to lib/boot.
17109: Adds notes about Keep-web Same-Site restrictions.
Merge branch '16981-logincluster-sync-groups-tests'
17109: Explains how keep-web handles requests with tokens in the URL.
17109: Fixes typo.
Merge branch '17109-keepweb-urls-samesite-doc'
17256: Makes arvados-server install to ask for node v10.x
17256: Changes required nodejs version on package building scripts.
Merge branch '17256-nodejs-dependency-update'
16736: Enhances tests about login issued tokens.
16736: Adds API.MaxTokenLifetime config knob.
16736: Limit token's expires_at depending on the cluster config and user type.
16736: Fixes typo.
16736: Updates arvados-login-sync to support expiring tokens.
16736: Replaces Time.now with db_current_time on token expiration handling code.
16736: Simplifies conditionals.
16736: Adds tests to confirm expires_at gets properly set on runtime tokens.
17295: Adds tests exposing the bug.
17295: Adds cluster ID validation on the config file.
Merge branch '16736-max-token-lifetime'
Merge branch '17295-configured-cluster-ids-validation'
16736: Enhances tests about login issued tokens.
16736: Adds API.MaxTokenLifetime config knob.
16736: Limit token's expires_at depending on the cluster config and user type.
16736: Fixes typo.
16736: Updates arvados-login-sync to support expiring tokens.
16736: Replaces Time.now with db_current_time on token expiration handling code.
16736: Simplifies conditionals.
16736: Adds tests to confirm expires_at gets properly set on runtime tokens.
17295: Adds tests exposing the bug.
17295: Adds cluster ID validation on the config file.
17476: Updates rails related gems.
Merge branch '17476-railsapi-security-updates'
16159: Expires token after logout (WIP)
Merge branch 'master' into 16159-token-expiration-on-logout
16159: Makes test login form to autofocus on username field.
16159: Attempts to expire the user's token getting it from the context. (WIP)
16159: Validates token uuid & secret before expiring.
17508: Exposes bug with a test.
17508: Fixes arv-keepdocker bug.
17508: Fixes unit test.
Merge branch '17508-arvkeepdocker-fix'
16159: Adds error logging on token expiration failure. Fixes SQL query.
16159: Pass token to expire to controller on logout.
16159: Expires tokens on logout on different login controllers.
16159: Adds tests checking token expiration at logout.
16159: Merge branch 'master' into 16159-token-expiration-on-logout
Merge branch '16159-token-expiration-on-logout'
17522: Exposes bug through test. Also fixes help message.
17522: Fixes bug, corrects updated test's assertion.
Merge branch '17522-arvput-stdin-transcode-fix'
17171: Exposes bug with a test.
17171: Fixes the bug by removing the default timeout value.
17171: Merge branch 'master' into 17171-pysdk-timeout-fix
17171: Sets default timeout on arvados.api() to 10 seconds.
Merge branch '17171-pysdk-timeout-fix'
17711: Upgrades nokogiri on railsAPI & workbench1
Merge branch '17711-nokogiri-upgrade'
17738: Fixes the issue by strip!()ing a mutable version of OS_VERSION.
Merge branch '17738-frozen-string-error'
17799: Upgrades API & Workbench rails to 5.2.6
17800: Exposes bug on test.
17800: Fixes bug.
17800: Improves help message. Shows warnings when ignoring given paths.
17800: Avoids saving a new empty collection.
Michael R. Crusoe (2):
SSLHandshakeError is Python 2 only refs #17008
Link to the coding standards
Nico Cesar (19):
17014: controller handles container requests
addressing https://dev.arvados.org/issues/17014#note-41
Merge branch '17014-controller-container-requests-take3'
Doc update: Arvados 2.1 is not compatible with cgroups V2.
Merge branch '17271-doc-cgroupv2'
Changed 'api' -> 'API in runtime_constraints
fixed test for 17299
doc: clarification about proxy flag
Merge branch '16974-remote-clusters-and-activate-users-doc-take2'
Merge branch '17299-uppercase-api'
Changed 'api' -> 'API in runtime_constraints
fixed test for 17299
Added note about /bin/false as UNIX login
Merge branch '17312-doc-PAM-nologin'
Added note about /bin/false as UNIX login
17530: Added check if API host is missing
Merge branch '17530-arvados-client-fastfail-take2'
SSO deprecation in documentation
Merge branch '17651-sso-deprecated'
Peter Amstutz (170):
16982: OS packages build as ~devN, Python and Ruby use .devN
Fix heading for "upgrading" no issue #
Merge branch '16982-tilde-devN' refs #16982
Separate inline/download keep-web ports refs #16812
Add WebDAV and S3 API documentation
Collection$create returns (vector of) ArvadosFile object
17010: Redesign "Re-run..." button to choose project to run in
17010: When running workflow from workbench, enable reuse by default
17010: Fix debug comment
17010: Fix tests
17010: Fix tests. Tests check that --enable-reuse is set
17010: Don't double up --enable-reuse
17010: Use !! instead of (? true : false)
Merge branch '17010-re-run-workflow' refs #17010
17040: Swap the order of where clauses in the readable_by query
17040: Refactor trash check
17040: Get user_uuids and embed them as a constant in the main query
17040: Cache results of User.group_permissions
17040: RefreshTrashedGroups migration, clear_permissions calls forget_cached_group_perms
17040: Update structure.sql
Merge branch '17040-slow-query' refs #17040
17090: Use EXCLUSIVE lock for permission updates
17090: Migration to refresh_permissions
Merge branch '17090-exclusive-lock' refs #17090
17022: Start work on user activity reporting script
17022: Produce user activity report from the audit logs
17022: Specify time period in days on command line.
17022: Python packaging for arv-user-activity
17022: Make this a fully packaged tool.
17022: Fix packaging
17015: Ensure that containers belong to this cluster
Merge branch '17015-cds-correct-containers' refs #17015
17154: Make sure most current user record is loaded.
17154: Copy updates on federated users to local cluster
16774: Keep-web errors include messages
17154: Add comment. Use strings.HasPrefix
Merge branch '17154-wb-profile' refs #17154
16774: Fix tests. Use encoder for xml error response.
16774: text/plain response uses crlf. Tests check error codes.
17022: Improve output. Added documentation page.
17022: Add test cases for keyset_list_all
17022: Add example usage of keyset_list_all to code cookbook.
17072: Bump cwltool version for unbound 'result' fix
17072: Fix imports. Use task_queue from cwltool.
17072: Increase default submit thread concurrency to 4
17072: Fix for added args on cwltool.docker.get_image
Merge branch '16774-keep-web-errors' refs #16774
17022: Update install docs & fix Marc's email.
Merge branch '17022-user-activity-report' refs #17022
Merge branch '17072-update-cwltool' refs #17072
17224: Fix to have multiple clients connected to separate clusters
17224: Provide alternate credentials to use for creating user tokens
Merge branch '17225-ruby-sdk' refs #17225
17224: Document LoginCluster configuration for login-sync
Merge branch '17224-login-sync' refs #17224
17267: Don't immediately fail if an extension schema is missing
17267: Add integration test for broken link in $schemas
Merge branch '17267-broken-schema-links' refs #17267
17286: Log clickable URL to container request in workbench
17286: URL to final output collection
17286: Tweak output if neither workbench2 or workbench1 is defined
Merge branch '17286-print-urls' refs #17286
Add missing file closes #17281
17293: Update trash_at/deleted_at even on MarshalManifest error
Merge branch '17293-save-logs' refs #17293
17165: Add rake task to copy from arvados-vscode-cwl-training
Update from upstream
17165: Adjust some titles
17165: Update training after going back over it step-by-step
17165: Update vscode training doc
17165: Sync up again
Merge branch '17165-vscode-training-doc' refs #17165
Add missing images refs #17165
Put the missing images in the right place refs #17165
Update vscode training page no issue #
Update cwltool for bug fixes. refs #17213
17165: Add rake task to copy from arvados-vscode-cwl-training
Update from upstream
17165: Adjust some titles
17165: Update training after going back over it step-by-step
17165: Update vscode training doc
17165: Sync up again
Add missing images refs #17165
Put the missing images in the right place refs #17165
Update vscode training page no issue #
Update cwltool for bug fixes. refs #17213
17462: Bump cwltool for scandeps bugfix
17462: Fix fetch_text() signature
17462: Fix tests
Merge branch '17462-default-secondaryfiles' refs #17462
Fix regression refs #17462
17462: Add integration test to confirm fix
Merge branch '17462-secondaryfiles-regression' refs #17462
17521: Add tests, refs #10380 and refs #17521
17521: Use normpath to clean up the path segment.
Merge branch '17521-dot-slash-glob' refs #17521
17598: Handle comparison URLs with :80 or :443
17598: stripDefaultPort behavior, error message when !credentialsOK
Merge branch '17598-keep-web-url' refs #17598
17598: Also use lowercase for URL host comparison
Merge branch '17598-keep-web-url-case' refs #17598
17449: Expand the "token expiration" admin page
17449: Clarifications and edits.
Merge branch '17449-gxp-docs' refs #17449
17589: Ensure that 'group contents' requests are routed correctly
17589: Use more efficient & stable keyset paging.
17589: Disallow offset with group contents count=none
17589: when count=none and offset=0 don't do unnecessary row counts
Merge branch '17589-contents-count-none' refs #17589
Fix integration test closes #17673
17499: Support username/password login on workbench1
17499: Add logo so default WelcomePageHTML works
17499: Adjust formatting. improve error reporting.
17499: Adjust the default welcome page text used by wb1/wb2
17499: Rewrite javascript to pass phantomJS tests
17499: Fixing tests WIP
17499: Fix tests
Merge branch '17499-wb-login-form' refs #17499
17677: Document the "authenticate" endpoint
Merge branch '17677-authenticate-endpoint' refs #17677
Update "supported distributions" table no issue #
Fix case statement for selection of wb1 login UI, refs #17499
17702: Federated lists supports cluster_id parameter
17702: Move check for ClusterID into splitListRequest
Merge branch '17702-wb1-bypass-fed' refs #17702
17703: master branch provision.sh is development install
17703: Salt install docs point to versioned branches to get the scripts.
17703: Be more explicit about package version.
Merge branch '17703-provision-version' refs #17703
17722: Adjust token expiry behavior
17722: Update tests for adjusted MaxTokenLifetime behavior
17722: Tweak tests to be clearer about new behavior
Merge branch '17722-adjust-token-expiry' refs #17722
Pin arvados 2.2 version in provision.sh, refs #17703
Need to export ARVADOS_BUILDING_ so arvados_version.py sees them.
17464: Start by writing the documentation page
17464: Fix config entry
17464: Add upload/download permission checks and logging
17464: Log collection uuid for FileSystem requests
17464: Fix shadowed "sess" variable
17464: Permission/logging testing WIP
17464: Reset database after upload tests
17464: Refactor tests and check that log events are posted
17464: Add upload/download logging and permissions to keepproxy
17464: Fix test.
17464: Activity report lists upload/download events
17464: Update config variables & docs from feedback
17464: Clean up tests
17464: Add tests for paths by /users/ and by PDH
17464: Don't deny or log GET on directories.
17464: Replace cache with LRU cache
17464: Update exported config
17464: Add note about special case involving sharing links
17464: Fix typo in exported config
17464: Unknown user gets "User" permission check instead of failure
17464: keep-web handles cases where user is unknown
17464: MakeRESTRouter returns erro instead of panicking
17464: Couple of doc fixes
17801: Handle glob capture of keep URI with a trailing slash
17333: Add check for valid project uuid, with test
17858: Add test to reproduce bug
17858: Integration test passes
17858: Add ExpressionTool to classes checked for ids when visiting
17858: Tweak logic to avoid KeyError
17879: Default --thread-count=0, upgrade schema-salad
17879: Add test that acr doesn't fail on sbg fields
Add missing link to "restricting-upload-download" to doc refs #17464
Back out some undesired test changes refs #17817
Pin networkx to avoid new version that pulls in scipy/numpy
Update version in provision.sh refs #17877
Peter van Heusden (2):
Fix salt-install's crunch-dispatch-local config and tests
Fix hardcoded initial user name and email
Tom Clegg (280):
16306: Add automatic install page.
16306: Add "install -type package" and "buildpackage".
16306: Sync bundler version to services/api/Gemfile.lock.
16306: Packaging dev cycle, type=production support in lib/boot.
16306: Show logprefix like 'passenger at railsapi'
16306: Add hostname as subjectAltName.
16306: Option to start shell in docker-boot.sh.
16306: Fixup nginx in arvados-boot production mode.
16306: Include wwwtmp dir in package.
16306: Fix nginx port probe.
16306: Set Workbench1 secret key.
16306: Add "ping" health check to keep-balance.
16306: Update gem command line option spelling.
16306: Add --os argument to package build scripts.
16306: Merge branch 'master'
16669: Move fake OIDC provider to arvadostest pkg.
16669: Accept OIDC access token in lieu of arvados api token.
16669: Give LoginCluster a chance to validate bare (non-v2) tokens.
16669: Accept OIDC access token in RailsAPI auth.
16669: Set expiry time when inserting new access token record.
16669: Fix nil pointer dereference.
16669: Fix use of timestamp in local timezone.
16669: Test access tokens in federation scenario.
16669: Fix access token cache panic.
16669: Fix pass-through of cached remote token.
16669: Fix test.
Merge branch '16669-oidc-access-token'
17111: Deselect unsigned_manifest_text by default in groups#contents.
Merge branch '17111-deselect-unsigned-manifest'
17106: Accept v2 token with / replaced by _ as s3 access/secret key.
17106: Test S3 with modified v2 token issued by LoginCluster.
17106: Skip s3cmd test if s3cmd not installed.
17106: Clean up test.
17106: Improve handling of bare tokens issued by remote clusters.
17106: Comment on stored_secret behavior.
17106: Update docs.
17009: Support accessing S3 with virtual hosted-style URLs.
17009: Mention S3 considerations in keep-web install doc.
Merge branch '17009-s3-bucket-vhost'
17106: Recommend using full tokens for S3 access.
17106: Allow use of URL-encoded token as S3 access/secret key.
17106: Fix key unescape: don't convert + to space.
17106: Add examples to S3 auth instructions.
Merge branch '17106-s3-fed-token'
17009: Fix bucket-level ops using virtual host-style requests.
Update error regexp in test case.
17161: Improve SystemRootToken docs.
17009: Test virtual host-style S3 requests.
17009: Fix s3 ListObjects endpoint with vhost-style requests.
Fix tests.
Merge branch '17009-s3-vhost-list'
Warn about missing/short secrets. Delete Rails session key.
17199: Avoid returning same port twice from find_available_port().
Merge branch '17161-doc-system-root-token'
17151: Merge branch 'master'
17202: Bypass 303-with-token on cross-origin requests.
17202: Use explicit SameSite=Lax for 303-with-cookie.
Merge branch '17199-available-port-race'
17202: Test avoiding redirect for cross-origin inline images.
Merge branch '17202-no-redir-crossorigin'
17208: Use normalized path to compute signatures.
17208: Merge branch 'master'
17208: Add test case.
17208: Update test for s3cmd's new console output.
Merge branch '17208-s3-signature-double-slash'
16360: Don't bypass autofillConfig in production mode.
16306: Fix Nginx not starting when running as non-root.
16306: Comment why rm instead of exclude. Delete go tools, too.
16306: Monkeypatch fpm bug.
16306: Remove some unneeded deps from prod/pkg.
16306: Move nginx temp dirs into a subdir.
16306: Merge branch 'master'
16306: Add -eatmydata flag.
16306: Use tmpfs to speed up package building.
16306: Add health check endpoint to dispatcher.
16306: Circumvent Rails redirect-to-https in workbench health check.
16306: Fix permission issues.
16306: Remove more unneeded files from package.
16306: Fix env var ordering.
16306: Comment out Workbench2 so health check succeeds.
17175: Fix logging label for setuidgid-wrapped procs.
17175: Wait for seedDatabase before starting railsapi.
Merge branch '17151-system-token-validation'
16306: Rename arvados-dev buildpackage -> arvados-package build
16306: Refactor docker scripts into arvados-package command.
16306: Fix inability to shutdown passenger processes.
16306: Exit 0 when startup-then-shutdown goes as planned.
16306: Remove daemontools dependency.
Merge branch '17175-boot-fail-rake-seed'
16306: Command usage help.
17170: Add "arvados-client shell" subcommand and backend support.
17170: Specify login username. Improve logging.
17170: Use TLS for controller->crunch-run traffic.
17170: Fixup gateway auth secret.
17170: Test controller->crunch-run tunnel.
17170: Fix dial when API host var is host:port.
17170: Test arvados-client shell command.
17170: Allow shell only if this user submitted all associated CRs.
17170: Dry up close-connection-on-error.
17170: Don't reuse transport that might have http2 enabled.
17170: Improve error messages.
17170: "arvados-client shell" accepts container request UUID.
17170: Fixup error display.
17170: Fix closing pty/tty when nil.
17170: Merge branch 'master'
17170: Fix -help output.
17170: Check container is readable before checking write permission.
17170: Improve error messages.
17170: Use exec() to eliminate intermediate arvados-client process.
17170: Add missing method to APIStub.
17170: Drop gateway_address from searchable columns.
16306: Merge branch 'master'
16306: Use cwd as default source tree.
16306: Update tests.
16306: Remove old bash scripts.
17170: Fix crash when http transport uses default nil transport.
16306: Fixup test.
16306: Hide "easy install" option from the install docs.
17170: Merge branch 'master'
17170: Improve error message for unrecognizable target UUID.
16306: Merge branch 'master'
17170: Allow admin users to run commands in any container.
17170: Re-word comment, document ...-Login-Username header.
16306: Remove obsolete RailsSessionSecretToken config.
16306: Merge branch 'master'
16306: Fix runPassenger HOME env in non-production case.
16669: Fix cache bug.
16669: Test oidcTokenAuthorizer cache.
17170: Add config keys to enable shell access for users/admins.
17170: Add interactive_session_started flag to containers.
17170: Attempt tunnel setup before exec()ing ssh client.
17170: Add new Nginx configs to upgrade notes.
Merge branch '16669-oidc-access-token'
17170: Test OpenSSH client -> shell gateway -> docker exec.
17170: More helpful message if ARVADOS_* env vars are not set.
17170: Return more helpful error if APIHost is not set.
16306: Accept -package-version arg to testinstall.
17170: Merge branch 'master'
16306: Update to Ruby 2.7.2.
16306: Exclude {rails}/config/environments from package.
16306: Add note about dpkg-scanpackages.
16306: Add package metadata.
16306: Print PASS line when testinstall succeeds.
16306: Don't generate Packages.gz until/unless testing the package.
16306: Merge branch 'master'
Merge branch '16306-arvados-easy-install'
17170: Merge branch 'master'
17170: Improve error messages and command help text.
17170: Update test.
17335: Configurable auth params for OIDC and Google.
17212: Propagate -listen-host to postgresql and passenger.
Merge branch '17212-fix-port-conflicts'
Merge branch '17170-container-shell'
Merge branch '17335-oidc-auth-params'
Fix panic when OIDC provider returns no name claim.
17384: Respect CrunchRunCommand and CrunchRunArgumentsList in a-d-c.
Merge branch '17384-crunch-run-configs'
17398: Skip gateway server if dispatcher does not send desired addr.
Merge branch '17398-no-ctr-gateway'
16745: Keep a SiteFileSystem alive for multiple read requests.
16745: Prune enough sessions to reach size limit, not all.
16745: Don't store nil in an atomic.Value (panic).
16745: Handle GetBucketLocation API.
16745: Reject unsupported APIs instead of mishandling.
16745: Rename session cache size metric.
16745: Update test.
Merge branch '16745-keep-web-cache'
16669: Accept OIDC access token in federated requests.
Merge branch '16669-oidc-access-token-fed'
Fix panic when OIDC provider returns no name claim.
17384: Respect CrunchRunCommand and CrunchRunArgumentsList in a-d-c.
17398: Skip gateway server if dispatcher does not send desired addr.
16745: Keep a SiteFileSystem alive for multiple read requests.
16745: Prune enough sessions to reach size limit, not all.
16745: Don't store nil in an atomic.Value (panic).
16745: Handle GetBucketLocation API.
16745: Reject unsupported APIs instead of mishandling.
16745: Rename session cache size metric.
16745: Update test.
16669: Accept OIDC access token in federated requests.
17353: Don't show config-dump warnings for empty config.
Merge branch '17353-install-warnings'
Add test cases for special chars in filename.
13382: Report storage class(es) in headers after successful write.
13382: Use caller-specified storage classes when writing.
13382: Test storage class failure cases.
13382: Rename putResult -> putProgress.
Merge branch '13382-write-to-storage-class'
17392: Ensure requested storage classes are satisfied on write.
16159: Provide a localdb transaction for federation tests.
17392: Test satisfying storage classes via multiple servers.
Merge branch '17392-go-write-to-storage-class'
17531: Remove ForceLegacyAPI14 config flag.
17529: Return RequestLimitExceeded as a RateLimitError.
17346: Don't try to rebalance the zero-length data block.
Merge branch '17531-remove-forcelegacyapi14-config'
17529: Heed MaxCloudOpsPerSecond when calling SetTags.
17529: Catch rate limit errors from DescribeInstances, too.
17529: Update comment.
17528: Don't load config when doing assets:precompile in postinst.
17528: Remove bin/yarn from Rails projects.
17528: Fix assets:precompile @ build time, skip at install time.
17528: Set ready=0 if config is incomplete/missing during install.
Merge branch '17529-ec2-rate-limit'
17529: Heed MaxCloudOpsPerSecond in Instances() and returned insts.
Merge branch '17529-listinstances-rate-limit'
17346: Add test case.
17566: Use configured MaxRequestSize.
17566: Allow large request bodies in integration tests.
17566: Don't bypass controller in SDK integration tests.
17437: Don't copy incoming Content-Length header when proxying.
Merge branch '17437-drop-content-length-header'
Merge branch '17528-install-warnings'
17204: Fix misleading log message on 304 Not Modified response.
17343: Add option to boot without workbench1 to speed up tests.
Merge branch '17346-keep-balance-empty-block'
Merge branch '17204-not-modified'
Merge branch '17566-max-request-size'
17507: Support ListObjectsV2 API.
17507: Fix calling Child() without lock.
17284: Redact RailsAPI host:port in error messages.
Merge branch '17343-workbench1-optional'
Merge branch '17507-listobjectsv2'
16997: Test map key order in check/dump. Fix duplicate warnings.
16997: Use go-yaml fork to avoid key-sorting bug.
Merge branch '17284-redact-railsapi-host'
Merge branch '16997-sort-config-for-diff'
17610: Check scopes when using a remote token.
17284: Fix missing "/" in error message.
Merge branch '17284-redact-railsapi-host'
Update tests for go 1.16.
Don't ask nginx to log to stderr when using setuid.
Merge branch '17610-remote-token-scopes'
17587: Don't reject federated query with large limit param.
Fix "docker port" usage.
17587: Comment SetUpTest calls.
Merge branch '17587-workbench-federated-query'
Fix test regexp.
17590: Rename S3 volume config keys to match AWS terms.
17650: Fix test order dependency.
Merge branch '17650-fix-cwl-tests'
17590: Merge branch 'master'
17590: Improve log messages when old AWS config keys are used.
17590: Fix spelling of S3 driver name.
17590: Error out if both old+new S3 credential configs are provided.
17590: Add upgrade note about changed config keys.
Merge branch '17590-ec2-config-keys'
17657: Allow ssh port forwarding to container ports.
17657: Test port forwarding using OpenSSH client.
17657: Improve test failure messages.
Merge branch '17657-ssh-port-forward'
17680: Document accepting OIDC access tokens.
17680: Add OIDC access token section to "tokens" page.
Merge branch '17680-oidctoken-doc'
17682: Fix stutter in "arvados-client shell" output.
17708: Test skipping non-regular file in output dir.
17704: Check scope before accepting OIDC access tokens.
17704: Enable OIDC access tokens for tests.
17704: Split access token scope config into 2 keys.
17719: Fix incorrect cache update.
Merge branch '17719-keep-web-pdh-cache'
Merge branch '17704-check-token-scope'
Merge branch '17682-fix-stutter'
Remove old Go installation when upgrading.
17464: Add DebugLocksPanicMode and fix some missing locks.
17464: Fix auto-enable DebugLocksPanicMode.
17774: Ignore addition of zero/default values to mounts when frozen.
17774: Test runtime_constraints and scheduling_parameters, too.
17774: Add non-empty mounts to test fixtures.
17803: Warn when config keys are ignored due to case mismatch.
17803: Ensure keys with mismatched case don't get used.
17803: Fix unnecessarily convoluted test case.
17803: Note todo's.
17810: Fix S3 signature verification.
17705: Add dispatchcloud architecture page.
17705: Mention IdleBehavior tag name.
17705: Link install page to arch page.
17705: Improve InstanceSetID wording, update link to mgmt API docs.
17853: Fix map write when only RLock held.
Merge branch '17810-s3-escape-non-unreserved-chars'
Ward Vandewege (265):
16106: add Azure spot instance support.
16922: disable the postgres pager in the rails postinst script.
16992: Merge branch 'master' into 16992-disable-pg-pager
Merge branch '16992-disable-pg-pager' into master
Fix whitespace in build/run-library.sh
Bugfix: fix detection of already generated Python deb/rpm packages.
When calculating the version of our Go and Rails deb/rpm packages, take
Fix arvados-cwl-conformance-tests.
Update new cluster checklist to reflect the deprecation of the SSO
16471: fix a few typos.
16471: refactor documentation to reflect different Salt-based
Make run-build-docker-images.sh a little smarter, allow building just
Make run-build-docker-images.sh a little smarter, allow building just
Fix author e-mail addresses in our gemspecs.
16930: remove local 'latest' tag before pushing.
Merge branch '16930-tagging' into master
Fix more golint warnings.
Fix more golint warnings.
17044: remove Debian "stretch" from the build infrastructure. Update
17044: implement review comments (part 1).
17044: implement review comments (part 2): update cwl tests to use
Merge branch '17044-remove-debian-stretch' into master
documentation: Mention distribution packages on the "Install the Slurm
build: Remove remaining references to the SSO server packages.
17047: bugfixes, and add an entry to the upgrade notes about the
16950: a few cleanups for our container request fixtures: attach a real
16950: add the costanalyzer to arvados-client.
Fix more golint warnings.
16950: add tests for the costanalyzer.
Fix more golint warnings.
17086: build packages for Ubuntu 20.04, Focal Fossa.
Fix require path in the 'script/rails' script for api server.
17086: Merge branch 'master' into 17086-add-focal-fossa
Merge branch '17086-add-focal-fossa' into master
Fix more golint warnings.
16306: shut up bundle warnings about /var/www
16306: really exclude /var/lib/arvados/go from the package, cf.
16306: Make sure that the non-passenger nginx process runs as the
16306: in cmd/arvados-dev/docker-build-install.sh, make sure nginx is
16306: switch to shared ruby libraries.
16306: shrink package size by removing unused cache and .git directories
16950: changes after review.
Fix more golint warnings.
16950: more changes after review.
16950: refactor caching; use ~/.cache/arvados/costanalyzer for that
Fix more golint warnings.
Fix more golint warnings.
17012: when calculating the version of our Python packages, take the
17012: remove old gittaggers.py files.
17012: update calculation of python version number in run-library.sh
17012: switch calculate_python_sdk_cwl_package_versions() to use the
Merge branch 'master' into 17012-fix-python-version-calculation
Merge branch '17012-fix-python-version-calculation' into master
16950: make specifying of the output directory mandatory (remove
16950: switch to os.UserHomeDir(), and send all output to stderr.
Merge branch 'master' into 16950-add-costanalyzer
Merge branch '16950-add-costanalyzer' into master
Remove one more python2 remnant. This is a fix for the
Fix more golint warnings.
Move the handle_python_package() function from run-library.sh to
Now that calculate_python_sdk_cwl_package_versions returns python-style
Remove now-unneeded code from sdk/cwl/test_with_arvbox.sh, add comment
Update error checking in run-build-docker-jobs-image.sh
Fix OS package iteration number in run-build-docker-jobs-image.sh
Make run-build-packages-python-and-ruby.sh say so when it decides to
Documentation cleanups.
Fix more golint warnings.
Fix more golint warnings.
Fix more golint warnings.
Fix more golint warnings.
Fix more golint warnings - update crunchrun tests.
Now that our k8s helm charts retain state, update the documentation
Clarify token details for the arv-user-activity tool.
Upgrade script/create_superuser_token.rb in the api server codebase to
17187: costanalyzer: add support for collection uuids.
17187: costanalyzer: allow specifying multiple comma-separated uuids via
17187: costanalyzer: print the total from the aggregate cost accounting
17187: implement review feedback:
17187: Merge branch 'master' into 17187-costanalyzer-updates
Merge branch '17187-costanalyzer-updates'
Fix ineffassign warning.
Costanalyzer bugfix: when a collection uuid is supplied, write the csv
Fix more golint warnings.
Fix more golint warnings.
Fix a few more golint warnings.
Fix another golint warning.
Fix a few more golint warnings.
Fix a few staticcheck warnings.
We've made a change in the structure of our apt repositories.
Merge branch '17218-repository-update'
Fix detection of packages that were already built.
Fix arvados-src package version generation.
We now publish packages for Ubuntu Focal (20.04), and have stopped
Fix typos in the documentation.
16106: Merge branch 'master' into 16106-azure-spot-instance-support
Documentation: fix typos.
16106: update Azure preemptible node code after real world testing. Add
16106: address review comments.
16106: Merge branch 'master' into 16106-azure-spot-instance-support
Merge branch '16106-azure-spot-instance-support'
Documentation: make the arvados-dispatch-cloud installation instructions
17222: add overview documentation for the components of Keep.
17215: add IAM role support to arvados-dispatch-cloud on EC2.
17222: implement review feedback.
Merge branch 'master' into 17222-doc-add-keep-components-overview
Merge branch '17222-doc-add-keep-components-overview'
17215: Merge branch 'master' into 17215-aws-roles-a-d-c
Merge branch '17215-aws-roles-a-d-c'
Make sure that our Python 3 based packages conflict with the older
Fix ineffassign warning.
Documentation: the Arvados SSO server is deprecated, it is not the
Documentation: reflect the current state of anonymous token generation.
17245: documenation: re-add a modified version of our Slurm
17245: documentation: remove unlinked pages.
17255: Document the "can_login" permission link in the API section.
Fix golint warning.
Fix tests after yesterday's golint warning fix.
17245: Merge branch 'master' into 17245-slurm-install-docs
Merge branch '17245-slurm-install-docs'
17255: Merge branch 'master' into 17255-document-can_login-permission
Merge branch '17255-document-can_login-permission'
Fix broken documentation links.
Documentation: add a default base_url to the Rakefile to simplify
17249: make costanalyzer report preemptible status of the instance in
17340: arvados-dispatch-cloud should take the Containers.ReserveExtraRAM
Merge branch '17340-a-d-c-respects-ReserveExtraRAM'
The configuration parameter is MaxKeepBlobBuffers, not MaxBuffers.
17249: Merge branch 'master' into 17249-costanalyzer-preemptible
Merge branch '17249-costanalyzer-preemptible'
Documentation: fix grammar.
17355: keepstore should take the volume's AccessViaHosts ReadOnly flag
Merge branch '17355-report-volume-ReadOnly-correctly'
17119: First take: add groups endpoints to controller.
Documentation: include the cluster id namespace explanation on the
17119: tweaks for groups endpoints.
17119: remove the default project_class again on the group model, it is
17119: fix options and response type of the groups/shared and
Documentation: fix typo.
17119: make the controller group/contents endpoint conform more
Documentation: fix typos.
17119: merge SharedGroupList into GroupList, which now gets an
17119: merge SharedOptions into ListOptions, which now gets an extra
17119: rename ContentsOptions to GroupContentsOptions.
17119: rename alternate EndpointGroupContents, add comment.
17119: drop the 'Kind' fields from the structs, autogenerate them instead.
17119: fix field type on legacy objects.
17119: make customFileSystem use the group contents endpoint.
17119: make arvados_fuse.fusedir.ProjectDirectory use the group contents endpoint.
When a compute node comes up, we run `mkfs.xfs` on a newly encrypted
Fix a few more golint warnings.
17119: make controller understand filter groups.
17119: add second test, simplify code by switching to the generic
17119: implement review feedback.
17119: one more fix based on review feedback.
17119: Merge branch 'master' into 17119-virtual-folder-from-query
Merge branch '17119-virtual-folder-from-query'
17119: Merge branch 'master' into 17119-use-group-contents
Merge branch '17119-use-group-contents'
Documentation: fix copy/paste error in keep-web installation
17119: controller should export the include_old_versions flag on group
Merge branch '17119-controller-bugfix'
17119: add filter validation for filter groups. Add a test for the
17119: add documentation.
17119: add filter group support to arv-mount.
17119: add (rudimentary) filter group support to workbench.
17119: implement review feedback.
17119: one more fix based on review feedback.
17355: keepstore should take the volume's AccessViaHosts ReadOnly flag
Documentation: include the cluster id namespace explanation on the
Documentation: fix typo.
Documentation: fix typos.
When a compute node comes up, we run `mkfs.xfs` on a newly encrypted
Fix a few more golint warnings.
Documentation: fix copy/paste error in keep-web installation
17119: controller should export the include_old_versions flag on group
17119: Make arv-mount work with the new filter groups code. Also in
17119: further documentation updates.
10458: add some basic documentation for crunchstat-summary.
10458: implement review feedback.
Merge branch '10458-document-crunchstat-summary'
17119: the home project should include filter groups.
17119: address review feedback.
Add license file to the git.arvados.org/arvados.git/sdk/go/arvados
In git.arvados.org/arvados.git/sdk/go/arvados, change the name of the
Add license file to all the git.arvados.org/arvados.git/sdk/go module
Formatting change in cc-by-sa-3.0.txt to make the license text
Append the full license text for Apache 2.0, AGPL v3 and CC-BY-SA 3.0 to
Revert "Add license file to all the git.arvados.org/arvados.git/sdk/go
Revert "In git.arvados.org/arvados.git/sdk/go/arvados, change the name
Revert "Add license file to the
17119: add missing GroupTrash endpoint.
Change the license of 2 files in the Go SDK to Apache 2, they were
17119: add missing fields to GroupContentsOptions.
17119: when the count: none option is supplied, the itemsAvailable field
17495: document the deduplication report. Fix example invocation in the
17495: fix typo.
17495: Merge branch 'master' into 17495-document-dedup-report
Merge branch '17495-document-dedup-report'
17119: implement review feedback.
17119: fix tests.
Update mimemagic gem version to 0.3.6, the previous version (0.3.5) was
Update mimemagic gem version to 0.3.6, the previous version (0.3.5) was
17119: bugfix: when "count: none" is specified, the group/contents
17119: bugfix: the group/contents endpoint should do the right thing
Update mimemagic gem version to 0.3.8, the previous version (0.3.6) was
Update mimemagic gem version to 0.3.8, the previous version (0.3.6) was
The latest version of the mimemagic gem has a new dependency on the
Fix centos7 api server package test.
Due to the mimemagic gem changes, shared-mime-info is now a build
Fix golint warning.
Fix golint warning (incorrect function name in comment).
Add a comment at the top of the documentation Rakefile about generating
17503: the deduplication report tool should not require the Arvados
17119: more changes after review feedback.
17119: one more change after review feedback.
17119: Merge branch 'master' into 17119-add-filter-groups
Merge branch '17119-add-filter-groups'
17503: implement review feedback.
17503: Merge branch 'master' into 17503-fix-deduplication-report-paper-cuts
Merge branch '17503-fix-deduplication-report-paper-cuts'
Fix deduplication report test.
Simplify code a bit.
Fix golint warning.
17498: add a note about the python 3 package names in the upgrade guide.
17498: Build metapackages to ease the migration from python 2 to
17498: address review comments.
Merge branch '17498-python3-migration-metapackages'
Do not pin arvados-login-sync on an ancient version of the arvados gem.
The sks-keyservers network is dying. Update our documentation to use
Bump the Go version to 1.16.3
Our python3 packages should be marked as 'Replaces:' for the old python
Update `arvados-server install` to use go 1.16.3
The upgrade to go 1.16.3 requires a `go mod tidy` to make the build
17651: Wording tweak on the SSO authentication flow page.
Fix typo in a comment on the configuration reference.
Mention the 'Rendezvous' parameter on Keepstore's InternalURLs, for
17678: add documentation for the `arvados-client costanalyzer` command.
17668: basic documentation for the new container shell feature.
17668: A few more tweaks after review feedback.
17668: one more tweak to the firewall rule description for this feature.
17668: Merge branch 'master' into 17668-doc-container-shell-access
Merge branch '17668-doc-container-shell-access'
17678: implement review feedback.
17678: Merge branch 'master' into 17678-costanalyzer-doc
Merge branch '17678-costanalyzer-doc'
A few more doc tweaks.
Change the default for Collections.WebDAVCache.MaxBlockEntries from 4 to
17708: when crunch-run encounters an unsupported file type while copying
Merge branch '17708-crunch-run-unsupported-file-types'
When building compute node images, print the version of packer used.
17738: remove the monkey patch of the OS_VERSION constant from the
Merge branch '17738-remove-constant-modification'
17738: Make our arvados-api and arvados-workbench Gemfiles use the arvados
Merge branch '17738-pin-gemfiles-to-2.1.4'
Make our arvados-api and arvados-workbench Gemfiles use the arvados
Fix building of metapackages for Ubuntu 18.04 and Ubuntu 20.04.
17757: On our compute node images, Docker should not start by default;
Tweak upgrading doc page to reflect the release of 2.2.0.
Remove leftover dead link from the ToC in the 'Set up a shell node'
17778: update docs.
The bleeding edge branch for arvados-workbench2 is now called 'main'.
17776: Basic throttling for VcpuLimitExceeded, MaxSpotInstanceCountExceeded,
17776: address review comments.
The bleeding edge branch is now called 'main'.
Small lib/config load_test.go change to reflect the absense of the
-----------------------------------------------------------------------
hooks/post-receive
--
More information about the arvados-commits
mailing list