[arvados] created: 2.7.0
git repository hosting
git at public.arvados.org
Thu Sep 21 15:49:53 UTC 2023
at 838e396a18ba3dedeaed9f25fbcb2b5a874c3a2a (tag)
tagging 101971b92790b8461ac4c3387014fe70cb7787e5 (commit)
replaces 2.6.0
tagged by Peter Amstutz
on Thu Sep 21 11:48:43 2023 -0400
Release notes at https://arvados.org/release-notes/2.7.0/
Alex Coleman (4):
20497/17846 Updating WGS tutorial for workbench2.
20497/17846 Updating WGS tutorial for based on roadbumps.
20497 adding editable to description
20497: Updating documentation
AnetaSta22 (1):
Update README.md
Brett Smith (130):
18799: Initial prototype of API pydoc generator
18799: Include schemas in API pydoc
18799: Add deprecation notices to API pydoc
18799: Remove old API documentation scripts
18799: Commit canonical discovery document with check
18799: Support relative path to discovery document
18799: Run discovery2pydoc as part of SDK build
18799: Build Python SDK before generating web documentation
18799: Add background to API docstrings
18799: Add discovery2pydoc to Python SDK manifest
18799: Make discovery2pydoc status check Py3.7-compatible
18799: Move canonical discovery document to sdk/python
18799: Mark self parameters as POSITIONAL_OR_KEYWORD
18799: Add missing f-string prefix
18799: Clean up redundant setuptools requirement listing
18799: Add Python 3.7 compatibility for TypedDict
18799: Make the PySDK's build subcommand extend build_py
18799: Link back to resource class from schema docstring
18799: Make schema docstring more specific about how to select object keys
Merge branch '18799-api-pydoc'
18799: Force UTF-8 encoding for discovery2pydoc output
20241: Add ed25519-sk test key
18799: Version PySDK's typing_extensions dependency
12684: Remove custom retry logic from PySDK
12684: Support num_retries in PySDK client constructors
12684: PySDK client retries specific 4xx errors
12684: Check for no log case in controller integration tests
12684/20425: Skip TestContainerInputOnDifferentCluster
12684: Use mock services in arvfile sparse write tests
Refine PySDK collection walk recipe
12684: Stop retrying 422 responses in PySDK
12684: Test that plain 403 responses are not retried
Merge branch '12684-pysdk-auto-retry'
20527: Document the select argument of the groups contents API method
Merge branch '20527-group-contents-select-doc'
20433: Document that LimitLogBytesPerJob=0 disables live logging
20545: Drop If-None-Match from requests proxied by controller
Merge branch '20433-crunch-log-zero-bytes-job'
Merge branch '20545-drop-if-none-match'
20613: Start PySDK logging module with existing constants
20613: Introduce arvados.logging.GoogleHTTPClientFilter
20613: Log early discovery document retries
20613: Use GoogleHTTPClientFilter in a-c-r
20613: Bugfix boolean tucnaround
20613: Deconfigure logger after an exception
20613: Fix test syntax for older Pythons
20613: Add an upgrade note about new PySDK logging
20613: Update unconfigured logger check to accommodate NullHandler
Merge branch '20613-googleapiclient-init-logs'
20663: Improve permissions and ownership handling
20663: Make minimum groups configurable
20663: Use set operations for group management
20663: Make arvados-login-sync actions configurable
20663: Clarify comment about what "safe" config means
20663: Add configuration for arvados-login-sync
20663: Bugfix configuration lookup
20663: Add IgnoredGroups configuration to arvados-login-sync
20663: Merge 2.6.3 upgrading notes
20663: Expand the default SyncIgnoredGroups
Merge branch '20663-login-sync-config'
20710: Switch from pipes.quote to shlex.quote
20710: Remove old backwards compatibility import fallback
Merge branch '20710-shlex-quoting'
20343: Define Python regexps with raw strings
20684: Clean up FUSE references in a-c-r install instructions
20684: Expand "Getting started at the command line" documentation
20684: Copyedit tutorial expectations include
20684: Note crunchstat-summary can be installed in a virtualenv
20684: Note tutorial expectations for all Crunch CLI tools
20684: Simplify curl dependency background
20684: Modernize pycurl dependency discussion
Merge branch '20684-user-install-doc-fixes'
Merge branch '20343-regexp-prefixes'
20543: Recommend users install Python packages in a virtualenv
Merge branch '20543-pip-install-virtualenv'
20797: Add initial support for rocky8 package builds
20797: Streamline setup of Python build variables
20797: Update for new createrepo package+executable name
20797: Update bundler version in rocky8 Docker images
20797: Add basic intro documentation to build README
20797: Add basic documentation for how to add a new target distro
20797: Copyedit "CentOS" for consistent capitalization
20797: Note Alma/CentOS/Red Hat/Rocky 8 support in install docs
20797: Update cross compilation detection logic
20797: Prefer dnf in PostgreSQL install instructions
20797: Run microdnf with --assumeyes
20797: Merge Red Hat package install instructions
Merge branch '20797-rhel8-packages'
20754: Remove test requirements from docker-cleaner
20754: Upgrade docker module for docker-cleaner
Merge branch '20754-docker-py-upgrade'
20853: Switch from pdoc3 to pdoc
20853: Modernize pdoc installation process
20878: Parameterize URL for RPM package builds
20878: Improve RPM download logic
20878: Improve processed RPM check style
20878: Document package download change to add a target distribution
Merge branch '20878-rh-package-download'
Merge branch '20853-pdoc'
20750: Document the api_client_authorizations current API endpoint
20750: Valid tokens can always GET the current token
20750: DRY uncache token test code
20750: Reorder remote token validation strategy
20750: Fix documentation link typo
20839: Remove old Python 2 TextIOWrapper shim
20839: Replace arvados.util.run_command calls in arv-copy
20839: Optimize list sort
20839: Replace arvados.util.list_all calls throughout
20839: Replace arvados.util.mkdir_dash_p calls throughout
20839: Add order_key to select in keyset_list_all
20839: Mark deprecated PySDK functions as such
20836: Update test_select for Py<3.8 compatibility
Merge branch '20839-pysdk-deprecations'
20915: Add missing import to _pycurlhelper
20750: Fix comment typo
20750/20927: Add TODO about network error handling
Merge branch '20750-sharing-token-scopes'
20840: Typo fixes.
20932/20850/20890: Remove switch instructions from Workbench migration guide
20932: Update un/trash instructions for Workbench 2
Merge branch '20932-wb2-docs'
20955: Typo fixes throughout
20497: Make button text consistent with Workbench 2 UI
20497: Add missing paragraph break
20497: Direct the reader to the tutorial project via Public Favorites
20497: Clean up section 5 opening paragraph
20497: Clarify collection view/download
20497: Give brief instructions for reviewing subprocess output
20497: Typo fixes
Merge branch '20497-updating-wgs-tutorial'
George Chlipala (1):
Fix for cached files from arvados-controller
Krzysztof Majewski (1):
Add new list method parameters: include_old_versions, include_trash
Lucas Di Pentima (136):
18790: Updates salt-installer's arvados config to reflect upgrade notes.
18790: Updates salt-installer's keep-web nginx conf to reflect upgrade notes.
20325: Upgrades rack gem on RailsAPI & Workbench1
Merge branch '20325-rack-upgrade'. Refs #20325
20325: Upgrades golang.org/x/net.
Merge branch '20325-go-x-net-upgrade'. Refs #20325
23025: Upgrades nokogiri gem on RailsAPI & Workbench1.
Merge branch '20325-nokogiri-upgrade'. Refs #20325
20325: Upgrades github.com/containerd/containerd dependency.
Merge branch '20325-go-containerd-upgrade'. Refs #20325
20325: Upgrades the globalid gem on both RailsAPI & WB1.
Merge branch '20325-globalid-gem-upgrade'. Refs #20325
20325: Upgrades github.com/docker/distribution module dependency.
Merge branch '20325-go-docker-distribution-upgrade'. Refs #20325
20388: Adds missing arvados services as prometheus targets.
Merge branch '20388-installer-prom-targets'. Closes #20388
20468: Adds config knobs for RailsAPI & controller performance tuning.
Merge branch '20468-installer-perf-knobs'. Closes #20468
20489: Fixes privileges escalation issue on installer's terraform code.
Merge branch '20489-iam-policy-fix'. Closes #20489
20482: Fixes S3 bucket creation for Keep blocks due to changes in AWS defaults.
20482: Allow the site admin to create a non-public Arvados cluster.
20482: Fixes use of var domain_name, it's now used for the Route53 zone.
20482: Allows deploying on known VPC & subnets.
20325: Upgrades jquery-rails and dependencies on RailsAPI & Workbench1.
Merge branch '20325-jquery-rails-upgrade'. Refs #20325
20482: Allows the admin to specify the user for deployment.
20482: Allows the site admin to specify a custom AMI for the nodes.
20482: Allows the site admin to customize tags applied to every resource.
20482: Extracts the private IP addr map as configurable variables.
20482: Extracts DNS aliases map as configurable variables.
20482: Adds proper compute node instance profile instead of using keepstore's.
20482: Sets output as sensitive to make Terraform happy.
20482: Fixes PassRole's target to point to the newly created compute node role.
20482: Allows setting instance types per service node.
20482: Improves readability of instance profile assignment code.
20482: Allows the site admin to specify instance volume sizes per node.
20482: Pins terraform and AWS provider versions.
20482: Adds upgrade notes on domain_name variable changes.
20482: Improves file/dir creation on user_data script.
20482: Improves upgrade note's title.
Merge branch '20482-terraform-custom-configs'. Closes #20482
20482: Fixes formatting.
20482: Don't create S3 endpoint if using a preexisting VPC.
20482: Makes installer.sh compatible with older (Ubuntu 18.04) git versions.
20325: Upgrades github.com/docker/distribution module.
Merge branch '20325-go-docker-distribution-upgrade2'. Refs #20325
Merge branch '20482-further-terraform-improvements'. Refs #20482
20482: Allows the cluster operator to use an arbitrary domain.
20482: Overrides shellinabox config templates to fix the domain name usage.
20482: Re-exports VPC's CIDR.
20482: Code cleanup for readability.
20482: Updates installer's documentation to reflect latest changes.
20482: Updates the upgrade notice to include the DOMAIN envvar at local.params.
20482: For some reason, symlinks don't seem to be ignored for copyright checks.
Merge branch '20482-installer-improvements'. Closes #20482
20474: Adds 5 to controller's request queue size for RailsAPI.
20474: Changes RailsAPI queue size to be 10% more than controller's.
20474: Updates documentation stating that RailsAPI supports /metrics endpoint.
Merge branch '20474-installer-api-reqs-limit'. Closes #20474
20595: Scales nginx settings depending on max concurrent requests config.
Merge branch '20594-scaling-nginx-settings'. Closes #20594
20643: Skip (with a log error) users that don't have their HOME dirs created.
20643: Improves error message.
20643: Skips user account processing earlier to avoid any partial configs.
Merge branch '20643-login-sync-homedir-check'. Closes #20643
20665: Handles secrets on a separate file.
20665: Updates documentation reflecting the new local.params.secrets file.
20665: Updates single-host docs to reflect local.params.secrets addition.
20665: Code style improvements.
20665: Provides examples on how to securely handle the secrets file.
20665: Fixes logic script error & minor docs improvements.
Merge branch '20665-installer-secrets-handling'. Closes #20665
20610: Removes unused keepstore reference from Terraform.
20610: Adds 'balancer' role to the installer scripts.
20610: Adds the new pillars for the balancer role.
20610: Updates arvados' pillar to handle the dispatcher's IP separately.
20610: Tweaks controller's nginx pillar to support "balanced mode".
20610: Tweaks postgresql access control to allow multiple controller hosts.
20707: Updates default to Debian 11 AMI. Forces cgroups v1 for crunchstat.
20707: Don't rely on GRUB_CMDLINE_LINUX be empty in /etc/default/grub
20718: Upgrades google.golang.org/grpc to 1.56.1
20718: Cleans up by running "go mod tidy -compat=1.17"
Merge branch '20718-grpc-upgrade'. Closes #20718
20722: Upgrades github.com/docker/docker to latest version.
20722: Cleans up dependencies with 'go mod tidy'
Merge branch '20707-aws-compute-ami-cgroupsv1'. Closes #20707
Fixes salt bootstrapping on nodes by the installer. Refs #20665
20610: Removes the need to directly edit the arvados.sls pillar.
20610: Fixes a template variable usage.
20610: Adds node list & role->nodes map variables.
20610: Removes duplication on balancer & backend declarations.
20610: Fixes prometheus configuration to track the controller nodes.
20610: Restricts backends' HTTP access by nginx rules.
20610: Allows disabling backend controllers for rolling updates.
20610: Fixes deployment order to avoid failures.
20610: Removes the need to manually set up the ENABLE_BALANCER variable.
20610: Adds documentation for load-balancing & rolling upgrades.
20610: Updates docs to reflect changes on arvados.sls configuration.
20610: Moves code from local.params to its own common.sh file.
20610: Renames the ROLES map variable because the name was being used already.
20610: Deduplicates variable substitution code.
20610: Improves provision.sh code readability.
20610: Unifies the 'api' role with the 'controller' role.
20610: Fixes balancer nginx's request queue config depending on # of backends
20610: Documentation fixes & additions.
20610: Changes the default installer config in order to simplify documentation.
20610: Documentation changes, including simplification & fixes.
Merge branch '20610-installer-load-balancer'. Refs #20610
Fixes instance profile assignment. Refs #20610
Fixes comment formatting. No issue #
Fixes deployment when using envvar BRANCH=main. No issue #
Further fixes on single host installer deployment. No issue #
20889: Install Prometheus server from archives instead of package repo.
20889: Adds configurable data retention parameter for Prometheus.
20889: Sets default values for environment variables.
20889: Removes DISABLED_CONTROLLER from the user-editable local.params file.
20889: Removes unnecessary documentation about rolling upgrades.
20889: Adds config handling of external database service.
20889: Allows configurable S3 bucket name and IAM profile for Keep backend.
20889: Allows customization on database name and user.
20889: Fixes a bug when database & controller roles are on a single node.
20889: Checks that cert files are present before trying to use them.
20889: Fixes installer.sh indentation to match the how provision.sh is written.
20889: Adds documentation explaining the use of TLS cert keys encryption.
20889: Fixes Keep S3 bucket instructions.
Merge branch '20889-installer-fixes'. Closes #20889
20888: Expands the encrypted cert key feature's documentation.
20888: Applies suggested improvements.
Merge branch '20888-encrypted-cert-key-doc'. Closes #20888
20926: Allows the database version to be configurable from local.params.
20926: Requires manually setting PG version when not using the 'database' role.
20926: Sets PostgreSQL v15 the default version.
20926: Sets default PG version when when using single host deployment.
20926: Makes regex for postgres.client state more strict.
Merge branch '20926-installer-pg-client-version'. Closes #20926
Peter Amstutz (140):
Update R package version to 2.6.0
20123: Make OpenID connect token a proper subsection
20123: Add note about scopes
20123: Fix tabs vs spaces
Merge branch '20123-access-token-doc' refs #20123
Add 2.6.1 to upgrade notes. refs #20345
20257: Refactor http-to-keep downloader
20257: Need to parse status code out of the header, because pyCurl
20257: Record basic workflow status in "activity"
20257: Tweak runtime status for 'activity'
20257: Add message before doing any HTTP activity
20257: Set INFO log level explicitly
20257: Don't log arvados.keep at INFO
20257: Fix test
20257: Mark functions and classes internal not intended for use
20257: Fix use of dataclass
Merge branch '20257-http-import' refs #20257
Adjust trash_at of log collection to now+2 weeks refs #20378
Adjust default value of BalanceCollectionBuffers down to 4
20422: Do GET when cache slot is empty instead of raising an error
Import dataclasses for py 3.6, refs #20257
Merge branch '20422-cache-slot' refs #20422
20462: Refactor "common prefix" function & fix fencepost errors
20462: Move to util & use Brett's implementation
Merge branch '20462-workflow-prefix' refs #20462
20432: Tweak "error checking states on API server" message
Merge branch '20432-getting-containers' refs #20432
20470: Implement select parameter for 'contents' API calls
20470: Handle nil selection, selecting on writable_by
20470: Fix tests
20470: Disallow selecting manifest_text on group contents
20470: Update priorities with a single stored query
20470: Remove locks on containers table
20472: Remove special handling of update_priority
20472: Inherit priority being propagated down
20472: Add a few comments and add container_tree function
20472: Add a couple more cancellation tests
20472: Need to make sure :id is selected in update_priority for reload
20470: Restore error selecting on invalid fields
20472: Always do "select for update" before priority update
20470: Fix discovery document generation to drop unpublished fields
20470: select_for_klass checks for bogus prefixed fields
Merge branch '20472-priority-update' refs #20472
Merge branch '20457-max-supervisors-overquota' refs #20457
Merge branch '20470-contents-select' refs #20470
20529: Lock direct parent containers on updates
Merge branch '20529-container-deadlocks' refs #20529
Add 2.6.2 to the upgrading notes refs #20393
20561: crunch-run logs files/directories propagated from keep
20531: don't print crunch-run log when the error is with the tool
20531: Add an extra newline to make the error section easier to see
20531: Add toplevel dependency to solve install error
20561: Don't fail when inspecting a file outside the output directory
Merge branch '20561-file-copy-logging' refs #20561
20531: Remove urllib3 pin, add cwltest pin.
Increase WatchdogInterval and WatchdogThreshold
20531: Suppress googleapiclient retry warning, better download error
20531: Bump cwltool and schema-salad versions
20531: Add --reinstall option to test_with_arvbox.sh
Merge branch '20531-cwl-log-tail' refs #20531
20548: Rework git deployment a bit
20548: Emit the git commit in the deploy log.
Initialize rcode variable, refs #20611
Merge branch '20548-installer-deploy' refs #20548
20614: Better query for live container requests when deciding to retry
Merge branch '20614-no-retry-cancel' refs #20614
20601: Rename Scheduler.maxSupervisors -> Scheduler.supervisorFraction
Merge branch '20601-supervisor-fraction' refs #20601
20652: When polling the API server, limit fields returned
20637: Move the prefetch thread pool to KeepClient
20637: Fix arv-get
20637: Fix tests
Merge branch '20637-prefetch-threads' refs #20637
Merge branch '20652-cwl-poll-select' refs #20652
20660: Add devtools::check to run_test.R
Merge branch '20664-java-sdk-pr-205' refs #20664
20660: Tweaks to eliminate check warnings
20374: add arv:workflowMain to metadata properties doc.
Merge branch '20660-r-sdk-pr-204' refs #20660
Merge branch '20374-workflow-main-prop' refs #20374
20619: Add fpm-info for arvados-client to depend on fuse
20619: Add test arvados-client executable starts
Merge branch '20619-arv-client-libfuse' closes #20619
20731: Make some text changes & reorganization based on workbench 2 updates
Merge branch '20731-user-guide-wb2' refs #20731
20680: Rework worker settings for new controller behavior
20688: Add wb1 to wb2 redirects to arvbox
20688: Fix quoting issue
20688: Add nginx redirects from wb1 paths to wb2 paths to salt
20688: check for ssh ahead of time, sync only before deploy
20688: Reorder redirects by priority
20688: "workbench" host is now workbench2
20688: Update single host/multiple hostname template
20680: Fix nginx_balancer_configuration & add note about defaults
Merge branch '20680-default-config-updates' refs #20680
20680: installer does rolling update of controller
20680: Only do a rolling update when there is multiple controllers
20680: Increase MaxConcurrentRequests to 8
Merge branch '20680-rolling-deploy' refs #20680
Merge branch '20688-wb1-to-wb2-redirects' refs #20688
Add packages required to build newer singularity, refs #20735
20680: Set concurrency to num_cpus * 2 with a minimum of 8
20858: Enable 'exists' filter to use index
Merge branch '20680-cores-concurrency' refs #20680
Merge branch '20858-jsonb-exists' refs #20858
Add pdoc to arvbox, refs #20853
20877: Add test for trashing project
20877: When trashing a project, update priorities on container requests
20877: Don't retry trashed container requests
20877: Fix missing 'and'
20894: Change InitialQuotaEstimate and SupervisorFraction defaults.
20894: Wordsmithing
20894: Set LimitLogBytesPerJob to 0
20894: Change default retention on prometheus to 90 days
Revert "20894: Change default retention on prometheus to 90 days"
Merge branch '20894-instances-default' refs #20894
Merge branch '20877-trashed-priority' refs #20877
20877: Do not create log or output collections if parent is frozen or trashed
Merge branch '20877-trashed-priority' refs #20877
20850: Add deprecation notice & wb2 redirect to every page
20850: Fix test selector
20840: Add warning boxes to legacy APIs and rearrange API listing
20840: Add deprecations to upgrade notes
20850: Don't show wb2 deprecation notice to anonymous users
20840: Fix broken url
Merge branch '20840-api-deprecate-notice' refs #20840
20850: Fix capitalization and indentation
Merge branch '20850-wb1-deprecated' refs #20850
Add note about api_client_authorization deprecated fields refs #20951
20955: Reorder upgrade notes in rough order of disruptiveness
20955: Update documentation about the new and legacy container logging systems
Merge branch '20955-log-update-doc' refs #20955
Pin cwltest version that we package, refs #20973
Merge branch '20973-cwltest' refs #20973
Fix cwltest version pin, refs #20973
Set 2.7.0 release date, refs #20769
Add singularity build deps libglib2.0-dev and libseccomp-dev to packer
Check out singularity from git to get submodules
Need to have nvidia installed so singularity detects it
Fix 2.7.0 date in upgrading notes, refs #20769
Tom Clegg (213):
18790: Add arvados-client logs command.
18790: Prefix each line with source filename.
18790: Don't retry unless we know the container exists.
18790: Improve error messages.
18790: Fix range used for checking file size.
18790: Use WebDAV.InternalURLs instead of WebDAVDownload.
18790: Add upgrade note re WebDAV.InternalURLs.
18790: Error out instead of retrying if server is too old.
18790: Don't check stderr.txt for container state hints.
18790: Sort lines by timestamp before displaying a chunk.
18790: Improve status update messages.
20123: Add hints about OpenID Connect configuration.
20123: Add detail about OIDC token validation/cache implementation.
20334: Batch permission updates during link dedup migration.
20336: Reject >64 bit operands when filtering on integer columns.
20336: Allow filtering on set of integers.
19620: Remove old "v1" S3 keepstore driver.
20203: Fix global var reset on db reset; skip in non-test mode.
Merge branch '20336-filter-bigint'
Merge branch '20334-slow-dedup-migration'
19620: Remove goamz dependency in non-testing code.
Merge branch '20203-rails-cache'
Merge branch '19620-remove-old-s3-driver'
20241: Move authorized_keys to new code path, validate public key.
20319: Move /containers/*/log to /container_requests/*/log.
20319: Merge branch 'main' into 20319-container-request-logs
Merge branch '20241-validate-ssh-keys'
20319: Update documentation.
14070: Add trigram indexes on collections.name and projects.name.
Merge branch '14070-name-index'
Merge branch '20319-container-request-logs'
18790: Merge branch 'main' into 18790-log-client
18790: Move to container_requests/*/log endpoint.
18790: Fix usage messages.
18790: Enable follow mode with -f flag.
20447: Don't lock containers table for cost updates.
20447: Don't lock containers table for CR name/description updates.
20457: Log at info level when flapping lock at concurrency limit.
20457: Implement MaxDispatchAttempts in test stub.
20457: Don't keep ctr mounts in memory after computing node size.
20457: Add logging in test case wrt 503 responses.
Merge branch '20447-less-table-locking'
20457: Don't keep non-"tmp" mounts in memory at all.
Merge branch '20457-logs-and-mem-usage'
20457: Include delayed supervisor containers in overquota metric.
Merge branch '18790-log-client'
20457: Add dispatchcloud_probe_age_seconds_max and _median metrics.
20475: Option to dump active requests when queue is >=90% full.
Merge branch '20475-dump-busy-queue'
Check /metrics & /_inspect/requests are available during busy times.
Merge branch '20457-max-supervisors-overquota'
20229: Add "inspecting active requests" page.
20457: Don't displace locked containers with queued containers.
Merge branch '20457-queue-churn'
20522: Load dispatch key from file if configured as file:///...
20520: Add Containers.CloudVMs.InstanceInitCommand config.
20511: Start with 8 concurrent outgoing API calls, not unlimited.
20511: Fix slow-expansion logic.
20511: Limit server-to-server client to 1/4 of API req capacity.
20511: Don't shutdown/unlock based on dynamic maxConcurrency.
20511: Fix unclosed response body in test.
20520: Add test for custom init command.
20511: Don't shutdown excess instances just because MaxSupervisors.
20511: Fix allowing too many supervisor processes.
Merge branch '20511-aborted-boot'
20520: Fix unreleased mutex on error importing SSH key.
20520: Fix broken link.
20540: Remove arvadosclient usage in copier and git_tree.
Merge branch '20520-instance-init-command'
20540: Use arvados.Client for arvadosclient.ArvadosClient reqs.
20485: Option to skip automatic SSH key deployment on cloud VMs.
20229: Improve formatting.
Merge branch '20229-doc-inspect-requests'
20541: Unselect unneeded fields in API calls from crunch-run.
20540: Implement nearly-full jitter for exponential backoff.
20541: Auto unselect fields if response body will not be read.
20540: Ensure delay>0 at attempt>0, even if requested min=0.
20485: Test handling of nil publickey argument.
Merge branch '20485-optional-deploy-ssh-key'
20540: Increase crunch-run API call timeouts to 10m.
Merge branch '20540-crunch-run-retry'
Merge branch '20541-less-fetching-mounts'
Merge branch '20522-load-dispatch-priv-key'
20602: Add priority queue to RequestLimiter.
20602: Add MaxQueuedRequests config.
20602: Priority MinInt64 means never wait in queue.
20602: Prioritize interactive (browser) requests.
20602: Attach assigned priority to response log entry.
20602: Prioritize backend traffic from keep-web as interactive.
20602: Disable queue when testing DumpRequests.
20425: Revert "12684/20425: Skip TestContainerInputOnDifferentCluster"
20425: Test response status for mixed-status backend errors.
20425: Fix response status for mixed-status backend errors.
20425: Reduce timeout for keep-web->controller calls from 5m to 1m.
20601: Fetch only high-priority containers when queue is long.
20601: Fetch mounts field only once per container.
20602: Use stdlib heap implementation.
20602: Add IneligibleForQueuePriority const.
20601: Slow down container queue polling when busy/slow.
20601: Add comment re fetch-by-uuid loop.
Merge branch '20602-controller-qos'
Merge branch '20601-big-ctr-queue'
20601: MaxSupervisorFraction is relative to maxConcurrency.
20647: Fix CORS preflight request handling.
20647: Test CORS preflight request routing.
Merge branch '20647-cr-logs-preflight'
20602: Add queue metrics.
20647: Fix duplicate response headers via reverse proxy.
20602: Report queue time for pos/neg/zero-priority reqs.
20602: Report queue usage bucketed by priority.
20647: Improve comment on header deduplication.
20602: Allow lock requests to queue up to 2s (configurable).
Merge branch '20647-cr-logs-preflight'
Merge branch '20602-queue-metrics'
20425: Merge branch 'main' into 20425-fed-pdh-retry
Merge branch '20425-fed-pdh-retry'
20667: Reduce max supervisors if pool reaches cloud quota.
20667: Adjust timeout/retry settings to address occasional failures.
20667: Add at_quota metric.
20667: Add InitialQuotaEstimate config.
20606: Don't reuse unstarted preemptible ctr for non-preemptible cr.
20606: Update retry tests.
20559: Test concurrent writes using same token.
20559: Serialize writes for a given collection ID.
20559: Garbage collect unused per-collection mutexes.
20559: Refactor session sharing.
20559: Explain locking strategy in comments.
Merge branch '20606-reuse-preemptible'
20559: Trim session count explicitly instead of using LRU cache.
20722: Update ContainerCreate usage for new docker client library.
Merge branch '20722-docker-upgrade'
Merge branch '20559-dav-concurrent-writes'
Merge branch '20667-maxsuper-atquota'
20726: Update s3ListObjects paging test.
20726: Fix ListObjects[V2] pages duplicating last item on next page.
20726: Fix traversing projects/collections that precede page marker.
Merge branch '20726-s3list-pages'
17244: Remove crunchstat debian package.
17244: Refactor crunchstat to use cgroup unified/hybrid modes.
17244: Make -cgroup-parent-subsystem=X work in cgroups v2.
17244: Fix singularity reporting host stats as container stats.
20726: Fix unreleased session in s3 handler.
Merge branch '20726-s3-session-release'
17244: Test findCgroup on cgroup files in crunchstat testdata.
17244: Use crunch-run's cgroup, not init's, for "host" stats.
20705: Warn if some stats are missing.
17244: Clarify log message.
17244: Update docs for -cgroup-parent-subsystem flag.
17244: Fix doc link.
Merge branch '17244-cgroup2'
20735: Update to go 1.20.
20735: Update ruby and singularity.
20735: Update Go to 1.20.6.
20755: Support multiple/alternate subnets on EC2.
20755: Allow cloud drivers to register their own metrics.
20755: Report metrics for ec2 instances per subnet.
20735: Sync bundler version.
20705: 10% failure on stub Create to ensure running error path.
Merge branch '20705-crunchstat-warn-missing-data'
20735: Update singularity version in docs and build script.
20735: Merge branch 'main' into 20735-update-deps
Fix error check.
20735: Clarify singularity version/compatibility expectations.
Merge branch '20735-update-deps'
20755: Run cloudtest suite once per configured subnet, not just 1st.
20755: Fix test case by accepting empty DriverParameters.
20755: Merge branch 'main' into 20755-ec2-multiple-subnets
20457: When passing prior quota level, raise maxConcurrency slowly.
20457: Exercise quota handling in dispatcher chaos test.
20457: Fix flaky test.
Merge branch '20755-ec2-multiple-subnets'
20649: cloudtest obeys DeployPublicKey config, like a-d-c.
20457: Fix total instances count.
20457: Don't lock-cycle next-in-line ctr while waiting for quota.
20457: Update test to match new unlock-at-quota behavior.
20649: Log boot probe errors other than usual wait-for-boot errors.
20649: Log actual error from last failed boot probe.
20457: Fix flaky test.
20649: Don't wait timeoutSignal before sending first TERM signal.
20649: Fix panic on race, worker shutdown vs. container startup.
20649: Mention `arvados-server cloudtest` in boot timeout log msg.
Merge branch '20457-careful-near-quota'
Merge branch '20649-ssh-help'
17244: Use cpu.max to get available fraction of CPUs.
17244: New debian10 testdata, add cpu.max and cpuinfo for others.
17244: Add upgrade note re number formatting change.
Merge branch '17244-cgroup2-cpu-max'
20735: Fixup singularity dependencies (test/dev-only).
20735: Fix firefox package name on debian 11.
20735: Revive lib/install dependency test.
20735: Fix auto version generator.
20735: Override git directory ownership check.
20735: Fix default workbench2-source path.
20735: Workaround nginx/glibc/docker issue.
Merge branch '20735-install-test'
20757: `arvados-client shell` uses settings.conf if present.
20612: Run diagnostics from inside the test container too.
20757: Split tests into separate funcs.
Merge branch '20757-ctr-shell-settings'
github-207: Fix outgoing Host header in proxy request.
20612: Set DEBIAN_FRONTEND=noninteractive for container build.
20612: Document diagnostics image building / container options.
Merge branch '20919-fix-proxy-url'
20612: Fix up punctuation/capitalization in docs.
Merge branch '20612-diag-ctr-api-access'
Avoid Python3.7 incompatibility introduced in typing_extensions 4.8.
20930: Fix unhelpful test failure output.
20930: Fix passing arvados.Client (with a sync.Mutex) by value.
20930: Concurrency optimization.
20930: Test many clients connecting and disonnecting.
20930: Fix deadlock in notify/listen event loop.
Fix flaky dispatchcloud test.
Merge branch '20930-websocket'
Zoë Ma (15):
Doc: Update Ruby dependencies and fix Rakefile
Doc: Update "Accessing Arvados Workbench" for Workbench 2
Doc: Update "Running a workflow using Workbench"
Doc: Update "Getting an API token".
Doc: Update "Accessing an Arvados VM with Webshell"
Doc: Update "Accessing an Arvados VM with SSH - Unix Environments"
Doc: Remove reference to "dashboard" in template about adding SSH key
Doc: Update "Uploading data"
Doc: Update "Downloading data".
Doc: Add a figure caption in "Downloading data".
Doc: Update "Trashing and untrashing data"
Doc: Update "Starting a Workflow at the Command Line"
Doc: Update "Adding a new Arvados git repository"
Doc: Update "Working with an Arvados git repository"
Doc: Update the included note about Workbench 2 transition.
-----------------------------------------------------------------------
hooks/post-receive
--
More information about the arvados-commits
mailing list