[ARVADOS] updated: 2.1.0-259-g42d491072
Git user
git at public.arvados.org
Mon Jan 11 14:17:52 UTC 2021
Summary of changes:
doc/admin/federation.html.textile.liquid | 2 +-
doc/admin/spot-instances.html.textile.liquid | 6 +++---
doc/api/index.html.textile.liquid | 2 +-
doc/index.html.liquid | 4 ++--
doc/install/config.html.textile.liquid | 2 +-
doc/install/install-keep-web.html.textile.liquid | 2 +-
.../install-shell-server.html.textile.liquid | 22 +++++++++++++++++++++-
doc/sdk/java-v2/index.html.textile.liquid | 2 +-
.../tutorials/wgs-tutorial.html.textile.liquid | 2 +-
lib/boot/supervisor.go | 12 ++++++------
lib/cloud/azure/azure.go | 3 +--
services/login-sync/bin/arvados-login-sync | 5 ++++-
12 files changed, 43 insertions(+), 21 deletions(-)
via 42d491072c6757a68cbc597961237a1566de4172 (commit)
via bfd4fc641457a4786a5c14b7ae574acc65e1f2b8 (commit)
via e98f4df4aa47fba614e2a078c0ab6d4213d96674 (commit)
via 96afcc7682db1f1f67bcf4ae6acab54927418f1e (commit)
via a622b6980539db9563b6a92e0996197b61dae862 (commit)
via 5280006cf7e9ce93db3390d76f7760353b10479d (commit)
via 1ce3429c4005567a450a28f774e3f543010cd5c6 (commit)
via f53363ea4642dd165decc6786b835979a1dc9f73 (commit)
via e4a6240bf2ca163c36a4357ef0f80958c40bd39a (commit)
via 1917992733f0a467cd068bedfa236efd6f4c37bc (commit)
from c1a84bf6f6c570cc632a5ba8c6406543e2206e3a (commit)
Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.
commit 42d491072c6757a68cbc597961237a1566de4172
Merge: bfd4fc641 e98f4df4a
Author: Ward Vandewege <ward at curii.com>
Date: Mon Jan 11 09:17:32 2021 -0500
16106: Merge branch 'master' into 16106-azure-spot-instance-support
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward at curii.com>
commit bfd4fc641457a4786a5c14b7ae574acc65e1f2b8
Author: Ward Vandewege <ward at curii.com>
Date: Mon Jan 11 09:16:58 2021 -0500
16106: address review comments.
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward at curii.com>
diff --git a/doc/admin/spot-instances.html.textile.liquid b/doc/admin/spot-instances.html.textile.liquid
index 7b4789295..07b721502 100644
--- a/doc/admin/spot-instances.html.textile.liquid
+++ b/doc/admin/spot-instances.html.textile.liquid
@@ -42,11 +42,11 @@ Clusters:
When @UsePreemptibleInstances@ is enabled, child containers (workflow steps) will automatically be made preemptible. Note that because preempting the workflow runner would cancel the entire workflow, the workflow runner runs in a reserved (non-preemptible) instance.
-No additional configuration is required, "arvados-dispatch-cloud":{{site.baseurl}}/install/crunch2-cloud/install-dispatch-cloud.html will now start preemptable instances where appropriate.
+No additional configuration is required, "arvados-dispatch-cloud":{{site.baseurl}}/install/crunch2-cloud/install-dispatch-cloud.html will now start preemptible instances where appropriate.
h3. Cost Tracking
-Preemptable instances prices are declared at instance request time and defined by the maximum price that the user is willing to pay per hour. By default, this price is the same amount as the on-demand version of each instance type, and this setting is the one that @arvados-dispatch-cloud@ uses for now, as it doesn't include any pricing data to the spot instance request.
+Preemptible instances prices are declared at instance request time and defined by the maximum price that the user is willing to pay per hour. By default, this price is the same amount as the on-demand version of each instance type, and this setting is the one that @arvados-dispatch-cloud@ uses for now, as it doesn't include any pricing data to the spot instance request.
For AWS, the real price that a spot instance has at any point in time is discovered at the end of each usage hour, depending on instance demand. For this reason, AWS provides a data feed subscription to get hourly logs, as described on "Amazon's User Guide":https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-data-feeds.html.
@@ -70,6 +70,6 @@ For general information, see "Use Spot VMs in Azure":https://docs.microsoft.com/
When starting preemptible instances on Azure, Arvados configures the eviction policy to 'delete', with max price set to '-1'. This has the effect that preemptible VMs will not be evicted for pricing reasons. The price paid for the instance will be the current spot price for the VM type, up to a maximum of the price for a standard, non-spot VM of that type.
-Please note that Azure provides no SLA for preemptible instances. Even in this configuration, preemptable instances can still be evicted for capacity reasons. If that happens and a container is aborted, Arvados will try to restart it, subject to the usual retry rules.
+Please note that Azure provides no SLA for preemptible instances. Even in this configuration, preemptible instances can still be evicted for capacity reasons. If that happens and a container is aborted, Arvados will try to restart it, subject to the usual retry rules.
Spot pricing is not available on 'B-series' VMs, those should not be defined in the configuration file with the _Preemptible_ flag set to true. Spot instances have a separate quota pool, make sure you have sufficient quota available.
diff --git a/lib/cloud/azure/azure.go b/lib/cloud/azure/azure.go
index 100d87c33..1ff0798ea 100644
--- a/lib/cloud/azure/azure.go
+++ b/lib/cloud/azure/azure.go
@@ -528,13 +528,12 @@ func (az *azureInstanceSet) Create(
},
}
- var maxPrice float64
if instanceType.Preemptible {
// Setting maxPrice to -1 is the equivalent of paying spot price, up to the
// normal price. This means the node will not be pre-empted for price
// reasons. It may still be pre-empted for capacity reasons though. And
// Azure offers *no* SLA on spot instances.
- maxPrice = -1
+ var maxPrice float64 = -1
vmParameters.VirtualMachineProperties.Priority = compute.Spot
vmParameters.VirtualMachineProperties.EvictionPolicy = compute.Delete
vmParameters.VirtualMachineProperties.BillingProfile = &compute.BillingProfile{MaxPrice: &maxPrice}
-----------------------------------------------------------------------
hooks/post-receive
--
More information about the arvados-commits
mailing list