[ARVADOS] updated: 1.1.4-725-gc8a4dee5e

Git user git at public.curoverse.com
Tue Jul 31 11:38:43 EDT 2018


Summary of changes:
 README.md                                          |    4 +-
 apps/workbench/Gemfile.lock                        |    4 +-
 .../app/assets/javascripts/models/session_db.js    |   11 +-
 build/run-library.sh                               |    3 +-
 doc/_config.yml                                    |   34 +-
 doc/_includes/_install_compute_docker.liquid       |   27 +
 doc/_includes/_skip_sso_server_install.liquid      |   12 -
 doc/admin/health-checks.html.textile.liquid        |   70 +
 doc/admin/management-token.html.textile.liquid     |   56 +
 doc/admin/metrics.html.textile.liquid              |  163 ++
 doc/admin/upgrading.html.textile.liquid            |   46 +-
 doc/api/execution.html.textile.liquid              |   28 +
 doc/css/images.css                                 |    8 +
 doc/install/cheat_sheet.html.textile.liquid        |    2 +-
 ...opy_pipeline_from_curoverse.html.textile.liquid |   20 +-
 .../create-standard-objects.html.textile.liquid    |   84 -
 .../install-dispatch.html.textile.liquid           |   31 +-
 .../install-slurm.html.textile.liquid              |    2 -
 doc/install/index.html.textile.liquid              |   16 +-
 doc/install/install-api-server.html.textile.liquid |   32 +-
 .../install-arv-git-httpd.html.textile.liquid      |   45 +
 doc/install/install-components.html.textile.liquid |   28 +
 doc/install/install-composer.html.textile.liquid   |   59 +
 doc/install/install-controller.html.textile.liquid |  180 ++
 .../install-keep-balance.html.textile.liquid       |    7 +-
 doc/install/install-keepproxy.html.textile.liquid  |   23 +-
 doc/install/install-keepstore.html.textile.liquid  |   39 +-
 ...nstall-manual-prerequisites.html.textile.liquid |    8 +-
 .../install-nodemanager.html.textile.liquid        |   29 +-
 .../firstpipeline.html.textile.liquid              |    2 +-
 doc/user/composer/c1.png                           |  Bin 0 -> 17420 bytes
 doc/user/composer/c10.png                          |  Bin 0 -> 33020 bytes
 doc/user/composer/c11.png                          |  Bin 0 -> 26144 bytes
 doc/user/composer/c12.png                          |  Bin 0 -> 175462 bytes
 doc/user/composer/c13.png                          |  Bin 0 -> 11645 bytes
 doc/user/composer/c14.png                          |  Bin 0 -> 13116 bytes
 doc/user/composer/c15.png                          |  Bin 0 -> 50066 bytes
 doc/user/composer/c16.png                          |  Bin 0 -> 32472 bytes
 doc/user/composer/c17.png                          |  Bin 0 -> 34259 bytes
 doc/user/composer/c18.png                          |  Bin 0 -> 59780 bytes
 doc/user/composer/c19.png                          |  Bin 0 -> 53580 bytes
 doc/user/composer/c2.png                           |  Bin 0 -> 41693 bytes
 doc/user/composer/c20.png                          |  Bin 0 -> 23625 bytes
 doc/user/composer/c21.png                          |  Bin 0 -> 11379 bytes
 doc/user/composer/c22.png                          |  Bin 0 -> 13713 bytes
 doc/user/composer/c23.png                          |  Bin 0 -> 12253 bytes
 doc/user/composer/c24.png                          |  Bin 0 -> 19931 bytes
 doc/user/composer/c2b.png                          |  Bin 0 -> 14285 bytes
 doc/user/composer/c2c.png                          |  Bin 0 -> 9123 bytes
 doc/user/composer/c3.png                           |  Bin 0 -> 38471 bytes
 doc/user/composer/c4.png                           |  Bin 0 -> 8811 bytes
 doc/user/composer/c5.png                           |  Bin 0 -> 24020 bytes
 doc/user/composer/c6.png                           |  Bin 0 -> 41978 bytes
 doc/user/composer/c7.png                           |  Bin 0 -> 26904 bytes
 doc/user/composer/c8.png                           |  Bin 0 -> 44358 bytes
 doc/user/composer/c9.png                           |  Bin 0 -> 18920 bytes
 doc/user/composer/composer.html.textile.liquid     |  119 +
 doc/user/cwl/cwl-runner.html.textile.liquid        |   10 +-
 doc/user/cwl/cwl-style.html.textile.liquid         |    2 +
 doc/user/topics/arv-copy.html.textile.liquid       |    4 +-
 doc/user/topics/arv-docker.html.textile.liquid     |   10 +-
 .../running-external-program.html.textile.liquid   |    4 +-
 ...tutorial-workflow-workbench.html.textile.liquid |    4 +
 .../writing-cwl-workflow.html.textile.liquid       |    6 +-
 lib/controller/federation.go                       |  117 +
 lib/controller/federation_test.go                  |  301 +++
 lib/controller/handler.go                          |  146 +-
 lib/controller/handler_test.go                     |   14 +-
 lib/controller/proxy.go                            |   83 +
 lib/controller/server_test.go                      |   68 +
 lib/crunchstat/crunchstat.go                       |   64 +-
 sdk/R/R/Arvados.R                                  | 2796 ++++++++++----------
 sdk/R/R/ArvadosFile.R                              |   20 +-
 sdk/R/R/Collection.R                               |   22 +-
 sdk/R/R/CollectionTree.R                           |   10 +-
 sdk/R/R/HttpParser.R                               |    6 +-
 sdk/R/R/HttpRequest.R                              |   15 +-
 sdk/R/R/RESTService.R                              |   15 +-
 sdk/R/R/Subcollection.R                            |   14 +-
 sdk/R/R/autoGenAPI.R                               |   16 +-
 sdk/R/tests/testthat/fakes/FakeHttpParser.R        |    6 +-
 sdk/R/tests/testthat/fakes/FakeHttpRequest.R       |   29 +-
 sdk/R/tests/testthat/fakes/FakeRESTService.R       |    4 +-
 sdk/R/tests/testthat/test-ArvadosFile.R            |   46 +-
 sdk/R/tests/testthat/test-Collection.R             |    6 +-
 sdk/R/tests/testthat/test-CollectionTree.R         |   20 +-
 sdk/R/tests/testthat/test-HttpParser.R             |   10 +-
 sdk/R/tests/testthat/test-HttpRequest.R            |   85 +-
 sdk/R/tests/testthat/test-RESTService.R            |   99 +-
 sdk/R/tests/testthat/test-Subcollection.R          |   62 +-
 sdk/R/tests/testthat/test-util.R                   |   20 +-
 sdk/cli/arvados-cli.gemspec                        |    4 +-
 sdk/cli/bin/crunch-job                             |   10 +
 sdk/go/arvados/api_client_authorization.go         |    4 +
 sdk/go/arvados/config.go                           |   26 +-
 sdk/go/arvados/postgresql.go                       |   20 +
 sdk/go/arvadostest/fixtures.go                     |    2 +
 sdk/go/auth/auth.go                                |   24 +-
 sdk/go/auth/salt.go                                |   48 +
 sdk/go/dispatch/dispatch.go                        |   12 +-
 sdk/go/httpserver/metrics.go                       |  129 +
 sdk/python/tests/run_test_server.py                |   17 +-
 sdk/ruby/lib/arvados/google_api_client.rb          |    5 +
 services/api/Gemfile                               |    5 +-
 services/api/Gemfile.lock                          |   14 +-
 services/api/app/controllers/static_controller.rb  |    2 +-
 services/api/config/initializers/oj_mimic_json.rb  |   11 +
 services/api/config/initializers/time_format.rb    |    2 +
 services/api/db/structure.sql                      |    3 +-
 services/api/lib/crunch_dispatch.rb                |    5 +
 services/api/lib/safe_json.rb                      |    6 +
 services/api/test/integration/cross_origin_test.rb |    4 +-
 services/api/test/test_helper.rb                   |    2 +-
 .../crunch-dispatch-slurm_test.go                  |   14 +-
 services/crunch-dispatch-slurm/squeue.go           |   24 +-
 services/crunch-dispatch-slurm/squeue_test.go      |   44 +
 services/crunch-run/crunchrun.go                   |    1 +
 services/crunchstat/crunchstat.go                  |    4 +-
 services/keep-web/doc.go                           |    6 +
 services/keep-web/handler.go                       |    4 +
 services/keep-web/handler_test.go                  |    5 +-
 services/keep-web/server.go                        |    7 +-
 services/keep-web/server_test.go                   |   72 +
 services/keepproxy/keepproxy_test.go               |    2 +-
 services/keepstore/config.go                       |   64 -
 services/keepstore/handlers.go                     |   12 +-
 services/login-sync/arvados-login-sync.gemspec     |    2 +-
 .../arvnodeman/computenode/dispatch/__init__.py    |   24 +-
 .../arvnodeman/computenode/driver/__init__.py      |    8 +-
 .../arvnodeman/computenode/driver/azure.py         |    4 +-
 .../arvnodeman/computenode/driver/dummy.py         |    2 +-
 .../arvnodeman/computenode/driver/ec2.py           |    4 +-
 .../arvnodeman/computenode/driver/gce.py           |    5 +-
 services/nodemanager/arvnodeman/config.py          |    3 +-
 services/nodemanager/arvnodeman/daemon.py          |   69 +-
 services/nodemanager/arvnodeman/jobqueue.py        |    5 +-
 services/nodemanager/arvnodeman/launcher.py        |    3 +-
 services/nodemanager/doc/azure.example.cfg         |   10 +
 services/nodemanager/doc/ec2.example.cfg           |    9 +
 services/nodemanager/doc/gce.example.cfg           |    9 +
 services/nodemanager/tests/fake_azure.cfg.template |    6 +-
 services/nodemanager/tests/integration_test.py     |    5 +-
 .../nodemanager/tests/test_computenode_dispatch.py |   14 +-
 services/nodemanager/tests/test_daemon.py          |   16 +
 services/ws/config.go                              |    4 +-
 services/ws/event_source.go                        |   16 -
 services/ws/event_source_test.go                   |   30 +-
 services/ws/server.go                              |    2 +-
 tools/arvbox/lib/arvbox/docker/Dockerfile.base     |    2 +-
 tools/arvbox/lib/arvbox/docker/api-setup.sh        |    8 +-
 tools/arvbox/lib/arvbox/docker/common.sh           |    4 +-
 tools/arvbox/lib/arvbox/docker/crunch-setup.sh     |    2 +-
 tools/arvbox/lib/arvbox/docker/keep-setup.sh       |   23 +-
 .../lib/arvbox/docker/service/api/run-service      |    4 +-
 .../docker/service/arv-git-httpd/run-service       |    2 +-
 .../lib/arvbox/docker/service/composer/run-service |    2 +-
 .../service/{api => controller}/log/main/.gitstub  |    0
 .../docker/service/{api => controller}/log/run     |    0
 .../lib/arvbox/docker/service/controller/run       |   50 +
 .../service/crunch-dispatch-local/run-service      |    2 +-
 tools/arvbox/lib/arvbox/docker/service/doc/run     |   10 +-
 .../lib/arvbox/docker/service/doc/run-service      |   31 +-
 .../lib/arvbox/docker/service/gitolite/run-service |    4 +-
 .../lib/arvbox/docker/service/keep-web/run-service |    2 +-
 .../arvbox/docker/service/keepproxy/run-service    |    2 +-
 .../service/{api => nginx}/log/main/.gitstub       |    0
 .../arvbox/docker/service/{api => nginx}/log/run   |    0
 .../lib/arvbox/docker/service/{api => nginx}/run   |    0
 .../lib/arvbox/docker/service/nginx/run-service    |   54 +
 tools/arvbox/lib/arvbox/docker/service/ready/run   |   10 +-
 .../lib/arvbox/docker/service/ready/run-service    |    4 +-
 .../lib/arvbox/docker/service/sso/run-service      |    2 +-
 tools/arvbox/lib/arvbox/docker/service/vm/run      |    2 +-
 .../lib/arvbox/docker/service/vm/run-service       |    2 +-
 .../arvbox/docker/service/websockets/run-service   |    2 +-
 .../arvbox/docker/service/workbench/run-service    |    6 +-
 ...application_yml_override.py => yml_override.py} |    9 +-
 vendor/vendor.json                                 |   26 +-
 178 files changed, 4254 insertions(+), 2201 deletions(-)
 delete mode 100644 doc/_includes/_skip_sso_server_install.liquid
 create mode 100644 doc/admin/health-checks.html.textile.liquid
 create mode 100644 doc/admin/management-token.html.textile.liquid
 create mode 100644 doc/admin/metrics.html.textile.liquid
 delete mode 100644 doc/install/create-standard-objects.html.textile.liquid
 create mode 100644 doc/install/install-components.html.textile.liquid
 create mode 100644 doc/install/install-composer.html.textile.liquid
 create mode 100644 doc/install/install-controller.html.textile.liquid
 create mode 100644 doc/user/composer/c1.png
 create mode 100644 doc/user/composer/c10.png
 create mode 100644 doc/user/composer/c11.png
 create mode 100644 doc/user/composer/c12.png
 create mode 100644 doc/user/composer/c13.png
 create mode 100644 doc/user/composer/c14.png
 create mode 100644 doc/user/composer/c15.png
 create mode 100644 doc/user/composer/c16.png
 create mode 100644 doc/user/composer/c17.png
 create mode 100644 doc/user/composer/c18.png
 create mode 100644 doc/user/composer/c19.png
 create mode 100644 doc/user/composer/c2.png
 create mode 100644 doc/user/composer/c20.png
 create mode 100644 doc/user/composer/c21.png
 create mode 100644 doc/user/composer/c22.png
 create mode 100644 doc/user/composer/c23.png
 create mode 100644 doc/user/composer/c24.png
 create mode 100644 doc/user/composer/c2b.png
 create mode 100644 doc/user/composer/c2c.png
 create mode 100644 doc/user/composer/c3.png
 create mode 100644 doc/user/composer/c4.png
 create mode 100644 doc/user/composer/c5.png
 create mode 100644 doc/user/composer/c6.png
 create mode 100644 doc/user/composer/c7.png
 create mode 100644 doc/user/composer/c8.png
 create mode 100644 doc/user/composer/c9.png
 create mode 100644 doc/user/composer/composer.html.textile.liquid
 create mode 100644 lib/controller/federation.go
 create mode 100644 lib/controller/federation_test.go
 create mode 100644 lib/controller/proxy.go
 create mode 100644 lib/controller/server_test.go
 create mode 100644 sdk/go/arvados/postgresql.go
 create mode 100644 sdk/go/auth/salt.go
 create mode 100644 sdk/go/httpserver/metrics.go
 create mode 100644 services/api/config/initializers/oj_mimic_json.rb
 copy tools/arvbox/lib/arvbox/docker/service/{api => controller}/log/main/.gitstub (100%)
 copy tools/arvbox/lib/arvbox/docker/service/{api => controller}/log/run (100%)
 create mode 100755 tools/arvbox/lib/arvbox/docker/service/controller/run
 mode change 120000 => 100755 tools/arvbox/lib/arvbox/docker/service/doc/run
 copy tools/arvbox/lib/arvbox/docker/service/{api => nginx}/log/main/.gitstub (100%)
 copy tools/arvbox/lib/arvbox/docker/service/{api => nginx}/log/run (100%)
 copy tools/arvbox/lib/arvbox/docker/service/{api => nginx}/run (100%)
 create mode 100755 tools/arvbox/lib/arvbox/docker/service/nginx/run-service
 mode change 120000 => 100755 tools/arvbox/lib/arvbox/docker/service/ready/run
 rename tools/arvbox/lib/arvbox/docker/{application_yml_override.py => yml_override.py} (79%)

       via  c8a4dee5e52feed137ca3cb4c4a4e224efbb694f (commit)
       via  d80674f09b714ee2ced537f18d73d325672db3c2 (commit)
       via  db33fa2b2d1f09a186bc07a2956cb0edae380d2c (commit)
       via  996776292b5bfaeadb89457943ea1fba0700d030 (commit)
       via  cd5cd1855c02319ca31410943c4d944133294b17 (commit)
       via  676d3522be04f774ba3a7db38d88b284252e0408 (commit)
       via  43175f034f8015c6ca89a04fa8d9a322cf156265 (commit)
       via  c0b02133b2988b05772de5f2716d152aec4864ca (commit)
       via  904e0b03fd558491d9dee39d7679a6c77eb6abd5 (commit)
       via  d6c7e2952413c33a4af9b1599e4000b9df622661 (commit)
       via  35ac725af39a6326323cac66b28c532e49e27510 (commit)
       via  8fdac0b6f954b6265798390b95e61f8192b85630 (commit)
       via  f5d7521ca506d63f631c603938cac5f40663bcca (commit)
       via  22f96cd164a9a86e577b1ca4de24a281e7fbfa17 (commit)
       via  641ef213571f793bb290a182dee3c4325bc85096 (commit)
       via  cdc146d447ae1ba42275d4ce7f34bd0b04158306 (commit)
       via  92fba2405fc9cd6bbb6b1c4f5a7774f15b242696 (commit)
       via  c775680aefe1b6813b50f0a97dc073caeb4befbc (commit)
       via  85f6919fae720c41474e60f5c21710f70e446070 (commit)
       via  c41b3893a26d542142de86a641e43077df3bda16 (commit)
       via  3ae140fa072b2f2fbc8576c20ffd81fe463e78a5 (commit)
       via  b211e857d304f7fbe8787d2b65a307da841d047b (commit)
       via  57153b5a518646399e9b62ad693ce213dae21972 (commit)
       via  0853b16ad82a6b4411f04910d0035a2c653cfc29 (commit)
       via  b9a322e1aba0030f2dc13c2cf71fb581876c68cc (commit)
       via  d63984fdc1cf7c48cab9a57640415e85c8bfc48f (commit)
       via  0a3d7a02236cbec448203a1b2218b5e0630d1c00 (commit)
       via  a77e606772cd4909f2401f55cd7c3c08f8325fb8 (commit)
       via  cec8e2705d260c9df1042858941419a3b9160c0e (commit)
       via  9cc572d6a44262e21251372e28b549cfc09e681a (commit)
       via  115e837fd16eecd80868267b0a6f99a531d4cc93 (commit)
       via  febdebbb58592be73dcf7d4bd4b2c7ff96657741 (commit)
       via  bef56b9a22efac9ce73006623080e84a0b57f243 (commit)
       via  b3b3d214f54d7909f12e60a911b02676818400b1 (commit)
       via  711711827bb0c3564836707bb7d4453c60c6a98c (commit)
       via  3271e860e871b19a2f3be68376c57c2ce88993ac (commit)
       via  8df5b745955fafef08056a742680979b81faeb1e (commit)
       via  d6e1bfee59569d79f0f3e24620280e70aa161403 (commit)
       via  0985649e03f3112be396fb67ee7507ff47a37571 (commit)
       via  d91eb0fae8d2ef4c2348769694573bf725ef16d4 (commit)
       via  6c66177816fe128595454e9890d2c82a984cbc90 (commit)
       via  2f4a5bef7433097558b89844c84d4cc40a447c53 (commit)
       via  8ab6b482342b95ad35775867bcdb8fd691b78fb7 (commit)
       via  58a026e09bda4c1e2374347615c325007c64fac4 (commit)
       via  e2cc6c1935565ee965f38501a4974e9d0e6b29e5 (commit)
       via  d2bb622dce5e765e55942e4da6348f949883d9fc (commit)
       via  c09663a2b1342e755daafcf8e4a4c2b121e4a253 (commit)
       via  649d52a70fd75e255437deb1798fa9f09697b78c (commit)
       via  fba33040ea730ccc30035557226fc1a1de32ba6e (commit)
       via  7f0f3ab4e13dd808b7b761039c857d55c7843175 (commit)
       via  9a80d15b7cab21efe16ec2b543dfb566bea9def4 (commit)
       via  297c4aaf43858eff5022a1e72eb8e09660bde4b0 (commit)
       via  080c940d7a8134a6e277a53b7e45eb27e2b2c87f (commit)
       via  eef816fa8450fd3ce5388f4701ed888691ba897a (commit)
       via  55137e6828bf11f76c3f9ec61e4a76954f5d6fa1 (commit)
       via  cb64653912a604809c3429f7dbda781741acd18a (commit)
       via  0011b5236fc9a562bc13f943f9a431c496b2b7cd (commit)
       via  3c23a0a57bde2978402e5d46ca2b003becee6d58 (commit)
       via  42012c4746d6dd81eb3c72fddb2fdd36cff381e7 (commit)
       via  bc66b072e80a69cd9cb4f0c4bf746995305eaf8d (commit)
       via  6fe8e52020d421797306e5c6536afbcee761510a (commit)
       via  a4166f402b34e018940ae1df726351e8c52ac1c1 (commit)
       via  355173ba2e8c42b29011493d1d8c7cc4d69295c6 (commit)
       via  ab3afbb684bc1b32577c2696e13882123bfff7d2 (commit)
       via  321e025cde18b8069dfc8977754af39f2efe505a (commit)
       via  265fe64e5b7a931736f156c3cb446fbbbc27f018 (commit)
       via  84f21d5634e17be62748f29f4303a86e0be6715b (commit)
       via  83d08d7ccbc622ec97948929c83fb91f96743ca2 (commit)
       via  051b9e763b0a14f9039f536859bd2c1580faa31c (commit)
       via  66fc74001e777ac7ceff2b02cfc459b1368f42f3 (commit)
       via  d27d94532c173335cae9dddc30f1cc9a2e372bd7 (commit)
       via  b3c1156e1d4ed9f15a36bc51f2cd125a65aab3d3 (commit)
       via  843b4e5cf7727528fb5b45629030fd0d6a364ab7 (commit)
       via  a93ef946eb1e73ee190ea4ff19c4f9278235530c (commit)
       via  db5107dca09b786374f06a35abb51ffc3f032abd (commit)
       via  50cbdcbd67f8b0da06d3b188e7bfdea3963661a7 (commit)
       via  c9653ef070009e03061e59f2e13ea06cf7c16b01 (commit)
       via  0279d2f8a27170c151833c470b88cf361aa3b91e (commit)
       via  ef7718f230f076d369f8c66064e7b542d24e57ed (commit)
       via  9ba887f887aa3736ab50728ccd2c0ae20e45d2a4 (commit)
       via  ec9ecf93b25f849e8480ece08b330c22b13bfe5f (commit)
       via  e0033099ba12ae2c42d41d3d049b9d759663d35d (commit)
       via  d4df74752927fbd464567f13723ba0dc5d9e5ff0 (commit)
       via  cd5141d405db649f0b99ca55b46ff68f16dc13b9 (commit)
       via  336095d3ba51bf434c11a6d9d67e510bad165a0a (commit)
       via  8d75c13b5601cb3450ad253cdddfef41499ba493 (commit)
       via  5c2e355aca8dd456a646e743652a1be87113113f (commit)
       via  b5e8bde902d5b6d806c087fb30aea568da01a81c (commit)
       via  0c27a910dc594c3d9eee5a69866cac220c0b18ba (commit)
       via  115d8b18837272ee53144586454a684541318b84 (commit)
       via  1980d00a9afeaea0bc6f266892e43de14ccd297e (commit)
       via  7c893856e22073b10dc147b887b0fd64b11a1f81 (commit)
       via  d640a546f2cd55cfbd0a959bcfb84be1eecdd6a6 (commit)
       via  09afabfb3de546d55c3a33ae0b68291edf414fcb (commit)
       via  29776dabd84b8070b647ee38289214b7a56b2c1c (commit)
       via  146f7179c88c0d25acc91ff2b5faff8e7f98d1be (commit)
       via  3712b5943d9d32346552cb91ec5c4690e14485b9 (commit)
       via  2ac43c8c20d917376b2b92c09c46fa5641d054f8 (commit)
       via  bc248010427eded4610d7f337d3ee01d4d06538a (commit)
       via  ce85cd0b2605a6cbfb96bf18c1f2913d33b60f44 (commit)
       via  8ae6680ebae91af9b0aafd6c9cfe5e5fb97f8b12 (commit)
       via  5eda2f0ee6fcab67d3a74517a85946435931c67b (commit)
       via  7c1e0140fb0d059299af08a102d30d65dfb60990 (commit)
       via  f4fd17ccc26166a195b7344b84d95e9ff2315a36 (commit)
       via  cf24a6137c3b70060fc5a9197f751595b1033131 (commit)
       via  8d3ecc67ad5d208e5327b81dffda0c10ef0a8378 (commit)
       via  3934348cf5166ed53248bed7f2aa3b98d067cbc2 (commit)
       via  acf545571425b2a2d8a26cb703f75926b6b2a987 (commit)
       via  0a2cc29e409f85381a8ee1ae1f0097937eb11804 (commit)
       via  fe8e22166ce16ec8ee78c53e49d0ab23f767d9a6 (commit)
       via  951c8a79bca7224fdf8c50463d0c9a60b43ce930 (commit)
       via  b29c13b372bd39075eabda49ea57b0cb6d5a8452 (commit)
       via  81d5bd428962c1819c0c60de5bc5d93710798424 (commit)
       via  d22f92638664d9744a38e60dce9f0d95a2d393f0 (commit)
       via  6b8a3d3d912573ab432c319121eaffd0bbe2216b (commit)
       via  424298694945c9f66676bd401753be44f6fc5fa8 (commit)
       via  64a357242cc7ba9fb877a9b3d622160318098c5c (commit)
       via  57074c15587686e066d7e44adec7b6c7154d6ac4 (commit)
       via  95de13bdab14eb803a4c9e2243df50e1eb0df69a (commit)
       via  e1633d0a8365f63db56777524b1281d90bd9ee46 (commit)
       via  890195dc78d25d9a8f1e513197e4adc71be4f146 (commit)
       via  967821ec0ac00aef677f943e709ea079ebc30f78 (commit)
       via  116f934f0359b27ae3bd3047860fc5e7f27bdcf5 (commit)
       via  59cf374273bfae0baec8370526a747bbb8e5edb7 (commit)
       via  a6ab70e907a47e8e28aae2dd3eb357aa72c8b673 (commit)
      from  f9a05f61abdf33891b09d62205d009d1cae73d1b (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.


commit c8a4dee5e52feed137ca3cb4c4a4e224efbb694f
Author: Tom Clegg <tclegg at veritasgenetics.com>
Date:   Tue Jul 31 11:31:55 2018 -0400

    13497: Link issues and commit hashes to redmine.
    
    "#1234" and "commit:foo" markup doesn't work here like it did on the
    redmine wiki where the content came from.
    
    Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg at veritasgenetics.com>

diff --git a/doc/admin/upgrading.html.textile.liquid b/doc/admin/upgrading.html.textile.liquid
index 359142dd7..55f39f7d8 100644
--- a/doc/admin/upgrading.html.textile.liquid
+++ b/doc/admin/upgrading.html.textile.liquid
@@ -30,7 +30,7 @@ Note to developers: Add new items at the top. Include the date, issue number, co
 TODO: extract this information based on git commit messages and generate changelogs / release notes automatically.
 {% endcomment %}
 
-h3. 2018-07-31: #13497 commit:db5107dca adds a new system service, arvados-controller
+h3. 2018-07-31: "#13497":https://dev.arvados.org/issues/13497 "db5107dca":https://dev.arvados.org/projects/arvados/repository/revisions/db5107dca adds a new system service, arvados-controller
 * "Install the controller":../install/install-controller.html after upgrading your system.
 * Verify your setup by confirming that API calls appear in the controller's logs (_e.g._, @journalctl -fu arvados-controller@) while loading a workbench page.
 
@@ -155,7 +155,7 @@ baseCommand: echo
 
 This bug will be fixed in an upcoming release of Arvados.
 
-h3. 2017-12-08: #11908 commit:8f987a9271 now requires minimum of Postgres 9.4 (previously 9.3)
+h3. 2017-12-08: "#11908":https://dev.arvados.org/issues/11908 "8f987a9271":https://dev.arvados.org/projects/arvados/repository/revisions/8f987a9271 now requires minimum of Postgres 9.4 (previously 9.3)
 * Debian 8 (pg 9.4) and Debian 9 (pg 9.6) do not require an upgrade
 * Ubuntu 16.04 (pg 9.5) does not require an upgrade
 * Ubuntu 14.04 (pg 9.3) requires upgrade to Postgres 9.4: https://www.postgresql.org/download/linux/ubuntu/
@@ -164,7 +164,7 @@ h3. 2017-12-08: #11908 commit:8f987a9271 now requires minimum of Postgres 9.4 (p
 *# Install the @rh-postgresql94@ backport package from either Software Collections: http://doc.arvados.org/install/install-postgresql.html or the Postgres developers: https://www.postgresql.org/download/linux/redhat/
 *# Restore from the backup using @psql@
 
-h3. 2017-09-25: #12032 commit:68bdf4cbb now requires minimum of Postgres 9.3 (previously 9.1)
+h3. 2017-09-25: "#12032":https://dev.arvados.org/issues/12032 "68bdf4cbb":https://dev.arvados.org/projects/arvados/repository/revisions/68bdf4cbb now requires minimum of Postgres 9.3 (previously 9.1)
 * Debian 8 (pg 9.4) and Debian 9 (pg 9.6) do not require an upgrade
 * Ubuntu 16.04 (pg 9.5) does not require an upgrade
 * Ubuntu 14.04 (pg 9.3) is compatible, however upgrading to Postgres 9.4 is recommended: https://www.postgresql.org/download/linux/ubuntu/
@@ -173,21 +173,21 @@ h3. 2017-09-25: #12032 commit:68bdf4cbb now requires minimum of Postgres 9.3 (pr
 *# Install the @rh-postgresql94@ backport package from either Software Collections: http://doc.arvados.org/install/install-postgresql.html or the Postgres developers: https://www.postgresql.org/download/linux/redhat/
 *# Restore from the backup using @psql@
 
-h3. 2017-06-30: #11807 commit:55aafbb converts old "jobs" database records from YAML to JSON, making the upgrade process slower than usual.
-* The migration can take some time if your database contains a substantial number of YAML-serialized rows (i.e., you installed Arvados before March 3, 2017 commit:660a614 and used the jobs/pipelines APIs). Otherwise, the upgrade will be no slower than usual.
+h3. 2017-06-30: "#11807":https://dev.arvados.org/issues/11807 "55aafbb":https://dev.arvados.org/projects/arvados/repository/revisions/55aafbb converts old "jobs" database records from YAML to JSON, making the upgrade process slower than usual.
+* The migration can take some time if your database contains a substantial number of YAML-serialized rows (i.e., you installed Arvados before March 3, 2017 "660a614":https://dev.arvados.org/projects/arvados/repository/revisions/660a614 and used the jobs/pipelines APIs). Otherwise, the upgrade will be no slower than usual.
 * The conversion runs as a database migration, i.e., during the deb/rpm package upgrade process, while your API server is unavailable.
 * Expect it to take about 1 minute per 20K jobs that have ever been created/run.
 
-h3. 2017-06-05: #9005 commit:cb230b0 reduces service discovery overhead in keep-web requests.
+h3. 2017-06-05: "#9005":https://dev.arvados.org/issues/9005 "cb230b0":https://dev.arvados.org/projects/arvados/repository/revisions/cb230b0 reduces service discovery overhead in keep-web requests.
 * When upgrading keep-web _or keepproxy_ to/past this version, make sure to update API server as well. Otherwise, a bad token in a request can cause keep-web to fail future requests until either keep-web restarts or API server gets upgraded.
 
-h3. 2017-04-12: #11349 commit:2c094e2 adds a "management" http server to nodemanager.
+h3. 2017-04-12: "#11349":https://dev.arvados.org/issues/11349 "2c094e2":https://dev.arvados.org/projects/arvados/repository/revisions/2c094e2 adds a "management" http server to nodemanager.
 * To enable it, add to your configuration file: <pre>[Manage]
   address = 127.0.0.1
   port = 8989</pre> (see example configuration files in source:services/nodemanager/doc or https://doc.arvados.org/install/install-nodemanager.html for more info)
 * The server responds to @http://{address}:{port}/status.json@ with a summary of how many nodes are in each state (booting, busy, shutdown, etc.)
 
-h3. 2017-03-23: #10766 commit:e8cc0d7 replaces puma with arvados-ws as the recommended websocket server.
+h3. 2017-03-23: "#10766":https://dev.arvados.org/issues/10766 "e8cc0d7":https://dev.arvados.org/projects/arvados/repository/revisions/e8cc0d7 replaces puma with arvados-ws as the recommended websocket server.
 * See http://doc.arvados.org/install/install-ws.html for install/upgrade instructions.
 * Remove the old puma server after the upgrade is complete. Example, with runit: <pre>
 $ sudo sv down /etc/sv/puma
@@ -197,17 +197,17 @@ $ systemctl disable puma
 $ systemctl stop puma
 </pre>
 
-h3. 2017-03-06: #11168 commit:660a614 uses JSON instead of YAML to encode hashes and arrays in the database.
+h3. 2017-03-06: "#11168":https://dev.arvados.org/issues/11168 "660a614":https://dev.arvados.org/projects/arvados/repository/revisions/660a614 uses JSON instead of YAML to encode hashes and arrays in the database.
 * Aside from a slight performance improvement, this should have no externally visible effect.
 * Downgrading past this version is not supported, and is likely to cause errors. If this happens, the solution is to upgrade past this version.
 * After upgrading, make sure to restart puma and crunch-dispatch-* processes.
 
-h3. 2017-02-03: #10969 commit:74a9dec introduces a Docker image format compatibility check: the @arv keep docker@ command prevents users from inadvertently saving docker images that compute nodes won't be able to run.
+h3. 2017-02-03: "#10969":https://dev.arvados.org/issues/10969 "74a9dec":https://dev.arvados.org/projects/arvados/repository/revisions/74a9dec introduces a Docker image format compatibility check: the @arv keep docker@ command prevents users from inadvertently saving docker images that compute nodes won't be able to run.
 * If your compute nodes run a version of *docker older than 1.10* you must override the default by adding to your API server configuration (@/etc/arvados/api/application.yml@): <pre><code class="yaml">docker_image_formats: ["v1"]</code></pre>
-* Refer to the comments above @docker_image_formats@ in @/var/www/arvados-api/current/config/application.default.yml@ or source:services/api/config/application.default.yml or issue #10969 for more detail.
+* Refer to the comments above @docker_image_formats@ in @/var/www/arvados-api/current/config/application.default.yml@ or source:services/api/config/application.default.yml or issue "#10969":https://dev.arvados.org/issues/10969 for more detail.
 * *NOTE:* This does *not* include any support for migrating existing Docker images from v1 to v2 format. This will come later: for now, sites running Docker 1.9 or earlier should still *avoid upgrading Docker further than 1.9.*
 
-h3. 2016-09-27: several Debian and RPM packages -- keep-balance (commit:d9eec0b), keep-web (commit:3399e63), keepproxy (commit:6de67b6), and arvados-git-httpd (commit:9e27ddf) -- now enable their respective components using systemd. These components prefer YAML configuration files over command line flags (commit:3bbe1cd).
+h3. 2016-09-27: several Debian and RPM packages -- keep-balance ("d9eec0b":https://dev.arvados.org/projects/arvados/repository/revisions/d9eec0b), keep-web ("3399e63":https://dev.arvados.org/projects/arvados/repository/revisions/3399e63), keepproxy ("6de67b6":https://dev.arvados.org/projects/arvados/repository/revisions/6de67b6), and arvados-git-httpd ("9e27ddf":https://dev.arvados.org/projects/arvados/repository/revisions/9e27ddf) -- now enable their respective components using systemd. These components prefer YAML configuration files over command line flags ("3bbe1cd":https://dev.arvados.org/projects/arvados/repository/revisions/3bbe1cd).
 * On Debian-based systems using systemd, services are enabled automatically when packages are installed.
 * On RedHat-based systems using systemd, unit files are installed but services must be enabled explicitly: e.g., <code>"sudo systemctl enable keep-web; sudo systemctl start keep-web"</code>.
 * The new systemd-supervised services will not start up successfully until configuration files are installed in /etc/arvados/: e.g., <code>"Sep 26 18:23:55 62751f5bb946 keep-web[74]: 2016/09/26 18:23:55 open /etc/arvados/keep-web/keep-web.yml: no such file or directory"</code>
@@ -222,33 +222,33 @@ h3. 2016-09-27: several Debian and RPM packages -- keep-balance (commit:d9eec0b)
 ** keepproxy - /etc/arvados/keepproxy/keepproxy.yml
 ** arvados-git-httpd - /etc/arvados/arv-git-httpd/arv-git-httpd.yml
 
-h3. 2016-05-31: commit:ae72b172c8 and commit:3aae316c25 install Python modules and scripts to different locations on the filesystem.
-* Previous packages installed these files to the distribution's preferred path under @/usr/local@ (or the equivalent location in a Software Collection).  Now they get installed to a path under @/usr at .  This improves compatibility with other Python packages provided by the distribution.  See #9242 for more background.
+h3. 2016-05-31: "ae72b172c8":https://dev.arvados.org/projects/arvados/repository/revisions/ae72b172c8 and "3aae316c25":https://dev.arvados.org/projects/arvados/repository/revisions/3aae316c25 install Python modules and scripts to different locations on the filesystem.
+* Previous packages installed these files to the distribution's preferred path under @/usr/local@ (or the equivalent location in a Software Collection).  Now they get installed to a path under @/usr at .  This improves compatibility with other Python packages provided by the distribution.  See "#9242":https://dev.arvados.org/issues/9242 for more background.
 * If you simply import Python modules from scripts, or call Python tools relying on $PATH, you don't need to make any changes.  If you have hardcoded full paths to some of these files (e.g., in symbolic links or configuration files), you will need to update those paths after this upgrade.
 
-h3. 2016-04-25: commit:eebcb5e requires the crunchrunner package to be installed on compute nodes and shell nodes in order to run CWL workflows.
+h3. 2016-04-25: "eebcb5e":https://dev.arvados.org/projects/arvados/repository/revisions/eebcb5e requires the crunchrunner package to be installed on compute nodes and shell nodes in order to run CWL workflows.
 * On each Debian-based compute node and shell node, run: @sudo apt-get install crunchrunner@
 * On each Red Hat-based compute node and shell node, run: @sudo yum install crunchrunner@
 
-h3. 2016-04-21: commit:3c88abd changes the Keep permission signature algorithm.
+h3. 2016-04-21: "3c88abd":https://dev.arvados.org/projects/arvados/repository/revisions/3c88abd changes the Keep permission signature algorithm.
 * All software components that generate signatures must be upgraded together. These are: keepstore, API server, keep-block-check, and keep-rsync. For example, if keepstore < 0.1.20160421183420 but API server >= 0.1.20160421183420, clients will not be able to read or write data in Keep.
 * Jobs and client operations that are in progress during the upgrade (including arv-put's "resume cache") will fail.
 
-h3. 2015-01-05: commit:e1276d6e disables Workbench's "Getting Started" popup by default.
+h3. 2015-01-05: "e1276d6e":https://dev.arvados.org/projects/arvados/repository/revisions/e1276d6e disables Workbench's "Getting Started" popup by default.
 * If you want new users to continue seeing this popup, set @enable_getting_started_popup: true@ in Workbench's @application.yml@ configuration.
 
-h3. 2015-12-03: commit:5590c9ac makes a Keep-backed writable scratch directory available in crunch jobs (see #7751)
-* All compute nodes must be upgraded to arvados-fuse >= 0.1.2015112518060 because crunch-job uses some new arv-mount flags (--mount-tmp, --mount-by-pdh) introduced in merge commit:346a558
+h3. 2015-12-03: "5590c9ac":https://dev.arvados.org/projects/arvados/repository/revisions/5590c9ac makes a Keep-backed writable scratch directory available in crunch jobs (see "#7751":https://dev.arvados.org/issues/7751)
+* All compute nodes must be upgraded to arvados-fuse >= 0.1.2015112518060 because crunch-job uses some new arv-mount flags (--mount-tmp, --mount-by-pdh) introduced in merge "346a558":https://dev.arvados.org/projects/arvados/repository/revisions/346a558
 * Jobs will fail if the API server (in particular crunch-job from the arvados-cli gem) is upgraded without upgrading arvados-fuse on compute nodes.
 
-h3. 2015-11-11: commit:1e2ace5 changes recommended config for keep-web (see #5824)
+h3. 2015-11-11: "1e2ace5":https://dev.arvados.org/projects/arvados/repository/revisions/1e2ace5 changes recommended config for keep-web (see "#5824":https://dev.arvados.org/issues/5824)
 * proxy/dns/ssl config should be updated to route "https://download.uuid_prefix.arvadosapi.com/" requests to keep-web (alongside the existing "collections" routing)
 * keep-web command line adds @-attachment-only-host download.uuid_prefix.arvadosapi.com@
 * Workbench config adds @keep_web_download_url@
 * More info on the (still beta/non-TOC-linked) "keep-web doc page":http://doc.arvados.org/install/install-keep-web.html
 
-h3. 2015-11-04: commit:1d1c6de removes stopped containers (see #7444)
+h3. 2015-11-04: "1d1c6de":https://dev.arvados.org/projects/arvados/repository/revisions/1d1c6de removes stopped containers (see "#7444":https://dev.arvados.org/issues/7444)
 * arvados-docker-cleaner removes _all_ docker containers as soon as they exit, effectively making @docker run@ default to @--rm at . If you run arvados-docker-cleaner on a host that does anything other than run crunch-jobs, and you still want to be able to use @docker start@, read the "new doc page":http://doc.arvados.org/install/install-compute-node.html to learn how to turn this off before upgrading.
 
-h3. 2015-11-04: commit:21006cf adds a keep-web service (see #5824)
+h3. 2015-11-04: "21006cf":https://dev.arvados.org/projects/arvados/repository/revisions/21006cf adds a keep-web service (see "#5824":https://dev.arvados.org/issues/5824)
 * Nothing relies on it yet, but early adopters can install it now by following http://doc.arvados.org/install/install-keep-web.html (it is not yet linked in the TOC).

commit d80674f09b714ee2ced537f18d73d325672db3c2
Author: Tom Clegg <tclegg at veritasgenetics.com>
Date:   Tue Jul 31 11:26:36 2018 -0400

    13497: Add controller to upgrade notes.
    
    Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg at veritasgenetics.com>

diff --git a/doc/admin/upgrading.html.textile.liquid b/doc/admin/upgrading.html.textile.liquid
index 7a330a963..359142dd7 100644
--- a/doc/admin/upgrading.html.textile.liquid
+++ b/doc/admin/upgrading.html.textile.liquid
@@ -30,6 +30,10 @@ Note to developers: Add new items at the top. Include the date, issue number, co
 TODO: extract this information based on git commit messages and generate changelogs / release notes automatically.
 {% endcomment %}
 
+h3. 2018-07-31: #13497 commit:db5107dca adds a new system service, arvados-controller
+* "Install the controller":../install/install-controller.html after upgrading your system.
+* Verify your setup by confirming that API calls appear in the controller's logs (_e.g._, @journalctl -fu arvados-controller@) while loading a workbench page.
+
 h3. 2018-04-05: v1.1.4 regression in arvados-cwl-runner for workflows that rely on implicit discovery of secondaryFiles
 
 h4. Secondary files missing from toplevel workflow inputs

commit db33fa2b2d1f09a186bc07a2956cb0edae380d2c
Author: Tom Clegg <tclegg at veritasgenetics.com>
Date:   Mon Jul 30 15:53:45 2018 -0400

    13497: Add controller to install docs.
    
    Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg at veritasgenetics.com>

diff --git a/doc/_config.yml b/doc/_config.yml
index 03fc5af0c..c2c97a9ff 100644
--- a/doc/_config.yml
+++ b/doc/_config.yml
@@ -177,6 +177,7 @@ navbar:
     - Core:
       - install/install-postgresql.html.textile.liquid
       - install/install-api-server.html.textile.liquid
+      - install/install-controller.html.textile.liquid
     - Keep:
       - install/install-keepstore.html.textile.liquid
       - install/configure-fs-storage.html.textile.liquid
diff --git a/doc/install/install-api-server.html.textile.liquid b/doc/install/install-api-server.html.textile.liquid
index 7201460dd..1d071a46d 100644
--- a/doc/install/install-api-server.html.textile.liquid
+++ b/doc/install/install-api-server.html.textile.liquid
@@ -164,10 +164,11 @@ The Nginx server will serve API requests using Passenger. It will also be used t
 
 First, "Install Nginx and Phusion Passenger":https://www.phusionpassenger.com/library/walkthroughs/deploy/ruby/ownserver/nginx/oss/install_passenger_main.html.
 
-Edit the http section of your Nginx configuration to run the Passenger server, and serve SSL requests. Add a block like the following, adding SSL and logging parameters to taste:
+Edit the http section of your Nginx configuration to run the Passenger server. Add a block like the following, adding SSL and logging parameters to taste:
 
 <notextile>
-<pre><code>server {
+<pre><code>
+server {
   listen 127.0.0.1:8000;
   server_name localhost-api;
 
@@ -202,33 +203,6 @@ geo $external_client {
   default        1;
   <span class="userinput">10.20.30.0/24</span>  0;
 }
-
-server {
-  listen       <span class="userinput">[your public IP address]</span>:443 ssl;
-  server_name  <span class="userinput">uuid_prefix.your.domain</span>;
-
-  ssl on;
-  ssl_certificate     <span class="userinput">/YOUR/PATH/TO/cert.pem</span>;
-  ssl_certificate_key <span class="userinput">/YOUR/PATH/TO/cert.key</span>;
-
-  index  index.html index.htm index.php;
-
-  # Refer to the comment about this setting in the server section above.
-  client_max_body_size 128m;
-
-  location / {
-    proxy_pass            http://api;
-    proxy_redirect        off;
-    proxy_connect_timeout 90s;
-    proxy_read_timeout    300s;
-
-    proxy_set_header      X-Forwarded-Proto https;
-    proxy_set_header      Host $http_host;
-    proxy_set_header      X-External-Client $external_client;
-    proxy_set_header      X-Real-IP $remote_addr;
-    proxy_set_header      X-Forwarded-For $proxy_add_x_forwarded_for;
-  }
-}
 </code></pre>
 </notextile>
 
diff --git a/doc/install/install-controller.html.textile.liquid b/doc/install/install-controller.html.textile.liquid
new file mode 100644
index 000000000..ccb8d980a
--- /dev/null
+++ b/doc/install/install-controller.html.textile.liquid
@@ -0,0 +1,180 @@
+---
+layout: default
+navsection: installguide
+title: Install the controller
+...
+{% comment %}
+Copyright (C) The Arvados Authors. All rights reserved.
+
+SPDX-License-Identifier: CC-BY-SA-3.0
+{% endcomment %}
+
+The arvados-controller service must be installed on your API server node.
+
+On Debian-based systems:
+
+<notextile>
+<pre><code>~$ <span class="userinput">sudo apt-get install arvados-controller</span>
+</code></pre>
+</notextile>
+
+On Red Hat-based systems:
+
+<notextile>
+<pre><code>~$ <span class="userinput">sudo yum install arvados-controller</span>
+</code></pre>
+</notextile>
+
+Verify the @arvados-controller@ program is functional:
+
+<notextile>
+<pre><code>~$ <span class="userinput">arvados-controller -h</span>
+Usage:
+  -config file
+[...]
+</code></pre>
+</notextile>
+
+h3. Configure Nginx to route requests to the controller
+
+Add @upstream@ and @server@ definitions inside the @http@ section of your Nginx configuration using the following template.
+
+{% include 'notebox_begin' %}
+
+If you are adding arvados-controller to an existing system as part of the upgrade procedure, do not add a new "server" part here. Instead, add only the "upstream" part as shown here, and update your existing "server" section by changing its @proxy_pass@ directive from @http://api@ to @http://controller@.
+
+{% include 'notebox_end' %}
+
+<notextile>
+<pre><code>upstream controller {
+  server     127.0.0.1:9004  fail_timeout=10s;
+}
+
+server {
+  listen       <span class="userinput">[your public IP address]</span>:443 ssl;
+  server_name  <span class="userinput">uuid_prefix.your.domain</span>;
+
+  ssl on;
+  ssl_certificate     <span class="userinput">/YOUR/PATH/TO/cert.pem</span>;
+  ssl_certificate_key <span class="userinput">/YOUR/PATH/TO/cert.key</span>;
+
+  # Refer to the comment about this setting in the passenger (arvados
+  # api server) section of your Nginx configuration.
+  client_max_body_size 128m;
+
+  location / {
+    proxy_pass            http://controller;
+    proxy_redirect        off;
+    proxy_connect_timeout 90s;
+    proxy_read_timeout    300s;
+
+    proxy_set_header      X-Forwarded-Proto https;
+    proxy_set_header      Host $http_host;
+    proxy_set_header      X-External-Client $external_client;
+    proxy_set_header      X-Real-IP $remote_addr;
+    proxy_set_header      X-Forwarded-For $proxy_add_x_forwarded_for;
+  }
+}
+</code></pre>
+</notextile>
+
+Restart Nginx to apply the new configuration.
+
+<notextile>
+<pre><code>~$ <span class="userinput">sudo nginx -s reload</span>
+</code></pre>
+</notextile>
+
+h3. Configure arvados-controller
+
+Create the cluster configuration file @/etc/arvados/config.yml@ using the following template.
+
+<notextile>
+<pre><code>Clusters:
+  <span class="userinput">uuid_prefix</span>:
+    NodeProfiles:
+      apiserver:
+        arvados-controller:
+          Listen: ":<span class="userinput">9004</span>" # must match the "upstream controller" section of your Nginx config
+        arvados-api-server:
+          Listen: ":<span class="userinput">8000</span>" # must match the "upstream api" section of your Nginx config
+    PostgreSQL:
+      ConnectionPool: 128
+      Connection:
+        host: localhost
+        dbname: arvados_production
+        user: arvados
+        password: <span class="userinput">xxxxxxxx</span>
+        sslmode: require
+</code></pre>
+</notextile>
+
+Create the host configuration file @/etc/arvados/environment at .
+
+<notextile>
+<pre><code>ARVADOS_NODE_PROFILE=apiserver
+</code></pre>
+</notextile>
+
+h3. Start the service (option 1: systemd)
+
+If your system does not use systemd, skip this section and follow the "runit instructions":#runit instead.
+
+If your system uses systemd, the arvados-controller service should already be set up. Restart it to load the new configuration file, and check its status:
+
+<notextile>
+<pre><code>~$ <span class="userinput">sudo systemctl restart arvados-controller</span>
+~$ <span class="userinput">sudo systemctl status arvados-controller</span>
+&#x25cf; arvados-controller.service - Arvados controller
+   Loaded: loaded (/lib/systemd/system/arvados-controller.service; enabled; vendor preset: enabled)
+   Active: active (running) since Tue 2018-07-31 13:17:44 UTC; 3s ago
+     Docs: https://doc.arvados.org/
+ Main PID: 25066 (arvados-control)
+   CGroup: /system.slice/arvados-controller.service
+           └─25066 /usr/bin/arvados-controller
+
+Jul 31 13:17:44 zzzzz systemd[1]: Starting Arvados controller...
+Jul 31 13:17:44 zzzzz arvados-controller[25191]: {"Listen":"[::]:9004","Service":"arvados-controller","level":"info","msg":"listening","time":"2018-07-31T13:17:44.521694195Z"}
+Jul 31 13:17:44 zzzzz systemd[1]: Started Arvados controller.
+</code></pre>
+</notextile>
+
+Skip ahead to "confirm the service is working":#confirm.
+
+h3(#runit). Start the service (option 2: runit)
+
+Install runit to supervise the arvados-controller daemon.  {% include 'install_runit' %}
+
+Create a supervised service.
+
+<notextile>
+<pre><code>~$ <span class="userinput">sudo mkdir /etc/service/arvados-controller</span>
+~$ <span class="userinput">cd /etc/service/arvados-controller</span>
+~$ <span class="userinput">sudo mkdir log log/main</span>
+~$ <span class="userinput">printf '#!/bin/sh\nset -a\n. /etc/arvados/environment\nexec arvados-controller 2>&1\n' | sudo tee run</span>
+~$ <span class="userinput">printf '#!/bin/sh\nexec svlogd main\n' | sudo tee log/run</span>
+~$ <span class="userinput">sudo chmod +x run log/run</span>
+~$ <span class="userinput">sudo sv exit .</span>
+~$ <span class="userinput">cd -</span>
+</code></pre>
+</notextile>
+
+Use @sv stat@ and check the log file to verify the service is running.
+
+<notextile>
+<pre><code>~$ <span class="userinput">sudo sv stat /etc/service/arvados-controller</span>
+run: /etc/service/arvados-controller: (pid 12520) 2s; run: log: (pid 12519) 2s
+~$ <span class="userinput">tail /etc/service/arvados-controller/log/main/current</span>
+{"Listen":"[::]:9004","Service":"arvados-controller","level":"info","msg":"listening","time":"2018-07-31T13:17:44.521694195Z"}
+</code></pre>
+</notextile>
+
+h3(#confirm). Confirm the service is working
+
+Confirm the service is listening on its assigned port and responding to requests.
+
+<notextile>
+<pre><code>~$ <span class="userinput">curl -X OPTIONS http://0.0.0.0:<b>9004</b>/login</span>
+{"errors":["Forbidden"],"error_token":"1533044555+684b532c"}
+</code></pre>
+</notextile>

-----------------------------------------------------------------------


hooks/post-receive
-- 




More information about the arvados-commits mailing list