[ARVADOS] created: c25d075dc2eb72f45b93b77e1e24033b83ecb168

git at public.curoverse.com git at public.curoverse.com
Tue Aug 11 17:38:29 EDT 2015


        at  c25d075dc2eb72f45b93b77e1e24033b83ecb168 (commit)


commit c25d075dc2eb72f45b93b77e1e24033b83ecb168
Author: Brett Smith <brett at curoverse.com>
Date:   Tue Aug 11 17:38:21 2015 -0400

    6950: Improve "make a job" check in Crunch dispatch install guide.
    
    * This check ensures that Crunch has something to dispatch.  It
      doesn't test anything about the disptacher itself.  Move it up, as a
      prerequisite sanity check.
    * Explain what success looks like.
    * Explain common error causes and how to debug them.
    * Better markup for the user input.

diff --git a/doc/install/install-crunch-dispatch.html.textile.liquid b/doc/install/install-crunch-dispatch.html.textile.liquid
index c3512fc..9b885be 100644
--- a/doc/install/install-crunch-dispatch.html.textile.liquid
+++ b/doc/install/install-crunch-dispatch.html.textile.liquid
@@ -7,6 +7,30 @@ title: Install the Crunch dispatcher
 
 The dispatcher normally runs on the same host/VM as the API server.
 
+h2. Test the Arvados job queue
+
+Crunch dispatches work from the job queue on the Arvados API server.  Before you start installing the Crunch dispatcher, now's a good time to check that the API server and Git server can coordinate to create job records.  Run this command *on your shell server* to create a job to calculate the MD5 checksum of every file in the collection you specify.
+
+<notextile>
+<pre><code>~$ <span class="userinput">read -rd $'\000' newjob <<EOF; arv job create --job "$newjob"
+{"script_parameters":{"input":"<strong>[your collection's content address]</strong>"},
+ "script_version":"0988acb472849dc0",
+ "script":"hash",
+ "repository":"arvados"}
+EOF</span>
+</code></pre>
+</notextile>
+
+If you get the error
+
+<pre>
+ArgumentError: Specified script_version does not resolve to a commit
+</pre>
+
+it often means that the API server can't read the specified repository—either because it doesn't exist, or the user running the API server doesn't have permission to read the repository files.  Check the API server's log (@/var/www/arvados-api/current/log/production.log@) for details, and double-check the instructions in the "Git server installation guide":install-arv-git-httpd.html.
+
+If the API server creates a job record with state @Queued@ and script_version @0988acb472849dc08d576ee40493e70bde2132ca@, then everything's working well.  You can proceed to install the Crunch dispatcher and a compute node.  This job will remain queued until they're both ready.
+
 h2. Perl SDK dependencies
 
 Install the Perl SDK on the controller.
@@ -128,27 +152,6 @@ h2. Crunch user account
 
 Run @sudo adduser crunch at .  The crunch user should have the same UID, GID, and home directory on all compute nodes and on the dispatcher (API server).
 
-h2. Git Repositories
-
-Crunch scripts must be in Git repositories in the directory configured as @git_repositories_dir@/*.git (see the "API server installation":install-api-server.html#git_repositories_dir).
-
-Once you have a repository with commits -- and you have read access to the repository -- you should be able to create a new job:
-
-<pre>
-read -rd $'\000' newjob <<EOF; arv job create --job "$newjob"
-{"script_parameters":{"input":"f815ec01d5d2f11cb12874ab2ed50daa"},
- "script_version":"master",
- "script":"hash",
- "repository":"arvados"}
-EOF
-</pre>
-
-Without getting this error:
-
-<pre>
-ArgumentError: Specified script_version does not resolve to a commit
-</pre>
-
 h2. Run the Crunch dispatcher service
 
 To dispatch Arvados jobs:

-----------------------------------------------------------------------


hooks/post-receive
-- 




More information about the arvados-commits mailing list