[ARVADOS] updated: 7079ddb46ce3e855a30a4bd5b8f1f3e626ce7b7a

git at public.curoverse.com git at public.curoverse.com
Tue Mar 25 11:27:28 EDT 2014


Summary of changes:
 .../tutorial-firstscript.html.textile.liquid       |    4 +++-
 .../tutorial-new-pipeline.html.textile.liquid      |    8 +++++---
 2 files changed, 8 insertions(+), 4 deletions(-)

       via  7079ddb46ce3e855a30a4bd5b8f1f3e626ce7b7a (commit)
       via  9a405be1112c8bad4c56160a4fc234943449f7c5 (commit)
      from  b50bbef5f429465fe71781be7edebbb8c4479d50 (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.


commit 7079ddb46ce3e855a30a4bd5b8f1f3e626ce7b7a
Author: Tom Clegg <tom at curoverse.com>
Date:   Tue Mar 25 11:27:22 2014 -0400

    Add/explain output_is_persistent flag in example pipelines.

diff --git a/doc/user/tutorials/tutorial-firstscript.html.textile.liquid b/doc/user/tutorials/tutorial-firstscript.html.textile.liquid
index 245e890..ad2f0a4 100644
--- a/doc/user/tutorials/tutorial-firstscript.html.textile.liquid
+++ b/doc/user/tutorials/tutorial-firstscript.html.textile.liquid
@@ -111,7 +111,8 @@ Next, create a file that contains the pipeline definition:
           "dataclass": "Collection"
         }
       },
-      "script_version":"<b>you</b>:master"
+      "script_version":"<b>you</b>:master",
+      "output_is_persistent":true
     }
   }
 }
@@ -128,6 +129,7 @@ EOF
 * @"script"@ specifies the name of the script to run.  The script is searched for in the "crunch_scripts/" subdirectory of the @git@ checkout specified by @"script_version"@.
 * @"script_version"@ specifies the version of the script that you wish to run.  This can be in the form of an explicit @git@ revision hash, or in the form "repository:branch" (in which case it will take the HEAD of the specified branch).  Arvados logs the script version that was used in the run, enabling you to go back and re-run any past job with the guarantee that the exact same code will be used as was used in the previous run.  You can access a list of available @git@ repositories on the Arvados workbench under "Compute %(rarr)→% Code repositories":http://{{site.arvados_workbench_host}}//repositories .
 * @"script_parameters"@ describes the parameters for the script.  In this example, there is one parameter called @input@ which is @required@ and is a @Collection at .
+* @"output_is_persistent"@ indicates whether the output of the job is considered valuable. If this value is false (or not given), the output will be treated as intermediate data and eventually deleted to reclaim disk space.
 
 Now, use @arv pipeline_template create@ tell Arvados about your pipeline template:
 
diff --git a/doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid b/doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid
index f0d54e0..6852886 100644
--- a/doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid
+++ b/doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid
@@ -43,7 +43,8 @@ Next, create a file that contains the pipeline definition:
           "dataclass": "Collection"
         }
       },
-      "script_version":"<b>you</b>:master"
+      "script_version":"<b>you</b>:master",
+      "output_is_persistent":false
     },
     "filter":{
       "script":"0-filter.py",
@@ -52,7 +53,8 @@ Next, create a file that contains the pipeline definition:
           "output_of":"do_hash"
         }
       },
-      "script_version":"<b>you</b>:master"
+      "script_version":"<b>you</b>:master",
+      "output_is_persistent":true
     }
   }
 }

commit 9a405be1112c8bad4c56160a4fc234943449f7c5
Author: Tom Clegg <tom at curoverse.com>
Date:   Tue Mar 25 11:27:07 2014 -0400

    Fix reversed input/output in dependency explanation.

diff --git a/doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid b/doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid
index d218c3b..f0d54e0 100644
--- a/doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid
+++ b/doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid
@@ -60,7 +60,7 @@ EOF
 </span></code></pre>
 </notextile>
 
-* @"output_of"@ indicates that the @input@ of the @do_hash@ component is connected to the @output@ of @filter at .  This is a _dependency_.  Arvados uses the dependencies between jobs to automatically determine the correct order to run the jobs.
+* @"output_of"@ indicates that the @output@ of the @do_hash@ component should be used as the @"input"@ parameter for the @filter@ component. Arvados determines the correct order to run the jobs when such dependencies are present.
 
 Now, use @arv pipeline_template create@ tell Arvados about your pipeline template:
 

-----------------------------------------------------------------------


hooks/post-receive
-- 




More information about the arvados-commits mailing list