Changes between Version 15 and Version 16 of WebValidation


Ignore:
Timestamp:
Jun 23, 2010, 12:08:32 AM (14 years ago)
Author:
Neil Christensen
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • WebValidation

    v15 v16  
    1515      * Run CH & MG on resulting code.
    1616      * Each of these condor jobs relies on previous ones.  If a necessary previous step fails, then the next job is not run.  This is controlled by a "DAG" script.
     17   * User can choose "stock" models.  There are 2 choices:
     18      * Precompiled models that ship with the MEG can be chosen from drop down menu.
     19      * User can upload their own "stock" model, but this is harder.
     20      * User must also upload "particle translation" file.
     21      * User can upload 1 or more parameter files.
     22      * Site tests that particle translation file and parameter files work.
     23      * If tests passed, then this model can be used in validations.
    1724    * If 1 or more MEG passes, the user is allowed to run 2->2 cs processes. 
    1825      * They can choose the MEG they want to test (among the ones that pass the previous tests).
     
    2229        * User can restrict on indices and charges.
    2330    * After processes are generated, user can run them. 
     31      * User can choose from restrictions and parameters.
     32      * User can choose which MEGs to run.
     33      * User can choose which "stock" models to run (and which parameter files for them.)
    2434      * The processes are run on Condor.
    2535        * Currently 4 parallel nodes.  Seems pretty fast.
    26         * Adds 10 processes to the queue at a time.  This allows multiple users and validations to be run at the same time and make progress at the same time.
     36        * Adds 10 jobs to the queue at a time.  Each job has ~5 processes.  This allows multiple users and validations to be run at the same time and make progress at the same time.
    2737        * User can refresh their browser to see the progress.  Each process and MEG that is finished will show up as they are finished.
    28       * User can rerun processes.
     38      * User can rerun processes choosing new MEG's and new stock models if they like.
    2939    * User can create multiple validations.
    3040    * Multiple validations can be run concurrently.  Condor handles this.
     
    3242    * Users can delete models.  (But only when no condor jobs are running for this model.)
    3343    * Users can delete validations.  (But only when this validation is not being run.)
     44    * Users can delete stock models.
    3445    * Security:
    3546        * All user code is run on condor jobs and no where else.
     
    3849        * Users do not control condor.  They can only use web form to start jobs and see the outcome.
    3950  * ''To-do'' (for this summer):
    40     * Get FR-SH and FR-WO working.  (Christian Speckner is helping with WO).  This shouldn't be difficult.  The scaffolding is there.
     51    * Get FR-SH and FR-WO working.  (WO almost done.).  This shouldn't be difficult.  The scaffolding is there.
    4152    * Test whether a Mathematica license is available.  If not, wait and try again.
    42     * Use parameter files in tests.
    43     * Allow upload and comparison with "stock" versions of models.
    44     * Improve security:
    45       * Test that nothing can be written outside of condor job dir.
    46       * Test that condor job cannot do any network connections _except_ certain database updates.
    47       * Control time, memory and disk space available to condor jobs (admin side).
    48       * Only allow transfer back of certain files.  Don't let user overwrite important files...
     53  * ''To-do'' (not gauranteed for this summer but hopefully by summer of 2011):
    4954    * Versions of all software used (partly done).
    50   * ''To-do'' (not gauranteed for this summer but hopefully by summer of 2011):
    5155    * Add links moving around model database.
    5256    * Add history (if model changes, then keep the old model with versioning.  Do the same for validations, etc..)
     
    7478      * Add {{{find /var/tmp/. /tmp/. -user $USER | xargs rm -rf}}} to scripts?
    7579      * Test that the web forms do not allow the user to perform any nasty actions (no user commands should be performed.)
     80      * Test that nothing can be written outside of condor job dir.
     81      * Test that condor job cannot do any network connections _except_ certain database updates.
     82      * Control time, memory and disk space available to condor jobs (admin side).
     83      * Only allow transfer back of certain files.  Don't let user overwrite important files...
    7684    * Add admin pages for...
    7785