Changes between Version 15 and Version 16 of WebValidation
- Timestamp:
- Jun 23, 2010, 12:08:32 AM (14 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
WebValidation
v15 v16 15 15 * Run CH & MG on resulting code. 16 16 * Each of these condor jobs relies on previous ones. If a necessary previous step fails, then the next job is not run. This is controlled by a "DAG" script. 17 * User can choose "stock" models. There are 2 choices: 18 * Precompiled models that ship with the MEG can be chosen from drop down menu. 19 * User can upload their own "stock" model, but this is harder. 20 * User must also upload "particle translation" file. 21 * User can upload 1 or more parameter files. 22 * Site tests that particle translation file and parameter files work. 23 * If tests passed, then this model can be used in validations. 17 24 * If 1 or more MEG passes, the user is allowed to run 2->2 cs processes. 18 25 * They can choose the MEG they want to test (among the ones that pass the previous tests). … … 22 29 * User can restrict on indices and charges. 23 30 * After processes are generated, user can run them. 31 * User can choose from restrictions and parameters. 32 * User can choose which MEGs to run. 33 * User can choose which "stock" models to run (and which parameter files for them.) 24 34 * The processes are run on Condor. 25 35 * Currently 4 parallel nodes. Seems pretty fast. 26 * Adds 10 processes to the queue at a time. This allows multiple users and validations to be run at the same time and make progress at the same time.36 * Adds 10 jobs to the queue at a time. Each job has ~5 processes. This allows multiple users and validations to be run at the same time and make progress at the same time. 27 37 * User can refresh their browser to see the progress. Each process and MEG that is finished will show up as they are finished. 28 * User can rerun processes .38 * User can rerun processes choosing new MEG's and new stock models if they like. 29 39 * User can create multiple validations. 30 40 * Multiple validations can be run concurrently. Condor handles this. … … 32 42 * Users can delete models. (But only when no condor jobs are running for this model.) 33 43 * Users can delete validations. (But only when this validation is not being run.) 44 * Users can delete stock models. 34 45 * Security: 35 46 * All user code is run on condor jobs and no where else. … … 38 49 * Users do not control condor. They can only use web form to start jobs and see the outcome. 39 50 * ''To-do'' (for this summer): 40 * Get FR-SH and FR-WO working. ( Christian Speckner is helping with WO). This shouldn't be difficult. The scaffolding is there.51 * Get FR-SH and FR-WO working. (WO almost done.). This shouldn't be difficult. The scaffolding is there. 41 52 * Test whether a Mathematica license is available. If not, wait and try again. 42 * Use parameter files in tests. 43 * Allow upload and comparison with "stock" versions of models. 44 * Improve security: 45 * Test that nothing can be written outside of condor job dir. 46 * Test that condor job cannot do any network connections _except_ certain database updates. 47 * Control time, memory and disk space available to condor jobs (admin side). 48 * Only allow transfer back of certain files. Don't let user overwrite important files... 53 * ''To-do'' (not gauranteed for this summer but hopefully by summer of 2011): 49 54 * Versions of all software used (partly done). 50 * ''To-do'' (not gauranteed for this summer but hopefully by summer of 2011):51 55 * Add links moving around model database. 52 56 * Add history (if model changes, then keep the old model with versioning. Do the same for validations, etc..) … … 74 78 * Add {{{find /var/tmp/. /tmp/. -user $USER | xargs rm -rf}}} to scripts? 75 79 * Test that the web forms do not allow the user to perform any nasty actions (no user commands should be performed.) 80 * Test that nothing can be written outside of condor job dir. 81 * Test that condor job cannot do any network connections _except_ certain database updates. 82 * Control time, memory and disk space available to condor jobs (admin side). 83 * Only allow transfer back of certain files. Don't let user overwrite important files... 76 84 * Add admin pages for... 77 85