Batch Systems
🪵 How to use different known batch systems for scalable job execution.
Currently Isabl supports out-of-the-box the following Batch Systems to submit jobs with isabl_cli
:
Batch System | Import string | Resources |
---|---|---|
LSF |
| See more IBM Spectrum LSF Reference |
Slurm |
| See more Slurm - Worload Manager |
SGE |
| See more Sun Grid Engine - queueing system |
By default, all submissions are run locally using isabl_cli.batch_systems.submit_local
What about other systems?
To support other systems or to customize your own submission steps, you may need just to create your own method and define it on your isabl_cli
's SUBMIT_ANALYSES
setting.
Example:
For help, creating your custom submit method, follow direction from the existing ones.
Please consider contributing any new one to the Isabl Project! 💌
Submit Configuration
isabl_cli
's settings have a SUBMIT_CONFIGURATION
dictionary to provide extra arguments to the submission methods. Current parameters used are:
Attribute | Type | Description | Example value |
---|---|---|---|
| String | Any additional extra arguments passed to the batch submission command. |
|
| Import String | To define custom resources needs for different applications or methods. | See the example above. |
| Integer | To control the maximum number of jobs running simultaneously in a job array submission. |
|
| Boolean | redirect stdout and stderr to same file with ascii characters that allow colored logs. |
|
Example Settings:
Last updated