/projects
directory (A), retrieving only samples from Project 393, and match files using Sample Identifiers (B).--commit
, Isabl-CLI proceeds to move (or symlink) matched files into scalable directory structures (C). The experiments data path is created by hashing the four last digits of the its primary key. For instance, data for Experiment 57395 will be stored at {storage-directory}/experiments/73/95/57395/
. This hashing approach ensures a maximum of 1000 subdirectories in any folder at a worst case scenario of 10 million experiments.MAF
format:isabl_cli.data.LocalDataImporter
and overwriting RAW_DATA_INSPECTORS
might be enough to support new data formats.import-data-from-yaml
command. The metadata will be added to the file_data
field in an experiment's raw_data
.system_id
of TEST_EXPERIMENT_T01
, the argument would look like: /absolute/path/to/files_data.yaml
with the following contents: isabl import-data-from-yaml --help
sub class
: