beat.cmdline issueshttps://gitlab.idiap.ch/beat/beat.cmdline/-/issues2020-08-06T14:39:48Zhttps://gitlab.idiap.ch/beat/beat.cmdline/-/issues/72Local support for splittable2020-08-06T14:39:48ZSamuel GAISTLocal support for splittableCurrently there's no possibility to validate a splittable algorithm locally.
There's nothing in the experiment execution part and in the algorithm execution the number of slots is locked to one and not even used.
The splitting part is ...Currently there's no possibility to validate a splittable algorithm locally.
There's nothing in the experiment execution part and in the algorithm execution the number of slots is locked to one and not even used.
The splitting part is currently done at the beat/beat.web> level and then the scheduler takes the generated tasks and sends them to the appropriate worker machines.
That part shall be ported to beat/beat.cmdline> so that the behaviour can be mimicked locally through maybe multiprocessing.https://gitlab.idiap.ch/beat/beat.cmdline/-/issues/60Add support for protocol template2019-05-08T09:45:49ZSamuel GAISTAdd support for protocol templateFor database v2, the new protocol template object has been created (see beat/beat.core#64, beat/beat.core!67, and beat/beat.core!71).
This issue tracks adding support for it in beat/beat.cmdline>
Todo:
- [x] Local support
- [ ] Remote ...For database v2, the new protocol template object has been created (see beat/beat.core#64, beat/beat.core!67, and beat/beat.core!71).
This issue tracks adding support for it in beat/beat.cmdline>
Todo:
- [x] Local support
- [ ] Remote supportSamuel GAISTSamuel GAISThttps://gitlab.idiap.ch/beat/beat.cmdline/-/issues/56There is no way to make a clean prefix directory structure with only trusted ...2018-12-21T14:52:06ZZohreh MOSTAANIThere is no way to make a clean prefix directory structure with only trusted system files.In the ALLIES meeting one of the points that was raised was that how to get a clean prefix directory structure, with databases, dataformats, etc in place. With only data from the system not other users, and not to go through copying a pr...In the ALLIES meeting one of the points that was raised was that how to get a clean prefix directory structure, with databases, dataformats, etc in place. With only data from the system not other users, and not to go through copying a prefix from another git repository.
It may be possible to use command line to make such a directory.https://gitlab.idiap.ch/beat/beat.cmdline/-/issues/39Better copy/paste support for `exp caches`2018-06-11T08:13:15ZJaden DIEFENBAUGHBetter copy/paste support for `exp caches`Right now the caches printed are file paths:
```
block: `pre_training'
algorithm: `test/iris_preprocessor/1'
output: `/home/jae/code/beat.editor/prefix/cache/a9/e2/0b/2ba5928422351e52a508bd0cbc55e3d0e5bacb05896dc28413bcd0a1a4'
block:...Right now the caches printed are file paths:
```
block: `pre_training'
algorithm: `test/iris_preprocessor/1'
output: `/home/jae/code/beat.editor/prefix/cache/a9/e2/0b/2ba5928422351e52a508bd0cbc55e3d0e5bacb05896dc28413bcd0a1a4'
block: `pre_testing'
algorithm: `test/iris_preprocessor/1'
output: `/home/jae/code/beat.editor/prefix/cache/1e/a5/74/80c7d48bae3d0f6baf0883c3a7f78b5324830931029fcee4fd3bffff4d'
block: `training_alg'
algorithm: `test/iris_training/1'
output: `/home/jae/code/beat.editor/prefix/cache/45/61/15/3438e272598bf15e6bd729709536f4ca38b2b9d1061dd286c6dae5f288'
block: `testing_alg'
algorithm: `test/iris_testing/1'
output: `/home/jae/code/beat.editor/prefix/cache/39/d4/20/a6709aca3cac7e9a9a7cb2c36d536184554b5e19358927f2e866ad5751'
block: `analyzer'
analyzer: `test/iris_analyzer/1'
output: `/home/jae/code/beat.editor/prefix/cache/f0/a0/86/a645856dcbee4edc2729fcc60554212ed5def33334670602be6086aafb'
```
But you only use path segments relative to the cache folder to operate on that cache:
```
$ beat ca view a9/e2/0b/2ba5928422351e52a508bd0cbc55e3d0e5bacb05896dc28413bcd0a1a4
```
It would make sense for `exp caches` to only print out this bit, not the absolute path.https://gitlab.idiap.ch/beat/beat.cmdline/-/issues/36Add `--long` flag when listing things2018-05-30T08:28:19ZJaden DIEFENBAUGHAdd `--long` flag when listing thingsIt's just like `ls`'s `-l` flag:
- last edited
- maybe which filetypes the object has associated with it?It's just like `ls`'s `-l` flag:
- last edited
- maybe which filetypes the object has associated with it?https://gitlab.idiap.ch/beat/beat.cmdline/-/issues/35Add sort option for `beat <subcommand> list`2018-05-30T08:24:38ZJaden DIEFENBAUGHAdd sort option for `beat <subcommand> list`Sort by:
- Name
- Last edited
- ???Sort by:
- Name
- Last edited
- ???https://gitlab.idiap.ch/beat/beat.cmdline/-/issues/27[all packages] code cleanup2018-09-04T09:09:56ZFlavio TARSETTI[all packages] code cleanupbeat.cmdline needs to get some things changed such as:
- type keyword to remove
- status = None returned (to return a real status)beat.cmdline needs to get some things changed such as:
- type keyword to remove
- status = None returned (to return a real status)https://gitlab.idiap.ch/beat/beat.cmdline/-/issues/18Autocompletion of BEAT objects in prefix & commands2018-03-23T08:38:40ZJaden DIEFENBAUGHAutocompletion of BEAT objects in prefix & commandsThis would improve productivity SO MUCH. I almost think this is a required feature for the June 2018 deliverable. We'd probably want to pull in a new dependency...maybe even need to rewrite a bunch of the CLI code. But I'm not sure since...This would improve productivity SO MUCH. I almost think this is a required feature for the June 2018 deliverable. We'd probably want to pull in a new dependency...maybe even need to rewrite a bunch of the CLI code. But I'm not sure since I haven't worked much with CLI python.https://gitlab.idiap.ch/beat/beat.cmdline/-/issues/17Better cache search/discovery/browsing2018-06-11T07:59:30ZJaden DIEFENBAUGHBetter cache search/discovery/browsingRight now you have to give a path to a `.data` cache file to see anything about the cache. At the very least, I think there should be a cache listing command that gives relevant info about all the existing caches.Right now you have to give a path to a `.data` cache file to see anything about the cache. At the very least, I think there should be a cache listing command that gives relevant info about all the existing caches.https://gitlab.idiap.ch/beat/beat.cmdline/-/issues/14More detailed logging at various verbosity levels2017-08-25T07:36:23ZJaden DIEFENBAUGHMore detailed logging at various verbosity levelsRight now, the various verbosity levels don't provide much more information than not passing a verbosity level at all. Some ideas:
- More cache information
- Logging the block & its cache would be especially useful
- More statistics (...Right now, the various verbosity levels don't provide much more information than not passing a verbosity level at all. Some ideas:
- More cache information
- Logging the block & its cache would be especially useful
- More statistics (especially for the local executor)
- Printing output of every block, not just the analyserhttps://gitlab.idiap.ch/beat/beat.cmdline/-/issues/12Add support for multiprocessing & multi environments2017-08-24T09:20:28ZJaden DIEFENBAUGHAdd support for multiprocessing & multi environmentsRe-add/enable support for `describe` from `beat.backend.python` in `beat.cmdline` for non-docker multi-environment support.Re-add/enable support for `describe` from `beat.backend.python` in `beat.cmdline` for non-docker multi-environment support.https://gitlab.idiap.ch/beat/beat.cmdline/-/issues/11Add gridtk executor2017-08-24T08:42:54ZJaden DIEFENBAUGHAdd gridtk executorAdd another executor beside the Docker & local executors. This would also require refactoring the management of multiple executors.Add another executor beside the Docker & local executors. This would also require refactoring the management of multiple executors.https://gitlab.idiap.ch/beat/beat.cmdline/-/issues/10Add cli options for overriding parameters2017-08-24T08:41:28ZJaden DIEFENBAUGHAdd cli options for overriding parametersFor example, to override the database `atnt/3`'s root folder, you could use the cli option `--database`:
```bash
./bin/beat exp run <example> --database='atnt/3=../atnt_db'
```
This could be expanded to experiment parameters (overriding...For example, to override the database `atnt/3`'s root folder, you could use the cli option `--database`:
```bash
./bin/beat exp run <example> --database='atnt/3=../atnt_db'
```
This could be expanded to experiment parameters (overriding values defined in experiment JSON files) by giving JSON objects. The following format could be used:
```bash
./bin/beat exp run <example> --override='"globals":{"user/pca/1":{"number-of-components": 20}}'
```