After several years of running the platform, it has been clear that the online development of algorithms and experiment is less than ideal due to the fact that if an algorithm has an error, there are only two possible ways to modify it:
- Nuke the experiment, so the algorithm can be edited again then recreate the experiment.
- Create a new version of the algorithm and assign that one to the experiment.
Situation number can be workable if a small experiment is concerned however it quickly becomes impractical when it grows larger.
Situation number two will generate lots of useless versions used either for debugging or because of wrong code.
The conclusion thus was that providing people with beat/beat.editor> would allow them to comfortably develop their algorithm on their machine and once ready they can upload them on the platform and run their experiments against the databases provided by it.
This milestone will track the work of moving the platform to a mainly read-only state so that people can still see the assets they have access to but won't be able to edit them online.
The work will be split in several phases starting with the small editors first and then with the more consequent ones like the toolchain and experiment editor.