Temporary files and caches are written into the result directory
In the old version, we had two different directories to store elements: the result_directory
and the temp_directory
. These two directories where there for a purpose: anything inside of temp
could be easily removed after the experiments have finished, while important results were stored in the results
directory. This separation also allowed to have the temporary files on a local disk -- with much faster access and without backup -- and only the result files in a directory with backups.
Unfortunately, this split has gone in the new version -- for no obvious reasons other than laziness IMHO. Is there any possibility to have some kind of mechanism to have files in tmp
and cached files in sampleswrapper
, biometric_references
and scores
to be placed in a different directory than the --output
? Or is there any particular reason that you only want to have a single directory for all output that I am overlooking here?