GitLab

Improve synchronized output handling

Closes #27

See merge request !61

This allows the evaluator to properly write to its own
output as the method is called each time a processor
output is written to.

Fixes #27

Currently there's nothing in the log so if there's an error,
the result will be a missing file error.

[execution][messagehandlers] Fix write end_data_index handling in LoopMessageHandler

See merge request !60

The None value is not properly handled and ends up
triggering a warning while it is a valid value for
end_data_index.

This patch fixes this.

Do not systematically decode incoming zmq parts

Closes #26

See merge request !59

Under some circumstances the decoding may fail as the binary
data may contain values outside the utf-8 "visible" range.

Fixes #26

Change loop parts name

See merge request !58

This change also updates the valid check to print the
error if any should appear making the failure easy to
understand.

Renaming the algorithm has the added benefit of making
the prefix content clearer to understand.

WARNING this is a breaking change

xxx_loop and xxx_loop_user were not really clear.

They are now:
- xxx_loop_evaluator
- xxx_loop_processor

This makes their role easier to understand.

Implement loop reading input sequentially

See merge request !57

Now requires a sequential loop algorithm.

This method will trigger the reading of the input
by the loop algorithm.

Implement loop output

See merge request !54

This makes its usage more clear and explicit.

It also fixes an issue where the loop paradigm can only be
used with a block having a database as input.

This change requires update in beat/beat.core> executors
calling these scripts.

This allows to have the data generated with the correct user id
if provided in the configuration and doesn't match the current
user running the container.

This will allow to reuse the code in beat/beat.core.

Currently input and output cache files were "shared"
because of how the configuration was made.

Also, the input for the loop algorithm, although the same
as the loop_user, was not properly generated as a separate
input.

This reduces code duplication and will also
help clean up beat/beat.core> a bit.

This allows files with similar name not to clash.

For example input and input_data.

If process fails, return early and send done message to
other parties. This allows to stop everything more
cleanly.