make two copies of training data to make the code simpler.
Add options for overridng read and write methods in callables.
remove confusing returns. make parallel ones generators