[checkpointer] Make it flexible to directory renames; Fix saving of trainlog...

[checkpointer] Make it flexible to directory renames; Fix saving of trainlog in case we are interrupted