[checkpointer] Make it flexible to directory renames; Fix saving of trainlog in case we are interrupted
