train_and_evaluate function return Cache lockfile already exists after eval part

Using the train_and_evaluate method from estimator API and cache policy on filesystem, I get an error because the evaluation starts before that all cache is written on the filesystem. So when the train runs the second time, after the evaluation, I get the error because it finds the lock file. Mostly this is a problem with large dataset when after 100 steps or 600 seconds as throttle_secs the first epoch is not done yet.

Similar error is reported in https://github.com/tensorflow/tensorflow/issues/18266