[build,data] Cache eventual pytorch checkpoints used in unit testing

This MR will make our CI cache models downloaded during pytorch tests.