[build,data] Cache eventual pytorch checkpoints used in unit testing

This MR will make our CI cache models downloaded during pytorch tests.

merged

mentioned in commit 5098f5cf