Relax numpy/pytorch constraints

After fixes in conda-forge, I was able to relax the pytorch pin. This MR brings pytorch 2.4 into the mix, together with torchvision 0.19.1. It also relaxes the numpy pin, so numpy 2.1.1 is also in the lock.