[conda] Skip macOS arm build

conda-forge does not provide PyQt yet for that architecture
and that channel is mandatory because of bob.