Implements builds for Apple Silicon

This MR introduces support for building our packages on Apple Silicon. We currently use the M1-macmini available.

changed the description

We are apparently missing a few packages for this architecture:

Encountered problems while solving:
    - nothing provides requested mkl 2020.4.*
    - nothing provides requested pyqt 5.12.3
    - nothing provides requested sox 14.4.2
    - nothing provides requested libblitz 1.0.2

Well, for obvious reasons, intel-mkl should not be available on M1 macs. @amohammadi: do you understand why it's been picked up? (solved!)

pyqt and sox are not available on the specified versions. What to do here?

Finally, I think we are the maintainers of libblitz - @amohammadi: can you enable builds for osx-arm64?

For pyqt, we are stuck until Qt can be compiled on osx-arm64: https://github.com/conda-forge/pyqt-feedstock/issues/101

For sox, a similar issue is not even opened so far on https://github.com/conda-forge/sox-feedstock

added 2 commits

• f1607889 - 1 commit from branch master
• 511aff08 - Implements builds for Apple Silicon

Compare with previous version

Issues to track:

• libblitz: https://github.com/conda-forge/libblitz-feedstock/issues/18
• sox: https://github.com/conda-forge/sox-feedstock/issues/23
• pyqt: https://github.com/conda-forge/pyqt-feedstock/issues/101 -> blocked on qt: https://github.com/conda-forge/qt-feedstock/pull/206 (qt=5.15.2)

@amohammadi: something is fishy with the way we test "bob-devel" here. I added a selector for mkl to intel machines only. However, "bob-devel" insists in using all packages after the # AUTOMATIC PARSING START, even the ones with selectors. Can you please have a look? Thanks!

I don't see any modification on bob-devel here, where did you add this mkl selector?

I put it at the conda build config. Wasn’t it the right place?

you haven't pushed it here.

You are right - I mistakenly pushed this mod to master, and then rebased here. You can have a look at this commit: f1607889

please revert that in master

Why?

because the changes here are not ready and I don't want to have half of the changes already in master.

added 5 commits

• 511aff08...f78bc4ad - 3 commits from branch master
• 4d82d646 - Implements builds for Apple Silicon
• 917d94dd - Revert "Revert "[conda_build_config] Only install mkl on intel processors""

Compare with previous version

There, @amohammadi

Thank you.

added 1 commit

• 44bf12a4 - [conda_build_config] Only install mkl on intel processors (avoid definition of mkl variable)

Compare with previous version

resolved all threads

added 3 commits

• 9e9fed77 - [conda_build_config] pyqt is not yet available for osx-arm64
• 021206c2 - [data/gitlab-ci/single-package.yaml] Revert conda-package recipe to inital...
• adbc0d56 - [data/gitlab-ci/osx-arm64-support] Extends the standard single-package.yaml to...

Compare with previous version

ffmpeg does not work as intended, due to some compilation problem with libvpx: https://github.com/conda-forge/libvpx-feedstock/issues (this was just fixed by the responsible developer, Oct. 23rd, 2021).

Last piece (seemingly): https://github.com/conda-forge/cryptography-feedstock/issues/78 (also a miscompilation as it looks like). This is crashing bdt -h already.

Pinning the package cryptography to 3.4.7 seems to solve this issue locally.

resolved all threads

resolved all threads

This is now green. The strategy to support m1 builds is to add an include on your package. If you do, then an extra set of stages are run on the m1 mac.

assigned to @amohammadi and unassigned @andre.anjos

let's wait for a bob release, builds are green now.

added 15 commits

• adbc0d56...daa2cc0e - 9 commits from branch master
• 0859e3ed - Implements builds for Apple Silicon
• f18850af - Revert "Revert "[conda_build_config] Only install mkl on intel processors""
• 9ac95232 - [conda_build_config] Only install mkl on intel processors (avoid definition of mkl variable)
• 766d6b01 - [conda_build_config] pyqt is not yet available for osx-arm64
• c2b6d829 - [data/gitlab-ci/single-package.yaml] Revert conda-package recipe to inital...
• 93c46a91 - [data/gitlab-ci/osx-arm64-support] Extends the standard single-package.yaml to...

Compare with previous version

added 12 commits

• 93c46a91...0bb8c66e - 7 commits from branch master
• 28eb6cf3 - Implements builds for Apple Silicon
• 5fd9424e - Revert "Revert "[conda_build_config] Only install mkl on intel processors""
• 50ff0c3b - [conda_build_config] Only install mkl on intel processors (avoid definition of mkl variable)
• 69609e2c - [conda_build_config] pyqt is not yet available for osx-arm64
• 20e7b416 - [data/gitlab-ci/osx-arm64-support] Extends the standard single-package.yaml to...

Compare with previous version

added 1 commit

• 663afe43 - Implement arm builds on nightlies (fail-safe on individual packages)

Compare with previous version

added 1 commit

• e2b0b04b - Upload beta arm packages if available

Compare with previous version

@amohammadi: this will enable osx-arm64 builds every night. This will also allow individual packages to build osx-arm64 versions as part of their individual pipelines. For the time being allow_failure: true is set on arm pipelines, which means pipelines may succeed when arm64 builds do not. You may merge when green.

added 10 commits

• e2b0b04b...52d304a8 - 2 commits from branch master
• e436a937 - Implements builds for Apple Silicon
• 2d720f13 - Revert "Revert "[conda_build_config] Only install mkl on intel processors""
• 41a24106 - [conda_build_config] Only install mkl on intel processors (avoid definition of mkl variable)
• 6e33704a - [conda_build_config] pyqt is not yet available for osx-arm64
• e75a9636 - [data/gitlab-ci/osx-arm64-support] Extends the standard single-package.yaml to...
• aa0b0b3c - Implement arm builds on nightlies (fail-safe on individual packages)
• 7afb23a9 - Upload beta arm packages if available
• e4075090 - [data/gitlab-ci] remove base-build.yaml as indicated by @amohammadi

Compare with previous version

resolved all threads

enabled an automatic merge when the pipeline for e4075090 succeeds

merged

mentioned in commit 21ddc761