Getting conda package conflict on the CI

This happens on mac python 2.7 only: See: https://gitlab.idiap.ch/bob/bob.bio.face/-/jobs/126422

failed to get install actions, retrying.  exception was: The following specifications were found to be in conflict:
  - bob.bio.face==3.3.1b0=py27h0955f8a_6
  - bob.db.replay
Use "conda info <package>" to see the dependencies for each package.

If someone has some insights, it would be great.

mentioned in merge request bob.bio.face!41 (merged)

The CI of bob.db.replay fails on mac and python 2.7 too: https://gitlab.idiap.ch/bob/bob.db.replay/-/jobs/126457

Something weird is going on here. Old stable packages are being pulled when building bob.db.replay:

    bob.blitz:                     2.0.14-np113py27_0      http://www.idiap.ch/public/conda           
    bob.core:                      2.1.9-np113py27_0       http://www.idiap.ch/public/conda           
    bob.db.base:                   2.3.2-py27_0            http://www.idiap.ch/public/conda           
    bob.extension:                 2.4.6b1-py27h77e8b37_20 http://www.idiap.ch/public/conda/label/beta
    bob.io.base:                   3.0.2-np113py27_0       http://www.idiap.ch/public/conda           
    bob.io.image:                  2.3.0-np113py27_0       http://www.idiap.ch/public/conda           
    bob.io.video:                  2.0.19-np113py27_0      http://www.idiap.ch/public/conda  

Apparently bob.io.video py27 packages were deleted by our clean-betas script and since nightlies failed on bob.io.video mac python 2.7, our beta channel is broken.

Here is what we have left on linux:

[ ]	bob.io.video-2.0.20b0-py27h6550771_13.tar.bz2	2018-03-07 21:36 	5.3M	 
[ ]	bob.io.video-2.0.20b0-py36h6550771_13.tar.bz2	2018-03-08 21:35 	5.3M	 
[ ]	bob.io.video-2.0.20b0-py36h6550771_14.tar.bz2	2018-03-11 21:36 	5.3M	 

Here is what we have left on mac:

[ ]	bob.io.video-2.0.20b0-py36h5223d36_14.tar.bz2	2018-03-06 21:58 	5.3M	 

This is bizarre!

From the last pipeline of bob.io.video I see build number 8 was released https://gitlab.idiap.ch/bob/bob.io.video/-/jobs/122627:

(14:31:45.812) curl: cp /Users/buildbot/work/gitlab/f6f95b82/0/bob/bob.io.video/miniconda/conda-bld/osx-64/bob.io.video-2.0.20b0-py27h2e12400_8.tar.bz2 -> http://www.idiap.ch/private-upload/conda/osx-64/
(14:31:46.303) curl: cp /Users/buildbot/work/gitlab/f6f95b82/0/bob/bob.io.video/miniconda/conda-bld/osx-64/bob.io.video-2.0.20b0-py36h2e12400_8.tar.bz2 -> http://www.idiap.ch/private-upload/conda/osx-64/
(14:31:46.796) curl: cp /Users/buildbot/work/gitlab/f6f95b82/0/bob/bob.io.video/miniconda/conda-bld/linux-64/bob.io.video-2.0.20b0-py27h5d3ff96_8.tar.bz2 -> http://www.idiap.ch/private-upload/conda/linux-64/
(14:31:47.288) curl: cp /Users/buildbot/work/gitlab/f6f95b82/0/bob/bob.io.video/miniconda/conda-bld/linux-64/bob.io.video-2.0.20b0-py36h5d3ff96_8.tar.bz2 -> http://www.idiap.ch/private-upload/conda/linux-64/

Ok I see what is wrong now. The bob_build_number parameter is calculated per os/python_ver but in some rare cases (for example when mac py27 fails but when you restart it works again) the bob_build_number is different for a beta package in each os/python_ver setting. Here because the latest beta of bob.io.video had different build numbers on each platform and python version, its latest beta package was deleted.

My previous implementation with the py27/py36 parsing from the build string had that covered. Shall we do nothing and leave it as is?

We should go back to the os/py based implementation. Doing nothing is going to break our CI every Sunday.

So, I got it right in the first shot! I hate to be right...

I'm not sure what you had was exactly right. Care to open a merge request please so that we can take a look at it again?

assigned to @andre.anjos

changed milestone to %Conda-based CI

mentioned in commit 46badcc1

mentioned in merge request !70 (merged)

closed via merge request !70 (merged)

closed via commit fff16e5f

@amohammadi: please check the log on the associated MR and confirm all good for you.

reopened

mentioned in merge request !71 (merged)

closed via merge request !71 (merged)

closed via commit 30b87cad