inter-sphinx sources not picked up for private packages in the nightlies

Sphinx doesn't pick up the private packages as sources in the nightlies, see for instance this MR

assigned to @amohammadi

After careful analysis, I'd say the problem is related to the "privacy" test conducted here: https://gitlab.idiap.ch/bob/bob.devtools/-/blob/master/bob/devtools/scripts/ci.py#L701

You can test this locally with:

>>> from urllib.request import urlopen
>>> urlopen("https://gitlab.idiap.ch/whatever").getcode() == 200
True

So, the gitlab server is now always returning a successful response (login page), even if URL is not accessible or the package does not exist.

As a result, we cannot rely on this test any longer for a measure of package privacy. That explains why private packages are being installed on the public channel as well.

This seems to work instead (https://stackoverflow.com/questions/54959589/check-if-git-repo-is-public-with-http-request/54964584).

>>> from urllib.request import urlopen
>>> urlopen("https://gitlab.idiap.ch/bob/bob.ip.stereo/info/refs?service=git-upload-pack")

Notice the strange effect of:

>>> urlopen("https://gitlab.idiap.ch/whatever/info/refs?service=git-upload-pack").getcode()
200

So, the project to be tested need to be in an existing namespace. Let me check if a better fix exists until tomorrow.

Some form of git ls-remote --exit-code -h "$REPO_URL" may also work, TBT.

mentioned in merge request !221 (merged)

closed via merge request !221 (merged)

mentioned in commit 216d9381

mentioned in issue bob#269 (closed)