Nightlies broken - scipy intersphinx is broken

We are getting 404 while fetching the scipy intersphinx.

There are some discussion going on here

https://github.com/scipy/scipy/issues/14267

and here

https://github.com/scipy/scipy/issues/15574

Let's see how it goes