Buildout not working / Couldn't find index page for / Couldn't find a distribution / Disabling non HTTPS access to APIs on PyPI

idgserpro · October 27, 2017, 3:12pm

Adding this to my buildout didn't work.

warning: no previously-included files matching '*.pyc' found anywhere in distribution
Not found: 
https://pypi.python.org/simple/plone.recipe.zope2instance/
Not found: 
https://pypi.python.org/simple/plone.recipe.zope2instance/
Couldn't find index page for 'plone.recipe.zope2instance' (maybe misspelled?)
Not found: 
https://pypi.python.org/simple/
Getting distribution for 'plone.recipe.zope2instance==4.2.20'.
While:
  Installing.
  Getting section instance.
  Initializing section instance.
  Installing recipe plone.recipe.zope2instance.
  Getting distribution for 'plone.recipe.zope2instance==4.2.20'.
Error: Couldn't find a distribution for 'plone.recipe.zope2instance==4.2.20'.

Do you have shared eggs directories? Did you try to add to a CI configuration?

fredvd · October 27, 2017, 3:18pm

@idgserpro I just spotted your line where you noticed adding index = doesn't work, for me it does, but with zc.buildout 2.8.0 in my buildout(s). Weird indeed.

Jenkins build jobs will start to fail now as well where bootstrap.py is run.

mauritsvanrees · October 27, 2017, 3:46pm

If you use a bootstrap.py for zc.buildout version 1.x, you probably have a wrong ez_setup.py url. For coredev 4.3 I have fixed it here:

idgserpro · October 27, 2017, 4:11pm

https://bootstrap.pypa.io/bootstrap-buildout.py is already using https://bootstrap.pypa.io/ez_setup.py. At least in the Plone 4 tests I made above, I don't think it's related.

mauritsvanrees · October 27, 2017, 4:16pm

Coredev 4.3 uses a bootstrap.py that installs zc.buildout 1.x. It is this one, which has the old ez_setup url:

http://downloads.buildout.org/1/bootstrap.py

I made a pull request for updating it at https://github.com/buildout/buildout/pull/419

mauritsvanrees · October 27, 2017, 4:22pm

Oh, for those who cannot reprocuce the bootstrap error locally, try using a virtualenv without setuptools, otherwise the failing part gets ignored:

  virtualenv --no-setuptools --no-pip --no-wheel --python=python2.7 .

idgserpro · October 27, 2017, 4:33pm

Using your commit in https://github.com/plone/buildout.coredev/commit/316da91ced540273bc161987b43423955ee5d8c7:

git clone https://github.com/collective/minimalplone4 && cd minimalplone4 && wget https://raw.githubusercontent.com/plone/buildout.coredev/316da91ced540273bc161987b43423955ee5d8c7/bootstrap.py && python bootstrap.py && mkdir eggs && bin/buildout buildout:eggs-directory="eggs" buildout:download-cache="eggs" versions:zc.buildout=1.7.1

Gives the same error:

Couldn't find index page for 'plone.recipe.zope2instance' (maybe misspelled?)
Getting distribution for 'plone.recipe.zope2instance==4.3'.
While:
  Installing.
  Getting section instance.
  Initializing section instance.
  Installing recipe plone.recipe.zope2instance.
  Getting distribution for 'plone.recipe.zope2instance==4.3'.
Error: Couldn't find a distribution for 'plone.recipe.zope2instance==4.3'.

But we'll try to reproduce like you said in Buildout not working / Couldn't find index page for / Couldn't find a distribution / Disabling non HTTPS access to APIs on PyPI.

idgserpro · October 27, 2017, 4:42pm

If you already has cached eggs, there's no error, that's why we're using mkdir eggs && bin/buildout buildout:eggs-directory="eggs" buildout:download-cache="eggs", to force it to always download the eggs.

@mauritsvanrees using the virtualenv and different bootstrap (for buildout 1 and 2) we still get the same error if zc.buildout is pinned to any version different from 2.9.5.

mauritsvanrees · October 27, 2017, 10:18pm

@idgserpro: I need the updated bootstrap.py because otherwise the bootstrap call gives an error. After that finishes correctly, and I ignore the eggs cache, I get the same error as you. It works for me when I add this to your last command:

buildout:index=https://pypi.python.org/simple/

tkimnguyen · October 28, 2017, 12:32am

This topic is now a banner. It will appear at the top of every page until it is dismissed by the user.

tkimnguyen · October 28, 2017, 12:33am

This topic is no longer a banner. It will no longer appear at the top of every page.

tkimnguyen · October 28, 2017, 12:34am

h2o · October 28, 2017, 3:15am

I confirm that this solution works for me. I replaced my bootstrap.py with the one at:

https://bootstrap.pypa.io/bootstrap-buildout.py

and added the line in my default.cfg:

index=https://pypi.python.org/simple/

Putting the above line in the [buildout] section of buildout.cfg should work as well.

idgserpro · October 30, 2017, 12:44pm

There was a typo in my buildout.cfg. This doesn't work:

index = 
    https://pypi.python.org/simple/

But this does:

index = https://pypi.python.org/simple/

So, the command

git clone https://github.com/collective/minimalplone4 && cd minimalplone4 && wget https://bootstrap.pypa.io/bootstrap-buildout.py && python bootstrap-buildout.py && mkdir eggs && bin/buildout buildout:eggs-directory="eggs" buildout:download-cache="eggs" buildout:index=https://pypi.python.org/simple/ versions:zc.buildout=1.7.1

Now runs successfully. I know it doesn't make sense to have a multiline index (since it expects just one value) but it's funny that didn't work even having just one url.

idgserpro · October 30, 2017, 3:44pm

@mauritsvanrees we need to update zc.buildout in coredev for 4.3.x or add this index.

mauritsvanrees · October 30, 2017, 5:20pm

I have added the index in coredev 4.3.

khink · November 3, 2017, 10:54am

Specifying the --find-links argument to buildout might also help, in situations where other solutions aren't helpful.
http://docs.buildout.org/en/latest/reference.html?highlight=--find-links

jschinnerer · November 5, 2017, 4:29am

I confirm that adding the 'index=' line in [buildout] section of my buildout.cfg fixes this problem for me.
Plone 5.0.7 fresh install using unified installer on Debian 9 server with installer generated buildout.cfg.
I did not do anything else with any files such as bootstrap.py or others mentioned here (messing with pieces of buildout at that level is way over my head).
I'd just started trying to install add-ons to this fresh install via the usual means and kept getting the:

Couldn't find index page for product-xyz (maybe misspelled?)
...
Error: Couldn't find a distribution for product-xyz

I found this thread by sheer luck, after a fruitless hour+ searching & trying to solve this - because the thread subject/title has nothing to do with the errors one gets at the buildout user level and is most likely to be searching for help with.
Is it possible to change the title of this thread to make it more findable vs. the actual error msg?

tkimnguyen · November 5, 2017, 1:38pm

Sure, what title do you suggest? "buildout not working" seems pretty clear but ok

jschinnerer · November 5, 2017, 8:12pm

Including the start of the two main error message is great, thanks.
That gives a search for the actual error message something to find.
The last part of the title is not search-useful, nobody will search on that if they get this error. If they know it's about the http/https change on pypi they likely know the solution already.
Just some tips on issue titles from 7+ years software QA/test experience...