Timeouts when installing collections from Ansible Galaxy (https://galaxy.ansible.com/)

Hello,

There seems to be a problem during collections installation from galaxy.ansible.com

ERROR! Unknown error when attempting to call Galaxy at 'https://galaxy.ansible.com/api/v3/collections/community/postgresql/versions/': The read operation timed out
ERROR! Unknown error when attempting to call Galaxy at 'https://galaxy.ansible.com/api/v3/plugin/ansible/content/published/collections/index/community/general/versions/?limit=10&offset=40': The read operation timed out

This normally takes a few seconds, but now it seems to be taking minutes and it returns a timeout error once it reaches the configured limit.
I began noticing this issue last week, and it is still persisting now.
Does anyone have the same issue ?

@Ahmedjed Thanks for reporting this, though I’ve not personally seen any other mentions.

Is it still happening?

cc @CommunityEngTeam

We didn’t have any errors to report, but when running AWX jobs or GitHub Actions that needed to install Galaxy collections around 11am EST today we noticed that jobs that normally took a couple of minutes were taking 30 minutes or more. We had one job fail with a message that it couldn’t retrieve a collection, but relaunching it worked (but it still took forever).

I am seeing similar behavior. The API calls don’t timeout when using the ansible-galaxy client, but they have gone from 90s to 12min.

The API is also very slow when answering requests for a version page, like Ansible Galaxy. That was never fast to begin with, but now it’s extremely slow.

Yes the problem is still happening. I’m still experiencing the same timeout errors when installing collections from Galaxy.

Can confirm this has been an issue over the last 1-2 days. I have people in Australia (Perth, Brisbane, Melbourne) and New Zealand with multiple carriers/connection types, as well as our Github CI continues to fail.

For us, the final error is:

ERROR! Unexpected Exception, this is probably a bug: The read operation timed out

Let me know if you need any more info to troubleshoot.

Same here (France). It’s been 2 days and it’s super annoying

Can confirm. Galaxy installation in AWX takes 4-5 minutes per run.

TASK [Fetch galaxy collections from collections/requirements.(yml/yaml)] *******
changed: [localhost] 09:44:54
TASK [Fetch galaxy roles and collections from requirements.(yml/yaml)] *********
skipping: [localhost] 09:49:46