Project Update failure during Collection download from Galaxy

Hi all,

AWX-Operator version: 0.29.0
AWX version: 21.6.0

We have noticed an periodic failures during the project update jobs when downloading Ansible Collection dependencies from Galaxy. Usually re-running the project sync resolves works successfully. This same issue happens across different projects.

An example of the error is shown below.

Can you suggest any way to resolve this periodic error?

Thanks!

TASK [fetch galaxy collections from collections/requirements.(yml/yaml)] *******
failed: [localhost] (item=/var/lib/awx/projects/_74__environment_cleanup/collections/requirements.yml) => {"ansible_loop_var": "item", "changed": false, "cmd": ["ansible-galaxy", "collection", "install", "-r", "/var/lib/awx/projects/_74__environment_cleanup/collections/requirements.yml", "--collections-path", "/var/lib/awx/projects/.__awx_cache/_74__environment_cleanup/stage/requirements_collections"], "delta": "0:01:02.437910", "end": "2023-02-28 02:01:28.175334", "item": "/var/lib/awx/projects/_74__environment_cleanup/collections/requirements.yml", "msg": "non-zero return code", "rc": 1, "start": "2023-02-28 02:00:25.737424", "stderr": "ERROR! Unknown error when attempting to call Galaxy at 'https://galaxy.ansible.com/api/v2/collections/ansible/posix/versions/1.5.1/': The read operation timed out", "stderr_lines": ["ERROR! Unknown error when attempting to call Galaxy at 'https://galaxy.ansible.com/api/v2/collections/ansible/posix/versions/1.5.1/': The read operation timed out"], "stdout": "Starting galaxy collection install process\nProcess install dependency map", "stdout_lines": ["Starting galaxy collection install process", "Process install dependency map"]}

This most likely is a galaxy server error, in which case just relaunching the project update is the best way to get around it.

AWX Team