All my project sync fails but unfortunately the error is inconclusive.
Does anyone would know what could cause this or where I could look to further troubleshoot this?
From this job, [66404](https://***.com/#/jobs/project/66404/output) the error at the project sync
2025-05-30 19:45:40,304 INFO [afbac8a1a4b14ed3aed18716f5cb82de] awx.analytics.job_lifecycle projectupdate-66404 pre run {"type": "projectupdate", "task_id": 66404, "state": "pre_run", "work_unit_id": null, "task_name": "prod_infra-converge"}
2025-05-30 19:45:40,309 INFO [afbac8a1a4b14ed3aed18716f5cb82de] awx.analytics.job_lifecycle projectupdate-66404 preparing playbook {"type": "projectupdate", "task_id": 66404, "state": "preparing_playbook", "work_unit_id": null, "task_name": "prod_infra-converge"}
2025-05-30 19:45:40,329 INFO [afbac8a1a4b14ed3aed18716f5cb82de] awx.analytics.job_lifecycle projectupdate-66404 running playbook {"type": "projectupdate", "task_id": 66404, "state": "running_playbook", "work_unit_id": null, "task_name": "prod_infra-converge"}
2025-05-30 19:45:40,338 INFO [afbac8a1a4b14ed3aed18716f5cb82de] awx.analytics.job_lifecycle projectupdate-66404 work unit id received {"type": "projectupdate", "task_id": 66404, "state": "work_unit_id_received", "work_unit_id": "2M5MYAO2", "task_name": "prod_infra-converge"}
2025-05-30 19:45:40,346 INFO [afbac8a1a4b14ed3aed18716f5cb82de] awx.analytics.job_lifecycle projectupdate-66404 work unit id assigned {"type": "projectupdate", "task_id": 66404, "state": "work_unit_id_assigned", "work_unit_id": "2M5MYAO2", "task_name": "prod_infra-converge"}
2025-05-30 19:45:49,538 INFO [-] awx.main.wsrelay Adding {'plat-awx-web-7d54647dc9-kk5c8'} to websocket broadcast list
2025-05-30 19:45:50,440 INFO [afbac8a1a4b14ed3aed18716f5cb82de] awx.main.commands.run_callback_receiver Starting EOF event processing for Job 66404
2025-05-30 19:45:50,440 ERROR [afbac8a1a4b14ed3aed18716f5cb82de] awx.main.tasks.receptor An error was encountered while getting status for work unit 2M5MYAO2
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.11/site-packages/awx/main/tasks/receptor.py", line 495, in _run_internal
unit_status = receptor_ctl.simple_command(f'work status {self.unit_id}')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/var/lib/awx/venv/awx/lib64/python3.11/site-packages/receptorctl/socket_interface.py", line 81, in simple_command
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.11/site-packages/receptorctl/socket_interface.py", line 101, in connect
self._socket.connect(path)
ConnectionRefusedError: [Errno 111] Connection refused
2025-05-30 19:45:50,441 WARNING [afbac8a1a4b14ed3aed18716f5cb82de] awx.main.tasks.receptor No result details or output from project_update 66404 (running), status:
2025-05-30 19:45:50,441 ERROR [afbac8a1a4b14ed3aed18716f5cb82de] awx.main.tasks.receptor Error releasing work unit 2M5MYAO2.
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.11/site-packages/awx/main/tasks/receptor.py", line 409, in run
receptor_ctl.simple_command(f"work release {self.unit_id}")
File "/var/lib/awx/venv/awx/lib64/python3.11/site-packages/receptorctl/socket_interface.py", line 82, in simple_command
self.writestr(f"{command}\n")
File "/var/lib/awx/venv/awx/lib64/python3.11/site-packages/receptorctl/socket_interface.py", line 48, in writestr
self._sockfile.write(str.encode())
^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'write'
bash-5.1$ /var/lib/awx/venv/awx/bin/receptorctl --socket '/var/run/receptor/receptor.sock' work results jdnpTOwU
Warning: receptorctl and receptor are different versions, they may not be compatible
...
{"uuid": "277d5d39-bc88-4560-b8a6-483a6ec79cff", "counter": 92, "stdout": "\u001b[0;34m<127.0.0.1> EXEC /bin/sh -c 'ANSIBLE_FORCE_COLOR=false GIT_SSH_COMMAND='\"'\"'ssh -o StrictHostKeyChecking=no'\"'\"' ANSIBLE_COLLECTIONS_PATHS=/var/lib/awx/projects/.__awx_cache/_511__prod_infra_converge/stage/requirements_collections ANSIBLE_ROLES_PATH=/var/lib/awx/projects/.__awx_cache/_511__***_converge/stage/requirements_roles ANSIBLE_LOCAL_TEMP=/var/lib/awx/projects/.__awx_cache/_511__***_converge/stage/tmp /usr/bin/python3 /runner/.ansible/tmp/ansible-tmp-1749252734.0434186-141-163465068796428/AnsiballZ_command.py && sleep 0'\u001b[0m", "start_line": 159, "end_line": 160, "runner_ident": "70250", "event": "verbose", "project_update_id": 70250, "pid": 47, "created": "2025-06-06T23:32:14.148183", "parent_uuid": "6a35b50f-31c9-e8c0-addd-000000000023", "event_data": {"playbook": "project_update.yml", "playbook_uuid": "a879e707-8e3c-49fd-a877-7d68adbe4848", "play": "Install content with ansible-galaxy command if necessary", "play_uuid": "6a35b50f-31c9-e8c0-addd-00000000001d", "play_pattern": "localhost", "task": "Fetch galaxy collections from collections/requirements.(yml/yaml)", "task_uuid": "6a35b50f-31c9-e8c0-addd-000000000023", "task_action": "ansible.builtin.command", "resolved_action": "ansible.builtin.command", "task_args": "", "task_path": "/tmp/awx_70250_nr6ig7i3/project/project_update.yml:235", "uuid": "277d5d39-bc88-4560-b8a6-483a6ec79cff"}}
ERROR: [Errno 104] Connection reset by peer