Jobs not executing

Our AWX implementation has suddenly stopped launching jobs. When launching them from templates, they got queued properly but then just get stuck “STATUS” of “Pending”, and the Standard Out field just shows “Waiting for results”. When looking at the process list on awx_task, it looks like the job never even starts.

I’ve tried shutting down all containers and starting them again, to no avail. I’m suspecting a problem with rabbitmq but not sure where to look. Any ideas?

I am having the same issue. After updated my AWX to 1.0.3.29. Any job I run will stuck at pending states. standard out is empty. It was fine before I updated AWX.

Thanks for help.

How much resources are yall giving to AWX itself? cpu/mem?

The server is VMware virtual machine assigned with 1CPU and 2G mem.

Thanks.

Hi,

I tried increasing the vm to 2CPU and 4G mem and got the same result. I am new to awx. Appreciated if you could point me to the log file or any place to check.

Thanks

Hi Juliana, without seeing any logs from your containers it’s hard to know… you are definitely under provisioning AWX though.

Hello Matt,

Thanks.

When I run the following command:
docker logs awx_task

I can see this error:
2018-02-14 19:22:00,010 ERRO pool awx-config-watcher event buffer overflowed, discarding event 150

Please let me know what else to look at.

Thank you
Juliana

The problem fixed. I am not sure if it is because I rebooted the server.

Thanks for your help.