Hi,
I have AWX 19.3.0 deployed on EKS k8s cluster and I have configured ELK as log aggregator, So far so good but the issue I’m facing is for 10 mins logs are pushed then it stops. Again if I made some changes to config and save it pushes logs but for 10 mins only then it stops again. Is this a bug or known issue? What is workaround or solution for this?
Please help! many thanks
Are you seeing any rsyslog errors in your container pods? Have you attempted this configuration on the latest version of AWX?
Thanks,
AWX Team
No, I’m not seeing any rsyslog errors in container pods. I tried on 20.1.0 with same issue.
Yes, I’m seeing below error:
ERROR rsyslogd was unresponsive: OSError: [Errno 90] Message too long
Please ignore my previous email.
Thank you very much
sounds like known issue, do you mind providing details as a comment on this github issue https://github.com/ansible/awx/issues/7278
Also, do you still get this error if you disable sending facts to the log aggregator,
In the UI, go to settings > Logging settings
remove “system_tracking” and “job_events” from the list and Save.
AWX Team
After removing “system_tracking” and “job_events” logging worked stable, but its not logging job logs that we need. Therefore we have added job_events. After adding again it broke.
What Should we do? Please help! Appreciate your response and help!
Thanks in advance.
Hi,
Are you running multiple jobs? Are you able to narrow this down to a particular job/task in a playbook? This seems like the issue linked in our earlier comment and the workaround in that issue is to add a no_log to the task(s) causing the issue. I’d recommend following the issue for further updates.
Thanks,
AWX Team