AWX Initial Install Fails To Launch Web UI

This is the error message I am receiving:

task path: /opt/ansible/roles/installer/tasks/install.yml:55\nfatal: [localhost]: FAILED! => {"changed": false, "module_stderr": "/usr/local/lib/python3.8/site-packages/kubernetes/client/apis/init.py:10: DeprecationWarning: The package kubernetes.client.apis is renamed and deprecated, use kubernetes.client.api instead (please note that the trailing s was removed).\n warnings.warn(\nTraceback (most recent call last):\n File \"/opt/ansible/.ansible/tmp/ansible-tmp-1692104818.010782-171474-238028690979369/AnsiballZ_k8s_exec.py\", line 102, in \n _ansiballz_main()\n File \"/opt/ansible/.ansible/tmp/ansible-tmp-1692104818.010782-171474-238028690979369/AnsiballZ_k8s_exec.py\", line 94, in _ansiballz_main\n invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS)\n File \"/opt/ansible/.ansible/tmp/ansible-tmp-1692104818.010782-171474-238028690979369/AnsiballZ_k8s_exec.py\", line 40, in invoke_module\n runpy.run_module(mod_name=‘ansible_collections.kubernetes.core.plugins.modules.k8s_exec’, init_globals=None, run_name=‘main’, alter_sys=True)\n File \"/usr/lib64/python3.8/runpy.py\", line 207, in run_module\n return _run_module_code(code, init_globals, run_name, mod_spec)\n File \"/usr/lib64/python3.8/runpy.py\", line 97, in _run_module_code\n _run_code(code, mod_globals, init_globals,\n File \"/usr/lib64/python3.8/runpy.py\", line 87, in _run_code\n exec(code, run_globals)\n File \"/tmp/ansible_k8s_exec_payload_rna56oce/ansible_k8s_exec_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_exec.py\", line 245, in \n File \"/tmp/ansible_k8s_exec_payload_rna56oce/ansible_k8s_exec_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_exec.py\", line 241, in main\n File \"/tmp/ansible_k8s_exec_payload_rna56oce/ansible_k8s_exec_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_exec.py\", line 212, in execute_module\nValueError: invalid literal for int() with base 10: ‘error executing command in container: http: invalid Host header’\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1}\n\r\nPLAY RECAP *********************************************************************\r\nlocalhost : ok=59 changed=0 unreachable=0 failed=1 skipped=57 rescued=0 ignored=0 \r\n\n",“job”:“4870190885301418797”,“name”:“awx”,“namespace”:“awx”,“error”:“exit status 2”}
{“level”:“error”,“ts”:1692104820.0656655,“msg”:“Reconciler error”,“controller”:“awx-controller”,“object”:{“name”:“awx”,“namespace”:“awx”},“namespace”:“awx”,“name”:“awx”,“reconcileID”:“5a259fcf-93f4-420c-9e4b-aeb2e57c14b7”,“error”:“event runner on failed”,“stacktrace”:“sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.2/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.2/pkg/internal/controller/controller.go:234”}

I’ve attached images of what I am currently seeing.

So all my AWX Pods are built and initialized fine, however the Web UI responses with a “404” not found error message when trying to navigate to the AWX UI URL.

Looking at my controller logs I see, this message…

“The package kubernetes.client.apis is renamed and deprecated, use kubernetes.client.api instead”

I don’t see how I change the Kubernetes packages during the initial build process using awx-operator?

I originally was using awx-operator 0.3.0, and had several successful builds several months ago on RHEL/Centos 8 machines, using a Playbook I wrote, but now AWX isn’t loading the Web UI, which seems as a result of these weird issues with the kubernetes packages saying essentially:

ansible_k8s_exec_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_exec.py\", line 241, in main\n File \"/tmp/ansible_k8s_exec_payload_cptv36h9/ansible_k8s_exec_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_exec.py\", line 212, in execute_module\nValueError: invalid literal for int() with base 10: ‘error executing command in container: http: invalid Host header’ message

I have upgraded to awx-operator 2.5.0, & yet the issues still remain.

Any help would be appreciated.

Phil

(attachments)


awx-running-pods.PNG

Has anyone responded to this yet?
I’m seeing the same with 2.5.2 operator as well on ubuntu with K3s.

{“level”:“error”,“ts”:“2023-09-04T15:30:15Z”,“msg”:“Reconciler error”,“controller”:“awx-controller”,“object”:{“name”:“awx”,“namespace”:“awx”},“namespace”:“awx”,“name”:“awx”,“reconcileID”:“3c924f4b-48af-4819-94a7-22baff688395”,“error”:“event runner on failed”,“stacktrace”:“sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.5/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.5/pkg/internal/controller/controller.go:274\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.5/pkg/internal/controller/controller.go:235”}

-Praveen

can you provide your AWX spec yaml file you used to deploy?

do you have the same issues if you do a fresh install of latest AWX (and not an upgrade)?

AWX Team

I was able to solve this….

There’s an issue with the newer versions of docker, that breaks the AWX install.

I was able to get AWX installed using k3s but I had to make sure I did not use the docker option when initially installing k3s, or have docker installed on my system.

It didn’t matter what awx-operator version I used, the awx install still failed, It wasn’t until I read that there might be some issue with the go-lang module that newer docker versions might be complied with did I test out the AWX install with docker removed, and it worked.

Phil