# Missing awx instance

**URL:** <https://forum.ansible.com/t/missing-awx-instance/37098>\
**Category:** AWX Project\
**Tags:** awx\
**Created:** [September 15, 2022, 9:41am UTC](https://forum.ansible.com/t/missing-awx-instance/37098 "2022-09-15T09:41:55Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![epi82](https://avatars.discourse-cdn.com/v4/letter/e/ed655f/32.png) [@epi82](https://forum.ansible.com/u/epi82)\
**Post date:** [September 15, 2022, 9:41am UTC](https://forum.ansible.com/t/missing-awx-instance/37098/1 "2022-09-15T09:41:55Z")

</div>

Hello,  
I’ve deployed in my aks cluster AWX with awx-operator 0.28.0

I have set 2 replicas for AWX.

 ![AWX.PNG](https://us1.discourse-cdn.com/ansible/original/2X/a/a528262537a1cd70ae79b37ae0a865078490bab1.png)

Now are both running but as you can see from RESTARTS they change status in “CrashLoopBackOff”.  
Then automatically we come back to running… is it normal?

Thank you very much.  
Elia

---

<div class="post-metadata">

**Author:** ![mani3887](https://avatars.discourse-cdn.com/v4/letter/m/9f8e36/32.png) [@mani3887](https://forum.ansible.com/u/mani3887)\
**Post date:** [September 15, 2022, 4:48pm UTC](https://forum.ansible.com/t/missing-awx-instance/37098/2 "2022-09-15T16:48:22Z")

</div>

I see a similar issue in AKS cluster. For me, it goes to CrashLoopBackOff and stays that way when I spin 4 AWX nodes. My base AKS cluster has 8 nodes, 32CPUs, and there is no reason why this could happen because of the load in the AKS cluster itself. Any pointers on why this happens would help greatly. I am running: AWX version: 21.3.0

Thanks and Regards,  
Mani

---

<div class="post-metadata">

**Author:** ![epi82](https://avatars.discourse-cdn.com/v4/letter/e/ed655f/32.png) [@epi82](https://forum.ansible.com/u/epi82)\
**Post date:** [September 16, 2022, 8:02am UTC](https://forum.ansible.com/t/missing-awx-instance/37098/3 "2022-09-16T08:02:44Z")

</div>

I have an AKS cluster dedicated to AWX with 3 nodes and globally 12 CPU… It’s a staging enviroment there is no load on the cluster. Now I’m testing it running manually some templates. The reason must be another… could not be the load on cluster.

 ![AWX.PNG](https://us1.discourse-cdn.com/ansible/original/2X/c/c273ffb9c9cb71effcb78e530010e09f86cd0394.png)

From yesterday (23h) pods are running without restarts… I don’t understand what it causing this issue.

Thanks for you reply,

Elia

---

<div class="post-metadata">

**Author:** ![AWX\_Project](https://avatars.discourse-cdn.com/v4/letter/a/eada6e/32.png) [@AWX\_Project](https://forum.ansible.com/u/AWX_Project)\
**Post date:** [September 16, 2022, 5:40pm UTC](https://forum.ansible.com/t/missing-awx-instance/37098/4 "2022-09-16T17:40:03Z")

</div>

In this case we suspect the awx-operator to have some useful logs around this,

You might change you AWX CR (custom resource) with “kubectl edit awx” to setno\_log: “false”  
so that you can get more details about pod failures when viewing awx-operator logs after the crashloopbackoff  
kubectl logs deployments/awx-operator-controller-manager -c awx-manager -f

you may grep the logs for “Failed=1” and look through those to find relevant error messages.

AWX Team

---

<div class="post-metadata">

**Author:** ![epi82](https://avatars.discourse-cdn.com/v4/letter/e/ed655f/32.png) [@epi82](https://forum.ansible.com/u/epi82)\
**Post date:** [September 20, 2022, 7:22am UTC](https://forum.ansible.com/t/missing-awx-instance/37098/5 "2022-09-20T07:22:35Z")

</div>

Hello,  
I’ve done a new clean installation with awx-operator 0.28.0 and now I’m having the issue so it couldn’t be due to load on aks cluster.

 ![ErrCrashLoop.PNG](https://us1.discourse-cdn.com/ansible/original/2X/4/42c430b1427003c60e5cd5e60025209c46f4860c.png)

I’ve found this in awx-manager container:

**_localhost : ok=48 changed=1 unreachable=0 failed=1 skipped=39 rescued=0 ignored=0_**  
**_{“level”:“error”,“ts”:1663658311.580133,“msg”:“Reconciler error”,“controller”:“awx-controller”,“object”:{“name”:“awx”,“namespace”:“awx”},“namespace”:“awx”,“name”:“awx”,“reconcileID”:“1b0a8f47-4283-49e6-abd1-264fefb86f4a”,“error”:“event runner on failed”,“stacktrace”:“[sigs.k8s.io/controller-runtime/pkg/internal/controller.(\*Controller).processNextWorkItem](http://sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem)\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.1/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(\*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.1/pkg/internal/controller/controller.go:234”}_**

Thank you for your help.

---

<div class="post-metadata">

**Author:** ![epi82](https://avatars.discourse-cdn.com/v4/letter/e/ed655f/32.png) [@epi82](https://forum.ansible.com/u/epi82)\
**Post date:** [September 21, 2022, 7:51am UTC](https://forum.ansible.com/t/missing-awx-instance/37098/6 "2022-09-21T07:51:40Z")

</div>

Is there any information from the log above to help you understand the issue?

Thank you,  
Elia

---

<div class="post-metadata">

**Author:** ![epi82](https://avatars.discourse-cdn.com/v4/letter/e/ed655f/32.png) [@epi82](https://forum.ansible.com/u/epi82)\
**Post date:** [October 13, 2022, 7:38am UTC](https://forum.ansible.com/t/missing-awx-instance/37098/7 "2022-10-13T07:38:43Z")

</div>

Hello,  
here we are again:

 ![AWX.PNG](https://us1.discourse-cdn.com/ansible/original/2X/7/79abe02d38deff8346ff2958b13182b72b16a3b0.png)

The “CrashLoopBackOff” issue is related to “awx-web” container.  
What could be the problem?  
Thank you very much.

I’m watching container logs but I find no errors:

**_[wait-for-migrations] Waiting for database migrations…_**  
**_[wait-for-migrations] Attempt 1 of 30_**  
**_2022-10-13 07:29:47,921 INFO RPC interface ‘supervisor’ initialized_**  
**_2022-10-13 07:29:47,921 INFO RPC interface ‘supervisor’ initialized_**  
**_2022-10-13 07:29:47,921 CRIT Server ‘unix\_http\_server’ running without any HTTP authentication checking_**  
**_2022-10-13 07:29:47,921 CRIT Server ‘unix\_http\_server’ running without any HTTP authentication checking_**  
**_2022-10-13 07:29:47,921 INFO supervisord started with pid 7_**  
**_2022-10-13 07:29:47,921 INFO supervisord started with pid 7_**  
**_2022-10-13 07:29:48,923 INFO spawned: ‘superwatcher’ with pid 26_**  
**_2022-10-13 07:29:48,923 INFO spawned: ‘superwatcher’ with pid 26_**  
**_2022-10-13 07:29:48,925 INFO spawned: ‘nginx’ with pid 27_**  
**_2022-10-13 07:29:48,925 INFO spawned: ‘nginx’ with pid 27_**  
**_2022-10-13 07:29:48,927 INFO spawned: ‘uwsgi’ with pid 28_**  
**_2022-10-13 07:29:48,927 INFO spawned: ‘uwsgi’ with pid 28_**  
**_2022-10-13 07:29:48,930 INFO spawned: ‘daphne’ with pid 29_**  
**_[uWSGI] getting INI configuration from /etc/tower/uwsgi.ini_**  
**_\*\*\* Starting uWSGI 2.0.18 (64bit) on [Thu Oct 13 07:29:48 2022] \*\*\*_**  
**_compiled with version: 11.3.1 20220421 (Red Hat 11.3.1-2) on 16 September 2022 16:25:19_**  
**_os: Linux-5.4.0-1083-azure #87~18.04.1-Ubuntu SMP Fri Jun 3 13:19:07 UTC 2022_**  
**_nodename: awx-7566768857-pm6wn_**  
**_machine: x86\_64_**  
**_clock source: unix_**  
**_detected number of CPU cores: 4_**  
**_current working directory: /var/lib/awx_**  
**_detected binary path: /var/lib/awx/venv/awx/bin/uwsgi_**  
**_!!! no internal routing support, rebuild with pcre support !!!_**  
**_your memory page size is 4096 bytes_**  
**_detected max file descriptor number: 1048576_**  
**_lock engine: pthread robust mutexes_**  
**_thunder lock: disabled (you can enable it with --thunder-lock)_**  
**_uwsgi socket 0 bound to TCP address 127.0.0.1:8050 fd 3_**  
**_Python version: 3.9.13 (main, Jul 25 2022, 00:00:00) [GCC 11.3.1 20220421 (Red Hat 11.3.1-2)]_**  
**_2022-10-13 07:29:48,930 INFO spawned: ‘daphne’ with pid 29_**  
**_2022-10-13 07:29:48,932 INFO spawned: ‘wsbroadcast’ with pid 30_**  
**_2022-10-13 07:29:48,932 INFO spawned: ‘wsbroadcast’ with pid 30_**  
**_2022-10-13 07:29:48,935 INFO spawned: ‘awx-rsyslogd’ with pid 32_**  
**_2022-10-13 07:29:48,935 INFO spawned: ‘awx-rsyslogd’ with pid 32_**  
**_READY_**  
**_\*\*\* Python threads support is disabled. You can enable it with --enable-threads \*\*\*_**  
**_Python main interpreter initialized at 0x7bb480_**  
**_your server socket listen backlog is limited to 100 connections_**  
**_your mercy for graceful operations on workers is 60 seconds_**  
**_mapped 609552 bytes (595 KB) for 5 cores_**  
**_\*\*\* Operational MODE: preforking \*\*\*_**  
**_\*\*\* uWSGI is running in multiple interpreter mode \*\*\*_**  
**_spawned uWSGI master process (pid: 28)_**  
**_spawned uWSGI worker 1 (pid: 33, cores: 1)_**  
**_spawned uWSGI worker 2 (pid: 34, cores: 1)_**  
**_spawned uWSGI worker 3 (pid: 35, cores: 1)_**  
**_spawned uWSGI worker 4 (pid: 36, cores: 1)_**  
**_spawned uWSGI worker 5 (pid: 37, cores: 1)_**  
**_mounting awx.wsgi:application on /_**  
**_mounting awx.wsgi:application on /_**  
**_mounting awx.wsgi:application on /_**  
**_mounting awx.wsgi:application on /_**  
**_mounting awx.wsgi:application on /_**  
**_2022-10-13 07:29:49,981 INFO success: superwatcher entered RUNNING state, process has stayed up for \> than 1 seconds (startsecs)_**  
**_2022-10-13 07:29:49,981 INFO success: superwatcher entered RUNNING state, process has stayed up for \> than 1 seconds (startsecs)_**  
**_WSGI app 0 (mountpoint=‘/’) ready in 3 seconds on interpreter 0x7bb480 pid: 33 (default app)_**  
**_WSGI app 0 (mountpoint=‘/’) ready in 3 seconds on interpreter 0x7bb480 pid: 37 (default app)_**  
**_WSGI app 0 (mountpoint=‘/’) ready in 3 seconds on interpreter 0x7bb480 pid: 34 (default app)_**  
**_WSGI app 0 (mountpoint=‘/’) ready in 3 seconds on interpreter 0x7bb480 pid: 36 (default app)_**  
**_WSGI app 0 (mountpoint=‘/’) ready in 3 seconds on interpreter 0x7bb480 pid: 35 (default app)_**  
**_2022-10-13 07:29:51,432 INFO [-] daphne.cli Starting server at tcp:port=8051:interface=127.0.0.1_**  
**_2022-10-13 07:29:51,432 INFO Starting server at tcp:port=8051:interface=127.0.0.1_**  
**_2022-10-13 07:29:51,434 INFO [-] daphne.server HTTP/2 support not enabled (install the http2 and tls Twisted extras)_**  
**_2022-10-13 07:29:51,434 INFO HTTP/2 support not enabled (install the http2 and tls Twisted extras)_**  
**_2022-10-13 07:29:51,434 INFO [-] daphne.server Configuring endpoint tcp:port=8051:interface=127.0.0.1_**  
**_2022-10-13 07:29:51,434 INFO Configuring endpoint tcp:port=8051:interface=127.0.0.1_**  
**_2022-10-13 07:29:51,435 INFO [-] daphne.server Listening on TCP address 127.0.0.1:8051_**  
**_2022-10-13 07:29:51,435 INFO Listening on TCP address 127.0.0.1:8051_**  
**_2022-10-13 07:29:51,965 INFO [-] awx.main.wsbroadcast Unable to return currently active instance: No instance found with the current cluster host id, retry in 5s…_**  
**_2022-10-13 07:29:57,428 INFO exited: wsbroadcast (exit status 0; not expected)_**  
**_2022-10-13 07:29:57,428 INFO exited: wsbroadcast (exit status 0; not expected)_**  
**_2022-10-13 07:29:58,431 INFO spawned: ‘wsbroadcast’ with pid 52_**  
**_2022-10-13 07:29:58,431 INFO spawned: ‘wsbroadcast’ with pid 52_**  
**_2022-10-13 07:30:00,437 INFO [-] awx.main.wsbroadcast Unable to return currently active instance: No instance found with the current cluster host id, retry in 5s…_**  
**_2022-10-13 07:30:05,830 INFO exited: wsbroadcast (exit status 0; not expected)_**  
**_2022-10-13 07:30:05,830 INFO exited: wsbroadcast (exit status 0; not expected)_**  
**_2022-10-13 07:30:07,834 INFO spawned: ‘wsbroadcast’ with pid 55_**  
**_2022-10-13 07:30:07,834 INFO spawned: ‘wsbroadcast’ with pid 55_**  
**_2022-10-13 07:30:09,892 INFO [-] awx.main.wsbroadcast Unable to return currently active instance: No instance found with the current cluster host id, retry in 5s…_**  
**_2022-10-13 07:30:15,277 INFO exited: wsbroadcast (exit status 0; not expected)_**  
**_2022-10-13 07:30:15,277 INFO exited: wsbroadcast (exit status 0; not expected)_**  
**_2022-10-13 07:30:18,283 INFO spawned: ‘wsbroadcast’ with pid 58_**  
**_2022-10-13 07:30:18,283 INFO spawned: ‘wsbroadcast’ with pid 58_**  
**_2022-10-13 07:30:19,285 INFO success: nginx entered RUNNING state, process has stayed up for \> than 30 seconds (startsecs)_**  
**_2022-10-13 07:30:19,285 INFO success: nginx entered RUNNING state, process has stayed up for \> than 30 seconds (startsecs)_**  
**_2022-10-13 07:30:19,285 INFO success: uwsgi entered RUNNING state, process has stayed up for \> than 30 seconds (startsecs)_**  
**_2022-10-13 07:30:19,285 INFO success: uwsgi entered RUNNING state, process has stayed up for \> than 30 seconds (startsecs)_**  
**_2022-10-13 07:30:19,285 INFO success: daphne entered RUNNING state, process has stayed up for \> than 30 seconds (startsecs)_**  
**_2022-10-13 07:30:19,285 INFO success: daphne entered RUNNING state, process has stayed up for \> than 30 seconds (startsecs)_**  
**_2022-10-13 07:30:19,285 INFO success: awx-rsyslogd entered RUNNING state, process has stayed up for \> than 30 seconds (startsecs)_**  
**_2022-10-13 07:30:19,285 INFO success: awx-rsyslogd entered RUNNING state, process has stayed up for \> than 30 seconds (startsecs)_**  
**_2022-10-13 07:30:20,136 INFO [-] awx.main.wsbroadcast Unable to return currently active instance: No instance found with the current cluster host id, retry in 5s…_**  
**_2022-10-13 07:30:25,562 INFO exited: wsbroadcast (exit status 0; not expected)_**  
**_2022-10-13 07:30:25,562 INFO exited: wsbroadcast (exit status 0; not expected)_**  
**_2022-10-13 07:30:26,564 INFO gave up: wsbroadcast entered FATAL state, too many start retries too quickly_**  
**_2022-10-13 07:30:26,564 INFO gave up: wsbroadcast entered FATAL state, too many start retries too quickly_**  
**_2022-10-13 07:30:27,566 WARN received SIGQUIT indicating exit request_**  
**_2022-10-13 07:30:27,566 WARN received SIGQUIT indicating exit request_**  
**_Processing Event: ver:3.0 server:supervisor serial:0 pool:superwatcher poolserial:0 eventname:PROCESS\_STATE\_FATAL len:68_**  
**_2022-10-13 07:30:27,577 INFO waiting for superwatcher, nginx, uwsgi, daphne, awx-rsyslogd to die_**  
**_…brutally killing workers…_**  
**_2022-10-13 07:30:27,566 INFO [-] daphne.server Killed 0 pending application instances_**  
**_2022-10-13 07:30:27,566 INFO Killed 0 pending application instances_**  
**_2022-10-13 07:30:27,577 INFO waiting for superwatcher, nginx, uwsgi, daphne, awx-rsyslogd to die_**  
**_2022-10-13 07:30:27,578 INFO stopped: awx-rsyslogd (exit status 0)_**  
**_2022-10-13 07:30:27,578 INFO stopped: awx-rsyslogd (exit status 0)_**  
**_2022-10-13 07:30:27,610 INFO stopped: nginx (exit status 0)_**  
**_2022-10-13 07:30:27,610 INFO stopped: nginx (exit status 0)_**  
**_2022-10-13 07:30:27,965 INFO stopped: daphne (exit status 0)_**  
**_2022-10-13 07:30:27,965 INFO stopped: daphne (exit status 0)_**  
**_worker 1 buried after 1 seconds_**  
**_worker 2 buried after 1 seconds_**  
**_worker 3 buried after 1 seconds_**  
**_worker 4 buried after 1 seconds_**  
**_worker 5 buried after 1 seconds_**  
**_binary reloading uWSGI…_**  
**_chdir() to /var/lib/awx_**  
**_closing all non-uwsgi socket fds \> 2 (max\_fd = 1048576)…_**  
**_found fd 3 mapped to socket 0 (127.0.0.1:8050)_**  
**_running /var/lib/awx/venv/awx/bin/uwsgi_**  
**_[uWSGI] getting INI configuration from /etc/tower/uwsgi.ini_**  
**_\*\*\* Starting uWSGI 2.0.18 (64bit) on [Thu Oct 13 07:30:29 2022] \*\*\*_**  
**_compiled with version: 11.3.1 20220421 (Red Hat 11.3.1-2) on 16 September 2022 16:25:19_**  
**_os: Linux-5.4.0-1083-azure #87~18.04.1-Ubuntu SMP Fri Jun 3 13:19:07 UTC 2022_**  
**_nodename: awx-7566768857-pm6wn_**  
**_machine: x86\_64_**  
**_clock source: unix_**  
**_detected number of CPU cores: 4_**  
**_current working directory: /var/lib/awx_**  
**_detected binary path: /var/lib/awx/venv/awx/bin/uwsgi_**  
**_!!! no internal routing support, rebuild with pcre support !!!_**  
**_your memory page size is 4096 bytes_**  
**_detected max file descriptor number: 1048576_**  
**_lock engine: pthread robust mutexes_**  
**_thunder lock: disabled (you can enable it with --thunder-lock)_**  
**_uwsgi socket 0 inherited INET address 127.0.0.1:8050 fd 3_**  
**_Python version: 3.9.13 (main, Jul 25 2022, 00:00:00) [GCC 11.3.1 20220421 (Red Hat 11.3.1-2)]_**  
**_\*\*\* Python threads support is disabled. You can enable it with --enable-threads \*\*\*_**  
**_Python main interpreter initialized at 0x10e5d90_**  
**_your server socket listen backlog is limited to 100 connections_**  
**_your mercy for graceful operations on workers is 60 seconds_**  
**_2022-10-13 07:30:30,582 INFO waiting for superwatcher, uwsgi to die_**  
**_2022-10-13 07:30:30,582 INFO waiting for superwatcher, uwsgi to die_**  
**_mapped 609552 bytes (595 KB) for 5 cores_**  
**_\*\*\* Operational MODE: preforking \*\*\*_**  
**_\*\*\* uWSGI is running in multiple interpreter mode \*\*\*_**  
**_gracefully (RE)spawned uWSGI master process (pid: 28)_**  
**_spawned uWSGI worker 1 (pid: 61, cores: 1)_**  
**_spawned uWSGI worker 2 (pid: 62, cores: 1)_**  
**_spawned uWSGI worker 3 (pid: 63, cores: 1)_**  
**_spawned uWSGI worker 4 (pid: 64, cores: 1)_**  
**_spawned uWSGI worker 5 (pid: 65, cores: 1)_**  
**_mounting awx.wsgi:application on /_**  
**_mounting awx.wsgi:application on /_**  
**_mounting awx.wsgi:application on /_**  
**_mounting awx.wsgi:application on /_**  
**_mounting awx.wsgi:application on /_**  
**_WSGI app 0 (mountpoint=‘/’) ready in 2 seconds on interpreter 0x10e5d90 pid: 61 (default app)_**  
**_WSGI app 0 (mountpoint=‘/’) ready in 2 seconds on interpreter 0x10e5d90 pid: 63 (default app)_**  
**_WSGI app 0 (mountpoint=‘/’) ready in 2 seconds on interpreter 0x10e5d90 pid: 65 (default app)_**  
**_WSGI app 0 (mountpoint=‘/’) ready in 2 seconds on interpreter 0x10e5d90 pid: 64 (default app)_**  
**_WSGI app 0 (mountpoint=‘/’) ready in 2 seconds on interpreter 0x10e5d90 pid: 62 (default app)_**  
**_2022-10-13 07:30:34,483 INFO waiting for superwatcher, uwsgi to die_**  
**_2022-10-13 07:30:34,483 INFO waiting for superwatcher, uwsgi to die_**  
**_2022-10-13 07:30:37,487 INFO waiting for superwatcher, uwsgi to die_**  
**_2022-10-13 07:30:37,487 INFO waiting for superwatcher, uwsgi to die_**  
**_2022-10-13 07:30:38,489 WARN killing ‘uwsgi’ (28) with SIGKILL_**  
**_2022-10-13 07:30:38,489 WARN killing ‘uwsgi’ (28) with SIGKILL_**  
**_2022-10-13 07:30:38,502 INFO stopped: uwsgi (terminated by SIGKILL)_**  
**_2022-10-13 07:30:38,502 INFO stopped: uwsgi (terminated by SIGKILL)_**  
**_2022-10-13 07:30:38,503 INFO stopped: superwatcher (terminated by SIGTERM)_**  
**_2022-10-13 07:30:38,503 INFO stopped: superwatcher (terminated by SIGTERM)_**

g

---

<div class="post-metadata">

**Author:** ![epi82](https://avatars.discourse-cdn.com/v4/letter/e/ed655f/32.png) [@epi82](https://forum.ansible.com/u/epi82)\
**Post date:** [October 13, 2022, 8:19am UTC](https://forum.ansible.com/t/missing-awx-instance/37098/8 "2022-10-13T08:19:45Z")

</div>

Edited awx and set “no\_log: false”.

For instance I’ve found this:

**onTime": "2022-10-13T08:00:55Z", "lastUpdateTime": "2022-10-13T08:00:55Z", "message": "Deployment does not have minimum availability.", "reason": "MinimumReplicasUnavailable", "status": "False", "type": "Available"}], "observedGeneration": 3, "readyReplicas": 1, "replicas": 2, "unavailableReplicas": 1, "updatedReplicas": 2}}}\n\r\nPLAY RECAP \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\r\nlocalhost : ok=50 changed=0 unreachable=0 failed=1 skipped=51 rescued=0 ignored=0 \r\n\n",“job”:“8583884555945897733”,“name”:“awx”,“namespace”:“awx”,“error”:“exit status 2”}**  
**{“level”:“error”,“ts”:1665648202.4457707,“msg”:“Reconciler error”,“controller”:“awx-controller”,“object”:{“name”:“awx”,“namespace”:“awx”},“namespace”:“awx”,“name”:“awx”,“reconcileID”:“be6d797d-28f7-48bf-ad55-c3816633a639”,“error”:“event runner on failed”,“stacktrace”:“[sigs.k8s.io/controller-runtime/pkg/internal/controller.(\*Controller).processNextWorkItem](http://sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem)\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.2/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(\*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.2/pkg/internal/controller/controller.go:234”}**  
**{“level”:“error”,“ts”:1665648347.4962242,“logger”:“logging\_event\_handler”,“msg”:“”,“name”:“awx”,“namespace”:“awx”,“gvk”:“[awx.ansible.com/v1beta1](http://awx.ansible.com/v1beta1), Kind=AWX”,“event\_type”:“runner\_on\_failed”,“job”:“114496043156805132”,“EventData.Task”:“Apply deployment resources”,“EventData.TaskArgs”:“”,“EventData.FailedTaskPath”:“/opt/ansible/roles/installer/tasks/resources\_configuration.yml:164”,“error”:“[playbook task failed]”}**  
**{“level”:“error”,“ts”:1665648347.7489324,“logger”:“runner”,“msg”:"ansible-playbook 2.9.27\r\n config file = /etc/ansible/ansible.cfg\r\n configured module search path = [‘/usr/share/ansible/openshift’]\r\n ansible python module location = /usr/local/lib/python3.8/site-packages/ansible\r\n executable location = /usr/local/bin/ansible-playbook\r\n python version = 3.8.12 (default, Sep 16 2021, 10:46:05) [GCC 8.5.0 20210514 (Red Hat 8.5.0-3)]\r\nUsing /etc/ansible/ansible.cfg as config file\r\nSkipping callback ‘actionable’, as we already have a stdout callback.\nSkipping callback ‘awx\_display’, as we already have a stdout callback.\nSkipping callback ‘counter\_enabled’, as we already have a stdout callback.\nSkipping callback ‘debug’, as we already have a stdout callback.\nSkipping callback ‘dense’, as we already have a stdout callback.\nSkipping callback ‘dense’, as we already have a stdout callback.\nSkipping callback ‘full\_skip’, as we already have a stdout callback.\nSkipping callback ‘json’, as we already have a stdout callback.\nSkipping callback ‘minimal’, as we already have a stdout callback.\nSkipping callback ‘null’, as we already have a stdout callback.\nSkipping callback ‘oneline’, as we already have a stdout callback.\nSkipping callback ‘selective’, as we already have a stdout callback.\nSkipping callback ‘skippy’, as we already have a stdout callback.\nSkipping callback ‘stderr’, as we already have a stdout callback.\nSkipping callback ‘unixy’, as we already have a stdout callback.\nSkipping callback ‘yaml’, as we already have a stdout callback.\n\r\nPLAYBOOK: awx.yml \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\***

Could help?  
Thanks.

---

<div class="post-metadata">

**Author:** ![epi82](https://avatars.discourse-cdn.com/v4/letter/e/ed655f/32.png) [@epi82](https://forum.ansible.com/u/epi82)\
**Post date:** [October 13, 2022, 8:34am UTC](https://forum.ansible.com/t/missing-awx-instance/37098/9 "2022-10-13T08:34:23Z")

</div>

Or this:

localhost : ok=50 changed=0 unreachable=0 failed=1 skipped=51 rescued=0 ignored=0  
“creationTimestamp": "2022-06-29T15:11:08Z", "labels": {"[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))”: "awx", "[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))“: "awx-operator", "[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))”: "awx", "[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)]([http://app.kubernetes.io/operator-version\](http://app.kubernetes.io/operator-version%5C))“: "0.29.0", "[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)]([http://app.kubernetes.io/part-of\](http://app.kubernetes.io/part-of%5C))”: "awx"}, "managedFields": [{"apiVersion": "v1", "fieldsType": "FieldsV1", "fieldsV1": {"f:data": {".": {}, "f:credentials.py": {}, "f:execution\_environments.py": {}, "f:ldap.py": {}}, "f:metadata": {"f:annotations": {".": {}, "f:[[kubectl.kubernetes.io/last-applied-configuration](http://kubectl.kubernetes.io/last-applied-configuration)]([http://kubectl.kubernetes.io/last-applied-configuration\](http://kubectl.kubernetes.io/last-applied-configuration%5C))“: {}}, "f:labels": {".": {}, "f:[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))”: {}, "f:[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))“: {}, "f:[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))”: {}, "f:[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)]([http://app.kubernetes.io/operator-version\](http://app.kubernetes.io/operator-version%5C))“: {}, "f:[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)]([http://app.kubernetes.io/part-of\](http://app.kubernetes.io/part-of%5C))”: {}}, "f:ownerReferences": {".": {}, "k:{\"uid\":\"093d7650-2976-4827-9751-e30d4640124d\"}": {}}}, "f:type": {}}, "manager": "OpenAPI-Generator", "operation": "Update", "time": "2022-06-29T15:11:08Z"}], "name": "awx-app-credentials", "namespace": "awx", "ownerReferences": [{"apiVersion": "[[awx.ansible.com/v1beta1](http://awx.ansible.com/v1beta1)]([http://awx.ansible.com/v1beta1\](http://awx.ansible.com/v1beta1%5C))“, "kind": "AWX", "name": "awx", "uid": "093d7650-2976-4827-9751-e30d4640124d"}], "resourceVersion": "34937463", "uid": "ac79ebed-c1b1-4ebd-ad27-3d39a80bbaf3"}, "type": "Opaque"}}\nok: [localhost] =\> (item=rbac/service\_account) =\> {"ansible\_loop\_var": "item", "changed": false, "item": "rbac/service\_account", "result": {"results": [{"changed": false, "duration": 0, "method": "apply", "result": {"apiVersion": "v1", "kind": "ServiceAccount", "metadata": {"annotations": {"[[kubectl.kubernetes.io/last-applied-configuration](http://kubectl.kubernetes.io/last-applied-configuration)]([http://kubectl.kubernetes.io/last-applied-configuration\](http://kubectl.kubernetes.io/last-applied-configuration%5C))”: "{\"apiVersion\":\"v1\",\"kind\":\"ServiceAccount\",\"metadata\":{\"labels\":{\"[[app.kubernetes.io/component](http://app.kubernetes.io/component)\]([http://app.kubernetes.io/component\\\](http://app.kubernetes.io/component%5C%5C%5C))“:\"awx\",\"[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)\]([http://app.kubernetes.io/managed-by\\\](http://app.kubernetes.io/managed-by%5C%5C%5C))”:\"awx-operator\",\"[[app.kubernetes.io/name](http://app.kubernetes.io/name)\]([http://app.kubernetes.io/name\\\](http://app.kubernetes.io/name%5C%5C%5C))“:\"awx\",\"[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)\]([http://app.kubernetes.io/operator-version\\\](http://app.kubernetes.io/operator-version%5C%5C%5C))”:\"0.29.0\",\"[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)\]([http://app.kubernetes.io/part-of\\\](http://app.kubernetes.io/part-of%5C%5C%5C))“:\"awx\"},\"name\":\"awx\",\"namespace\":\"awx\"}}"}, "creationTimestamp": "2022-06-29T15:11:09Z", "labels": {"[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))”: "awx", "[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))“: "awx-operator", "[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))”: "awx", "[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)]([http://app.kubernetes.io/operator-version\](http://app.kubernetes.io/operator-version%5C))“: "0.29.0", "[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)]([http://app.kubernetes.io/part-of\](http://app.kubernetes.io/part-of%5C))”: "awx"}, "managedFields": [{"apiVersion": "v1", "fieldsType": "FieldsV1", "fieldsV1": {"f:metadata": {"f:annotations": {".": {}, "f:[[kubectl.kubernetes.io/last-applied-configuration](http://kubectl.kubernetes.io/last-applied-configuration)]([http://kubectl.kubernetes.io/last-applied-configuration\](http://kubectl.kubernetes.io/last-applied-configuration%5C))“: {}}, "f:labels": {".": {}, "f:[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))”: {}, "f:[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))“: {}, "f:[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))”: {}, "f:[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)]([http://app.kubernetes.io/operator-version\](http://app.kubernetes.io/operator-version%5C))“: {}, "f:[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)]([http://app.kubernetes.io/part-of\](http://app.kubernetes.io/part-of%5C))”: {}}, "f:ownerReferences": {".": {}, "k:{\"uid\":\"093d7650-2976-4827-9751-e30d4640124d\"}": {}}}}, "manager": "OpenAPI-Generator", "operation": "Update", "time": "2022-06-29T15:11:09Z"}, {"apiVersion": "v1", "fieldsType": "FieldsV1", "fieldsV1": {"f:secrets": {".": {}, "k:{\"name\":\"awx-token-rxrvj\"}": {}}}, "manager": "kube-controller-manager", "operation": "Update", "time": "2022-06-29T15:11:09Z"}], "name": "awx", "namespace": "awx", "ownerReferences": [{"apiVersion": "[[awx.ansible.com/v1beta1](http://awx.ansible.com/v1beta1)]([http://awx.ansible.com/v1beta1\](http://awx.ansible.com/v1beta1%5C))“, "kind": "AWX", "name": "awx", "uid": "093d7650-2976-4827-9751-e30d4640124d"}], "resourceVersion": "34937465", "uid": "5d87ef47-b612-48d6-b802-795bfb346d66"}, "secrets": [{"name": "awx-token-rxrvj"}]}}, {"changed": false, "duration": 0, "method": "apply", "result": {"apiVersion": "[[rbac.authorization.k8s.io/v1](http://rbac.authorization.k8s.io/v1)]([http://rbac.authorization.k8s.io/v1\](http://rbac.authorization.k8s.io/v1%5C))”, "kind": "Role", "metadata": {"annotations": {"[[kubectl.kubernetes.io/last-applied-configuration](http://kubectl.kubernetes.io/last-applied-configuration)]([http://kubectl.kubernetes.io/last-applied-configuration\](http://kubectl.kubernetes.io/last-applied-configuration%5C))“: "{\"apiVersion\":\"[[rbac.authorization.k8s.io/v1](http://rbac.authorization.k8s.io/v1)\]([http://rbac.authorization.k8s.io/v1\\\](http://rbac.authorization.k8s.io/v1%5C%5C%5C))”,\"kind\":\"Role\",\"metadata\":{\"name\":\"awx\",\"namespace\":\"awx\"},\"rules\":[{\"apiGroups\":[\"\"],\"resources\":[\"pods\"],\"verbs\":[\"get\",\"list\",\"watch\",\"create\",\"update\",\"patch\",\"delete\"]},{\"apiGroups\":[\"\"],\"resources\":[\"pods/log\"],\"verbs\":[\"get\"]},{\"apiGroups\":[\"\"],\"resources\":[\"pods/attach\"],\"verbs\":[\"create\"]},{\"apiGroups\":[\"\"],\"resources\":[\"secrets\"],\"verbs\":[\"get\",\"create\",\"delete\"]}]}"}, "creationTimestamp": "2022-06-29T15:11:09Z", "managedFields": [{"apiVersion": "[[rbac.authorization.k8s.io/v1](http://rbac.authorization.k8s.io/v1)]([http://rbac.authorization.k8s.io/v1\](http://rbac.authorization.k8s.io/v1%5C))“, "fieldsType": "FieldsV1", "fieldsV1": {"f:metadata": {"f:annotations": {".": {}, "f:[[kubectl.kubernetes.io/last-applied-configuration](http://kubectl.kubernetes.io/last-applied-configuration)]([http://kubectl.kubernetes.io/last-applied-configuration\](http://kubectl.kubernetes.io/last-applied-configuration%5C))”: {}}, "f:ownerReferences": {".": {}, "k:{\"uid\":\"093d7650-2976-4827-9751-e30d4640124d\"}": {}}}, "f:rules": {}}, "manager": "OpenAPI-Generator", "operation": "Update", "time": "2022-06-29T15:11:09Z"}], "name": "awx", "namespace": "awx", "ownerReferences": [{"apiVersion": "[[awx.ansible.com/v1beta1](http://awx.ansible.com/v1beta1)]([http://awx.ansible.com/v1beta1\](http://awx.ansible.com/v1beta1%5C))“, "kind": "AWX", "name": "awx", "uid": "093d7650-2976-4827-9751-e30d4640124d"}], "resourceVersion": "27644", "uid": "48d00219-b8c8-4fb6-90b0-b2de5a775945"}, "rules": [{"apiGroups": [""], "resources": ["pods"], "verbs": ["get", "list", "watch", "create", "update", "patch", "delete"]}, {"apiGroups": [""], "resources": ["pods/log"], "verbs": ["get"]}, {"apiGroups": [""], "resources": ["pods/attach"], "verbs": ["create"]}, {"apiGroups": [""], "resources": ["secrets"], "verbs": ["get", "create", "delete"]}]}}, {"changed": false, "duration": 0, "method": "apply", "result": {"apiVersion": "[[rbac.authorization.k8s.io/v1](http://rbac.authorization.k8s.io/v1)]([http://rbac.authorization.k8s.io/v1\](http://rbac.authorization.k8s.io/v1%5C))”, "kind": "RoleBinding", "metadata": {"annotations": {"[[kubectl.kubernetes.io/last-applied-configuration](http://kubectl.kubernetes.io/last-applied-configuration)]([http://kubectl.kubernetes.io/last-applied-configuration\](http://kubectl.kubernetes.io/last-applied-configuration%5C))“: "{\"apiVersion\":\"[[rbac.authorization.k8s.io/v1](http://rbac.authorization.k8s.io/v1)\]([http://rbac.authorization.k8s.io/v1\\\](http://rbac.authorization.k8s.io/v1%5C%5C%5C))”,\"kind\":\"RoleBinding\",\"metadata\":{\"name\":\"awx\",\"namespace\":\"awx\"},\"roleRef\":{\"apiGroup\":\"[rbac.authorization.k8s.io](http://rbac.authorization.k8s.io)\",\"kind\":\"Role\",\"name\":\"awx\"},\"subjects\":[{\"kind\":\"ServiceAccount\",\"name\":\"awx\"}]}"}, "creationTimestamp": "2022-06-29T15:11:10Z", "managedFields": [{"apiVersion": "[[rbac.authorization.k8s.io/v1](http://rbac.authorization.k8s.io/v1)]([http://rbac.authorization.k8s.io/v1\](http://rbac.authorization.k8s.io/v1%5C))“, "fieldsType": "FieldsV1", "fieldsV1": {"f:metadata": {"f:annotations": {".": {}, "f:[[kubectl.kubernetes.io/last-applied-configuration](http://kubectl.kubernetes.io/last-applied-configuration)]([http://kubectl.kubernetes.io/last-applied-configuration\](http://kubectl.kubernetes.io/last-applied-configuration%5C))”: {}}, "f:ownerReferences": {".": {}, "k:{\"uid\":\"093d7650-2976-4827-9751-e30d4640124d\"}": {}}}, "f:roleRef": {}, "f:subjects": {}}, "manager": "OpenAPI-Generator", "operation": "Update", "time": "2022-06-29T15:11:09Z"}], "name": "awx", "namespace": "awx", "ownerReferences": [{"apiVersion": "[[awx.ansible.com/v1beta1](http://awx.ansible.com/v1beta1)]([http://awx.ansible.com/v1beta1\](http://awx.ansible.com/v1beta1%5C))“, "kind": "AWX", "name": "awx", "uid": "093d7650-2976-4827-9751-e30d4640124d"}], "resourceVersion": "27645", "uid": "da54729b-20b1-4bce-87fe-efffb9fca7af"}, "roleRef": {"apiGroup": "[rbac.authorization.k8s.io](http://rbac.authorization.k8s.io)", "kind": "Role", "name": "awx"}, "subjects": [{"kind": "ServiceAccount", "name": "awx"}]}}]}}\nok: [localhost] =\> (item=storage/persistent) =\> {"ansible\_loop\_var": "item", "changed": false, "item": "storage/persistent", "result": {"results": }}\nok: [localhost] =\> (item=networking/service) =\> {"ansible\_loop\_var": "item", "changed": false, "duration": 0, "item": "networking/service", "method": "apply", "result": {"apiVersion": "v1", "kind": "Service", "metadata": {"annotations": {"[[kubectl.kubernetes.io/last-applied-configuration](http://kubectl.kubernetes.io/last-applied-configuration)]([http://kubectl.kubernetes.io/last-applied-configuration\](http://kubectl.kubernetes.io/last-applied-configuration%5C))”: "{\"apiVersion\":\"v1\",\"kind\":\"Service\",\"metadata\":{\"labels\":{\"[[app.kubernetes.io/component](http://app.kubernetes.io/component)\]([http://app.kubernetes.io/component\\\](http://app.kubernetes.io/component%5C%5C%5C))“:\"awx\",\"[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)\]([http://app.kubernetes.io/managed-by\\\](http://app.kubernetes.io/managed-by%5C%5C%5C))”:\"awx-operator\",\"[[app.kubernetes.io/name](http://app.kubernetes.io/name)\]([http://app.kubernetes.io/name\\\](http://app.kubernetes.io/name%5C%5C%5C))“:\"awx\",\"[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)\]([http://app.kubernetes.io/operator-version\\\](http://app.kubernetes.io/operator-version%5C%5C%5C))”:\"0.29.0\",\"[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)\]([http://app.kubernetes.io/part-of\\\](http://app.kubernetes.io/part-of%5C%5C%5C))“:\"awx\"},\"name\":\"awx-service\",\"namespace\":\"awx\"},\"spec\":{\"ports\":[{\"name\":\"http\",\"nodePort\":30080,\"port\":80,\"protocol\":\"TCP\",\"targetPort\":8052}],\"selector\":{\"[[app.kubernetes.io/component](http://app.kubernetes.io/component)\]([http://app.kubernetes.io/component\\\](http://app.kubernetes.io/component%5C%5C%5C))”:\"awx\",\"[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)\]([http://app.kubernetes.io/managed-by\\\](http://app.kubernetes.io/managed-by%5C%5C%5C))“:\"awx-operator\",\"[[app.kubernetes.io/name](http://app.kubernetes.io/name)\]([http://app.kubernetes.io/name\\\](http://app.kubernetes.io/name%5C%5C%5C))”:\"awx\"},\"type\":\"NodePort\"}}"}, "creationTimestamp": "2022-06-29T15:11:11Z", "labels": {"[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))“: "awx", "[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))”: "awx-operator", "[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))“: "awx", "[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)]([http://app.kubernetes.io/operator-version\](http://app.kubernetes.io/operator-version%5C))”: "0.29.0", "[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)]([http://app.kubernetes.io/part-of\](http://app.kubernetes.io/part-of%5C))“: "awx"}, "managedFields": [{"apiVersion": "v1", "fieldsType": "FieldsV1", "fieldsV1": {"f:metadata": {"f:annotations": {".": {}, "f:[[kubectl.kubernetes.io/last-applied-configuration](http://kubectl.kubernetes.io/last-applied-configuration)]([http://kubectl.kubernetes.io/last-applied-configuration\](http://kubectl.kubernetes.io/last-applied-configuration%5C))”: {}}, "f:labels": {".": {}, "f:[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))“: {}, "f:[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))”: {}, "f:[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))“: {}, "f:[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)]([http://app.kubernetes.io/operator-version\](http://app.kubernetes.io/operator-version%5C))”: {}, "f:[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)]([http://app.kubernetes.io/part-of\](http://app.kubernetes.io/part-of%5C))“: {}}, "f:ownerReferences": {".": {}, "k:{\"uid\":\"093d7650-2976-4827-9751-e30d4640124d\"}": {}}}, "f:spec": {"f:externalTrafficPolicy": {}, "f:internalTrafficPolicy": {}, "f:ports": {".": {}, "k:{\"port\":80,\"protocol\":\"TCP\"}": {".": {}, "f:name": {}, "f:nodePort": {}, "f:port": {}, "f:protocol": {}, "f:targetPort": {}}}, "f:selector": {}, "f:sessionAffinity": {}, "f:type": {}}}, "manager": "OpenAPI-Generator", "operation": "Update", "time": "2022-06-29T15:11:11Z"}], "name": "awx-service", "namespace": "awx", "ownerReferences": [{"apiVersion": "[[awx.ansible.com/v1beta1](http://awx.ansible.com/v1beta1)]([http://awx.ansible.com/v1beta1\](http://awx.ansible.com/v1beta1%5C))”, "kind": "AWX", "name": "awx", "uid": "093d7650-2976-4827-9751-e30d4640124d"}], "resourceVersion": "34937475", "uid": "bc967b69-6cb9-453c-9ff2-5c7b4ae67e7e"}, "spec": {"clusterIP": "10.0.155.91", "clusterIPs": ["10.0.155.91"], "externalTrafficPolicy": "Cluster", "internalTrafficPolicy": "Cluster", "ipFamilies": ["IPv4"], "ipFamilyPolicy": "SingleStack", "ports": [{"name": "http", "nodePort": 30080, "port": 80, "protocol": "TCP", "targetPort": 8052}], "selector": {"[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))“: "awx", "[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))”: "awx-operator", "[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))“: "awx"}, "sessionAffinity": "None", "type": "NodePort"}, "status": {"loadBalancer": {}}}}\nok: [localhost] =\> (item=networking/ingress) =\> {"ansible\_loop\_var": "item", "changed": false, "item": "networking/ingress", "result": {"results": }}\n\r\nTASK [installer : Set default awx app image] \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\r\ntask path: /opt/ansible/roles/installer/tasks/resources\_configuration.yml:134\nok: [localhost] =\> {"ansible\_facts": {"\_default\_image": "[[quay.io/ansible/awx:21.6.0](http://quay.io/ansible/awx:21.6.0)]([http://quay.io/ansible/awx:21.6.0\](http://quay.io/ansible/awx:21.6.0%5C))”}, "changed": false}\n\r\nTASK [installer : Set user provided awx app image] \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\r\ntask path: /opt/ansible/roles/installer/tasks/resources\_configuration.yml:138\nskipping: [localhost] =\> {"changed": false, "skip\_reason": "Conditional result was False"}\n\r\nTASK [installer : Set AWX app image URL] \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\r\ntask path: /opt/ansible/roles/installer/tasks/resources\_configuration.yml:145\nok: [localhost] =\> {"ansible\_facts": {"\_image": "[[quay.io/ansible/awx:21.6.0](http://quay.io/ansible/awx:21.6.0)]([http://quay.io/ansible/awx:21.6.0\](http://quay.io/ansible/awx:21.6.0%5C))“}, "changed": false}\n\r\nTASK [installer : Set default redis image] \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\r\ntask path: /opt/ansible/roles/installer/tasks/resources\_configuration.yml:149\nok: [localhost] =\> {"ansible\_facts": {"\_default\_redis\_image": "[[docker.io/redis:7](http://docker.io/redis:7)]([http://docker.io/redis:7\](http://docker.io/redis:7%5C))”}, "changed": false}\n\r\nTASK [installer : Set user provided redis image] \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\r\ntask path: /opt/ansible/roles/installer/tasks/resources\_configuration.yml:153\nskipping: [localhost] =\> {"changed": false, "skip\_reason": "Conditional result was False"}\n\r\nTASK [installer : Set Redis image URL] \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\r\ntask path: /opt/ansible/roles/installer/tasks/resources\_configuration.yml:160\nok: [localhost] =\> {"ansible\_facts": {"\_redis\_image": "[[docker.io/redis:7](http://docker.io/redis:7)]([http://docker.io/redis:7\](http://docker.io/redis:7%5C))“}, "changed": false}\n\r\nTASK [installer : Apply deployment resources] \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\r\ntask path: /opt/ansible/roles/installer/tasks/resources\_configuration.yml:164\nfatal: [localhost]: FAILED! =\> {"changed": false, "duration": 120, "method": "apply", "msg": "Deployment awx: Resource apply timed out", "result": {"apiVersion": "apps/v1", "kind": "Deployment", "metadata": {"annotations": {"[[deployment.kubernetes.io/revision](http://deployment.kubernetes.io/revision)]([http://deployment.kubernetes.io/revision\](http://deployment.kubernetes.io/revision%5C))”: "3", "[[kubectl.kubernetes.io/last-applied-configuration](http://kubectl.kubernetes.io/last-applied-configuration)]([http://kubectl.kubernetes.io/last-applied-configuration\](http://kubectl.kubernetes.io/last-applied-configuration%5C))“: "{\"apiVersion\":\"apps/v1\",\"kind\":\"Deployment\",\"metadata\":{\"labels\":{\"[[app.kubernetes.io/component](http://app.kubernetes.io/component)\]([http://app.kubernetes.io/component\\\](http://app.kubernetes.io/component%5C%5C%5C))”:\"awx\",\"[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)\]([http://app.kubernetes.io/managed-by\\\](http://app.kubernetes.io/managed-by%5C%5C%5C))“:\"awx-operator\",\"[[app.kubernetes.io/name](http://app.kubernetes.io/name)\]([http://app.kubernetes.io/name\\\](http://app.kubernetes.io/name%5C%5C%5C))”:\"awx\",\"[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)\]([http://app.kubernetes.io/operator-version\\\](http://app.kubernetes.io/operator-version%5C%5C%5C))“:\"0.29.0\",\"[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)\]([http://app.kubernetes.io/part-of\\\](http://app.kubernetes.io/part-of%5C%5C%5C))”:\"awx\",\"[[app.kubernetes.io/version](http://app.kubernetes.io/version)\]([http://app.kubernetes.io/version\\\](http://app.kubernetes.io/version%5C%5C%5C))“:\"21.6.0\"},\"name\":\"awx\",\"namespace\":\"awx\"},\"spec\":{\"replicas\":2,\"selector\":{\"matchLabels\":{\"[[app.kubernetes.io/component](http://app.kubernetes.io/component)\]([http://app.kubernetes.io/component\\\](http://app.kubernetes.io/component%5C%5C%5C))”:\"awx\",\"[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)\]([http://app.kubernetes.io/managed-by\\\](http://app.kubernetes.io/managed-by%5C%5C%5C))“:\"awx-operator\",\"[[app.kubernetes.io/name](http://app.kubernetes.io/name)\]([http://app.kubernetes.io/name\\\](http://app.kubernetes.io/name%5C%5C%5C))”:\"awx\"}},\"template\":{\"metadata\":{\"labels\":{\"[[app.kubernetes.io/component](http://app.kubernetes.io/component)\]([http://app.kubernetes.io/component\\\](http://app.kubernetes.io/component%5C%5C%5C))“:\"awx\",\"[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)\]([http://app.kubernetes.io/managed-by\\\](http://app.kubernetes.io/managed-by%5C%5C%5C))”:\"awx-operator\",\"[[app.kubernetes.io/name](http://app.kubernetes.io/name)\]([http://app.kubernetes.io/name\\\](http://app.kubernetes.io/name%5C%5C%5C))“:\"awx\",\"[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)\]([http://app.kubernetes.io/operator-version\\\](http://app.kubernetes.io/operator-version%5C%5C%5C))”:\"0.29.0\",\"[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)\]([http://app.kubernetes.io/part-of\\\](http://app.kubernetes.io/part-of%5C%5C%5C))“:\"awx\",\"[[app.kubernetes.io/version](http://app.kubernetes.io/version)\]([http://app.kubernetes.io/version\\\](http://app.kubernetes.io/version%5C%5C%5C))”:\"21.6.0\"}},\"spec\":{\"containers\":[{\"args\":[\"redis-server\",\"/etc/redis.conf\"],\"image\":\"[[docker.io/redis:7](http://docker.io/redis:7)\]([http://docker.io/redis:7\\\](http://docker.io/redis:7%5C%5C%5C))“,\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"redis\",\"resources\":{\"requests\":{\"cpu\":\"50m\",\"memory\":\"64Mi\"}},\"volumeMounts\":[{\"mountPath\":\"/etc/redis.conf\",\"name\":\"awx-redis-config\",\"readOnly\":true,\"subPath\":\"redis.conf\"},{\"mountPath\":\"/var/run/redis\",\"name\":\"awx-redis-socket\"},{\"mountPath\":\"/data\",\"name\":\"awx-redis-data\"}]},{\"args\":[\"/usr/bin/launch\_awx.sh\"],\"env\":[{\"name\":\"MY\_POD\_NAMESPACE\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"metadata.namespace\"}}},{\"name\":\"UWSGI\_MOUNT\_PATH\",\"value\":\"/\"}],\"image\":\"[[quay.io/ansible/awx:21.6.0](http://quay.io/ansible/awx:21.6.0)\]([http://quay.io/ansible/awx:21.6.0\\\](http://quay.io/ansible/awx:21.6.0%5C%5C%5C))”,\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"awx-web\",\"ports\":[{\"containerPort\":8052}],\"resources\":{\"requests\":{\"cpu\":\"100m\",\"memory\":\"128Mi\"}},\"volumeMounts\":[{\"mountPath\":\"/etc/tower/conf.d/execution\_environments.py\",\"name\":\"awx-application-credentials\",\"readOnly\":true,\"subPath\":\"execution\_environments.py\"},{\"mountPath\":\"/etc/tower/conf.d/credentials.py\",\"name\":\"awx-application-credentials\",\"readOnly\":true,\"subPath\":\"credentials.py\"},{\"mountPath\":\"/etc/tower/conf.d/ldap.py\",\"name\":\"awx-application-credentials\",\"readOnly\":true,\"subPath\":\"ldap.py\"},{\"mountPath\":\"/etc/tower/SECRET\_KEY\",\"name\":\"awx-secret-key\",\"readOnly\":true,\"subPath\":\"SECRET\_KEY\"},{\"mountPath\":\"/etc/tower/settings.py\",\"name\":\"awx-settings\",\"readOnly\":true,\"subPath\":\"settings.py\"},{\"mountPath\":\"/etc/nginx/nginx.conf\",\"name\":\"awx-nginx-conf\",\"readOnly\":true,\"subPath\":\"nginx.conf\"},{\"mountPath\":\"/var/run/redis\",\"name\":\"awx-redis-socket\"},{\"mountPath\":\"/var/run/supervisor\",\"name\":\"supervisor-socket\"},{\"mountPath\":\"/var/run/awx-rsyslog\",\"name\":\"rsyslog-socket\"},{\"mountPath\":\"/var/lib/awx/rsyslog\",\"name\":\"rsyslog-dir\"},{\"mountPath\":\"/var/lib/awx/projects\",\"name\":\"awx-projects\"},{\"mountPath\":\"/etc/receptor/signing/work-public-key.pem\",\"name\":\"awx-receptor-work-signing\",\"readOnly\":true,\"subPath\":\"work-public-key.pem\"},{\"mountPath\":\"/etc/receptor/tls/ca\",\"name\":\"awx-receptor-ca\",\"readOnly\":true}]},{\"args\":[\"/usr/bin/launch\_awx\_task.sh\"],\"env\":[{\"name\":\"SUPERVISOR\_WEB\_CONFIG\_PATH\",\"value\":\"/etc/supervisord.conf\"},{\"name\":\"AWX\_SKIP\_MIGRATIONS\",\"value\":\"1\"},{\"name\":\"MY\_POD\_UID\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"metadata.uid\"}}},{\"name\":\"MY\_POD\_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"MY\_POD\_NAMESPACE\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"metadata.namespace\"}}}],\"image\":\"[[quay.io/ansible/awx:21.6.0](http://quay.io/ansible/awx:21.6.0)\]([http://quay.io/ansible/awx:21.6.0\\\](http://quay.io/ansible/awx:21.6.0%5C%5C%5C))“,\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"awx-task\",\"resources\":{\"requests\":{\"cpu\":\"100m\",\"memory\":\"128Mi\"}},\"volumeMounts\":[{\"mountPath\":\"/etc/tower/conf.d/execution\_environments.py\",\"name\":\"awx-application-credentials\",\"readOnly\":true,\"subPath\":\"execution\_environments.py\"},{\"mountPath\":\"/etc/tower/conf.d/credentials.py\",\"name\":\"awx-application-credentials\",\"readOnly\":true,\"subPath\":\"credentials.py\"},{\"mountPath\":\"/etc/tower/conf.d/ldap.py\",\"name\":\"awx-application-credentials\",\"readOnly\":true,\"subPath\":\"ldap.py\"},{\"mountPath\":\"/etc/tower/SECRET\_KEY\",\"name\":\"awx-secret-key\",\"readOnly\":true,\"subPath\":\"SECRET\_KEY\"},{\"mountPath\":\"/etc/tower/settings.py\",\"name\":\"awx-settings\",\"readOnly\":true,\"subPath\":\"settings.py\"},{\"mountPath\":\"/var/run/redis\",\"name\":\"awx-redis-socket\"},{\"mountPath\":\"/var/run/supervisor\",\"name\":\"supervisor-socket\"},{\"mountPath\":\"/var/run/awx-rsyslog\",\"name\":\"rsyslog-socket\"},{\"mountPath\":\"/var/lib/awx/rsyslog\",\"name\":\"rsyslog-dir\"},{\"mountPath\":\"/etc/receptor/\",\"name\":\"awx-receptor-config\"},{\"mountPath\":\"/etc/receptor/signing/work-private-key.pem\",\"name\":\"awx-receptor-work-signing\",\"readOnly\":true,\"subPath\":\"work-private-key.pem\"},{\"mountPath\":\"/var/run/receptor\",\"name\":\"receptor-socket\"},{\"mountPath\":\"/var/lib/awx/projects\",\"name\":\"awx-projects\"}]},{\"args\":[\"/bin/sh\",\"-c\",\"if [! -f /etc/receptor/receptor.conf]; then\\n cp /etc/receptor/receptor-default.conf /etc/receptor/receptor.conf\\n sed -i \\\"s/HOSTNAME/$HOSTNAME/g\\\" /etc/receptor/receptor.conf\\nfi\\nexec receptor --config /etc/receptor/receptor.conf\\n\"],\"env\":null,\"image\":\"[[quay.io/ansible/awx-ee:latest](http://quay.io/ansible/awx-ee:latest)\]([http://quay.io/ansible/awx-ee:latest\\\](http://quay.io/ansible/awx-ee:latest%5C%5C%5C))”,\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"awx-ee\",\"resources\":{\"requests\":{\"cpu\":\"100m\",\"memory\":\"64Mi\"}},\"volumeMounts\":[{\"mountPath\":\"/etc/receptor/receptor-default.conf\",\"name\":\"awx-default-receptor-config\",\"subPath\":\"receptor.conf\"},{\"mountPath\":\"/etc/receptor/\",\"name\":\"awx-receptor-config\"},{\"mountPath\":\"/etc/receptor/tls/ca/receptor-ca.crt\",\"name\":\"awx-receptor-ca\",\"readOnly\":true,\"subPath\":\"receptor-ca.crt\"},{\"mountPath\":\"/etc/receptor/signing/work-private-key.pem\",\"name\":\"awx-receptor-work-signing\",\"readOnly\":true,\"subPath\":\"work-private-key.pem\"},{\"mountPath\":\"/etc/receptor/tls/\",\"name\":\"awx-receptor-tls\"},{\"mountPath\":\"/var/run/receptor\",\"name\":\"receptor-socket\"},{\"mountPath\":\"/var/lib/awx/projects\",\"name\":\"awx-projects\"}]}],\"initContainers\":[{\"command\":[\"/bin/sh\",\"-c\",\"hostname=$MY\_POD\_NAME\\nreceptor --cert-makereq bits=2048 commonname=$hostname dnsname=$hostname nodeid=$hostname outreq=/etc/receptor/tls/receptor.req outkey=/etc/receptor/tls/receptor.key\\nreceptor --cert-signreq req=/etc/receptor/tls/receptor.req cacert=/etc/receptor/tls/ca/receptor-ca.crt cakey=/etc/receptor/tls/ca/receptor-ca.key outcert=/etc/receptor/tls/receptor.crt verify=yes\\n\"],\"env\":[{\"name\":\"MY\_POD\_NAME\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"[metadata.name](http://metadata.name)\"}}}],\"image\":\"[[quay.io/ansible/awx-ee:latest](http://quay.io/ansible/awx-ee:latest)\]([http://quay.io/ansible/awx-ee:latest\\\](http://quay.io/ansible/awx-ee:latest%5C%5C%5C))“,\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"init\",\"volumeMounts\":[{\"mountPath\":\"/etc/receptor/tls/ca\",\"name\":\"awx-receptor-ca\",\"readOnly\":true},{\"mountPath\":\"/etc/receptor/tls/\",\"name\":\"awx-receptor-tls\"}]}],\"priorityClassName\":\"\",\"serviceAccountName\":\"awx\",\"volumes\":[{\"name\":\"awx-application-credentials\",\"secret\":{\"items\":[{\"key\":\"credentials.py\",\"path\":\"credentials.py\"},{\"key\":\"ldap.py\",\"path\":\"ldap.py\"},{\"key\":\"execution\_environments.py\",\"path\":\"execution\_environments.py\"}],\"secretName\":\"awx-app-credentials\"}},{\"emptyDir\":{},\"name\":\"awx-receptor-tls\"},{\"name\":\"awx-receptor-ca\",\"secret\":{\"secretName\":\"awx-receptor-ca\"}},{\"name\":\"awx-receptor-work-signing\",\"secret\":{\"secretName\":\"awx-receptor-work-signing\"}},{\"name\":\"awx-secret-key\",\"secret\":{\"items\":[{\"key\":\"secret\_key\",\"path\":\"SECRET\_KEY\"}],\"secretName\":\"awx-secret-key\"}},{\"configMap\":{\"items\":[{\"key\":\"settings\",\"path\":\"settings.py\"}],\"name\":\"awx-awx-configmap\"},\"name\":\"awx-settings\"},{\"configMap\":{\"items\":[{\"key\":\"nginx\_conf\",\"path\":\"nginx.conf\"}],\"name\":\"awx-awx-configmap\"},\"name\":\"awx-nginx-conf\"},{\"configMap\":{\"items\":[{\"key\":\"redis\_conf\",\"path\":\"redis.conf\"}],\"name\":\"awx-awx-configmap\"},\"name\":\"awx-redis-config\"},{\"emptyDir\":{},\"name\":\"awx-redis-socket\"},{\"emptyDir\":{},\"name\":\"awx-redis-data\"},{\"emptyDir\":{},\"name\":\"supervisor-socket\"},{\"emptyDir\":{},\"name\":\"rsyslog-socket\"},{\"emptyDir\":{},\"name\":\"receptor-socket\"},{\"emptyDir\":{},\"name\":\"rsyslog-dir\"},{\"emptyDir\":{},\"name\":\"awx-receptor-config\"},{\"configMap\":{\"items\":[{\"key\":\"receptor\_conf\",\"path\":\"receptor.conf\"}],\"name\":\"awx-awx-configmap\"},\"name\":\"awx-default-receptor-config\"},{\"emptyDir\":{},\"name\":\"awx-projects\"}]}}}}"}, "creationTimestamp": "2022-06-29T15:11:13Z", "generation": 3, "labels": {"[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))”: "awx", "[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))“: "awx-operator", "[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))”: "awx", "[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)]([http://app.kubernetes.io/operator-version\](http://app.kubernetes.io/operator-version%5C))“: "0.29.0", "[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)]([http://app.kubernetes.io/part-of\](http://app.kubernetes.io/part-of%5C))”: "awx", "[[app.kubernetes.io/version](http://app.kubernetes.io/version)]([http://app.kubernetes.io/version\](http://app.kubernetes.io/version%5C))“: "21.6.0"}, "managedFields": [{"apiVersion": "apps/v1", "fieldsType": "FieldsV1", "fieldsV1": {"f:metadata": {"f:annotations": {".": {}, "f:[[kubectl.kubernetes.io/last-applied-configuration](http://kubectl.kubernetes.io/last-applied-configuration)]([http://kubectl.kubernetes.io/last-applied-configuration\](http://kubectl.kubernetes.io/last-applied-configuration%5C))”: {}}, "f:labels": {".": {}, "f:[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))“: {}, "f:[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))”: {}, "f:[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))“: {}, "f:[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)]([http://app.kubernetes.io/operator-version\](http://app.kubernetes.io/operator-version%5C))”: {}, "f:[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)]([http://app.kubernetes.io/part-of\](http://app.kubernetes.io/part-of%5C))“: {}, "f:[[app.kubernetes.io/version](http://app.kubernetes.io/version)]([http://app.kubernetes.io/version\](http://app.kubernetes.io/version%5C))”: {}}, "f:ownerReferences": {".": {}, "k:{\"uid\":\"093d7650-2976-4827-9751-e30d4640124d\"}": {}}}, "f:spec": {"f:progressDeadlineSeconds": {}, "f:replicas": {}, "f:revisionHistoryLimit": {}, "f:selector": {}, "f:strategy": {"f:rollingUpdate": {".": {}, "f:maxSurge": {}, "f:maxUnavailable": {}}, "f:type": {}}, "f:template": {"f:metadata": {"f:labels": {".": {}, "f:[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))“: {}, "f:[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))”: {}, "f:[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))“: {}, "f:[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)]([http://app.kubernetes.io/operator-version\](http://app.kubernetes.io/operator-version%5C))”: {}, "f:[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)]([http://app.kubernetes.io/part-of\](http://app.kubernetes.io/part-of%5C))“: {}, "f:[[app.kubernetes.io/version](http://app.kubernetes.io/version)]([http://app.kubernetes.io/version\](http://app.kubernetes.io/version%5C))”: {}}}, "f:spec": {"f:containers": {"k:{\"name\":\"awx-ee\"}": {".": {}, "f:args": {}, "f:image": {}, "f:imagePullPolicy": {}, "f:name": {}, "f:resources": {".": {}, "f:requests": {".": {}, "f:cpu": {}, "f:memory": {}}}, "f:terminationMessagePath": {}, "f:terminationMessagePolicy": {}, "f:volumeMounts": {".": {}, "k:{\"mountPath\":\"/etc/receptor/\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/etc/receptor/receptor-default.conf\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/receptor/signing/work-private-key.pem\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/receptor/tls/\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/etc/receptor/tls/ca/receptor-ca.crt\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/var/lib/awx/projects\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/var/run/receptor\"}": {".": {}, "f:mountPath": {}, "f:name": {}}}}, "k:{\"name\":\"awx-task\"}": {".": {}, "f:args": {}, "f:env": {".": {}, "k:{\"name\":\"AWX\_SKIP\_MIGRATIONS\"}": {".": {}, "f:name": {}, "f:value": {}}, "k:{\"name\":\"MY\_POD\_IP\"}": {".": {}, "f:name": {}, "f:valueFrom": {".": {}, "f:fieldRef": {}}}, "k:{\"name\":\"MY\_POD\_NAMESPACE\"}": {".": {}, "f:name": {}, "f:valueFrom": {".": {}, "f:fieldRef": {}}}, "k:{\"name\":\"MY\_POD\_UID\"}": {".": {}, "f:name": {}, "f:valueFrom": {".": {}, "f:fieldRef": {}}}, "k:{\"name\":\"SUPERVISOR\_WEB\_CONFIG\_PATH\"}": {".": {}, "f:name": {}, "f:value": {}}}, "f:image": {}, "f:imagePullPolicy": {}, "f:name": {}, "f:resources": {".": {}, "f:requests": {".": {}, "f:cpu": {}, "f:memory": {}}}, "f:terminationMessagePath": {}, "f:terminationMessagePolicy": {}, "f:volumeMounts": {".": {}, "k:{\"mountPath\":\"/etc/receptor/\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/etc/receptor/signing/work-private-key.pem\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/tower/SECRET\_KEY\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/tower/conf.d/credentials.py\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/tower/conf.d/execution\_environments.py\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/tower/conf.d/ldap.py\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/tower/settings.py\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/var/lib/awx/projects\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/var/lib/awx/rsyslog\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/var/run/awx-rsyslog\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/var/run/receptor\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/var/run/redis\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/var/run/supervisor\"}": {".": {}, "f:mountPath": {}, "f:name": {}}}}, "k:{\"name\":\"awx-web\"}": {".": {}, "f:args": {}, "f:env": {".": {}, "k:{\"name\":\"MY\_POD\_NAMESPACE\"}": {".": {}, "f:name": {}, "f:valueFrom": {".": {}, "f:fieldRef": {}}}, "k:{\"name\":\"UWSGI\_MOUNT\_PATH\"}": {".": {}, "f:name": {}, "f:value": {}}}, "f:image": {}, "f:imagePullPolicy": {}, "f:name": {}, "f:ports": {".": {}, "k:{\"containerPort\":8052,\"protocol\":\"TCP\"}": {".": {}, "f:containerPort": {}, "f:protocol": {}}}, "f:resources": {".": {}, "f:requests": {".": {}, "f:cpu": {}, "f:memory": {}}}, "f:terminationMessagePath": {}, "f:terminationMessagePolicy": {}, "f:volumeMounts": {".": {}, "k:{\"mountPath\":\"/etc/nginx/nginx.conf\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/receptor/signing/work-public-key.pem\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/receptor/tls/ca\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}}, "k:{\"mountPath\":\"/etc/tower/SECRET\_KEY\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/tower/conf.d/credentials.py\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/tower/conf.d/execution\_environments.py\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/tower/conf.d/ldap.py\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/etc/tower/settings.py\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/var/lib/awx/projects\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/var/lib/awx/rsyslog\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/var/run/awx-rsyslog\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/var/run/redis\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/var/run/supervisor\"}": {".": {}, "f:mountPath": {}, "f:name": {}}}}, "k:{\"name\":\"redis\"}": {".": {}, "f:args": {}, "f:image": {}, "f:imagePullPolicy": {}, "f:name": {}, "f:resources": {".": {}, "f:requests": {".": {}, "f:cpu": {}, "f:memory": {}}}, "f:terminationMessagePath": {}, "f:terminationMessagePolicy": {}, "f:volumeMounts": {".": {}, "k:{\"mountPath\":\"/data\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/etc/redis.conf\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}, "f:subPath": {}}, "k:{\"mountPath\":\"/var/run/redis\"}": {".": {}, "f:mountPath": {}, "f:name": {}}}}}, "f:dnsPolicy": {}, "f:initContainers": {".": {}, "k:{\"name\":\"init\"}": {".": {}, "f:command": {}, "f:env": {".": {}, "k:{\"name\":\"MY\_POD\_NAME\"}": {".": {}, "f:name": {}, "f:valueFrom": {".": {}, "f:fieldRef": {}}}}, "f:image": {}, "f:imagePullPolicy": {}, "f:name": {}, "f:resources": {}, "f:terminationMessagePath": {}, "f:terminationMessagePolicy": {}, "f:volumeMounts": {".": {}, "k:{\"mountPath\":\"/etc/receptor/tls/\"}": {".": {}, "f:mountPath": {}, "f:name": {}}, "k:{\"mountPath\":\"/etc/receptor/tls/ca\"}": {".": {}, "f:mountPath": {}, "f:name": {}, "f:readOnly": {}}}}}, "f:restartPolicy": {}, "f:schedulerName": {}, "f:securityContext": {}, "f:serviceAccount": {}, "f:serviceAccountName": {}, "f:terminationGracePeriodSeconds": {}, "f:volumes": {".": {}, "k:{\"name\":\"awx-application-credentials\"}": {".": {}, "f:name": {}, "f:secret": {".": {}, "f:defaultMode": {}, "f:items": {}, "f:secretName": {}}}, "k:{\"name\":\"awx-default-receptor-config\"}": {".": {}, "f:configMap": {".": {}, "f:defaultMode": {}, "f:items": {}, "f:name": {}}, "f:name": {}}, "k:{\"name\":\"awx-nginx-conf\"}": {".": {}, "f:configMap": {".": {}, "f:defaultMode": {}, "f:items": {}, "f:name": {}}, "f:name": {}}, "k:{\"name\":\"awx-projects\"}": {".": {}, "f:emptyDir": {}, "f:name": {}}, "k:{\"name\":\"awx-receptor-ca\"}": {".": {}, "f:name": {}, "f:secret": {".": {}, "f:defaultMode": {}, "f:secretName": {}}}, "k:{\"name\":\"awx-receptor-config\"}": {".": {}, "f:emptyDir": {}, "f:name": {}}, "k:{\"name\":\"awx-receptor-tls\"}": {".": {}, "f:emptyDir": {}, "f:name": {}}, "k:{\"name\":\"awx-receptor-work-signing\"}": {".": {}, "f:name": {}, "f:secret": {".": {}, "f:defaultMode": {}, "f:secretName": {}}}, "k:{\"name\":\"awx-redis-config\"}": {".": {}, "f:configMap": {".": {}, "f:defaultMode": {}, "f:items": {}, "f:name": {}}, "f:name": {}}, "k:{\"name\":\"awx-redis-data\"}": {".": {}, "f:emptyDir": {}, "f:name": {}}, "k:{\"name\":\"awx-redis-socket\"}": {".": {}, "f:emptyDir": {}, "f:name": {}}, "k:{\"name\":\"awx-secret-key\"}": {".": {}, "f:name": {}, "f:secret": {".": {}, "f:defaultMode": {}, "f:items": {}, "f:secretName": {}}}, "k:{\"name\":\"awx-settings\"}": {".": {}, "f:configMap": {".": {}, "f:defaultMode": {}, "f:items": {}, "f:name": {}}, "f:name": {}}, "k:{\"name\":\"receptor-socket\"}": {".": {}, "f:emptyDir": {}, "f:name": {}}, "k:{\"name\":\"rsyslog-dir\"}": {".": {}, "f:emptyDir": {}, "f:name": {}}, "k:{\"name\":\"rsyslog-socket\"}": {".": {}, "f:emptyDir": {}, "f:name": {}}, "k:{\"name\":\"supervisor-socket\"}": {".": {}, "f:emptyDir": {}, "f:name": {}}}}}}}, "manager": "OpenAPI-Generator", "operation": "Update", "time": "2022-09-29T08:05:29Z"}, {"apiVersion": "apps/v1", "fieldsType": "FieldsV1", "fieldsV1": {"f:metadata": {"f:annotations": {"f:[[deployment.kubernetes.io/revision](http://deployment.kubernetes.io/revision)]([http://deployment.kubernetes.io/revision\](http://deployment.kubernetes.io/revision%5C))“: {}}}, "f:status": {"f:availableReplicas": {}, "f:conditions": {".": {}, "k:{\"type\":\"Available\"}": {".": {}, "f:lastTransitionTime": {}, "f:lastUpdateTime": {}, "f:message": {}, "f:reason": {}, "f:status": {}, "f:type": {}}, "k:{\"type\":\"Progressing\"}": {".": {}, "f:lastTransitionTime": {}, "f:lastUpdateTime": {}, "f:message": {}, "f:reason": {}, "f:status": {}, "f:type": {}}}, "f:observedGeneration": {}, "f:readyReplicas": {}, "f:replicas": {}, "f:unavailableReplicas": {}, "f:updatedReplicas": {}}}, "manager": "kube-controller-manager", "operation": "Update", "subresource": "status", "time": "2022-10-13T08:18:58Z"}], "name": "awx", "namespace": "awx", "ownerReferences": [{"apiVersion": "[[awx.ansible.com/v1beta1](http://awx.ansible.com/v1beta1)]([http://awx.ansible.com/v1beta1\](http://awx.ansible.com/v1beta1%5C))”, "kind": "AWX", "name": "awx", "uid": "093d7650-2976-4827-9751-e30d4640124d"}], "resourceVersion": "40763918", "uid": "a12f3282-dd9e-4bba-80ed-236344f915d3"}, "spec": {"progressDeadlineSeconds": 600, "replicas": 2, "revisionHistoryLimit": 10, "selector": {"matchLabels": {"[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))“: "awx", "[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))”: "awx-operator", "[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))“: "awx"}}, "strategy": {"rollingUpdate": {"maxSurge": "25%", "maxUnavailable": "25%"}, "type": "RollingUpdate"}, "template": {"metadata": {"creationTimestamp": null, "labels": {"[[app.kubernetes.io/component](http://app.kubernetes.io/component)]([http://app.kubernetes.io/component\](http://app.kubernetes.io/component%5C))”: "awx", "[[app.kubernetes.io/managed-by](http://app.kubernetes.io/managed-by)]([http://app.kubernetes.io/managed-by\](http://app.kubernetes.io/managed-by%5C))“: "awx-operator", "[[app.kubernetes.io/name](http://app.kubernetes.io/name)]([http://app.kubernetes.io/name\](http://app.kubernetes.io/name%5C))”: "awx", "[[app.kubernetes.io/operator-version](http://app.kubernetes.io/operator-version)]([http://app.kubernetes.io/operator-version\](http://app.kubernetes.io/operator-version%5C))“: "0.29.0", "[[app.kubernetes.io/part-of](http://app.kubernetes.io/part-of)]([http://app.kubernetes.io/part-of\](http://app.kubernetes.io/part-of%5C))”: "awx", "[[app.kubernetes.io/version](http://app.kubernetes.io/version)]([http://app.kubernetes.io/version\](http://app.kubernetes.io/version%5C))“: "21.6.0"}}, "spec": {"containers": [{"args": ["redis-server", "/etc/redis.conf"], "image": "[[docker.io/redis:7](http://docker.io/redis:7)]([http://docker.io/redis:7\](http://docker.io/redis:7%5C))”, "imagePullPolicy": "IfNotPresent", "name": "redis", "resources": {"requests": {"cpu": "50m", "memory": "64Mi"}}, "terminationMessagePath": "/dev/termination-log", "terminationMessagePolicy": "File", "volumeMounts": [{"mountPath": "/etc/redis.conf", "name": "awx-redis-config", "readOnly": true, "subPath": "redis.conf"}, {"mountPath": "/var/run/redis", "name": "awx-redis-socket"}, {"mountPath": "/data", "name": "awx-redis-data"}]}, {"args": ["/usr/bin/launch\_awx.sh"], "env": [{"name": "MY\_POD\_NAMESPACE", "valueFrom": {"fieldRef": {"apiVersion": "v1", "fieldPath": "metadata.namespace"}}}, {"name": "UWSGI\_MOUNT\_PATH", "value": "/"}], "image": "[[quay.io/ansible/awx:21.6.0](http://quay.io/ansible/awx:21.6.0)]([http://quay.io/ansible/awx:21.6.0\](http://quay.io/ansible/awx:21.6.0%5C))“, "imagePullPolicy": "IfNotPresent", "name": "awx-web", "ports": [{"containerPort": 8052, "protocol": "TCP"}], "resources": {"requests": {"cpu": "100m", "memory": "128Mi"}}, "terminationMessagePath": "/dev/termination-log", "terminationMessagePolicy": "File", "volumeMounts": [{"mountPath": "/etc/tower/conf.d/execution\_environments.py", "name": "awx-application-credentials", "readOnly": true, "subPath": "execution\_environments.py"}, {"mountPath": "/etc/tower/conf.d/credentials.py", "name": "awx-application-credentials", "readOnly": true, "subPath": "credentials.py"}, {"mountPath": "/etc/tower/conf.d/ldap.py", "name": "awx-application-credentials", "readOnly": true, "subPath": "ldap.py"}, {"mountPath": "/etc/tower/SECRET\_KEY", "name": "awx-secret-key", "readOnly": true, "subPath": "SECRET\_KEY"}, {"mountPath": "/etc/tower/settings.py", "name": "awx-settings", "readOnly": true, "subPath": "settings.py"}, {"mountPath": "/etc/nginx/nginx.conf", "name": "awx-nginx-conf", "readOnly": true, "subPath": "nginx.conf"}, {"mountPath": "/var/run/redis", "name": "awx-redis-socket"}, {"mountPath": "/var/run/supervisor", "name": "supervisor-socket"}, {"mountPath": "/var/run/awx-rsyslog", "name": "rsyslog-socket"}, {"mountPath": "/var/lib/awx/rsyslog", "name": "rsyslog-dir"}, {"mountPath": "/var/lib/awx/projects", "name": "awx-projects"}, {"mountPath": "/etc/receptor/signing/work-public-key.pem", "name": "awx-receptor-work-signing", "readOnly": true, "subPath": "work-public-key.pem"}, {"mountPath": "/etc/receptor/tls/ca", "name": "awx-receptor-ca", "readOnly": true}]}, {"args": ["/usr/bin/launch\_awx\_task.sh"], "env": [{"name": "SUPERVISOR\_WEB\_CONFIG\_PATH", "value": "/etc/supervisord.conf"}, {"name": "AWX\_SKIP\_MIGRATIONS", "value": "1"}, {"name": "MY\_POD\_UID", "valueFrom": {"fieldRef": {"apiVersion": "v1", "fieldPath": "metadata.uid"}}}, {"name": "MY\_POD\_IP", "valueFrom": {"fieldRef": {"apiVersion": "v1", "fieldPath": "status.podIP"}}}, {"name": "MY\_POD\_NAMESPACE", "valueFrom": {"fieldRef": {"apiVersion": "v1", "fieldPath": "metadata.namespace"}}}], "image": "[[quay.io/ansible/awx:21.6.0](http://quay.io/ansible/awx:21.6.0)]([http://quay.io/ansible/awx:21.6.0\](http://quay.io/ansible/awx:21.6.0%5C))”, "imagePullPolicy": "IfNotPresent", "name": "awx-task", "resources": {"requests": {"cpu": "100m", "memory": "128Mi"}}, "terminationMessagePath": "/dev/termination-log", "terminationMessagePolicy": "File", "volumeMounts": [{"mountPath": "/etc/tower/conf.d/execution\_environments.py", "name": "awx-application-credentials", "readOnly": true, "subPath": "execution\_environments.py"}, {"mountPath": "/etc/tower/conf.d/credentials.py", "name": "awx-application-credentials", "readOnly": true, "subPath": "credentials.py"}, {"mountPath": "/etc/tower/conf.d/ldap.py", "name": "awx-application-credentials", "readOnly": true, "subPath": "ldap.py"}, {"mountPath": "/etc/tower/SECRET\_KEY", "name": "awx-secret-key", "readOnly": true, "subPath": "SECRET\_KEY"}, {"mountPath": "/etc/tower/settings.py", "name": "awx-settings", "readOnly": true, "subPath": "settings.py"}, {"mountPath": "/var/run/redis", "name": "awx-redis-socket"}, {"mountPath": "/var/run/supervisor", "name": "supervisor-socket"}, {"mountPath": "/var/run/awx-rsyslog", "name": "rsyslog-socket"}, {"mountPath": "/var/lib/awx/rsyslog", "name": "rsyslog-dir"}, {"mountPath": "/etc/receptor/", "name": "awx-receptor-config"}, {"mountPath": "/etc/receptor/signing/work-private-key.pem", "name": "awx-receptor-work-signing", "readOnly": true, "subPath": "work-private-key.pem"}, {"mountPath": "/var/run/receptor", "name": "receptor-socket"}, {"mountPath": "/var/lib/awx/projects", "name": "awx-projects"}]}, {"args": ["/bin/sh", "-c", "if [! -f /etc/receptor/receptor.conf]; then\n cp /etc/receptor/receptor-default.conf /etc/receptor/receptor.conf\n sed -i \"s/HOSTNAME/$HOSTNAME/g\" /etc/receptor/receptor.conf\nfi\nexec receptor --config /etc/receptor/receptor.conf\n"], "image": "[[quay.io/ansible/awx-ee:latest](http://quay.io/ansible/awx-ee:latest)]([http://quay.io/ansible/awx-ee:latest\](http://quay.io/ansible/awx-ee:latest%5C))“, "imagePullPolicy": "IfNotPresent", "name": "awx-ee", "resources": {"requests": {"cpu": "100m", "memory": "64Mi"}}, "terminationMessagePath": "/dev/termination-log", "terminationMessagePolicy": "File", "volumeMounts": [{"mountPath": "/etc/receptor/receptor-default.conf", "name": "awx-default-receptor-config", "subPath": "receptor.conf"}, {"mountPath": "/etc/receptor/", "name": "awx-receptor-config"}, {"mountPath": "/etc/receptor/tls/ca/receptor-ca.crt", "name": "awx-receptor-ca", "readOnly": true, "subPath": "receptor-ca.crt"}, {"mountPath": "/etc/receptor/signing/work-private-key.pem", "name": "awx-receptor-work-signing", "readOnly": true, "subPath": "work-private-key.pem"}, {"mountPath": "/etc/receptor/tls/", "name": "awx-receptor-tls"}, {"mountPath": "/var/run/receptor", "name": "receptor-socket"}, {"mountPath": "/var/lib/awx/projects", "name": "awx-projects"}]}], "dnsPolicy": "ClusterFirst", "initContainers": [{"command": ["/bin/sh", "-c", "hostname=$MY\_POD\_NAME\nreceptor --cert-makereq bits=2048 commonname=$hostname dnsname=$hostname nodeid=$hostname outreq=/etc/receptor/tls/receptor.req outkey=/etc/receptor/tls/receptor.key\nreceptor --cert-signreq req=/etc/receptor/tls/receptor.req cacert=/etc/receptor/tls/ca/receptor-ca.crt cakey=/etc/receptor/tls/ca/receptor-ca.key outcert=/etc/receptor/tls/receptor.crt verify=yes\n"], "env": [{"name": "MY\_POD\_NAME", "valueFrom": {"fieldRef": {"apiVersion": "v1", "fieldPath": "[metadata.name](http://metadata.name)"}}}], "image": "[[quay.io/ansible/awx-ee:latest](http://quay.io/ansible/awx-ee:latest)]([http://quay.io/ansible/awx-ee:latest\](http://quay.io/ansible/awx-ee:latest%5C))”, "imagePullPolicy": "IfNotPresent", "name": "init", "resources": {}, "terminationMessagePath": "/dev/termination-log", "terminationMessagePolicy": "File", "volumeMounts": [{"mountPath": "/etc/receptor/tls/ca", "name": "awx-receptor-ca", "readOnly": true}, {"mountPath": "/etc/receptor/tls/", "name": "awx-receptor-tls"}]}], "restartPolicy": "Always", "schedulerName": "default-scheduler", "securityContext": {}, "serviceAccount": "awx", "serviceAccountName": "awx", "terminationGracePeriodSeconds": 30, "volumes": [{"name": "awx-application-credentials", "secret": {"defaultMode": 420, "items": [{"key": "credentials.py", "path": "credentials.py"}, {"key": "ldap.py", "path": "ldap.py"}, {"key": "execution\_environments.py", "path": "execution\_environments.py"}], "secretName": "awx-app-credentials"}}, {"emptyDir": {}, "name": "awx-receptor-tls"}, {"name": "awx-receptor-ca", "secret": {"defaultMode": 420, "secretName": "awx-receptor-ca"}}, {"name": "awx-receptor-work-signing", "secret": {"defaultMode": 420, "secretName": "awx-receptor-work-signing"}}, {"name": "awx-secret-key", "secret": {"defaultMode": 420, "items": [{"key": "secret\_key", "path": "SECRET\_KEY"}], "secretName": "awx-secret-key"}}, {"configMap": {"defaultMode": 420, "items": [{"key": "settings", "path": "settings.py"}], "name": "awx-awx-configmap"}, "name": "awx-settings"}, {"configMap": {"defaultMode": 420, "items": [{"key": "nginx\_conf", "path": "nginx.conf"}], "name": "awx-awx-configmap"}, "name": "awx-nginx-conf"}, {"configMap": {"defaultMode": 420, "items": [{"key": "redis\_conf", "path": "redis.conf"}], "name": "awx-awx-configmap"}, "name": "awx-redis-config"}, {"emptyDir": {}, "name": "awx-redis-socket"}, {"emptyDir": {}, "name": "awx-redis-data"}, {"emptyDir": {}, "name": "supervisor-socket"}, {"emptyDir": {}, "name": "rsyslog-socket"}, {"emptyDir": {}, "name": "receptor-socket"}, {"emptyDir": {}, "name": "rsyslog-dir"}, {"emptyDir": {}, "name": "awx-receptor-config"}, {"configMap": {"defaultMode": 420, "items": [{"key": "receptor\_conf", "path": "receptor.conf"}], "name": "awx-awx-configmap"}, "name": "awx-default-receptor-config"}, {"emptyDir": {}, "name": "awx-projects"}]}}}, "status": {"availableReplicas": 1, "conditions": [{"lastTransitionTime": "2022-06-29T15:11:13Z", "lastUpdateTime": "2022-09-29T08:06:16Z", "message": "ReplicaSet \"awx-7566768857\" has successfully progressed.", "reason": "NewReplicaSetAvailable", "status": "True", "type": "Progressing"}, {"lastTransitionTime": "2022-10-13T08:18:58Z", "lastUpdateTime": "2022-10-13T08:18:58Z", "message": "Deployment does not have minimum availability.", "reason": "MinimumReplicasUnavailable", "status": "False", "type": "Available"}], "observedGeneration": 3, "readyReplicas": 1, "replicas": 2, "unavailableReplicas": 1, "updatedReplicas": 2}}}\n\r\nPLAY RECAP \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\r\nlocalhost : ok=50 changed=0 unreachable=0 failed=1 skipped=51 rescued=0 ignored=0 \r\n\n",“job”:“2815119228376918080”,“name”:“awx”,“namespace”:“awx”,“error”:“exit status 2”}

---

<div class="post-metadata">

**Author:** ![AWX\_Project](https://avatars.discourse-cdn.com/v4/letter/a/eada6e/32.png) [@AWX\_Project](https://forum.ansible.com/u/AWX_Project)\
**Post date:** [October 14, 2022, 5:28pm UTC](https://forum.ansible.com/t/missing-awx-instance/37098/10 "2022-10-14T17:28:50Z")

</div>

this looks relevant “Deployment does not have minimum availability” – how many cpu / memory does the cluster have access to?

Are you setting any custom resource requests/limits for the containers, or just using defaults?

Does your deployment work with replicas set to 1?

---

<div class="post-metadata">

**Author:** ![epi82](https://avatars.discourse-cdn.com/v4/letter/e/ed655f/32.png) [@epi82](https://forum.ansible.com/u/epi82)\
**Post date:** [October 17, 2022, 7:06am UTC](https://forum.ansible.com/t/missing-awx-instance/37098/11 "2022-10-17T07:06:16Z")

</div>

The cluster is dedicated to AWX with 3 nodes (4cpu 14GB) and I’m using defaults.  
My deployments works with 2 replicas and only one has the issue reported.  
The strange thing is that after about 20 restarts it starts working on its own again.

I don’t understand why sometimes an awx pod crashes like this, with no load on the cluster.

Thank you for your help,  
Elia

---

<div class="post-metadata">

**Author:** ![AWX\_Project](https://avatars.discourse-cdn.com/v4/letter/a/eada6e/32.png) [@AWX\_Project](https://forum.ansible.com/u/AWX_Project)\
**Post date:** [November 2, 2022, 6:46pm UTC](https://forum.ansible.com/t/missing-awx-instance/37098/12 "2022-11-02T18:46:50Z")

</div>

Have you made any progress on this? We have not run across this error but having to restart 20 times to get it working sounds really frustrating.

-The AWX Team

---

<div class="post-metadata">

**Author:** ![epi82](https://avatars.discourse-cdn.com/v4/letter/e/ed655f/32.png) [@epi82](https://forum.ansible.com/u/epi82)\
**Post date:** [November 3, 2022, 7:56am UTC](https://forum.ansible.com/t/missing-awx-instance/37098/13 "2022-11-03T07:56:08Z")

</div>

No progress but the problem has not occurred since the last report.  
However, the pod restarted on its own until it worked again.  
I don’t know what to think, it doesn’t happen often.

Thank you for your help.  
Elia
