# AWX Operator 2.5.1 New Deploy Never Completes (django.db.utils.OperationalError: connection is bad)

**URL:** <https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342>\
**Category:** AWX Project\
**Tags:** awx\
**Created:** [August 16, 2023, 2:59pm UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342 "2023-08-16T14:59:51Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![Nickel\_Wong](https://avatars.discourse-cdn.com/v4/letter/n/b5a626/32.png) [@Nickel\_Wong](https://forum.ansible.com/u/Nickel_Wong)\
**Post date:** [August 16, 2023, 2:59pm UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/1 "2023-08-16T14:59:51Z")

</div>

I have a fresh install of AWX (22.7.0) but end up with the same failure as I did in 22.6

TASK [Check if there are any super users defined.] \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*  
fatal: [localhost]: FAILED! =\> {“changed”: true, “rc”: 1, “return\_code”: 1, “stderr”: “Traceback (most recent call last):\n  
File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 289, in ensure\_connection\n  
self.connect()\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26, in inner\n  
return func(\*args, \*\*kwargs)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 270, in connect\n  
self.connection = self.get\_new\_connection(conn\_params)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26,  
in inner\n return func(\*args, \*\*kwargs)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/postgresql/base.py", line 275, in get\_new\_connection\n connection = self.Database.connect(\*\*conn\_params)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/psycopg/connection.py", line 728, in connect\n raise ex.with\_traceback(None)\npsycopg.OperationalError: connection is bad: Name or service not known\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n File "/usr/bin/awx-manage", line 8, in \n sys.exit(manage())\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/awx/ **init**.py", line 184, in manage\n if (connection.pg\_version // 10000) \< 12:\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/connection.py", line 15, in **getattr** \n return getattr(self.\_connections[self.\_alias], item)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/functional.py", line 57, in **get** \n res = instance. **dict** [self.name] = self.func(instance)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/postgresql/base.py", line 436, in pg\_version\n with self.temporary\_connection():\n File "/usr/lib64/python3.9/contextlib.py", line 119, in **enter** \n return next(self.gen)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 705, in temporary\_connection\n with self.cursor() as cursor:\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26, in inner\n return func(\*args, \*\*kwargs)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 330, in cursor\n return self.\_cursor()\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 306, in \_cursor\n self.ensure\_connection()\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26, in inner\n return func(\*args, \*\*kwargs)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 289, in ensure\_connection\n self.connect()\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/utils.py", line 91, in **exit** \n raise dj\_exc\_value.with\_traceback(traceback) from exc\_value\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 289, in ensure\_connection\n self.connect()\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26, in inner\n return func(\*args, \*\*kwargs)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 270, in connect\n self.connection = self.get\_new\_connection(conn\_params)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26, in inner\n return func(\*args, \*\*kwargs)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/postgresql/base.py", line 275, in get\_new\_connection\n connection = self.Database.connect(\*\*conn\_params)\n File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/psycopg/connection.py", line 728, in connect\n raise ex.with\_traceback(None)\ndjango.db.utils.OperationalError: connection is bad: Name or service not known\n”, “stderr\_lines”: [“Traceback (most recent call last):”, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 289, in ensure\_connection", " self.connect()“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26, in inner”, " return func(\*args, \*\*kwargs)“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 270, in connect”, " self.connection = self.get\_new\_connection(conn\_params)“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26, in inner”, " return func(\*args, \*\*kwargs)“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/postgresql/base.py", line 275, in get\_new\_connection”, " connection = self.Database.connect(\*\*conn\_params)“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/psycopg/connection.py", line 728, in connect”, " raise ex.with\_traceback(None)“, “psycopg.OperationalError: connection is bad: Name or service not known”, “”, “The above exception was the direct cause of the following exception:”, “”, “Traceback (most recent call last):”, " File "/usr/bin/awx-manage", line 8, in ”, " sys.exit(manage())“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/awx/ **init**.py", line 184, in manage”, " if (connection.pg\_version // 10000) \< 12:“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/connection.py", line 15, in **getattr** ”, " return getattr(self.\_connections[self.\_alias], item)“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/functional.py", line 57, in **get** ”, " res = instance. **dict** [self.name] = self.func(instance)“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/postgresql/base.py", line 436, in pg\_version”, " with self.temporary\_connection():“, " File "/usr/lib64/python3.9/contextlib.py", line 119, in **enter** ”, " return next(self.gen)“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 705, in temporary\_connection”, " with self.cursor() as cursor:“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26, in inner”, " return func(\*args, \*\*kwargs)“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 330, in cursor”, " return self.\_cursor()“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 306, in \_cursor”, " self.ensure\_connection()“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26, in inner”, " return func(\*args, \*\*kwargs)“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 289, in ensure\_connection”, " self.connect()“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/utils.py", line 91, in **exit** ”, " raise dj\_exc\_value.with\_traceback(traceback) from exc\_value", " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 289, in ensure\_connection", " self.connect()“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26, in inner”, " return func(\*args, \*\*kwargs)“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/db/backends/base/base.py", line 270, in connect”, " self.connection = self.get\_new\_connection(conn\_params)“, " File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/utils/asyncio.py", line 26, in inner”, " return func(\*args, \*\*kwargs)“, "  
File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/django/{“level”:“error”,“ts”:“2023-08-16T04:24:15Z”,“logger”:  
“logging\_event\_handler”,“msg”:”“,“name”:“awx”,“namespace”:“awx-dev”,“gvk”:“[awx.ansible.com/v1beta1](http://awx.ansible.com/v1beta1), Kind=AWX”,“event\_type”:“runner\_on\_failed”,  
“job”:“4754706633111121296”,“EventData.Task”:“Check if there are any super users defined.”,“EventData.TaskArgs”:”“,  
“EventData.FailedTaskPath”:”/opt/ansible/roles/installer/tasks/initialize\_django.yml:2",“error”:“[playbook task failed]”,“stacktrace”:  
“[github.com/operator-framework/operator-sdk/internal/ansible/events.loggingEventHandler.Handle](http://github.com/operator-framework/operator-sdk/internal/ansible/events.loggingEventHandler.Handle)\n\t/workspace/internal/ansible/events/log\_events.go:111”}  
db/backends/postgresql/base.py", line 275, in get\_new\_connection", " connection = self.Database.connect(\*\*conn\_params)“, "  
File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/psycopg/connection.py", line 728, in connect”, "  
raise ex.with\_traceback(None)", “django.db.utils.OperationalError: connection is bad: Name or service not known”],  
“stdout”: “”, “stdout\_lines”: }  
…ignoring

Any suggestion?  
seems everything is in RUNNING state …

Nick

---

<div class="post-metadata">

**Author:** ![Nickel\_Wong](https://avatars.discourse-cdn.com/v4/letter/n/b5a626/32.png) [@Nickel\_Wong](https://forum.ansible.com/u/Nickel_Wong)\
**Post date:** [August 16, 2023, 3:39pm UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/2 "2023-08-16T15:39:09Z")

</div>

I can see the following actions keep running from task and web

[wait-for-migrations] Waiting for database migrations…  
[wait-for-migrations] Attempt 1 of 30

Nick

---

<div class="post-metadata">

**Author:** ![Nickel\_Wong](https://avatars.discourse-cdn.com/v4/letter/n/b5a626/32.png) [@Nickel\_Wong](https://forum.ansible.com/u/Nickel_Wong)\
**Post date:** [August 16, 2023, 3:44pm UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/3 "2023-08-16T15:44:02Z")

</div>

I cannot run any of awx-manage command from task nor web

always getting " django.db.utils.OperationalError: connection is bad: Name or service not known"

---

<div class="post-metadata">

**Author:** ![Nickel\_Wong](https://avatars.discourse-cdn.com/v4/letter/n/b5a626/32.png) [@Nickel\_Wong](https://forum.ansible.com/u/Nickel_Wong)\
**Post date:** [August 16, 2023, 7:28pm UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/4 "2023-08-16T19:28:38Z")

</div>

when I turn on no\_log it showed both tasks  
TASK [Check if there are any super users defined.] \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*  
fatal: [localhost]: FAILED! =\> {“changed”: true, “rc”: 1,  
“django.db.utils.OperationalError: connection is bad: Name or service not known”],

TASK [Create super user via Django if it doesn’t exist.] \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*  
fatal: [localhost]: FAILED! =\> {“changed”: true, “failed\_when\_result”:  
raise ex.with\_traceback(None)", “django.db.utils.OperationalError: connection is bad: Name or service not known”], “stdout”: “”, “stdout\_lines”: }

Nick

---

<div class="post-metadata">

**Author:** ![AWX\_Project](https://avatars.discourse-cdn.com/v4/letter/a/eada6e/32.png) [@AWX\_Project](https://forum.ansible.com/u/AWX_Project)\
**Post date:** [August 23, 2023, 6:42pm UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/5 "2023-08-23T18:42:19Z")

</div>

Hello,  
If you are using an external database, could you please provide your secret Posgress configuration spec and your AWX spec? Please be sure to redact any sensitive information. This will better enable us to assist you.  
-AWX Team

---

<div class="post-metadata">

**Author:** ![Nickel\_Wong](https://avatars.discourse-cdn.com/v4/letter/n/b5a626/32.png) [@Nickel\_Wong](https://forum.ansible.com/u/Nickel_Wong)\
**Post date:** [August 24, 2023, 4:10pm UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/6 "2023-08-24T16:10:50Z")

</div>

I am not using external database.

---

<div class="post-metadata">

**Author:** ![Nickel\_Wong](https://avatars.discourse-cdn.com/v4/letter/n/b5a626/32.png) [@Nickel\_Wong](https://forum.ansible.com/u/Nickel_Wong)\
**Post date:** [August 24, 2023, 6:48pm UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/7 "2023-08-24T18:48:32Z")

</div>

Here is my postgres secret

secretGenerator:

- name: awx-postgres-configuration  
type: Opaque  
literals:
- host=awx-postgres-13
- port=5432
- database=awx
- username=awx
- password=xxxxxxxxxxxxxxxxxxxxxxxxxxx
- type=managed

---

<div class="post-metadata">

**Author:** ![AWX\_Project](https://avatars.discourse-cdn.com/v4/letter/a/eada6e/32.png) [@AWX\_Project](https://forum.ansible.com/u/AWX_Project)\
**Post date:** [August 25, 2023, 6:05pm UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/8 "2023-08-25T18:05:11Z")

</div>

what is the health of your postgres pod? Has it been restarting?

can you please output “kubectl get pods”

AWX Team

---

<div class="post-metadata">

**Author:** ![Nickel\_Wong](https://avatars.discourse-cdn.com/v4/letter/n/b5a626/32.png) [@Nickel\_Wong](https://forum.ansible.com/u/Nickel_Wong)\
**Post date:** [August 25, 2023, 6:15pm UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/9 "2023-08-25T18:15:39Z")

</div>

kubectl get pods -n awx-dev  
NAME READY STATUS RESTARTS AGE  
awx-operator-controller-manager-564f8dc4fc-69rk2 2/2 Running 0 8d  
awx-postgres-13-0 1/1 Running 0 8d  
awx-task-6948b766fb-bnk8m 4/4 Running 1144 (15m ago) 8d  
awx-web-7c59966546-dgw7d 3/3 Running 1144 (15m ago) 8d

---

<div class="post-metadata">

**Author:** ![Nickel\_Wong](https://avatars.discourse-cdn.com/v4/letter/n/b5a626/32.png) [@Nickel\_Wong](https://forum.ansible.com/u/Nickel_Wong)\
**Post date:** [September 14, 2023, 4:29am UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/10 "2023-09-14T04:29:56Z")

</div>

same error for basic install from AWX Operator 2.5.3

---

<div class="post-metadata">

**Author:** ![Nickel\_Wong](https://avatars.discourse-cdn.com/v4/letter/n/b5a626/32.png) [@Nickel\_Wong](https://forum.ansible.com/u/Nickel_Wong)\
**Post date:** [September 14, 2023, 4:31am UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/11 "2023-09-14T04:31:43Z")

</div>

from log

kubectl -n awx logs deploy/ansible-awx-task -c ansible-awx-task  
[wait-for-migrations] Waiting for database migrations…  
[wait-for-migrations] Attempt 1 of 30  
[wait-for-migrations] Waiting 0.5 seconds before next attempt  
[wait-for-migrations] Attempt 2 of 30

---

<div class="post-metadata">

**Author:** ![Nickel\_Wong](https://avatars.discourse-cdn.com/v4/letter/n/b5a626/32.png) [@Nickel\_Wong](https://forum.ansible.com/u/Nickel_Wong)\
**Post date:** [September 14, 2023, 10:50pm UTC](https://forum.ansible.com/t/awx-operator-2-5-1-new-deploy-never-completes-django-db-utils-operationalerror-connection-is-bad/38342/12 "2023-09-14T22:50:52Z")

</div>

got it resolved myself, it was problem on my setting on pod-network-cidr

Nickel