Upgrade with awx-operator 1.1.2 to 1.1.3 (or newer) fails
the awx web instance never gets going as waiting for db migrations fails and repeats continuously.
Are you able to provide the pod logs for the awx-web container?
NOTE please inject your own pod and container names.
kubectl logs $PODNAME -c $WEBCONTAINERNAME
Thanks,
AWX Team
I’ve reverted so they are gone, but it was just the waiting for db migrations message. waiting 5 seconds, then x seconds then 30 seconds try number x. then after 30 tries failed. no reason given.
I’ve seen those messages previously but after the final try it just moved on and web front end was available.
I’ve done the upgrade a number of times, same process. I do not see any release notes that say my helm needs any changes. Used to have to delete awx-controller-operator but that was fixed.
This happens on both my dev and prod instances
Hi,
In my case, what has helped was deleting coredns pods. Once those got recreated migration started within few seconds. I am using external db which I’m guessing there was an issue resolving. Not sure if this is going to be of help but thought I share anyway 
L.
still can’t upgrade to anything newer than 1.1.2:
[wait-for-migrations] Attempt 30 of 30
[wait-for-migrations] ERROR: Database migrations not applied
Database is managed by awx-operator so @Sinnl suggestion n/a
Hi,
we also see this Error sometimes and to resolve it we usually access the web-container terminal and then put the command ‘awx-manage migrate’ in.
Always resolved the problem and made the container working again.
Nicholas are you still experiencing trouble upgrading to 1.1.3?
Yes, I created external rds I confirmed connectivity from awx-web with python to the instance but seems to not be connecting on its own as it should.
Logging shows the migrating failure
I suspect issue with getting creds in configuration yaml but have tried a number of different ways so far no joy
can you provide logging from the external RDS postgres service? is it evident that the DB is trying to apply the migrations?
which postgres version are you running?
AWX Team
Got external dB working
So I am going through this process to make sure I can migrate my prod instance to external db and keep the data, but even setting up a new instance with managed db:
2023-03-07 18:10:04.698 UTC [270] ERROR: relation “django_migrations” does not exist at character 124
2023-03-07 18:10:04.698 UTC [270] STATEMENT: SELECT “django_migrations”.“id”, “django_migrations”.“app”, “django_migrations”.“name”, “django_migrations”.“applied” FROM “django_migrations” WHERE (“django_migrations”.“app” = ‘main’ AND NOT (“django_migrations”.“name”::text LIKE ‘%squashed%’)) ORDER BY “django_migrations”.“id” DESC LIMIT 1
postgres logs show this. I initially tried 1.2.0 - it failed so rolled back to 1.1.2 and deleted all the persistent data etc so make sure fresh setup. but just see that error repeat while the awx_web repeats the db migrations waiting messages