AWX deployment scale up possible?

Hi Team,
Is it possible to scale up AWX deployment pods on K8s base AWX environment ?

AWX version : 21.4.0
K8s Version:1.21.0
AWX operator: 0.26.0

my AWX is getting bombarded with log of Job Requests in a day. Approximately 700 Jobs for one project. it’s going to get increase in near future to 1700 jobs a day.

currently 2% jobs are failing with error: " Task was marked as running but was not present in the job queue, so it has been marked as failed."

Could you suggest any solution?

Thanks a ton!
Jagruti

you might be exceeding the max connections to the database.
what is your postgres max connections set to? do you monitor the active connections during peak times? any errors in the database logs?