To customize pod specification for your automation job pods, you should define Container Groups with customized pod specification that contains hostAliases, and specify it in Job Templates or Organizations.
Probably you already have the one with old IP addresses?
By the way how did you inject hostAliases to your AWX deployment means awx-task and awx-web deployments?