awx 19.5.0 EE container not able to connect to coredns

,

Hi!
I have a peculiar issue on awx 19.5.0. It was working till last week.

we are seeing dns issue on the EE pod. If the EE pod runs on specific kubernetis node it is working fine. When we checked, the EE pod could not reach coredns service ip in kube-sysem namespace. I have checked the pod cidr and itis correct across all nodes.

no network policy configured.

could some one help me here.

NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
pod/awx-operator-controller-manager-68678878f5-5s5k7 2/2 Running 17 119d 10.244.99.164 a002
pod/awxt-6768c5f87d-nrrgq 4/4 Running 0 14h 10.244.99.166 a002
pod/dnsutils 1/1 Running 1 61m 10.244.215.84 a001

a001 is the problem node. whatever pods run on this node not able to connect to core dns for name resolution. any help appreciated.

It is fixed by creating route for tunl0 interface on the node where the problem exist with reference of another slave node for cordns pod ip. Thanks.