ssh controlpath socket not created

Very new to AWX. Got it up and running last week.
I can connect to a remote host using a username and password but I’m having trouble connecting over ssh.
The job output is full of these messages:

wait_for_connection: attempting ping module test

sending connection check: [b’ssh’, b’-C’, b’-o’, b’ControlMaster=auto’, b’-o’, b’ControlPersist=60s’, b’-o’, b’StrictHostKeyChecking=no’, b’-o’, b’KbdInteractiveAuthentication=no’, b’-o’, b’PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey’, b’-o’, b’PasswordAuthentication=no’, b’-o’, b’User=“ansible”‘, b’-o’, b’ConnectTimeout=10’, b’-o’, b’ControlPath=“/runner/cp/e5de431746”‘, b’-O’, b’check’, b’10.32.31.30’]
No connection to reset: Control socket connect(/runner/cp/e5de431746): No such file or directory
<10.32.31.30> ESTABLISH SSH CONNECTION FOR USER: ansible
<10.32.31.30> SSH: EXEC ssh -C -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o ‘User=“ansible”’ -o ConnectTimeout=10 -o ‘ControlPath=“/runner/cp/e5de431746”’ 10.32.31.30 ‘/bin/sh -c ‘"’“‘echo ~ansible && sleep 0’”’"‘’
<10.32.31.30> (255, b’', b"Warning: Permanently added ‘10.32.31.30’ (ED25519) to the list of known hosts.\r\nansible@10.32.31.30: Permission denied (publickey,password).

If I connect to the container and run the ssh connand:

bash-5.1$ ssh -C -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o ‘User=“ansible”’ -o ConnectTimeout=10 -o ControlPath=“/runner/cp/e5de431746” -O check 10.32.31.30 ‘/bin/sh -c ‘"’“‘echo ~ansible && sleep 0’”’"‘’
Control socket connect(/runner/cp/e5de431746): No such file or directory

If I run the command without the ControlPath option:

bash-5.1$ ssh -C -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o ‘User=“ansible”’ -o ConnectTimeout=10 10.32.31.30 ‘/bin/sh -c ‘"’“‘echo ~ansible && sleep 0’”’"‘’
/home/ansible

What is going on here?

Not sure what was going on here but I restarted the k3s service and the problem went away.