Red Hat has finally fixed the bug with ControlPersist on RHEL 6.6 which causes Ansible to fail to connect on first try and some other strange behavior. So if you are using RHEL/CentOS 6.6 as your management host, make sure to update to the latest openssh-clients version.
Much rejoicing!