Docker container vs VM for control machine

Hi,

I currently use a VM as my Ansible control machine. I am considering moving it to a Docker container.
Just wondering if thats a good idea, i imagine enabling fact_caching might not be so straightforward.

Any thoughts?