In my experience this is always because of IO (some mount point gone stale)
Gather facts is running a lot of different commands like df, lvm, mount, swap, nfs and other network filesystems and many more.
You could login to the server a try different commands that list information about IO and see if some of them takes time.