Ansible 1.3 Command Module: "OSError: [Errno 24] Too many open files"

Archives Ansible Project
1

I started using Ansible 1.3.0, installed via pip, and have a found an issue that went away when I used Ansible 1.2.2 (the version I was previously using) instead. I have gone back to 1.2.2 for increased stability.

I did not see this error every time I used the command module, only in some places, particularly with extracting a tarball and with making or installing. On the commands that it happens to, it happens every time.

Command:
command: /bin/tar xfz libvorbis-1.3.3.tar.gz chdir=/var/tmp/ansible creates=/var/tmp/ansible/libvorbis-1.3.3

Error:

TASK: [unpack libvorbis-1.3.3] ************************************************
fatal: [ui.test.net] => Traceback (most recent call last):
File “/Library/Python/2.7/site-packages/ansible/runner/init.py”, line 382, in _executor
exec_rc = self._executor_internal(host, new_stdin)
File “/Library/Python/2.7/site-packages/ansible/runner/init.py”, line 471, in _executor_internal
return self._executor_internal_inner(host, self.module_name, self.module_args, inject, port, complex_args=complex_args)
File “/Library/Python/2.7/site-packages/ansible/runner/init.py”, line 654, in _executor_internal_inner
result = handler.run(conn, tmp, module_name, module_args, inject, complex_args)
File “/Library/Python/2.7/site-packages/ansible/runner/action_plugins/normal.py”, line 54, in run
return self.runner._execute_module(conn, tmp, module_name, module_args, inject=inject, complex_args=complex_args)
File “/Library/Python/2.7/site-packages/ansible/runner/init.py”, line 290, in _execute_module
(remote_module_path, module_style, shebang) = self._copy_module(conn, tmp, module_name, args, inject, complex_args)
File “/Library/Python/2.7/site-packages/ansible/runner/init.py”, line 845, in _copy_module
self._transfer_str(conn, tmp, module_name, module_data)
File “/Library/Python/2.7/site-packages/ansible/runner/init.py”, line 256, in _transfer_str
conn.put_file(afile, remote)
File “/Library/Python/2.7/site-packages/ansible/runner/connection_plugins/ssh.py”, line 268, in put_file
stdout=subprocess.PIPE, stderr=subprocess.PIPE)
File “/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py”, line 679, in init
errread, errwrite)
File “/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py”, line 1120, in _execute_child
errpipe_read, errpipe_write = os.pipe()
OSError: [Errno 24] Too many open files

2

Try increasing the number of open files (nofile). Look at the "ulimit -a" output. Then add something like below to /etc/security/limits.d/99-nofile.conf:

     * soft nofile 10240

Test again by re-login to the system with the user having this problem.

(Feel free to replace * with the user that requires this change, and 10240 with something more suitable for your environment, maybe unlimited)

Kind regards,

3

Incidentally I believe we have a pull request for a fix to pty handling that should address most of this.

It’s in queue for testing:

https://github.com/ansible/ansible/pull/4132

4

That pull request looks like it would do the trick. The max number of files I have is 100000, that should be sufficient to do a lot, I wouldn’t expect to have to raise it any further.