[AWX 19.3.0] Playbook2 can not find the fetched file by Playbook1

Archives AWX Project
1

I want to have a workflow job template which links 2 job templates. Each job template launch a playbook: playbook1 is used to fetch a file from remote host and save it to local path, such as “/tmp/remote_file.txt”. playbook2 is used to read the fetched file and do something else.

I have installed AWX v14 on docker and deployed such workflow job template, which always works well. The fetched file was saved on awx_task container.

Now I install AWX v19 on OCP via awx-operator, and deployed such workflow job template. playbook1 is successful (which means the fetched file is successfully saved to “/tmp”), but playbook2 is failed with error:

"FileNotFoundError: [Errno 2] No such file or directory: ‘/tmp/remote_file.txt’ "
I try to search both awx_task and awx_ee container, there is no fetched file in “/tmp”. I also try different path to save the fetched file, such as “/var/lib/awx/projects/my_project/tmp”, playbook1 is always successful, but same error when running playbook2.

Anyone could help?

2

We ran into similar issues. Try not to use use the file approach if possible though. We had to change the playbooks to use set_stats module to pass result of playbook1 to another in the workflow job since new AWX runs each job in a separate container.
There maybe better approaches but this is what we did and it’s working fine.

set_stats:
data:
my_value: “{{ my_data }}”

3

Using “set_stats” is a workaround, but it is not applicable if the data to be passed to playbook2 is huge. For example, playbook2 is required to process thousands of files which is fetched by playbook1.

Is it possible to have a shared volume for all containers of each AWX template job, so that these containers can access and share some specific file path?