# AWX EE Container to AWX VM Executor Node Connectivity issues

**URL:** <https://forum.ansible.com/t/awx-ee-container-to-awx-vm-executor-node-connectivity-issues/5303>\
**Category:** Get Help\
**Tags:** vmware, ansible, awx, ee\
**Created:** [May 6, 2024, 2:38pm UTC](https://forum.ansible.com/t/awx-ee-container-to-awx-vm-executor-node-connectivity-issues/5303 "2024-05-06T14:38:10Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![Sakshi](https://avatars.discourse-cdn.com/v4/letter/s/d78d45/32.png) [@Sakshi](https://forum.ansible.com/u/Sakshi)\
**Post date:** [May 6, 2024, 2:38pm UTC](https://forum.ansible.com/t/awx-ee-container-to-awx-vm-executor-node-connectivity-issues/5303/1 "2024-05-06T14:38:10Z")

</div>

We have executed the playbook on the AWX VM Executor node. However, we have got the below error. Could you please provide your input on this issue.

Error: writing blob: adding layer with blob “sha256:5ac5ee06926ae36c5ef4d076c5bc531d6ae9fa6920a3ed25feb0394556132ada”: processing tar file(mkdir /usr/local/lib/python3.9/site-packages/com/vmware/nsx/configs: no space left on device): exit status 1

---

<div class="post-metadata">

**Author:** ![kurokobo](https://sea1.discourse-cdn.com/ansible/user_avatar/forum.ansible.com/kurokobo/32/182_2.png) [@kurokobo](https://forum.ansible.com/u/kurokobo)\
**Post date:** [May 6, 2024, 3:13pm UTC](https://forum.ansible.com/t/awx-ee-container-to-awx-vm-executor-node-connectivity-issues/5303/2 "2024-05-06T15:13:58Z")

</div>

I think the error message is the answer, have you done any investigation?

---

<div class="post-metadata">

**Author:** ![Sakshi](https://avatars.discourse-cdn.com/v4/letter/s/d78d45/32.png) [@Sakshi](https://forum.ansible.com/u/Sakshi)\
**Post date:** [May 6, 2024, 3:27pm UTC](https://forum.ansible.com/t/awx-ee-container-to-awx-vm-executor-node-connectivity-issues/5303/3 "2024-05-06T15:27:15Z")

</div>

That’s correct, but what kind of remediations that we would need to perform for this issue. Could you please explain once in detail manner with the commands or practical explanation.

---

<div class="post-metadata">

**Author:** ![kurokobo](https://sea1.discourse-cdn.com/ansible/user_avatar/forum.ansible.com/kurokobo/32/182_2.png) [@kurokobo](https://forum.ansible.com/u/kurokobo)\
**Post date:** [May 6, 2024, 3:39pm UTC](https://forum.ansible.com/t/awx-ee-container-to-awx-vm-executor-node-connectivity-issues/5303/4 "2024-05-06T15:39:02Z")

</div>

Have you read the error message you posted to the end of the line?

---

<div class="post-metadata">

**Author:** ![Sakshi](https://avatars.discourse-cdn.com/v4/letter/s/d78d45/32.png) [@Sakshi](https://forum.ansible.com/u/Sakshi)\
**Post date:** [May 6, 2024, 4:07pm UTC](https://forum.ansible.com/t/awx-ee-container-to-awx-vm-executor-node-connectivity-issues/5303/5 "2024-05-06T16:07:24Z")

</div>

Let me try to explain my requirements more clearly. I want to perform some extensions of the space on the container-image layer, but in order to perform that, what are all the commands that we would need to apply on the AWX-EE container-image I’m not sure about it. Please let me know if you have any insights from your side.

---

<div class="post-metadata">

**Author:** ![kurokobo](https://sea1.discourse-cdn.com/ansible/user_avatar/forum.ansible.com/kurokobo/32/182_2.png) [@kurokobo](https://forum.ansible.com/u/kurokobo)\
**Post date:** [May 7, 2024, 12:50pm UTC](https://forum.ansible.com/t/awx-ee-container-to-awx-vm-executor-node-connectivity-issues/5303/6 "2024-05-07T12:50:58Z")

</div>

> [@Sakshi](#):
>
> want to perform some extensions of the space on the container-image layer, but in order to perform that, what are all the commands that we would need to apply on the AWX-EE container-image I’m not sure about it.

Okay, so personally I recommend that includes such question be in the initial post. Only pasting an error message without sufficient explanation is, um, just throwing all of the problem solving to someone else.

So, if you have read the error message in your own way, came up with your own solution, and still don’t know how to do it, all of these facts and thoughts should be presented clearly from the beginning. This will definitely make it easier for community members to understand your situation that you are facing, and the comments you get from others will probably be appropriate.

In addition, the description like “executed the playbook and got an error”, is also not informative enough. Providing actual playbook (or task at least), clarifying where the error appears, and providing a log that includes before and after of the errors without omitting anything other than the errors are also important to get appropreate answer.

So I want to say, to get good answers for you, you absolutely requires authoring good quality, clear and informative questions, with taking sufficient time and effort in the first place.

> [@Sakshi](#):
>
> Error: writing blob: adding layer with blob “sha256:5ac5ee06926ae36c5ef4d076c5bc531d6ae9fa6920a3ed25feb0394556132ada”: processing tar file(mkdir /usr/local/lib/python3.9/site-packages/com/vmware/nsx/configs: no space left on device): exit status 1

Now, back to the error in the very first question, anyway, `no space left on device` is the cause, as it is shown in the error.

Typically this error is insufficient space on the filesystem of the host you are running container images on. Check the free space on the file system of the host where the `docker` or `podman` is running.

Sorry for the lengthy post.

---

<div class="post-metadata">

**Author:** ![kurokobo](https://sea1.discourse-cdn.com/ansible/user_avatar/forum.ansible.com/kurokobo/32/182_2.png) [@kurokobo](https://forum.ansible.com/u/kurokobo)\
**Post date:** [May 7, 2024, 1:29pm UTC](https://forum.ansible.com/t/awx-ee-container-to-awx-vm-executor-node-connectivity-issues/5303/7 "2024-05-07T13:29:16Z")

</div>

If the error persists despite sufficient free space, perhaps you need to troubleshoot something about Docker or Podman.  
If so, please be specific about the playbook in which the error occurs and how the error is displayed and where. Also, the results of the following commands would be a good first lead-in.

```bash
df -h
df -ih
podman system df
podman system info
cat /etc/containers/storage.conf
cat /home/awx/.config/containers/storage.conf

```

---

<div class="post-metadata">

**Author:** ![Sakshi](https://avatars.discourse-cdn.com/v4/letter/s/d78d45/32.png) [@Sakshi](https://forum.ansible.com/u/Sakshi)\
**Post date:** [May 10, 2024, 4:35pm UTC](https://forum.ansible.com/t/awx-ee-container-to-awx-vm-executor-node-connectivity-issues/5303/8 "2024-05-10T16:35:16Z")

</div>

We have performed the above checkup and yet the issue remains unresolved. Could anybody please provide your insight.

History:

- We executed the playbook from AWX application and got the below error,

**Error** : writing blob: adding layer with blob “sha256:5d25feb0394556132ada”: processing tar file(mkdir /usr/local/lib/python3.9/site-packages/com/vmware/nsx/configs: no space left on device): exit status 1

We validated the log file from container layer and also validated the space and seems like we have sufficient space. On further validation on AWX executor node we are getting below errors,

ERROR 2024/05/10 15:09:50 Error locating unit: LoK6pciG  
ERROR 2024/05/10 15:09:50 unknown work unit LoK6pciG  
ERROR 2024/05/10 15:29:44 Error locating unit: fLcrpezz  
ERROR 2024/05/10 15:29:44 unknown work unit fLcrpezz  
ERROR 2024/05/10 15:31:26 Error locating unit: AX135Hp7  
ERROR 2024/05/10 15:31:26 unknown work unit AX135Hp7  
ERROR 2024/05/10 15:33:16 Error locating unit: 3mJ6owTL  
ERROR 2024/05/10 15:33:16 unknown work unit 3mJ6owTL  
ERROR 2024/05/10 15:36:34 Error locating unit: 3JxAN2mk  
ERROR 2024/05/10 15:36:34 unknown work unit 3JxAN2mk  
ERROR 2024/05/10 15:38:30 Error locating unit: 7uBQ2r8N  
ERROR 2024/05/10 15:38:30 unknown work unit 7uBQ2r8N  
ERROR 2024/05/10 15:40:45 Error locating unit: 5Och00Nu  
ERROR 2024/05/10 15:40:45 unknown work unit 5Och00Nu  
ERROR 2024/05/10 15:43:23 Error locating unit: 7wwxZSML  
ERROR 2024/05/10 15:43:23 unknown work unit 7wwxZSML  
ERROR 2024/05/10 15:44:46 Error locating unit: xTU8j35w  
ERROR 2024/05/10 15:44:46 unknown work unit xTU8j35w

Any insight would be highly appreciated.

---

<div class="post-metadata">

**Author:** ![manish\_singh](https://sea1.discourse-cdn.com/ansible/user_avatar/forum.ansible.com/manish_singh/32/2761_2.png) [@manish\_singh](https://forum.ansible.com/u/manish_singh)\
**Post date:** [May 11, 2024, 4:54am UTC](https://forum.ansible.com/t/awx-ee-container-to-awx-vm-executor-node-connectivity-issues/5303/9 "2024-05-11T04:54:36Z")

</div>

Hello All,

Any help/suggestions on this topic would be helpful…
