Hi, I don’t see my issue addressed in the docs or existing issues. I’m trying to override site-wide group_var/all config with an inventory-specific “all” but it looks like the site-wide vars get precedence, unexpectedly. Here’s my structure:
env
├── dev
│ ├── group_vars
│ │ ├── all
│ │ └── node
│ └── inventory.py
└── production
├── group_vars
│ └── all
└── inventory.py
group_vars
└── all
I have a simple debug playbook to test vars: ansible-playbook -i env/dev debug.yml
In group_vars/all, I set env: common
In env/dev/group_vars/all I set env: common/dev, but it does not override the “common” value (unless I remove env: common from group_vars/all
In env/dev/group_vars/node I set env: common/dev/node, and it does override the “common” value for any hosts that belong to the “node” group.
In #2, shouldn’t env/dev/group_vars/all be overriding the value set from group_vars/all?
No, the play specific group_vars is there for overriding inventory
group_vars, this works as designed.
In general inventory is something you normally share across projects,
plays are more specific to the action you want to accomplish, this is
the logic followed for the above behavior.
Sorry, not following you. In this example I’m not storing any vars in playbooks.
I find it strange that group-specific vars at env/dev/group_vars/node override group_vars/all, but env/dev/group_vars/all does not.
It sounds like that’s expected, so it’s not a bug, but I don’t understand the logic behind it.
An example of a var I’d like defined as a default but may want to override on a per-environment basis is version. Let’s say I want my default to be 0.9.0, but in production I want to override the default and specify 0.8.0.
Your plays are at the level of top env (assumed from how you call
debug.yml) and they load that group_vars, this is how you load
inventory vars at the play level (different from play vars). It is
meant to override the inventory as plays are more specific than
inventory.
if you do not want this to be the case, put the inventory outside the same hier,
env/
plays/
Then it would be ansible-playbook -i ../env/dev debug.yml and the
../env/group_vars/all will NOT be sourced.
You are mixing 2 loading methods, one is part of inventory, the other
part of plays, I think this is what is confusing you.
It seem I have a pretty common use case, so it feels strange there isn’t a more direct way of solving it. I see what you mean by mixing 2 loading methods though. I structured it this way following http://toja.io/using-host-and-group-vars-files-in-ansible/
There were other blog posts about multistage ansible environments, but this one was by far the simplest.
As a workaround, I might have my dynamic inventory script put all groups in a single supergroup “all_groups” to allow me to override vars at the env-level (e.g. env/dev/group_vars/all_groups). Or is there a better way to specify a var default at the inventory level (instead of play level)?
i think the example you posted/followed is a bit confusing because
their play is named group_vars.yml, it does not have an actual
group_vars dir at play level.
You’re right, adding group_vars/all was my own attempt at providing site-wide defaults that could be overriden at the env level.
So it sounds like I need a way to provide site-wide defaults at the Inventory level instead of Play level. I have an idea to manually load a defaults file with my dynamic inventory script and setting those vars, but it’s a bit ugly.
I completely eschew Ansible’s “all” supergroup because precedence was not behaving as I expected.
I use a dynamic inventory script which adds all my groups to a “defaults” supergroup. This is my “all” replacement, so env/defaults is my new group_vars/all. The script also manually reads in env/defaults and sets the vars in the JSON output.
env/defaults can specify site-wide defaults which can be overridden by env/dev/group_vars/defaults. There’s a third level of specificity at env/dev/group_vars/$group, e.g. env/dev/group_vars/zookeeper, which would override anything in env/dev/group_vars/defaults.
I’d really like to see Ansible create an official solution to this common problem. It’d take the burden off devs and increase uniformity in Ansible automation.
One awkward piece of my setup is having to set all my vars at the inventory level, when much of it belongs at the playbook level.
I’m still using the directory structure I posted above, with group_vars inside each env. The “defaults” group is the special one that I use to replace Ansible’s normal “all” group, except that I get expected override precedence. I modified the dynamic inventory script to load the non-env-specific defaults file and apply them like this:
def read_default_vars(self):
c = ConfigParser.ConfigParser()
c.read(“env/defaults”)
section = “all”
result = {}
for key in c.options(section):
result[key] = c.get(section, key)
return result