AWX - AWS invenroty not showing up in UI

Archives AWX Project
,
1

These are awx_task container logs, unable to figure out exact reason why aws inventory is not coming up on UI?

InterfaceError: connection already closed
2017-12-13 22:43:16,643 ERROR awx.main.tasks Encountered error on initial log configuration.
Traceback (most recent call last):
File “/usr/lib/python2.7/site-packages/awx/main/tasks.py”, line 116, in task_set_logger_pre_run
configure_external_logger(settings, is_startup=False)
File “/usr/lib/python2.7/site-packages/awx/main/utils/handlers.py”, line 342, in configure_external_logger
is_enabled = settings_module.LOG_AGGREGATOR_ENABLED
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 474, in getattr_without_cache
return getattr(self._wrapped, name)
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 387, in getattr
value = self._get_local(name)
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 307, in _get_local
self._preload_cache()
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 269, in _preload_cache
for setting in Setting.objects.filter(key__in=settings_to_cache.keys(), user__isnull=True).order_by(‘pk’):
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 250, in iter
self._fetch_all()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 1118, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 53, in iter
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/sql/compiler.py”, line 882, in execute_sql
cursor = self.connection.cursor()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 254, in cursor
return self._cursor()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 231, in _cursor
return self._prepare_cursor(self.create_cursor(name))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/utils.py”, line 94, in exit
six.reraise(dj_exc_type, dj_exc_value, traceback)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 231, in _cursor
return self._prepare_cursor(self.create_cursor(name))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/postgresql/base.py”, line 220, in create_cursor
cursor = self.connection.cursor()
InterfaceError: connection already closed
[2017-12-13 22:43:16,643: ERROR/ForkPoolWorker-2627] Encountered error on initial log configuration.
Traceback (most recent call last):
File “/usr/lib/python2.7/site-packages/awx/main/tasks.py”, line 116, in task_set_logger_pre_run
configure_external_logger(settings, is_startup=False)
File “/usr/lib/python2.7/site-packages/awx/main/utils/handlers.py”, line 342, in configure_external_logger
is_enabled = settings_module.LOG_AGGREGATOR_ENABLED
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 474, in getattr_without_cache
return getattr(self._wrapped, name)
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 387, in getattr
value = self._get_local(name)
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 307, in _get_local
self._preload_cache()
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 269, in _preload_cache
for setting in Setting.objects.filter(key__in=settings_to_cache.keys(), user__isnull=True).order_by(‘pk’):
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 250, in iter
self._fetch_all()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 1118, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 53, in iter
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/sql/compiler.py”, line 882, in execute_sql
cursor = self.connection.cursor()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 254, in cursor
return self._cursor()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 231, in _cursor
return self._prepare_cursor(self.create_cursor(name))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/utils.py”, line 94, in exit
six.reraise(dj_exc_type, dj_exc_value, traceback)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 231, in _cursor
return self._prepare_cursor(self.create_cursor(name))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/postgresql/base.py”, line 220, in create_cursor
cursor = self.connection.cursor()
InterfaceError: connection already closed
[2017-12-13 22:43:16,644: ERROR/ForkPoolWorker-2627] Signal handler <bound method ?.on_worker_process_init of <celery.fixups.django.DjangoWorkerFixup object at 0x3577ed0>> raised: InterfaceError(‘connection already closed’,)
Traceback (most recent call last):
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/celery/utils/dispatch/signal.py”, line 227, in send
response = receiver(signal=self, sender=sender, **named)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/celery/fixups/django.py”, line 151, in on_worker_process_init
self._maybe_close_db_fd(c.connection)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/celery/fixups/django.py”, line 159, in _maybe_close_db_fd
_maybe_close_fd(fd)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/celery/fixups/django.py”, line 28, in _maybe_close_fd
os.close(fh.fileno())
InterfaceError: connection already closed
[2017-12-13 22:43:16,740: DEBUG/MainProcess] TaskPool: Apply <function _fast_trace_task at 0x3417c80> (args:(‘awx.main.tasks.awx_periodic_scheduler’, ‘85c501dc-1d0d-42de-a858-a17c2b35c570’, {‘origin’: ‘gen96@awx’, ‘lang’: ‘py’, ‘task’: ‘awx.main.tasks.awx_periodic_scheduler’, ‘group’: None, ‘root_id’: ‘85c501dc-1d0d-42de-a858-a17c2b35c570’, u’delivery_info’: {u’priority’: None, u’redelivered’: False, u’routing_key’: u’tower’, u’exchange’: u’‘}, ‘expires’: ‘2017-12-13T22:43:36.548699+00:00’, u’correlation_id’: ‘85c501dc-1d0d-42de-a858-a17c2b35c570’, ‘retries’: 0, ‘timelimit’: [None, None], ‘argsrepr’: ‘()’, ‘eta’: None, ‘parent_id’: None, u’reply_to’: ‘003df874-f713-300b-8384-b8f128f4a8a8’, ‘id’: ‘85c501dc-1d0d-42de-a858-a17c2b35c570’, ‘kwargsrepr’: ‘{}’}, u’[, {}, {“chord”: null, “callbacks”: null, “errbacks”: null, “chain”: null}]', ‘application/json’, ‘utf-8’) kwargs:{})
[2017-12-13 22:43:16,742: DEBUG/MainProcess] basic.qos: prefetch_count->6776
[2017-12-13 22:43:16,748: DEBUG/MainProcess] Task accepted: awx.main.scheduler.tasks.run_task_manager[ef85803b-34b8-4f59-a086-0cd41a2d4dcf] pid:4183
2017-12-13 22:43:16,755 ERROR awx.main.tasks Encountered error on initial log configuration.
Traceback (most recent call last):
File “/usr/lib/python2.7/site-packages/awx/main/tasks.py”, line 116, in task_set_logger_pre_run
configure_external_logger(settings, is_startup=False)
File “/usr/lib/python2.7/site-packages/awx/main/utils/handlers.py”, line 342, in configure_external_logger
is_enabled = settings_module.LOG_AGGREGATOR_ENABLED
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 474, in getattr_without_cache
return getattr(self._wrapped, name)
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 387, in getattr
value = self._get_local(name)
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 307, in _get_local
self._preload_cache()
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 269, in _preload_cache
for setting in Setting.objects.filter(key__in=settings_to_cache.keys(), user__isnull=True).order_by(‘pk’):
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 250, in iter
self._fetch_all()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 1118, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 53, in iter
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/sql/compiler.py”, line 882, in execute_sql
cursor = self.connection.cursor()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 254, in cursor
return self._cursor()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 231, in _cursor
return self._prepare_cursor(self.create_cursor(name))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/utils.py”, line 94, in exit
six.reraise(dj_exc_type, dj_exc_value, traceback)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 231, in _cursor
return self._prepare_cursor(self.create_cursor(name))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/postgresql/base.py”, line 220, in create_cursor
cursor = self.connection.cursor()
InterfaceError: connection already closed
2017-12-13 22:43:16,755 ERROR awx.main.tasks Encountered error on initial log configuration.
Traceback (most recent call last):
File “/usr/lib/python2.7/site-packages/awx/main/tasks.py”, line 116, in task_set_logger_pre_run
configure_external_logger(settings, is_startup=False)
File “/usr/lib/python2.7/site-packages/awx/main/utils/handlers.py”, line 342, in configure_external_logger
is_enabled = settings_module.LOG_AGGREGATOR_ENABLED
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 474, in getattr_without_cache
return getattr(self._wrapped, name)
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 387, in getattr
value = self._get_local(name)
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 307, in _get_local
self._preload_cache()
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 269, in _preload_cache
for setting in Setting.objects.filter(key__in=settings_to_cache.keys(), user__isnull=True).order_by(‘pk’):
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 250, in iter
self._fetch_all()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 1118, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 53, in iter
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/sql/compiler.py”, line 882, in execute_sql
cursor = self.connection.cursor()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 254, in cursor
return self._cursor()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 231, in _cursor
return self._prepare_cursor(self.create_cursor(name))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/utils.py”, line 94, in exit
six.reraise(dj_exc_type, dj_exc_value, traceback)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 231, in _cursor
return self._prepare_cursor(self.create_cursor(name))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/postgresql/base.py”, line 220, in create_cursor
cursor = self.connection.cursor()
InterfaceError: connection already closed
[2017-12-13 22:43:16,755: ERROR/ForkPoolWorker-2628] Encountered error on initial log configuration.
Traceback (most recent call last):
File “/usr/lib/python2.7/site-packages/awx/main/tasks.py”, line 116, in task_set_logger_pre_run
configure_external_logger(settings, is_startup=False)
File “/usr/lib/python2.7/site-packages/awx/main/utils/handlers.py”, line 342, in configure_external_logger
is_enabled = settings_module.LOG_AGGREGATOR_ENABLED
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 474, in getattr_without_cache
return getattr(self._wrapped, name)
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 387, in getattr
value = self._get_local(name)
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 307, in _get_local
self._preload_cache()
File “/usr/lib/python2.7/site-packages/awx/conf/settings.py”, line 269, in _preload_cache
for setting in Setting.objects.filter(key__in=settings_to_cache.keys(), user__isnull=True).order_by(‘pk’):
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 250, in iter
self._fetch_all()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 1118, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/query.py”, line 53, in iter
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/models/sql/compiler.py”, line 882, in execute_sql
cursor = self.connection.cursor()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 254, in cursor
return self._cursor()
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 231, in _cursor
return self._prepare_cursor(self.create_cursor(name))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/utils.py”, line 94, in exit
six.reraise(dj_exc_type, dj_exc_value, traceback)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 231, in _cursor
return self._prepare_cursor(self.create_cursor(name))
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/django/db/backends/postgresql/base.py”, line 220, in create_cursor
cursor = self.connection.cursor()
InterfaceError: connection already closed
[2017-12-13 22:43:16,756: ERROR/ForkPoolWorker-2628] Signal handler <bound method ?.on_worker_process_init of <celery.fixups.django.DjangoWorkerFixup object at 0x3577ed0>> raised: InterfaceError(‘connection already closed’,)
Traceback (most recent call last):
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/celery/utils/dispatch/signal.py”, line 227, in send
response = receiver(signal=self, sender=sender, **named)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/celery/fixups/django.py”, line 151, in on_worker_process_init
self._maybe_close_db_fd(c.connection)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/celery/fixups/django.py”, line 159, in _maybe_close_db_fd
_maybe_close_fd(fd)
File “/var/lib/awx/venv/awx/lib/python2.7/site-packages/celery/fixups/django.py”, line 28, in _maybe_close_fd
os.close(fh.fileno())
InterfaceError: connection already closed
[2017-12-13 22:43:16,758: DEBUG/MainProcess] Task accepted: awx.main.tasks.awx_periodic_scheduler[85c501dc-1d0d-42de-a858-a17c2b35c570] pid:4184
2017-12-13 22:43:16,798 DEBUG awx.main.scheduler Running Tower task manager.
2017-12-13 22:43:16,798 DEBUG awx.main.scheduler Running Tower task manager.

(attachments)

couldNot.JPG
couldNot.JPG1952×887 132 KB

2

The tracebacks read to me like to me like logging is improperly configured–so unrelated to your inventory problem, so for as I understand. In terms of setting up logging, someone on the back end team may be able to help you.

The “Could not match supplied host pattern…” line in the standard out display visible in your screenshot seems like it is probably relevant to the issue. Not sure what the rest of that line says.

Can you make sure you’ve entered the correct values to access your AWS inventory within the sources tab of the inventory edit screen, as well as the AWS credential on the credentials edit screen?

3

Correct values? can you please elaborate I have tried with access key and secret key and also by using IAM role. Manully running on ec2 I am able to get all the instances so creds are good. Anything else m missing ?

4
(attachments)

eroor.JPG
eroor.JPG1487×548 85.8 KB