Could not upload a new collection version to Ansible Galaxy

Torie-Coding · October 19, 2023, 6:01pm

Hey there,

i have tried to upload a new version of my Ansible Collection but iam getting the following error message:

Status: 
Failed
Approval status: waiting for import to finish
Version: 1.1.0
Error message:
duplicate key value violates unique constraint "unique_is_highest"
DETAIL:  Key (collection_id, is_highest)=(018ae852-5831-78a0-b19f-d2d6a4e41174, t) already exists.
  File "/venv/lib64/python3.11/site-packages/pulpcore/tasking/tasks.py", line 66, in _execute_task
    result = func(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^
  File "/app/galaxy_ng/app/tasks/publishing.py", line 115, in import_and_auto_approve
    repo = _upload_collection(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/galaxy_ng/app/tasks/publishing.py", line 65, in _upload_collection
    general_create(*general_args, **kwargs)
  File "/venv/lib64/python3.11/site-packages/pulpcore/app/tasks/base.py", line 38, in general_create
    instance = serializer.save()
               ^^^^^^^^^^^^^^^^^
  File "/venv/lib64/python3.11/site-packages/rest_framework/serializers.py", line 212, in save
    self.instance = self.create(validated_data)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/venv/lib64/python3.11/site-packages/pulp_ansible/app/serializers.py", line 530, in create
    finish_collection_upload(content, tags=tags, origin_repository=origin_repository)
  File "/venv/lib64/python3.11/site-packages/pulp_ansible/app/tasks/upload.py", line 84, in finish_collection_upload
    _update_highest_version(collection_version)
  File "/venv/lib64/python3.11/site-packages/pulp_ansible/app/tasks/collections.py", line 439, in _update_highest_version
    update_qs.update(is_highest=F("new_is_highest"))
  File "/venv/lib64/python3.11/site-packages/django/db/models/query.py", line 1206, in update
    rows = query.get_compiler(self.db).execute_sql(CURSOR)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/venv/lib64/python3.11/site-packages/django/db/models/sql/compiler.py", line 1984, in execute_sql
    cursor = super().execute_sql(result_type)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/venv/lib64/python3.11/site-packages/django/db/models/sql/compiler.py", line 1562, in execute_sql
    cursor.execute(sql, params)
  File "/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 67, in execute
    return self._execute_with_wrappers(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
    return executor(sql, params, many, context)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 84, in _execute
    with self.db.wrap_database_errors:
  File "/venv/lib64/python3.11/site-packages/django/db/utils.py", line 91, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 89, in _execute
    return self.cursor.execute(sql, params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/venv/lib64/python3.11/site-packages/psycopg/cursor.py", line 723, in execute
    raise ex.with_traceback(None)

But the Log shows:
Importing with galaxy-importer 0.4.14
Getting doc strings via ansible-doc
Finding content inside collection
Loading module entry
Loading module group
Collection loading complete

Failed

I dont understand the error. It seems that it doesn’t have anything todo with my code. I have created the collection with ansible-galaxy collection build and tried to upload it via webinterface. When i try to upload this file again it says

ERROR! Error when publishing collection to cmd_arg (https://galaxy.ansible.com/api/) (HTTP Code: 400, Message: Collection torie_coding.keepass-1.1.0 already exists Code: invalid)

Thank you for your help.

fitbeard · October 19, 2023, 6:08pm

Hello,

I have same situation:

ERROR! Galaxy import process failed: duplicate key value violates unique constraint "unique_is_highest"
DETAIL:  Key (collection_id, is_highest)=(e201c1cf-1413-4f3b-9e57-2bac1ef184e5, t) already exists. (Code: UNKNOWN)

Also found this issue in Red Hat’s KB: On Red Hat Automation Hub, Sync of collection fails with error "duplicate key value violates unique constraint \"unique_is_highest\"\" - Red Hat Customer Portal

Torie-Coding · October 19, 2023, 6:16pm

So seems like there is no existing solution yet.
Thank you for your reply i i didn‘t find this article.

ccamacho · October 20, 2023, 12:15pm

Same problem here. Any help on this? It looks like a global problem affecting Galaxy. No solution so far.

tannerjc · October 20, 2023, 7:29pm

We believe this will be addressed by Fix update_highest_version when versions were uploaded out-of-order by gerrod3 · Pull Request #1624 · pulp/pulp_ansible · GitHub

jholland · October 23, 2023, 9:45am

Hit this issue too. Looking forward to the fix being deployed. Thank you

Torie-Coding · October 24, 2023, 8:12am

A few hours ago the Fix update_highest_version when versions were uploaded out-of-order (… · pulp/pulp_ansible@55f02c6 · GitHub was pushed into Master. So i belive that the Fix live now ? I tried to upload a new version again but i get the same error.

jholland · October 24, 2023, 8:50am

Same as @Torie-Coding, still unable to upload a new version

dineshsuthar786 · October 24, 2023, 10:41am

Also, If we retry to push the same collection version, we are getting error as “Artifact already exists” but there is no new collection version uploaded. To whom we can contact in galaxy team to delete this artifact, which was failed to upload and we can retry to push the same collection version.

tannerjc · October 24, 2023, 12:37pm

Hi folks, we’re still in the process of getting the patch out to production. Here’s a list things we typically have to do to get a patch deployed:

get the pulp_ansible PR merged Fix update_highest_version when versions were uploaded out-of-order by gerrod3 · Pull Request #1624 · pulp/pulp_ansible · GitHub
make a backport for pulp_ansible [PR #1624/55f02c62 backport][0.20] Fix update_highest_version when versions were uploaded out-of-order by patchback[bot] · Pull Request #1625 · pulp/pulp_ansible · GitHub
bump the pulp_ansible version in galaxy_ng update pulp_ansible to 0.20.2 by jctanner · Pull Request #1950 · ansible/galaxy_ng · GitHub
wait for the CI/CD setup to deploy galaxy_ng’s master branch to galaxy-dev.ansible.com
do QA/QE on dev
trigger a deploy to galaxy-stage.ansible.com and do QA/QE there again
trigger a deploy to galaxy.ansible.com

We’re on step 4 right now and will get through the rest as quick as we can.

UPDATE: the fix is in production now

Torie-Coding · October 24, 2023, 4:15pm

Thanks for the detailed process. Do you know what we can do regarding the error “Artifact already exists” when the fix is deployed ?

dineshsuthar786 · October 25, 2023, 3:22am

@tannerjc Thanks for the fix, I am able to deploy the latest collection to galaxy and did not face any issue.

system · November 24, 2023, 3:23am

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
ERROR! Error when finding available api versions from default (https://galaxy.ansible.com) (HTTP Code: 403, Message: Forbidden) Get Help galaxy-ng , collections , vmware	0	312	March 20, 2024
Zuul cannot upload a collection release saying that it already exists but it doesn't Get Help galaxy-ng , bug	4	445	October 25, 2023
Cannot upload to ktdreyer galaxy namespace Get Help galaxy-ng	2	161	October 16, 2023
Duplicate collection debian 12 Get Help galaxy-ng , collections , vmware	2	26	October 21, 2024
[Galaxy-NG] Guidance regarding syncing community collections Get Help galaxy-ng	8	260	May 28, 2024

Could not upload a new collection version to Ansible Galaxy

Related topics