While attempting to push EEs to Automation Hub periodically a 500 error is received and no images are able to be pushed to Hub. The only resolution appears to be dumping the database and re-running the installer.

Two customers have experienced this same issue:

https://access.redhat.com/support/cases/#/case/03138311

https://access.redhat.com/support/cases/#/case/03130208

Error received when trying to push:

Error: writing blob: uploading layer to https://towerpah.shadowman.dev/v2/shadowmaneeterraform/blobs/uploads/b37a1b0d-1680-465b-ae8c-36b7af8ffaaa?digest=sha256%3A67834771e49166960ac4bd12a1d4d65e5ac2bfd7c6b03a5d3456345421989b6a: received unexpected HTTP status: 500 Internal Server Error

Log errors that appear when running '

journalctl -u pulpcore-api.service'

 
django.request:ERROR: Internal Server Error: /v2/shadowmaneeterraform/blobs/uploads/b7169ea9-2925-49a4-bc1f-7083e8d49e94 Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: Traceback (most recent call last): Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/django/core/handlers/exception.py", line 47, in inner Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: response = get_response(request) Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/django/core/handlers/base.py", line 181, in get_response Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: response = wrapped_callback(request, *callback_args, **callback_kwargs) Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/django/views/decorators/csrf.py", line 54, in wrapped_view Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: return view_func(*args, **kwargs) Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/rest_framework/viewsets.py", line 125, in view Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: return self.dispatch(request, *args, **kwargs) Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/rest_framework/views.py", line 509, in dispatch Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: response = self.handle_exception(exc) Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/pulp_container/app/registry_api.py", line 288, in handle_exception Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: response = super().handle_exception(exc) Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/rest_framework/views.py", line 469, in handle_exception Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: self.raise_uncaught_exception(exc) Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: raise exc Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/rest_framework/views.py", line 506, in dispatch Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: response = handler(request, *args, **kwargs) Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/pulp_container/app/registry_api.py", line 717, in put Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: return BlobResponse(blob, path, 201, request) Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/pulp_container/app/registry_api.py", line 211, in __init_ Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: artifact = blob._artifacts.get() Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/django/db/models/manager.py", line 85, in manager_method Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: return getattr(self.get_queryset(), name)(*args, **kwargs) Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: File "/usr/lib/python3.8/site-packages/django/db/models/query.py", line 435, in get Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: raise self.model.DoesNotExist( Feb 11 15:06:33 towerpah.shadowman.dev gunicorn[1293]: pulpcore.app.models.content.Artifact.DoesNotExist: Artifact matching query does not exist.