• Icon: Bug Bug
    • Resolution: Done
    • Icon: Blocker Blocker
    • 1.0.0
    • 1.0.0
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • None

      bundle in catalog template, refer PR https://github.com/rhobs/konflux-coo/pull/548/files

      quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator-bundle@sha256:c37dbf90983bc2878ee714dd52ace3243ef52d667e903b7a4be45313093ba8df

      quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc doesn't exist

      quay.io/redhat-user-workloads/cluster-observabilit-tenant/obo-prometheus-operator-admission-webhook@sha256:d5f4a5fe2807d2b645e7067960504d7247f067067f066f232d5f6099b87c61d0 exist

      installed the bundle

      $ operator-sdk run bundle -n coo  --security-context-config restricted --timeout 5m registry.redhat.io/cluster-observability-operator-bundle@sha256:c37dbf90983bc2878ee714dd52ace3243ef52d667e903b7a4be45313093ba8df 
      $ oc -n coo get pod
      NAME                                                              READY   STATUS             RESTARTS   AGE
      37dbf90983bc2878ee714dd52ace3243ef52d667e903b7a4be45313093ba8df   1/1     Running            0          3m56s
      badace3509e93a1d038c51f3739ac4953e9a6a54990621eebb517a0917qbx68   0/1     Completed          0          3m28s
      obo-prometheus-operator-6dbc95f76c-t6jvv                          1/1     Running            0          2m36s
      obo-prometheus-operator-admission-webhook-77c847cbcf-r7txp        1/1     Running            0          2m36s
      obo-prometheus-operator-admission-webhook-77c847cbcf-vd99f        1/1     Running            0          2m36s
      observability-operator-6fc58c9b6c-j7bkz                           0/1     ImagePullBackOff   0          2m36s
      % oc -n coo describe pod observability-operator-6fc58c9b6c-j7bkz
      ......
        Normal   Pulling         87s (x4 over 3m3s)  kubelet            Pulling image "registry.redhat.io/cluster-observability-operator/cluster-observability-rhel8-operator@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc"
        Warning  Failed          86s (x4 over 3m2s)  kubelet            Failed to pull image "registry.redhat.io/cluster-observability-operator/cluster-observability-rhel8-operator@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc": (Mirrors also failed: [quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc: reading manifest sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc in quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator: unauthorized: access to the requested resource is not authorized]): registry.redhat.io/cluster-observability-operator/cluster-observability-rhel8-operator@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc: reading manifest sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc in registry.redhat.io/cluster-observability-operator/cluster-observability-rhel8-operator: manifest unknown
        Warning  Failed          86s (x4 over 3m2s)  kubelet            Error: ErrImagePull
        Warning  Failed          75s (x6 over 3m1s)  kubelet            Error: ImagePullBackOff
        Normal   BackOff         62s (x7 over 3m1s)  kubelet            Back-off pulling image "registry.redhat.io/cluster-observability-operator/cluster-observability-rhel8-operator@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc"
      $ oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc
      error: unable to read image quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc: unauthorized: access to the requested resource is not authorized
      $ oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/obo-prometheus-operator-admission-webhook@sha256:d5f4a5fe2807d2b645e7067960504d7247f067067f066f232d5f6099b87c61d0
      error: the image is a manifest list and contains multiple images - use --filter-by-os to select from:
      
      
        OS            DIGEST
        linux/amd64   sha256:30a5b20b65d216d192442558cbe7385f39967e8c6f23547bcb79bd2e09cb6e65
        linux/arm64   sha256:c1932e4f8f2f814afa41598a267d035e6d0721f022cb4b4bdc66d06d25a43a78
        linux/ppc64le sha256:8c99a3d5cf0ce275326a803f02a8f3c3fee86561918679ce32f9420a511c7944
        linux/s390x   sha256:f55b41a4da69d74382d2415905b2a4e6204a88af0fc6a32df45135fc9613b419

       

       

            [COO-660] image digest in bundle are wrong

            Hongyan Li added a comment -

            Update IDMS item to

              - mirrors:
                - quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator-container
                source: registry.redhat.io/cluster-observability-operator/cluster-observability-rhel8-operator 

            Bundle can be installed and works well.

            Hongyan Li added a comment - Update IDMS item to   - mirrors:     - quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability- operator -container     source: registry.redhat.io/cluster-observability- operator /cluster-observability-rhel8- operator Bundle can be installed and works well.

            Assigning to hongyli@redhat.com since we suspect this is an issue with the clusters ImageDigestMirrorSet.

            Jan Fajerski added a comment - Assigning to hongyli@redhat.com since we suspect this is an issue with the clusters ImageDigestMirrorSet.

            Ahh as prasriva@redhat.com pointed out: 
            quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc
            should really be 
            quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator-container@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc
            Mind double checking the  ImageDigestMirrorSet in the cluster?

             

            Jan Fajerski added a comment - Ahh as prasriva@redhat.com pointed out:  quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc should really be  quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator-container@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc Mind double checking the  ImageDigestMirrorSet in the cluster?  

            Just s small observation...
            The error says the image can not be found in registry.redhat.io which I think is expected, since this is not a prod release.

            However for quay.io it says unauthorized: access to the requested resource is not authorized

            Jan Fajerski added a comment - Just s small observation... The error says the image can not be found in registry.redhat.io which I think is expected, since this is not a prod release. However for quay.io it says unauthorized: access to the requested resource is not authorized . 

            Hongyan Li added a comment -

            Reproduced the issue when install with FBC image

            quay.io/redhat-user-workloads/cluster-observabilit-tenant/coo-fbc-v4-18@sha256:0ad583b73569b967fa9417757ba5b6807d0f5f49388d6dfbcfa0179118f2c1fa

            Hongyan Li added a comment - Reproduced the issue when install with FBC image quay.io/redhat-user-workloads/cluster-observabilit-tenant/coo-fbc-v4-18@sha256:0ad583b73569b967fa9417757ba5b6807d0f5f49388d6dfbcfa0179118f2c1fa

            Hongyan Li added a comment -

            Checked all the related image in csv, only quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator doesn't exist

            oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator@sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/obo-prometheus-operator-prometheus-config-reloader@sha256:f963365b89179cf463a3d0fc906c0a14595e3353bf526ae51e9e3c5c8b66c63b
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/alertmanager@sha256:04d2b403cec81e6f8bb7324573a734acc69dc2268a9f650982245021da094b3c
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/prometheus@sha256:38d2e6e18d8c22058505a35efa3387cf507af0e1aeb75f90bf0a069e42ed1d02
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/thanos@sha256:bb0b62bfde079f1c4dc638d1e8aa09269b90a2cd7581db0766983a0be881a569
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/obo-prometheus-operator-admission-webhook@sha256:d5f4a5fe2807d2b645e7067960504d7247f067067f066f232d5f6099b87c61d0
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/obo-prometheus-operator@sha256:6728a194cd7445bcbe1d531643e0b3db8c99c5c36eb07d2fda8399f60e702b3d
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/dashboards-console-plugin-0-3@sha256:16554d0dfc928e24e9259c12eecf25605d1ab17b2ca44316149b06e1a6e01e4e
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/distributed-tracing-console-plugin-0-3@sha256:1030a2735912829affd68eb59423b16810932d0c2d6f2cb2f74734979d7c23a1
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/logging-console-plugin-6-0@sha256:58651c88eec2787ebb1e438b26ded99286343eeb4388e586d9e065a67d22f19f
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/troubleshooting-panel-console-plugin-0-3@sha256:b654d2be4a6a1fac57e86743bfa8fd2e3acd45cf6d09d2ceedd312d1126f0f11 
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/monitoring-console-plugin-0-3@sha256:47145db0007979431d153c32e57694cb29c25b4901fdc743e0884cdc12d902d7
              oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/korrel8r@sha256:63a4cc85c064bfb32f7be06f598b1735881a644aa5ba5d65450dd050436cef98 

            Hongyan Li added a comment - Checked all the related image in csv, only quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability-operator doesn't exist oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/cluster-observability- operator @sha256:0cb38dad8dcd6de3ac4e023ff27575fe1a7140aa4155f631985505d6ec096fdc   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/obo-prometheus- operator -prometheus-config-reloader@sha256:f963365b89179cf463a3d0fc906c0a14595e3353bf526ae51e9e3c5c8b66c63b   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/alertmanager@sha256:04d2b403cec81e6f8bb7324573a734acc69dc2268a9f650982245021da094b3c   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/prometheus@sha256:38d2e6e18d8c22058505a35efa3387cf507af0e1aeb75f90bf0a069e42ed1d02   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/thanos@sha256:bb0b62bfde079f1c4dc638d1e8aa09269b90a2cd7581db0766983a0be881a569   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/obo-prometheus- operator -admission-webhook@sha256:d5f4a5fe2807d2b645e7067960504d7247f067067f066f232d5f6099b87c61d0   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/obo-prometheus- operator @sha256:6728a194cd7445bcbe1d531643e0b3db8c99c5c36eb07d2fda8399f60e702b3d   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/dashboards-console-plugin-0-3@sha256:16554d0dfc928e24e9259c12eecf25605d1ab17b2ca44316149b06e1a6e01e4e   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/distributed-tracing-console-plugin-0-3@sha256:1030a2735912829affd68eb59423b16810932d0c2d6f2cb2f74734979d7c23a1   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/logging-console-plugin-6-0@sha256:58651c88eec2787ebb1e438b26ded99286343eeb4388e586d9e065a67d22f19f   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/troubleshooting-panel-console-plugin-0-3@sha256:b654d2be4a6a1fac57e86743bfa8fd2e3acd45cf6d09d2ceedd312d1126f0f11   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/monitoring-console-plugin-0-3@sha256:47145db0007979431d153c32e57694cb29c25b4901fdc743e0884cdc12d902d7   oc image info quay.io/redhat-user-workloads/cluster-observabilit-tenant/korrel8r@sha256:63a4cc85c064bfb32f7be06f598b1735881a644aa5ba5d65450dd050436cef98

              hongyli@redhat.com Hongyan Li
              hongyli@redhat.com Hongyan Li
              Hongyan Li Hongyan Li
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: