Uploaded image for project: 'Red Hat Advanced Cluster Management'
  1. Red Hat Advanced Cluster Management
  2. ACM-2424

Containers stuck in ImagePullBackOff because incorrect image referenced in container specs

XMLWordPrintable

    • False
    • None
    • False
    • No

      Description of problem:

      Attempting to deploy or upgrade to ACM 2.7 with observability a missing image (oauth_proxy) in the mch-image-manifest is leaving some pods stuck in ImagePullBackOff

      Version-Release number of selected component (if applicable):

      2.7.0-DOWNSTREAM-2022-12-05-13-38-35

      Hub OCP - 4.11.13

      How reproducible:

      Steps to Reproduce:

      1.  
      2.  
      3. ...

      Actual results:

      Expected results:

      Additional info:

       

      # oc get po -n open-cluster-management-observability 
      NAME                                                       READY   STATUS             RESTARTS   AGE
      observability-alertmanager-0                               3/3     Running            0          43h
      observability-alertmanager-1                               3/3     Running            0          43h
      observability-alertmanager-2                               2/3     ImagePullBackOff   0          20h
      observability-grafana-65fc6f69c8-49hpr                     3/3     Running            0          43h
      observability-grafana-65fc6f69c8-fj6b6                     3/3     Running            0          43h
      observability-grafana-6b6b755889-z7m6w                     2/3     ImagePullBackOff   0          20h
      observability-observatorium-api-5fbf484665-ndc4x           1/1     Running            0          20h
      observability-observatorium-api-5fbf484665-x9tf4           1/1     Running            0          20h
      observability-observatorium-operator-6fc8ffff8d-bmwp9      1/1     Running            0          20h
      observability-rbac-query-proxy-665f474564-qd2kt            1/2     ImagePullBackOff   0          20h
      observability-rbac-query-proxy-8685795844-cdvhb            2/2     Running            0          20h
      observability-rbac-query-proxy-8685795844-jnfqx            2/2     Running            0          20h
      observability-thanos-compact-0                             1/1     Running            0          20h
      observability-thanos-query-68678465f5-5xtlt                1/1     Running            0          20h
      observability-thanos-query-68678465f5-w9xrq                1/1     Running            0          20h
      observability-thanos-query-frontend-7cd9cc4f4b-6r4ts       1/1     Running            0          20h
      observability-thanos-query-frontend-7cd9cc4f4b-w6f97       1/1     Running            0          20h
      observability-thanos-query-frontend-memcached-0            2/2     Running            0          20h
      observability-thanos-query-frontend-memcached-1            2/2     Running            0          20h
      observability-thanos-query-frontend-memcached-2            2/2     Running            0          20h
      observability-thanos-receive-controller-7dc6cdbd8f-jmzzd   1/1     Running            0          20h
      observability-thanos-receive-default-0                     1/1     Running            0          20h
      observability-thanos-receive-default-1                     1/1     Running            0          20h
      observability-thanos-receive-default-2                     1/1     Running            0          20h
      observability-thanos-rule-0                                2/2     Running            0          20h
      observability-thanos-rule-1                                2/2     Running            0          20h
      observability-thanos-rule-2                                2/2     Running            0          20h
      observability-thanos-store-memcached-0                     2/2     Running            0          20h
      observability-thanos-store-memcached-1                     2/2     Running            0          20h
      observability-thanos-store-memcached-2                     2/2     Running            0          20h
      observability-thanos-store-shard-0-0                       1/1     Running            0          20h
      observability-thanos-store-shard-1-0                       1/1     Running            0          20h
      observability-thanos-store-shard-2-0                       1/1     Running            0          20h
      
      
      

       

      For some unknown reason the images seem to be defaulting to a quay.io image:

      oc get deploy -n open-cluster-management-observability observability-grafana -o yaml | grep "image: "
              image: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-grafana-rhel8@sha256:b0df25d64089abfe04c86bec631c631c8b6212bc0edc741d8dd152a7db4a669a
              image: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/grafana-dashboard-loader-rhel8@sha256:064aac081f2e1c16225e8fde8a975a6aab6f8a9361e992d0dca8958a074196ba
              image: quay.io/stolostron/origin-oauth-proxy:4.5
      # oc get deploy -n open-cluster-management-observability observability-rbac-query-proxy -o yaml | grep "image: "
              image: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/rbac-query-proxy-rhel8@sha256:442ff99f3bd7029f1ecd702fa4b19e7ddc21beb19ce28ef195b59221a684a445
              image: quay.io/stolostron/origin-oauth-proxy:4.5
      # oc get sts -n open-cluster-management-observability observability-alertmanager -o yaml | grep "image: "
              image: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/prometheus-alertmanager-rhel8@sha256:1c19dab28e3db4c5275d76d96ed387deb63f5f45404a18e6f83c56076759f366
              image: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/ose-configmap-reloader@sha256:a8463accd3b01ff25023973f29f538d3273b1f50156b2b84c3a8894f1b89fc43
              image: quay.io/stolostron/origin-oauth-proxy:4.5

       

       

      The mch-image-manifest:

       

      # oc get cm -n open-cluster-management mch-image-manifest-2.7.0 -o yaml
      apiVersion: v1
      data:
        acm_must_gather: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-must-gather-rhel8@sha256:5c53d2c57a81f8aa0bec126165bb4fffa1cfcf5ab1780d8699711e8df614fa3d
        cert_policy_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/cert-policy-controller-rhel8@sha256:08313238d63d38870d6b0c189b97b947e7ea694b0a83d69a1bcbf2857690fa13
        cluster_backup_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/cluster-backup-rhel8-operator@sha256:ea5cdc4ef59eb70d1cbc087917b6977bbfc080b05b590d6406eeec2ac66fe9b0
        config_policy_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/config-policy-controller-rhel8@sha256:83a0b1e570feeb4157b4bbaec8b9c23df4e07d83d86837837c4de25e2a07378b
        console: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/console-rhel8@sha256:c38a62448a9267133d2ac09b41dd21d3f72468ef14380a7d46ee5e3c0f8c370d
        endpoint_monitoring_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/endpoint-monitoring-rhel8-operator@sha256:b5da7070d7102768b419b2f5729aead96733280b5503924d2ece949e14f5ec2e
        governance_policy_addon_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-governance-policy-addon-controller-rhel8@sha256:fe2aa5e191e0696562ab2043f4866eb626ecb475b89d74cfb2c38d5b597a0ac6
        governance_policy_framework_addon: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-governance-policy-framework-addon-rhel8@sha256:631f7d07d86903feb10472dabc46300677a4b506780394adf805c666f95e38d3
        governance_policy_propagator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/governance-policy-propagator-rhel8@sha256:0844a4efc9d0f325e5047408cd7f94931f6ff0feac505a56bd7dd0bbcc7766b2
        grafana: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-grafana-rhel8@sha256:b0df25d64089abfe04c86bec631c631c8b6212bc0edc741d8dd152a7db4a669a
        grafana_dashboard_loader: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/grafana-dashboard-loader-rhel8@sha256:064aac081f2e1c16225e8fde8a975a6aab6f8a9361e992d0dca8958a074196ba
        iam_policy_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/iam-policy-controller-rhel8@sha256:fa7f32e8929916ac6b3a0278429a045b0efb65bd6cdfa58c71e0e97fd8f1c4ef
        insights_client: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/insights-client-rhel8@sha256:6d8e2705a04107186418a192a6e2c154339e5c8150009ffd42170da829a1ce27
        insights_metrics: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/insights-metrics-rhel8@sha256:041970b1c3f8a5600af3f34cda38dc2efe7767e1ca3bdddf8aaa8cdf13b8fdeb
        klusterlet_addon_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/klusterlet-addon-controller-rhel8@sha256:4429e01e87882a0f2459179d67abb0ae9b7ae0d80ec2fc75ae2621f575cafd58
        kube_rbac_proxy: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/kube-rbac-proxy-rhel8@sha256:7770eae62bc1bab55ed13dbbc5256aa700a8bb9874ffe1c88b1cb33ebf8ec6c7
        kube_state_metrics: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/kube-state-metrics-rhel8@sha256:bad9c73fbf527b862df0732cd387780f0c1fcad3f34dfa8ffc87f304d8b1b00a
        management_ingress: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/management-ingress-rhel8@sha256:297f1f4815fdad4489846355bcc19b21c2a0b39869432db34a01caf7d19f5478
        memcached: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/memcached-rhel8@sha256:73a59205610e707467a8de362fc908dc25f8e415c1e6e3220252bb1f744daf2c
        memcached_exporter: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/memcached-exporter-rhel8@sha256:8e837dc2546d6a0595def500694eff51eb658c7948b077f54f9d0ccb5b3aa16a
        metrics_collector: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/metrics-collector-rhel8@sha256:f3a771f68a2a9936c091a3ad4b694b2d0a904dde6a57b9e8ed32933f2d5acd8a
        multicloud_integrations: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multicloud-integrations-rhel8@sha256:94c7eee439d9444d8d3c77b9280903aaf15e0526e12ba52a34c6f253a4e7c73d
        multicluster_observability_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multicluster-observability-rhel8-operator@sha256:579ad367dfa1f7da827d28b7976a02d21a895aa3b0d2ec74c98cda46c41d1ca4
        multicluster_operators_application: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multicluster-operators-application-rhel8@sha256:a8d998ac0d045bf072125529be9aaf1e8590848cdc4899e85ae5d70726d35c17
        multicluster_operators_channel: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multicluster-operators-channel-rhel8@sha256:fa6243ae5ef22150d0e8a4ee445dd504f9ce29ed1161017baf43cdb44f840713
        multicluster_operators_subscription: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multicluster-operators-subscription-rhel8@sha256:ee89857db84a671676d74c4133eca976354fccf576fab1a04f21072f1d900042
        multiclusterhub_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multiclusterhub-rhel8@sha256:e6eb95ebd7ae870e6a3063b081343edf2c9e371e2e546558570790fa73d95e45
        multiclusterhub_repo: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multiclusterhub-repo-rhel8@sha256:6d815b6b54c581bc13a23b33e089ac9ce734a75a0046946d848236ab5c77a697
        node_exporter: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/node-exporter-rhel8@sha256:114098939484b67e3b0f1ca7973e46cf5b184e0db21f408e1f386f06db42c22d
        oauth_proxy_48: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/ose-oauth-proxy@sha256:9221482cdee0e989f2f8211ae0cb8aede828cee2e5aed3776b5a773d12910d47
        oauth_proxy_49_and_up: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/ose-oauth-proxy@sha256:e94ab35f4e71b6b91b1c00381446588ccc7d075c3e5e6ab2362b9efa5f987fe9
        observatorium: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/observatorium-rhel8@sha256:aa3685113ca97fdb1a0a5cdd7db7aa44efd2acd82d1f71180061105c809a9149
        observatorium_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/observatorium-rhel8-operator@sha256:90a2c00c893f9cb303dc53261108da7f6da604febbea22f3a5cb3e8955ba83d9
        postgresql_13: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/postgresql-13@sha256:826a1a75f4186f36217b5c1f1aa270838c4b55b1021d33a4876566bfc3b8e629
        prometheus: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/prometheus-rhel8@sha256:cbbd5fc3368cc9923ee598a1b3df780e259c0692acd2f86acc5ac932f7064714
        prometheus-alertmanager: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/ose-prometheus-alertmanager@sha256:6a6356ed2f670802e0a0e27fe00cd59378eb62a2966baa828a8ac86fe7efc29b
        prometheus-config-reloader: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/ose-configmap-reloader@sha256:a8463accd3b01ff25023973f29f538d3273b1f50156b2b84c3a8894f1b89fc43
        prometheus_alertmanager: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/prometheus-alertmanager-rhel8@sha256:1c19dab28e3db4c5275d76d96ed387deb63f5f45404a18e6f83c56076759f366
        prometheus_config_reloader: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-prometheus-config-reloader-rhel8@sha256:62912fe514fe49a4aba1f6522fb2722f3d3d2ab4039a2396990bb7174e5af1ab
        prometheus_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-prometheus-rhel8@sha256:30b989219e460a74f6e312ca904ac1dbdf6079f0c18bda6aeb4f26d4fd64c4c3
        rbac_query_proxy: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/rbac-query-proxy-rhel8@sha256:442ff99f3bd7029f1ecd702fa4b19e7ddc21beb19ce28ef195b59221a684a445
        search_collector: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/search-collector-rhel8@sha256:c85f1fb730c43924b902426d1d718e9f1c540d2fd907dbad39c5808ff9d0dd86
        search_indexer: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-search-indexer-rhel8@sha256:b9ea10ab205408ce3fa896c7bd3d8b3abfd806ad0bde0cc3524a263426361f06
        search_v2_api: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-search-v2-api-rhel8@sha256:b187433676c4a947879092968b52cde5a72541f22257de978963469fcd2e08bf
        search_v2_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-search-v2-rhel8@sha256:8054e9acdcf0a80eb572367a18c673420fc2565993bd351768fd7e65abbcf022
        submariner_addon: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/submariner-addon-rhel8@sha256:2713c7cd633f0dadbc408043f9d6042473967aa41e10548a3fae6fea94e56acd
        thanos: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/thanos-rhel8@sha256:8ecb2c076f979bd3063c68d8b48d8d2ef48b12178b93603fbd8d149e3c5a995f
        thanos_receive_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/thanos-receive-controller-rhel8@sha256:133faadcf2cb4a6ddfb315d0b308581c5190e89af07c01b183ecb1bb81308508
        volsync_addon_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-volsync-addon-controller-rhel8@sha256:42920630081338d939841d5b659a6aa78f817df581dcb3236788b6c5fce61544
      kind: ConfigMap
      metadata:
        creationTimestamp: "2022-12-14T00:26:51Z"
        labels:
          ocm-configmap-type: image-manifest
          ocm-release-version: 2.7.0
        name: mch-image-manifest-2.7.0
        namespace: open-cluster-management
        ownerReferences:
        - apiVersion: operator.open-cluster-management.io/v1
          blockOwnerDeletion: true
          controller: true
          kind: MultiClusterHub
          name: multiclusterhub
          uid: 3a944f20-0ffb-41d6-91c5-fd254b573a85
        resourceVersion: "3969053"
        uid: a6014136-5180-402f-85b9-41e7c72d2afe

      And a 2.6.3 image manifest showing the missing image:

      # oc get cm -n open-cluster-management mch-image-manifest-2.6.3 -o yaml
      apiVersion: v1
      data:
        acm_must_gather: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-must-gather-rhel8@sha256:4feacf780c567a7b74d8f574e880535aaeed4254a0bbb0eb606e7209f9b4470c
        cert_policy_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/cert-policy-controller-rhel8@sha256:e2e5c2574a1dbbb01f5ed6dcb2538fa0a2fbed378cdb708d3301aa04f0de56c5
        cluster_backup_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/cluster-backup-rhel8-operator@sha256:dd5601172a1817799225f85a393cb2713e5845ff1c34a93e8f1f92afd67e8f5f
        config_policy_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/config-policy-controller-rhel8@sha256:e34003b8d0452d3d822affc48adeeb08e2db6c1c95bc175344bf4d7bc2d7d435
        console: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/console-rhel8@sha256:2d25540ad64fcd582a67dbfcd10f7f36335ff24fe781589448a2e551004a08e0
        endpoint_monitoring_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/endpoint-monitoring-rhel8-operator@sha256:d6307acbd9bae3c437f97d21e33a01ad5a08091757c261ecc5c7f005515d3e3c
        governance_policy_addon_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-governance-policy-addon-controller-rhel8@sha256:1f71389d904b068b527dcd5212308618289a987f88c55f324d3636408343fc7e
        governance_policy_propagator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/governance-policy-propagator-rhel8@sha256:1ee8255ee457ef9a26d0ff4e24e9675a5fdd8437eb7b267a6b5c0a2fccc0d2db
        governance_policy_spec_sync: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/governance-policy-spec-sync-rhel8@sha256:96695926c885ef72ad52d5aec7923d0e18b16bc34489d2da393af3474d4c717c
        governance_policy_status_sync: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/governance-policy-status-sync-rhel8@sha256:247a6e141080f02befe7d4d5da58f4bba9ece3f3db9bf4c54333f218759b2c3e
        governance_policy_template_sync: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/governance-policy-template-sync-rhel8@sha256:c596660eb8ceccf6358e52aa654f9b7fb7169c6a89b44261603c4803a663d05a
        grafana: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-grafana-rhel8@sha256:d3a0865d5e50c008774e4c3fdbff22a200caa9aacc1abb92e56dec0d621ca627
        grafana_dashboard_loader: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/grafana-dashboard-loader-rhel8@sha256:72e7ed24c9d6565bf7eaf9a8f32ae6bc217b607c0cb6ad33688d343a06de2646
        iam_policy_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/iam-policy-controller-rhel8@sha256:3a75560eda558a1f973d106fed0938d8a62125880472acbf09ad85b4281097cf
        insights_client: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/insights-client-rhel8@sha256:352d58ad584d578268acd5c09f7471bbeef8297683a4c35ec7ecb3337218cc0b
        insights_metrics: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/insights-metrics-rhel8@sha256:b4b0493cc3fb7abdb50c1166405bf0e938e099030be30af32e7d505ef443d91a
        klusterlet_addon_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/klusterlet-addon-controller-rhel8@sha256:b4cd2c54d6d7026b52f096321cad2aa48409e489f48e6871cdf49ff16d371119
        kube_rbac_proxy: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/kube-rbac-proxy-rhel8@sha256:ce5454974afd2e8f0407f708741ffd2eeec42e982b85d63fc24781e45cb5fc90
        kube_state_metrics: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/kube-state-metrics-rhel8@sha256:53859ab3312ccaa3dc32cbc57249f0d1057b7ed0c42668013ad17282cd7c4145
        management_ingress: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/management-ingress-rhel8@sha256:d5f02a1abf0d674f316bb38314b31ad58b4878efa694dbd5148eb607a29d7418
        memcached: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/memcached-rhel8@sha256:7f63e73821448eaf6eeb448ceaf5d2ae8c36e4175dd9d0f0ee844de14a5dd5a9
        memcached_exporter: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/memcached-exporter-rhel8@sha256:01d84f5e6ea3d16532a41175b07d9c3762174aa01df77543b08c9a20e04df67c
        metrics_collector: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/metrics-collector-rhel8@sha256:ec53eecda122a7f3cfdf11beadaf7103e0b3d1613bc1015919b927a7b3ec3bd6
        multicloud_integrations: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multicloud-integrations-rhel8@sha256:7c1fd8daf6a6084c211e69f09514f3f1598e4c9655a5320ba7b435760bde779d
        multicluster_observability_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multicluster-observability-rhel8-operator@sha256:2a1d3c99e46c11e14a14ff5a346c8c58b6260cb294aae766b660eadf4441514c
        multicluster_operators_application: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multicluster-operators-application-rhel8@sha256:6c7e100620aa97d1a51b6ecdd7d2793577b330cfcad6616cf87a8d1f0ed43837
        multicluster_operators_channel: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multicluster-operators-channel-rhel8@sha256:9f69a77f67f3b75e8aa1c405c3b8f8d902839e2a6ff0231dbc3593b3efba9a7b
        multicluster_operators_subscription: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multicluster-operators-subscription-rhel8@sha256:22395156bb212d712c9a0ff8fce27dcc4dafd5f0469b269660d2414b2a45dbb2
        multiclusterhub_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multiclusterhub-rhel8@sha256:2ad02ccd2d4995d4780619e6277a8f9153917629c70b2d26021544232ac51118
        multiclusterhub_repo: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/multiclusterhub-repo-rhel8@sha256:693dfc398ab450917130859bfa3df1f5b1fef4c39386541a4d405b6378c4d1b1
        node_exporter: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/node-exporter-rhel8@sha256:a1b602485a7ebbe870c650c0c3a1b2afcb3200583b9313487ac08f7d5ab4019d
        oauth_proxy: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/ose-oauth-proxy@sha256:e94ab35f4e71b6b91b1c00381446588ccc7d075c3e5e6ab2362b9efa5f987fe9
        oauth_proxy_48: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/ose-oauth-proxy@sha256:9221482cdee0e989f2f8211ae0cb8aede828cee2e5aed3776b5a773d12910d47
        oauth_proxy_49_and_up: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/ose-oauth-proxy@sha256:e94ab35f4e71b6b91b1c00381446588ccc7d075c3e5e6ab2362b9efa5f987fe9
        observatorium: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/observatorium-rhel8@sha256:bc52f893575739c1e7702216dd291013f9dcf9088dbcae1437e32b5d7698b190
        observatorium_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/observatorium-rhel8-operator@sha256:7cd305f9abeebe5a3b4ae2caa71479de7f4d517f041b77984dae5b42c5c93b87
        postgresql_13: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/postgresql-13@sha256:fd88f0893f0ee293319a2dadb8df5e41a1bad127ba1ec3ad6a7aca09b04094d8
        prometheus: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/prometheus-rhel8@sha256:56eb0fe5ce071825279b472c9252e1825df9abf4dc782566352c41894c4b5bb1
        prometheus-alertmanager: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/ose-prometheus-alertmanager@sha256:6a6356ed2f670802e0a0e27fe00cd59378eb62a2966baa828a8ac86fe7efc29b
        prometheus-config-reloader: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/ose-configmap-reloader@sha256:a8463accd3b01ff25023973f29f538d3273b1f50156b2b84c3a8894f1b89fc43
        prometheus_alertmanager: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/prometheus-alertmanager-rhel8@sha256:68a8d5c72d7dbe25e3644be98b20a46b9df3542452cd195161c702bfd0abfd4d
        prometheus_config_reloader: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-prometheus-config-reloader-rhel8@sha256:11ba8a61c906875946e769e08e59a6f20fb6e08020eecd3a04e5b1392e957d9d
        prometheus_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-prometheus-rhel8@sha256:8d44815df5d079fa6a450af6f8821c7da943119c741e74b99fa670e00e2b7098
        rbac_query_proxy: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/rbac-query-proxy-rhel8@sha256:00616c7588855e865eb57968938f52df02638453723a19520fe550600803a210
        redisgraph_tls: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/redisgraph-tls-rhel8@sha256:52c897e7f34ccb7726d3841c1ca7f7ab3a9b1400c88cff97f1d90c2a9be5fa78
        search_aggregator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/search-aggregator-rhel8@sha256:43fe3aca09708b7686c9e4f46e2f13e2a2e180416de8da2c596c2d6b7ce31428
        search_api: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/search-api-rhel8@sha256:ceca567d36630496e43a1c4ba7ef0e3fc1fec77be512575953fa06ebf90c41ce
        search_collector: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/search-collector-rhel8@sha256:7437276bcc44a83ea2ff20e04cc99dd6ccb5a23728e3052df504f6ff416f8090
        search_operator: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/search-rhel8@sha256:82ce922b76ebd63d9676b0589a5547576007eae514d91405474fa04cee47dede
        submariner_addon: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/submariner-addon-rhel8@sha256:c9e769f7636ec1688d5882450bd8e1eb55d65f14687f2f4b939b60798d3c704b
        thanos: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/thanos-rhel8@sha256:13a17b3a266aa67ecbe927e8bd19e8b61c8225bd18e68049d531f3b2230842f6
        thanos_receive_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/thanos-receive-controller-rhel8@sha256:4130431ca226f3b50c47cd90b688efb661df220c31115d9f7d32afa10555faee
        volsync_addon_controller: e40-h29-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-volsync-addon-controller-rhel8@sha256:90374ee7580cf111d771bfaa76620e44cc0ba53538ca1fdd57f8ce04427156a8
      kind: ConfigMap
      metadata:
        creationTimestamp: "2022-12-13T01:24:22Z"
        labels:
          ocm-configmap-type: image-manifest
          ocm-release-version: 2.6.3
        name: mch-image-manifest-2.6.3
        namespace: open-cluster-management
        ownerReferences:
        - apiVersion: operator.open-cluster-management.io/v1
          blockOwnerDeletion: true
          controller: true
          kind: MultiClusterHub
          name: multiclusterhub
          uid: 3a944f20-0ffb-41d6-91c5-fd254b573a85
        resourceVersion: "83777"
        uid: 01caefef-fa2e-421b-9976-7a7dcb46a766
      

       

       

            llan@redhat.com Ling Lan
            akrzos@redhat.com Alex Krzos
            Xiang Yin Xiang Yin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: