Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-53245

e2e is failing with "[sig-arch] events should not repeat pathologically for ns/openshift-machine-api"

    • Important
    • Yes
    • Proposed
    • False
    • Hide

      None

      Show
      None
    • Release Note Not Required
    • In Progress

      Description of problem:

         It appears that the machine controller is posting an event for each machine reconciliation. This is resulting in failed e2e tests. It appears to have started failing some time after January 10th:
      
      https://prow.ci.openshift.org/job-history/gs/test-platform-results/pr-logs/directory/pull-ci-openshift-machine-api-provider-nutanix-main-e2e-nutanix

      Version-Release number of selected component (if applicable):

          4.19 nightly

      How reproducible:

          

      Steps to Reproduce:

      N/A    

      Actual results:

          

      Expected results:

          

      Additional info:

      https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_machine-api-provider-nutanix/90/pull-ci-openshift-machine-api-provider-nutanix-main-e2e-nutanix/1900095602138550272
      
      
      I0313 09:53:36.750335       1 controller.go:173] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: reconciling Machine
      I0313 09:53:36.750362       1 actuator.go:114] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: actuator checking if machine exists
      I0313 09:53:36.750526       1 utils.go:202] Successfully set the PrismCentral credentials to the clientOptions to create the Prism Central client.
      I0313 09:53:36.750536       1 client.go:54] To create nutanixClient with creds: (url: prismcentral.lts-cluster.in.nutanix-ci.devcluster.openshift.com:9440, insecure: false)
      I0313 09:53:36.750755       1 vm.go:635] Checking if VM with UUID d827aa2a-c7d5-4c98-9ab2-a0e4f29d7ac6 exists.
      I0313 09:53:36.922352       1 reconciler.go:256] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: vm exists
      I0313 09:53:36.922398       1 controller.go:340] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: reconciling machine triggers idempotent update
      I0313 09:53:36.922405       1 actuator.go:130] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: actuator updating machine
      I0313 09:53:36.922692       1 utils.go:202] Successfully set the PrismCentral credentials to the clientOptions to create the Prism Central client.
      I0313 09:53:36.922703       1 client.go:54] To create nutanixClient with creds: (url: prismcentral.lts-cluster.in.nutanix-ci.devcluster.openshift.com:9440, insecure: false)
      I0313 09:53:36.922973       1 reconciler.go:85] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: updating machine
      I0313 09:53:36.922990       1 vm.go:635] Checking if VM with UUID d827aa2a-c7d5-4c98-9ab2-a0e4f29d7ac6 exists.
      I0313 09:53:37.080073       1 reconciler.go:336] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: updating machine providerID
      I0313 09:53:37.080112       1 reconciler.go:292] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: ProviderID already set in the machine Spec with value: nutanix://d827aa2a-c7d5-4c98-9ab2-a0e4f29d7ac6
      I0313 09:53:37.080245       1 reconciler.go:317] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: The node "ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh" spec.providerID is already set with value: nutanix://d827aa2a-c7d5-4c98-9ab2-a0e4f29d7ac6
      W0313 09:53:37.251808       1 reconciler.go:350] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: the machine.openshift.io/region label value is 'Unnamed', due to the prism-central cluster name not being set.
      I0313 09:53:37.251833       1 reconciler.go:373] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: updated machine instance labels/annotations.
      I0313 09:53:37.251841       1 machine_scope.go:280] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: Updating providerStatus
      I0313 09:53:37.251863       1 machine_scope.go:323] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: the machine status.addresses=[{Type:InternalIP Address:10.0.200.13} {Type:InternalIP Address:169.254.0.97} {Type:InternalIP Address:169.254.0.83} {Type:InternalIP Address:169.254.0.84} {Type:InternalIP Address:169.254.0.65} {Type:InternalIP Address:169.254.0.63} {Type:InternalIP Address:10.0.203.245} {Type:InternalIP Address:169.254.0.77} {Type:InternalIP Address:169.254.0.75} {Type:InternalIP Address:169.254.0.35} {Type:InternalIP Address:169.254.0.45} {Type:InternalIP Address:169.254.0.31} {Type:InternalIP Address:169.254.0.19} {Type:InternalIP Address:169.254.0.82} {Type:InternalIP Address:169.254.0.57} {Type:InternalIP Address:169.254.0.53} {Type:InternalIP Address:169.254.0.52} {Type:InternalIP Address:169.254.0.48} {Type:InternalIP Address:169.254.0.95} {Type:InternalIP Address:169.254.0.62} {Type:InternalIP Address:169.254.0.58} {Type:InternalIP Address:169.254.0.47} {Type:InternalIP Address:169.254.0.43} {Type:InternalIP Address:169.254.0.29} {Type:InternalIP Address:169.254.0.25} {Type:InternalIP Address:169.254.0.13} {Type:InternalIP Address:169.254.0.96} {Type:InternalIP Address:169.254.0.89} {Type:InternalIP Address:169.254.0.79} {Type:InternalIP Address:169.254.0.73} {Type:InternalIP Address:169.254.0.42} {Type:InternalIP Address:169.254.0.51} {Type:InternalIP Address:169.254.0.60} {Type:InternalIP Address:169.254.0.54} {Type:InternalIP Address:169.254.0.41} {Type:InternalIP Address:169.254.0.103} {Type:InternalIP Address:169.254.0.87} {Type:InternalIP Address:169.254.0.80} {Type:InternalIP Address:169.254.0.61} {Type:InternalIP Address:169.254.0.59} {Type:InternalIP Address:169.254.0.39} {Type:InternalIP Address:169.254.0.23} {Type:InternalIP Address:169.254.0.30} {Type:InternalIP Address:169.254.0.26} {Type:InternalIP Address:169.254.0.21} {Type:InternalIP Address:169.254.0.99} {Type:InternalIP Address:169.254.0.81} {Type:InternalIP Address:169.254.0.71} {Type:InternalIP Address:169.254.0.44} {Type:InternalIP Address:169.254.0.36} {Type:InternalIP Address:169.254.0.15} {Type:InternalDNS Address:ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh} {Type:Hostname Address:ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh}].
      I0313 09:53:37.251916       1 reconciler.go:157] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: updated machine vm state
      I0313 09:53:37.251928       1 machine_scope.go:187] ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh: patching machine
      I0313 09:53:37.299264       1 recorder.go:104] "msg"="Updated Machine ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh" "logger"="events" "object"={"kind":"Machine","namespace":"openshift-machine-api","name":"ci-op-fw74qdmz-b0395-rfnrs-worker-kz6qh","uid":"785eac88-4c39-4f91-8ca0-95527b54eb3e","apiVersion":"machine.openshift.io/v1beta1","resourceVersion":"236481"} "reason"="Update" "type"="Normal"
      I031

              yanhli@redhat.com Yanhua Li
              rhn-support-rvanderp Richard Vanderpool
              Zhaohua Sun Zhaohua Sun
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated: