Uploaded image for project: 'OpenShift SDN'
  1. OpenShift SDN
  2. SDN-2991

failure in alerts test case for KubePodNotReady firing on openshift-network-diagnostics

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Normal
    • None
    • None
    • None
    • SDN Sprint 218, SDN Sprint 219, SDN Sprint 220, SDN Sprint 221, SDN Sprint 222
    • 0
    • 0

    Description

      job link

      must-gather

      log snippet from e2e log:

      [It] shouldn't report any unexpected alerts in firing or pending state [Suite:openshift/conformance/parallel]
        github.com/openshift/origin/test/extended/prometheus/prometheus.go:270
      Apr 23 17:12:50.267: INFO: Alerts were detected during test run which are allowed:
      
      alert KubePodNotReady fired for 10 seconds with labels: {namespace="openshift-e2e-loki", pod="loki-promtail-8kh25", severity="warning"} (allowed: Loki is nice to have, but we can allow it to be down)
      Apr 23 17:12:50.267: FAIL: Unexpected alerts fired or pending after the test run:
      
      alert KubePodNotReady fired for 10 seconds with labels: {namespace="openshift-network-diagnostics", pod="network-check-target-6kqlg", severity="warning"}
      
      Full Stack Trace
      github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc0000001a0)
      	github.com/onsi/ginkgo@v4.7.0-origin.0+incompatible/internal/leafnodes/runner.go:113 +0xba
      github.com/onsi/ginkgo/internal/leafnodes.(*runner).run(0xc00308eea0)
      	github.com/onsi/ginkgo@v4.7.0-origin.0+incompatible/internal/leafnodes/runner.go:64 +0x125
      github.com/onsi/ginkgo/internal/leafnodes.(*ItNode).Run(0x7f23560a1fff)
      	github.com/onsi/ginkgo@v4.7.0-origin.0+incompatible/internal/leafnodes/it_node.go:26 +0x7b
      github.com/onsi/ginkgo/internal/spec.(*Spec).runSample(0xc0027cf2c0, 0xc00308f268, {0x8c6fc00, 0xc000468c00})
      	github.com/onsi/ginkgo@v4.7.0-origin.0+incompatible/internal/spec/spec.go:215 +0x2a9
      github.com/onsi/ginkgo/internal/spec.(*Spec).Run(0xc0027cf2c0, {0x8c6fc00, 0xc000468c00})
      	github.com/onsi/ginkgo@v4.7.0-origin.0+incompatible/internal/spec/spec.go:138 +0xe7
      github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpec(0xc003826000, 0xc0027cf2c0)
      	github.com/onsi/ginkgo@v4.7.0-origin.0+incompatible/internal/specrunner/spec_runner.go:200 +0xe5
      github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpecs(0xc003826000)
      	github.com/onsi/ginkgo@v4.7.0-origin.0+incompatible/internal/specrunner/spec_runner.go:170 +0x1a5
      github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run(0xc003826000)
      	github.com/onsi/ginkgo@v4.7.0-origin.0+incompatible/internal/specrunner/spec_runner.go:66 +0xc5
      github.com/onsi/ginkgo/internal/suite.(*Suite).Run(0xc000502000, {0x8c6ff20, 0xc0022525a0}, {0x0, 0x25f3c9b}, {0xc001436bf0, 0x1, 0x1}, {0x8d851f8, 0xc000468c00}, ...)
      	github.com/onsi/ginkgo@v4.7.0-origin.0+incompatible/internal/suite/suite.go:62 +0x4b2
      github.com/openshift/origin/pkg/test/ginkgo.(*TestOptions).Run(0xc00238bb90, {0xc00165cb90, 0xc640430, 0x484ebe0})
      	github.com/openshift/origin/pkg/test/ginkgo/cmd_runtest.go:61 +0x3be
      main.newRunTestCommand.func1.1()
      	github.com/openshift/origin/cmd/openshift-tests/openshift-tests.go:434 +0x32
      github.com/openshift/origin/test/extended/util.WithCleanup(0xc00221fc18)
      	github.com/openshift/origin/test/extended/util/test.go:168 +0xad
      main.newRunTestCommand.func1(0xc000a1f180, {0xc00165cb90, 0x1, 0x1})
      	github.com/openshift/origin/cmd/openshift-tests/openshift-tests.go:434 +0x349
      github.com/spf13/cobra.(*Command).execute(0xc000a1f180, {0xc00165cb30, 0x1, 0x1})
      	github.com/spf13/cobra@v1.2.1/command.go:856 +0x60e
      github.com/spf13/cobra.(*Command).ExecuteC(0xc000015180)
      	github.com/spf13/cobra@v1.2.1/command.go:974 +0x3bc
      github.com/spf13/cobra.(*Command).Execute(...)
      	github.com/spf13/cobra@v1.2.1/command.go:902
      main.main.func1(0xc0009ca600)
      	github.com/openshift/origin/cmd/openshift-tests/openshift-tests.go:84 +0x8a
      main.main()
      	github.com/openshift/origin/cmd/openshift-tests/openshift-tests.go:85 +0x3b6
      [AfterEach] [sig-instrumentation][Late] Alerts
        github.com/openshift/origin/test/extended/util/client.go:151
      [AfterEach] [sig-instrumentation][Late] Alerts
        github.com/openshift/origin/test/extended/util/client.go:152
      fail [github.com/onsi/ginkgo@v4.7.0-origin.0+incompatible/internal/leafnodes/runner.go:113]: Apr 23 17:12:50.267: Unexpected alerts fired or pending after the test run:
      
      alert KubePodNotReady fired for 10 seconds with labels: {namespace="openshift-network-diagnostics", pod="network-check-target-6kqlg", severity="warning"}
      
      failed: (2.1s) 2022-04-23T17:12:50 "[sig-instrumentation][Late] Alerts shouldn't report any unexpected alerts in firing or pending state [Suite:openshift/conformance/parallel]"
      

      link to this job's testgrid for reference.

       

      Attachments

        Activity

          People

            bpickard@redhat.com Ben Pickard
            jluhrsen Jamo Luhrsen
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: