Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-50587

Component Readiness: [Etcd] [operator-conditions] test regressed

XMLWordPrintable

    • Critical
    • None
    • Rejected
    • False
    • Hide

      None

      Show
      None

      (Feel free to update this bug's summary to be more specific.)
      Component Readiness has found a potential regression in the following test:

      operator conditions etcd

      Significant regression detected.
      Fishers Exact probability of a regression: 100.00%.
      Test pass rate dropped from 99.72% to 93.55%.

      Sample (being evaluated) Release: 4.18
      Start Time: 2025-02-04T00:00:00Z
      End Time: 2025-02-11T16:00:00Z
      Success Rate: 93.55%
      Successes: 87
      Failures: 6
      Flakes: 0

      Base (historical) Release: 4.17
      Start Time: 2024-09-01T00:00:00Z
      End Time: 2024-10-01T23:59:59Z
      Success Rate: 99.72%
      Successes: 355
      Failures: 1
      Flakes: 0

      View the test details report for additional context.

      The issue is currently being discussed via https://redhat-internal.slack.com/archives/C01CQA76KMX/p1739211100312459. It seems to specifically impact periodic-ci-openshift-cluster-control-plane-machine-set-operator-release-4.18-periodics-e2e-azure jobs which in part change instances / instance types during the job and appears to be impacting static pods.

      4.19 Test Analysis

      4.18 Test Analysis

            [OCPBUGS-50587] Component Readiness: [Etcd] [operator-conditions] test regressed

            Forrest Babcock created issue -
            Forrest Babcock made changes -
            QA Contact New: Ge Liu [ geliu ]
            OpenShift Jira Bot made changes -
            Release Blocker New: Proposed [ 25756 ]
            Dean West made changes -
            Assignee Original: Dean West [ dwest@redhat.com ] New: Ben Luddy [ bluddy ]
            Dean West made changes -
            Labels Original: component-regression New: component-regression rits-work
            Wallace Lewis made changes -
            Priority Original: Normal [ 10200 ] New: Critical [ 2 ]
            David Eads made changes -
            Release Blocker Original: Proposed [ 25756 ] New: Rejected [ 25757 ]
            Wallace Lewis made changes -
            Status Original: New [ 10016 ] New: ASSIGNED [ 14452 ]
            Ben Luddy made changes -
            Target Version New: 4.19.0 [ 12436719 ]
            Ben Luddy made changes -
            Target Backport Versions New: 4.18.z [ 12431398 ]
            Ben Luddy made changes -
            Description Original: (_Feel free to update this bug's summary to be more specific._)
            Component Readiness has found a potential regression in the following test:

            {code:none}operator conditions etcd{code}

            Significant regression detected.
            Fishers Exact probability of a regression: 100.00%.
            Test pass rate dropped from 99.72% to 93.55%.

            Sample (being evaluated) Release: 4.18
            Start Time: 2025-02-04T00:00:00Z
            End Time: 2025-02-11T16:00:00Z
            Success Rate: 93.55%
            Successes: 87
            Failures: 6
            Flakes: 0

            Base (historical) Release: 4.17
            Start Time: 2024-09-01T00:00:00Z
            End Time: 2024-10-01T23:59:59Z
            Success Rate: 99.72%
            Successes: 355
            Failures: 1
            Flakes: 0

            View the [test details report|https://sippy.dptools.openshift.org/sippy-ng/component_readiness/test_details?Aggregation=none&Architecture=amd64&Architecture=amd64&FeatureSet=default&FeatureSet=default&Installer=ipi&Installer=ipi&LayeredProduct=none&Network=ovn&Network=ovn&NetworkAccess=default&Platform=azure&Platform=azure&Procedure=none&Scheduler=default&SecurityMode=default&Suite=unknown&Suite=unknown&Topology=ha&Topology=ha&Upgrade=none&Upgrade=none&baseEndTime=2024-10-01%2023%3A59%3A59&baseRelease=4.17&baseStartTime=2024-09-01%2000%3A00%3A00&capability=operator-conditions&columnGroupBy=Architecture%2CNetwork%2CPlatform%2CTopology&component=Etcd&confidence=95&dbGroupBy=Platform%2CArchitecture%2CNetwork%2CTopology%2CFeatureSet%2CUpgrade%2CSuite%2CInstaller&environment=amd64%20default%20ipi%20ovn%20azure%20unknown%20ha%20none&flakeAsFailure=false&ignoreDisruption=true&ignoreMissing=false&includeMultiReleaseAnalysis=false&includeVariant=Architecture%3Aamd64&includeVariant=CGroupMode%3Av2&includeVariant=ContainerRuntime%3Acrun&includeVariant=ContainerRuntime%3Arunc&includeVariant=FeatureSet%3Adefault&includeVariant=Installer%3Aipi&includeVariant=Installer%3Aupi&includeVariant=Network%3Aovn&includeVariant=Owner%3Aeng&includeVariant=Platform%3Aaws&includeVariant=Platform%3Aazure&includeVariant=Platform%3Agcp&includeVariant=Platform%3Ametal&includeVariant=Platform%3Avsphere&includeVariant=Topology%3Aha&includeVariant=Topology%3Amicroshift&minFail=3&passRateAllTests=0&passRateNewTests=95&pity=5&sampleEndTime=2025-02-11%2023%3A59%3A59&sampleRelease=4.18&sampleStartTime=2025-02-04%2000%3A00%3A00&testBasisRelease=4.17&testId=Operator%20results%3A45d55df296fbbfa7144600dce70c1182&testName=operator%20conditions%20etcd] for additional context.
                        

            The issue is currently being discussed via https://redhat-internal.slack.com/archives/C01CQA76KMX/p1739211100312459. It seems to specifically impact [periodic-ci-openshift-cluster-control-plane-machine-set-operator-release-4.18-periodics-e2e-azure|https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-cluster-control-plane-machine-set-operator-release-4.18-periodics-e2e-azure/1889194576401403904] jobs which in part change instances / instance types during the job and appears to be impacting static pods.             		New: ({_}Feel free to update this bug's summary to be more specific.{_})
            Component Readiness has found a potential regression in the following test:
            {code:none}
            operator conditions etcd{code}
            Significant regression detected.
            Fishers Exact probability of a regression: 100.00%.
            Test pass rate dropped from 99.72% to 93.55%.

            Sample (being evaluated) Release: 4.18
            Start Time: 2025-02-04T00:00:00Z
            End Time: 2025-02-11T16:00:00Z
            Success Rate: 93.55%
            Successes: 87
            Failures: 6
            Flakes: 0

            Base (historical) Release: 4.17
            Start Time: 2024-09-01T00:00:00Z
            End Time: 2024-10-01T23:59:59Z
            Success Rate: 99.72%
            Successes: 355
            Failures: 1
            Flakes: 0

            View the [test details report|https://sippy.dptools.openshift.org/sippy-ng/component_readiness/test_details?Aggregation=none&Architecture=amd64&Architecture=amd64&FeatureSet=default&FeatureSet=default&Installer=ipi&Installer=ipi&LayeredProduct=none&Network=ovn&Network=ovn&NetworkAccess=default&Platform=azure&Platform=azure&Procedure=none&Scheduler=default&SecurityMode=default&Suite=unknown&Suite=unknown&Topology=ha&Topology=ha&Upgrade=none&Upgrade=none&baseEndTime=2024-10-01%2023%3A59%3A59&baseRelease=4.17&baseStartTime=2024-09-01%2000%3A00%3A00&capability=operator-conditions&columnGroupBy=Architecture%2CNetwork%2CPlatform%2CTopology&component=Etcd&confidence=95&dbGroupBy=Platform%2CArchitecture%2CNetwork%2CTopology%2CFeatureSet%2CUpgrade%2CSuite%2CInstaller&environment=amd64%20default%20ipi%20ovn%20azure%20unknown%20ha%20none&flakeAsFailure=false&ignoreDisruption=true&ignoreMissing=false&includeMultiReleaseAnalysis=false&includeVariant=Architecture%3Aamd64&includeVariant=CGroupMode%3Av2&includeVariant=ContainerRuntime%3Acrun&includeVariant=ContainerRuntime%3Arunc&includeVariant=FeatureSet%3Adefault&includeVariant=Installer%3Aipi&includeVariant=Installer%3Aupi&includeVariant=Network%3Aovn&includeVariant=Owner%3Aeng&includeVariant=Platform%3Aaws&includeVariant=Platform%3Aazure&includeVariant=Platform%3Agcp&includeVariant=Platform%3Ametal&includeVariant=Platform%3Avsphere&includeVariant=Topology%3Aha&includeVariant=Topology%3Amicroshift&minFail=3&passRateAllTests=0&passRateNewTests=95&pity=5&sampleEndTime=2025-02-11%2023%3A59%3A59&sampleRelease=4.18&sampleStartTime=2025-02-04%2000%3A00%3A00&testBasisRelease=4.17&testId=Operator%20results%3A45d55df296fbbfa7144600dce70c1182&testName=operator%20conditions%20etcd] for additional context.

            The issue is currently being discussed via [https://redhat-internal.slack.com/archives/C01CQA76KMX/p1739211100312459]. It seems to specifically impact [periodic-ci-openshift-cluster-control-plane-machine-set-operator-release-4.18-periodics-e2e-azure|https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-cluster-control-plane-machine-set-operator-release-4.18-periodics-e2e-azure/1889194576401403904] jobs which in part change instances / instance types during the job and appears to be impacting static pods.

            [4.19 Test Analysis|https://sippy.dptools.openshift.org/sippy-ng/tests/4.19/analysis?test=%5BIt%5D%20ControlPlaneMachineSet%20Operator%20With%20an%20active%20ControlPlaneMachineSet%20and%20the%20instance%20type%20is%20changed%20should%20perform%20a%20rolling%20update%20%5BPeriodic%5D&filters=%7B%22items%22%3A%5B%7B%22columnField%22%3A%22name%22%2C%22operatorValue%22%3A%22equals%22%2C%22value%22%3A%22%5BIt%5D%20ControlPlaneMachineSet%20Operator%20With%20an%20active%20ControlPlaneMachineSet%20and%20the%20instance%20type%20is%20changed%20should%20perform%20a%20rolling%20update%20%5BPeriodic%5D%22%7D%2C%7B%22columnField%22%3A%22variants%22%2C%22not%22%3Atrue%2C%22operatorValue%22%3A%22contains%22%2C%22value%22%3A%22never-stable%22%7D%2C%7B%22columnField%22%3A%22variants%22%2C%22not%22%3Atrue%2C%22operatorValue%22%3A%22contains%22%2C%22value%22%3A%22aggregated%22%7D%5D%2C%22linkOperator%22%3A%22and%22%7D]

            [4.18 Test Analysis|https://sippy.dptools.openshift.org/sippy-ng/tests/4.18/analysis?test=%5BIt%5D%20ControlPlaneMachineSet%20Operator%20With%20an%20active%20ControlPlaneMachineSet%20and%20the%20instance%20type%20is%20changed%20should%20perform%20a%20rolling%20update%20%5BPeriodic%5D&filters=%7B%22items%22%3A%5B%7B%22columnField%22%3A%22name%22%2C%22operatorValue%22%3A%22equals%22%2C%22value%22%3A%22%5BIt%5D%20ControlPlaneMachineSet%20Operator%20With%20an%20active%20ControlPlaneMachineSet%20and%20the%20instance%20type%20is%20changed%20should%20perform%20a%20rolling%20update%20%5BPeriodic%5D%22%7D%2C%7B%22columnField%22%3A%22variants%22%2C%22not%22%3Atrue%2C%22operatorValue%22%3A%22contains%22%2C%22value%22%3A%22never-stable%22%7D%2C%7B%22columnField%22%3A%22variants%22%2C%22not%22%3Atrue%2C%22operatorValue%22%3A%22contains%22%2C%22value%22%3A%22aggregated%22%7D%5D%2C%22linkOperator%22%3A%22and%22%7D]
            OpenShift Prow Bot made changes -
            Status Original: ASSIGNED [ 14452 ] New: POST [ 15726 ]
            OpenShift Prow Bot made changes -
            Remote Link New: This issue links to "openshift/api#2203: OCPBUGS-50587: Reject adding new node statuses with revision set. (Web Link)" [ 1952066 ]
            Ben Luddy made changes -
            Assignee Original: Ben Luddy [ bluddy ] New: Dean West [ dwest@redhat.com ]
            Bryce Palmer made changes -
            Link New: This issue depends on OCPBUGS-51075 [ OCPBUGS-51075 ]
            OpenShift Prow Bot made changes -
            Remote Link New: This issue links to "openshift/api#2208: OCPBUGS-50587: Reject new NodeStatus with non-zero revision set (Web Link)" [ 1957246 ]
            OpenShift Prow Bot made changes -
            Remote Link New: This issue links to "openshift/origin#29558: OCPBUGS-50587: apiserver/patch: update patch tests to use server side apply (Web Link)" [ 1958679 ]
            OpenShift Prow Bot made changes -
            Remote Link New: This issue links to "openshift/origin#29560: OCPBUGS-50587: Use server-side apply for node status updates instead of json patch (Web Link)" [ 1959344 ]
            OpenShift Prow Bot made changes -
            Remote Link Original: This issue links to "openshift/origin#29560: OCPBUGS-50587: Use server-side apply for node status updates instead of json patch (Web Link)" [ 1959344 ] New: This issue links to "openshift/origin#29560: OCPBUGS-50587: Prune invalid nodestatus fields while creating new nodestatus with json patch (Web Link)" [ 1959344 ]
            OpenShift Prow Bot made changes -
            Remote Link Original: This issue links to "openshift/origin#29558: OCPBUGS-50587: apiserver/patch: update patch tests to use server side apply (Web Link)" [ 1958679 ]
            Bryce Palmer made changes -
            Assignee Original: Dean West [ dwest@redhat.com ] New: Bryce Palmer [ rh-ee-bpalmer ]
            OpenShift Prow Bot made changes -
            Link New: This issue is cloned by OCPBUGS-51295 [ OCPBUGS-51295 ]
            OpenShift Prow Bot made changes -
            Link New: This issue blocks OCPBUGS-51295 [ OCPBUGS-51295 ]
            Bryce Palmer made changes -
            Link New: This issue is related to OCPBUGS-51272 [ OCPBUGS-51272 ]
            OpenShift Prow Bot made changes -
            Remote Link Original: This issue links to "openshift/api#2208: OCPBUGS-50587: Reject new NodeStatus with non-zero revision set (Web Link)" [ 1957246 ] New: This issue links to "openshift/api#2208: OCPBUGS-51272,OCPBUGS-50587: Reject new NodeStatus with revision set (Web Link)" [ 1957246 ]
            OpenShift Prow Bot made changes -
            Remote Link Original: This issue links to "openshift/api#2203: OCPBUGS-50587: Reject adding new node statuses with revision set. (Web Link)" [ 1952066 ]
            Arda Guclu made changes -
            Status Original: POST [ 15726 ] New: Verified [ 10015 ]
            Errata Tool made changes -
            Remote Link New: This issue links to "RHEA-2024:11038 (Web Link)" [ 1987357 ]
            Ramon Acedo made changes -
            Link New: This issue causes OCPSTRAT-1918 [ OCPSTRAT-1918 ]

              rh-ee-bpalmer Bryce Palmer
              rh-ee-fbabcock Forrest Babcock
              Ge Liu Ge Liu
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

                Created:
                Updated: