Uploaded image for project: 'OCP Technical Release Team'
  1. OCP Technical Release Team
  2. TRT-358

Cluster of CI payload failures due to etcd vertical scaling test

    XMLWordPrintable

Details

    • Story
    • Resolution: Done
    • Normal
    • None
    • None
    • False
    • None
    • False

    Description

      6 consecutive CI payloads have failed so far. Precise tests failing has varied every time, but there is a bit of a trend revolving around the control plane.

      https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/periodic-ci-openshift-release-master-ci-4.11-e2e-aws-serial/1539907334749294592

      • apiserver readiness probe failure repeating events

      https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/periodic-ci-openshift-release-master-ci-4.11-e2e-aws-serial/1539850922329378816

      • etcd and apiserver nodes not progressing to expected revisions
      • handful of etcd failures, including etcdNoLeader alert firing
      • openshift-machine-api readiness probe failure repeating events

      https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/periodic-ci-openshift-release-master-ci-4.11-e2e-aws-serial/1539794077426388992

      • apiserver readiness probe failure repeating events

      https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/periodic-ci-openshift-release-master-ci-4.11-e2e-aws-serial/1539683406797869056

      • kubeAPIErrorBudgetBurn alerts

      Attachments

        Activity

          People

            rhn-engineering-dgoodwin Devan Goodwin
            rhn-engineering-dgoodwin Devan Goodwin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: