Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-27749

IPv6 upgrade jobs permafailing since Collect certs from disk has been added

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Undefined
    • None
    • 4.16
    • Test Framework
    • None
    • Important
    • No
    • False
    • Hide

      None

      Show
      None

    Description

      Description of problem:

      Based on Metal Platform Team investigation, periodic-ci-openshift-release-master-nightly-4.16-e2e-metal-ipi-upgrade test pass rates dropped from 80% to 0% since https://github.com/openshift/origin/pull/28444 merged. This makes me think this PR likely caused permanent failures related to SSL certificates on IPv6. Since IPv6 tests only run on metal platform, it got picked up in Metal CI.
      
      Supporting information:
      
      Search for the error from permafailing jobs:
      https://search.ci.openshift.org/?search=openshift%2Forigin%2Ftest%2Fextended%2Foperators%2Fcerts.go%3A121%5D%3A+Unexpected+error&maxAge=168h&context=-1&type=build-log&name=metal-ipi&excludeName=&maxMatches=1&maxBytes=20971520&groupBy=none
      
      The first build manifesting the problem:
      https://amd64.ocp.releases.ci.openshift.org/releasestream/4.16.0-0.nightly/release/4.16.0-0.nightly-2024-01-18-111941 
      
      see TESTS section - it includes https://github.com/openshift/origin/pull/28444 which is what we suspect introduced this problem

      Version-Release number of selected component (if applicable):

          4.16

      How reproducible:

          Each 4.16 nightly build from 111941 onwards manifests the issue

      Steps to Reproduce:

          1.
          2.
          3.
          

      Actual results:

      periodic-ci-openshift-release-master-nightly-4.16-e2e-metal-ipi-upgrade-ovn-ipv6 and periodic-ci-openshift-release-master-nightly-4.16-upgrade-from-stable-4.15-e2e-metal-ipi-upgrade-ovn-ipv6 CI tests permanently fail

      Expected results:

      periodic-ci-openshift-release-master-nightly-4.16-e2e-metal-ipi-upgrade-ovn-ipv6 and periodic-ci-openshift-release-master-nightly-4.16-upgrade-from-stable-4.15-e2e-metal-ipi-upgrade-ovn-ipv6 CI tests pass CI

      Additional info:

      Note that the error message that shows in the failed runs and the search exactly matches the error added in the code added in the PR: https://github.com/openshift/origin/pull/28444/files#diff-5089d763812f699c79e646af23b3fe5fd33c1ddde7e994e8c0d21a283ce50066R330    

      Attachments

        Activity

          People

            rhn-engineering-dgoodwin Devan Goodwin
            janders@redhat.com Jacob Anders
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: