Uploaded image for project: 'OpenShift GitOps'
  1. OpenShift GitOps
  2. GITOPS-2778

argocd-e2e testsuite fails and need reruns for flakiness in tests

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Normal Normal
    • None
    • None
    • Testing
    • False
    • None
    • False

      Description of problem:

      The argocd-e2e testuite is failing or stops at multiple testcases when executed against ARGOCD_VERSION=2.5.xx/2.6.xx  for Gitops-1.7.x/1.8.x.

      Most common error of the failed test :-

       

      failed exit status 20: time=\"2023-03-02T08:11:32-05:00\" level=fatal msg=\"rpc error: code = Canceled desc = context canceled\"" execID=39829 

      Most of the failed test cases are flaky and PASS when testsuite is re-executed or individual failed testcase is executed.

      This problem has been observed on P/Z/x86.

      Prerequisites (if any, like setup, operators/versions):

      1. Gitops-1.7.x/1.8.x installed on OCP4.XX cluster
      2. Clone repository:- https://gitlab.cee.redhat.com/gitops/gitops-components-automated-testing.git
      3. export ARGOCD_VERSION=2.5.xx (for Gitops-1.7.x) / 2.6.x (for Gitops-1.8.x)

      Steps to Reproduce

      1. cd gitops-component-automated-testing
      2. make argocd-e2e-tests

      Actual results:

      Many testcases fails due to following error:-

      failed exit status 20: time=\"2023-03-02T08:11:32-05:00\" level=fatal msg=\"rpc error: code = Canceled desc = context canceled\"" execID=39829 

      When testcases re-executed individually, they PASS.

      Expected results:

      The testsuite shouldn't stop/stuck or not many testcase fail due to error menioned above

      Reproducibility (Always/Intermittent/Only Once):

      Build Details:

      Additional info (Such as Logs, Screenshots, etc):

            rhn-support-vab Varsha B
            kabhishe@redhat.com Kumar Abhishek
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: