Uploaded image for project: 'OpenShift GitOps'
  1. OpenShift GitOps
  2. GITOPS-4044

Gitops 1.11.0/1.12.0 test on Multiarch (x86 and s390x) cluster

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • None
    • False
    • None
    • False

      Description of problem:

      Production Gitops on multiarch cluster test results:

      GitOps ArgoCD
      1.11.0 2.9.1

       

       

      ArgoCD E2E test Multiarch s390x
        PASS # : 265
      FAILED #: 12
      PASS # : 265
      FAILED #: 12
           
      Kuttl test     
      – sequential : 33 cases failed: 11 pass
      – parallel :      95 cases failed:4 pass

       

      1) E2E test results matches with the result of s390x ocp; 

      2) Kuttl test has some differences as show by the above table. 
      possile resaons:
       a) test cases are flaky, even on  s390x ocp, it need to run multiple times/different OCPs to confirm the failurs consistence;
       b) a few cases may need to update for running on the multiarch ocp'

      Kuttl failure list:
        Sequntial: 

             --- FAIL: kuttl/harness/1-001_validate_kam_service (13.85s)
              — FAIL: kuttl/harness/1-078_validate_default_argocd_consoleLink (12.34s)
              — FAIL: kuttl/harness/1-105_validate_label_selector (10.37s)
              — FAIL: kuttl/harness/1-084_validate_prune_templates (14.29s)
              — FAIL: kuttl/harness/1-035_validate_argocd_secret_repopulate (44.57s)
              — FAIL: kuttl/harness/1-034_validate_custom_roles (47.77s)
              — FAIL: kuttl/harness/1-031_validate_toolchain (20.88s)
              — FAIL: kuttl/harness/1-018_validate_disable_default_instance (9.67s)
              — FAIL: kuttl/harness/1-056_validate_managed-by (30.75s)
              — FAIL: kuttl/harness/1-064_validate_tcp_reset_error (93.78s)
              — FAIL: kuttl/harness/1-040_validate_quoted_RBAC_group_names (9.84s)
        Parallel:
              — FAIL: kuttl/harness/1-030_validate_reencrypt (48.10s)
              — FAIL: kuttl/harness/1-077_validate_disable_dex_removed (9.17s)
              — FAIL: kuttl/harness/1-073_validate_rhsso (214.28s)
              — FAIL: kuttl/harness/1-090_validate_permissions (729.15s)

       

              shding Sam Ding
              shding Sam Ding
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: