Uploaded image for project: 'Red Hat OpenShift Dev Spaces (formerly CodeReady Workspaces) '
  1. Red Hat OpenShift Dev Spaces (formerly CodeReady Workspaces)
  2. CRW-2324

Operator container failed to start from "latest" operator channel: 'RELATED_IMAGE_gateway_authentication_sidecar'. Environment variable with default value was not found."

    XMLWordPrintable

Details

    • False
    • False

    Description

      CRW 2.12.0.RC-10-01 failed to install on OCP 4.8 on AWS from latest channel, using iib for codeready-workspaces-rhel8-operator-metadata-container-2.12-117:

      • Index image v4.6: registry-proxy.engineering.redhat.com/rh-osbs/iib:117611
      • Index image v4.7: registry-proxy.engineering.redhat.com/rh-osbs/iib:117612
      • Index image v4.8: registry-proxy.engineering.redhat.com/rh-osbs/iib:117613
      • Index image v4.9: registry-proxy.engineering.redhat.com/rh-osbs/iib:117614

      https://main-jenkins-csb-crwqe.apps.ocp4.prod.psi.redhat.com/job/CodereadyWorkspaces/job/e2e/job/basic/job/install-crw-using-crwctl/1430/artifact/logs-and-configs/logs/codeready-operator-f4b87f47f-zdk6j.pod.log

      time="2021-10-04T02:33:08Z" level=fatal msg="Failed to initialize default value: 'RELATED_IMAGE_gateway_authentication_sidecar'. Environment variable with default value was not found."
      crwctl logs
      05:13:17  + /mnt/hudson_workspace/workspace/CodereadyWorkspaces/e2e/basic/install-crw-using-crwctl/crwctl/bin/crwctl server:deploy --che-operator-cr-patch-yaml=/mnt/hudson_workspace/workspace/CodereadyWorkspaces/e2e/basic/install-crw-using-crwctl/custom-resource-patch.yaml --no-olm-suggested-namespace --catalog-source-name=crw-2-12-osbs --catalog-source-namespace=openshift-marketplace --package-manifest-name=codeready-workspaces --olm-channel=latest --listr-renderer=verbose -n crw-crwctl
      05:13:18  (node:5373) Warning: Accessing non-existent property 'cat' of module exports inside circular dependency
      05:13:18  (Use `node --trace-warnings ...` to show where the warning was created)
      05:13:18  (node:5373) Warning: Accessing non-existent property 'cd' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'chmod' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'cp' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'dirs' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'pushd' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'popd' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'echo' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'tempdir' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'pwd' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'exec' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'ls' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'find' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'grep' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'head' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'ln' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'mkdir' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'rm' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'mv' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'sed' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'set' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'sort' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'tail' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'test' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'to' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'toEnd' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'touch' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'uniq' of module exports inside circular dependency
      05:13:18  (node:5373) Warning: Accessing non-existent property 'which' of module exports inside circular dependency
      05:13:19  › Installer type is set to: 'olm'
      05:13:19  [22:13:18] Verify Kubernetes API [started]
      05:13:19  › Current Kubernetes context: 'default/api-ocp48-aws-crw-qe-com:6443/admin'
      05:13:19  [22:13:18] Verify Kubernetes API...OK [title changed]
      05:13:20  [22:13:19] Verify Kubernetes API...OK (it's OpenShift) [title changed]
      05:13:20  [22:13:19] Verify Kubernetes API...OK (it's OpenShift) [completed]
      05:13:20  [22:13:19]   Looking for an already existing CodeReady Workspaces instance [started]
      05:13:20  [22:13:19] Verify if CodeReady Workspaces is deployed into namespace "crw-crwctl" [started]
      05:13:20  [22:13:19] Verify if CodeReady Workspaces is deployed into namespace "crw-crwctl"...it is not [title changed]
      05:13:20  [22:13:19] Verify if CodeReady Workspaces is deployed into namespace "crw-crwctl"...it is not [completed]
      05:13:20  [22:13:19]   Looking for an already existing CodeReady Workspaces instance [completed]
      05:13:20  [22:13:19]  Openshift preflight checklist [started]
      05:13:20  [22:13:19] Verify if oc is installed [started]
      05:13:20  [22:13:19] Verify if oc is installed...done. [title changed]
      05:13:20  [22:13:19] Verify if oc is installed...done. [completed]
      05:13:20  [22:13:19] Verify if openshift is running [started]
      05:13:22  [22:13:20] Verify if openshift is running...done. [title changed]
      05:13:22  [22:13:20] Verify if openshift is running...done. [completed]
      05:13:22  [22:13:20] Check OpenShift version [started]
      05:13:23  [22:13:21] Check OpenShift version: 4.x [title changed]
      05:13:23  [22:13:21] Check OpenShift version: 4.x [completed]
      05:13:23  [22:13:21] Check Kubernetes version [started]
      05:13:23  [22:13:22] Check Kubernetes version: Unknown. [title changed]
      05:13:23  [22:13:22] Check Kubernetes version: Unknown. [completed]
      05:13:23  [22:13:22]   Openshift preflight checklist [completed]
      05:13:23  [22:13:22] Following CodeReady Workspaces logs [started]
      05:13:23  [22:13:22] Start following Operator logs [started]
      05:13:23  [22:13:22] Start following Operator logs...done [title changed]
      05:13:23  [22:13:22] Start following Operator logs...done [completed]
      05:13:23  [22:13:22] Start following CodeReady Workspaces Server logs [started]
      05:13:23  [22:13:22] Start following CodeReady Workspaces Server logs...done [title changed]
      05:13:23  [22:13:22] Start following CodeReady Workspaces Server logs...done [completed]
      05:13:23  [22:13:22] Start following PostgreSQL logs [started]
      05:13:23  [22:13:22] Start following PostgreSQL logs...done [title changed]
      05:13:23  [22:13:22] Start following PostgreSQL logs...done [completed]
      05:13:23  [22:13:22] Start following Keycloak logs [started]
      05:13:23  [22:13:22] Start following Keycloak logs...done [title changed]
      05:13:23  [22:13:22] Start following Keycloak logs...done [completed]
      05:13:23  [22:13:22] Start following Plug-in Registry logs [started]
      05:13:23  [22:13:22] Start following Plug-in Registry logs...done [title changed]
      05:13:23  [22:13:22] Start following Plug-in Registry logs...done [completed]
      05:13:23  [22:13:22] Start following Devfile Registry logs [started]
      05:13:23  [22:13:22] Start following Devfile Registry logs...done [title changed]
      05:13:23  [22:13:22] Start following Devfile Registry logs...done [completed]
      05:13:23  [22:13:22] Start following CodeReady Workspaces Dashboard logs [started]
      05:13:23  [22:13:22] Start following CodeReady Workspaces Dashboard logs...done [title changed]
      05:13:23  [22:13:22] Start following CodeReady Workspaces Dashboard logs...done [completed]
      05:13:23  [22:13:22] Start following namespace events [started]
      05:13:23  [22:13:22] Start following namespace events...done [title changed]
      05:13:23  [22:13:22] Start following namespace events...done [completed]
      05:13:23  [22:13:22] Following CodeReady Workspaces logs [completed]
      05:13:23  [22:13:22]   Running Olm installaion CodeReady Workspaces [started]
      05:13:23  [22:13:22] Check if OLM is pre-installed on the platform [started]
      05:13:23  [22:13:22] Check if OLM is pre-installed on the platform...done. [title changed]
      05:13:23  [22:13:22] Check if OLM is pre-installed on the platform...done. [completed]
      05:13:23  [22:13:22] Create Namespace (crw-crwctl) [started]
      05:13:24  [22:13:23] Create Namespace (crw-crwctl)...Done. [title changed]
      05:13:24  [22:13:23] Create Namespace (crw-crwctl)...Done. [completed]
      05:13:24  [22:13:23] Create operator group [started]
      05:13:25  [22:13:24] Create operator group...created new one. [title changed]
      05:13:25  [22:13:24] Create operator group...created new one. [completed]
      05:13:25  [22:13:24] Configure context information [started]
      05:13:25  [22:13:24] Configure context information...done. [title changed]
      05:13:25  [22:13:24] Configure context information...done. [completed]
      05:13:25  [22:13:24] Create operator subscription [started]
      05:13:25  [22:13:24] Create operator subscription...created new one. [title changed]
      05:13:25  [22:13:24] Create operator subscription...created new one. [completed]
      05:13:25  [22:13:24] Wait while subscription is ready [started]
      05:13:26  [22:13:25] Wait while subscription is ready...done. [title changed]
      05:13:26  [22:13:25] Wait while subscription is ready...done. [completed]
      05:13:26  [22:13:25] Wait while operator installed [started]
      05:13:31  [22:13:29] Wait while operator installed...done. [title changed]
      05:13:31  [22:13:29] Wait while operator installed...done. [completed]
      05:13:31  [22:13:29] Prepare CodeReady Workspaces cluster CR [started]
      05:13:32  [22:13:30] Prepare CodeReady Workspaces cluster CR...Done. [title changed]
      05:13:32  [22:13:30] Prepare CodeReady Workspaces cluster CR...Done. [completed]
      05:13:32  [22:13:30] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace crw-crwctl [started]
      05:13:32  [22:13:31] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace crw-crwctl...done. [title changed]
      05:13:32  [22:13:31] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace crw-crwctl...done. [completed]
      05:13:32  [22:13:31]   Running Olm installaion CodeReady Workspaces [completed]
      05:13:32  [22:13:31]   Post installation checklist [started]
      05:13:32  [22:13:31] PostgreSQL pod bootstrap [started]
      05:13:32  [22:13:31] Scheduling [started]
      05:41:11  [22:41:05] Scheduling [failed]
      05:41:11  [22:41:05]  Timeout: there are no pods in the namespace: crw-crwctl, selector: app=codeready,component=postgres. Check CodeReady Workspaces logs for details. Consider increasing error recheck timeout with --k8spoderrorrechecktimeout flag.
      05:41:11  [22:41:05] PostgreSQL pod bootstrap [failed]
      05:41:11  [22:41:05]  Timeout: there are no pods in the namespace: crw-crwctl, selector: app=codeready,component=postgres. Check CodeReady Workspaces logs for details. Consider increasing error recheck timeout with --k8spoderrorrechecktimeout flag.
      05:41:11  [22:41:05]  Post installation checklist [failed]
      05:41:11  [22:41:05]  Timeout: there are no pods in the namespace: crw-crwctl, selector: app=codeready,component=postgres. Check CodeReady Workspaces logs for details. Consider increasing error recheck timeout with --k8spoderrorrechecktimeout flag.
      05:41:11  Error: Command server:deploy failed. Error log: /home/hudson/.cache/crwctl/error.log.
      05:41:11      at newError (/mnt/hudson_workspace/workspace/CodereadyWorkspaces/e2e/basic/install-crw-using-crwctl/crwctl/lib/util.js:194:19)
      05:41:11      at Object.wrapCommandError (/mnt/hudson_workspace/workspace/CodereadyWorkspaces/e2e/basic/install-crw-using-crwctl/crwctl/lib/util.js:190:12)
      05:41:11      at Deploy.<anonymous> (/mnt/hudson_workspace/workspace/CodereadyWorkspaces/e2e/basic/install-crw-using-crwctl/crwctl/lib/commands/server/deploy.js:261:35)
      05:41:11      at Generator.throw (<anonymous>)
      05:41:11      at rejected (/mnt/hudson_workspace/workspace/CodereadyWorkspaces/e2e/basic/install-crw-using-crwctl/crwctl/node_modules/tslib/tslib.js:115:69)
      05:41:11      at runMicrotasks (<anonymous>)
      05:41:11  Cause: Error: Timeout: there are no pods in the namespace: crw-crwctl, selector: app=codeready,component=postgres. Check CodeReady Workspaces logs for details. Consider increasing error recheck timeout with --k8spoderrorrechecktimeout flag.
      05:41:11      at KubeTasks.<anonymous> (/mnt/hudson_workspace/workspace/CodereadyWorkspaces/e2e/basic/install-crw-using-crwctl/crwctl/lib/tasks/kube.js:155:23)
      05:41:11      at Generator.next (<anonymous>)
      05:41:11      at fulfilled (/mnt/hudson_workspace/workspace/CodereadyWorkspaces/e2e/basic/install-crw-using-crwctl/crwctl/node_modules/tslib/tslib.js:114:62)
      05:41:11      at runMicrotasks (<anonymous>)
      

      CSV: http://pastebin.test.redhat.com/998373

      Attachments

        Issue Links

          Activity

            People

              nickboldt Nick Boldt
              dnochevn Dmytro Nochevnov
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: