Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-1441

Failed to start quay-build service in builder worker pod

XMLWordPrintable

      Description of problem:

      When launch build worker on openshift, failed to start quay-build service in builder worker pod

      Version-Release number of selected component (if applicable):

      registry-proxy.engineering.redhat.com/rh-osbs/quay-quay@sha256:248988b8d20b66572e4123ce85424f6e34eac1e670306a0bad6d30b702f3aba1
      registry-proxy.engineering.redhat.com/rh-osbs/quay-quay:v3.4.0-40

      registry-proxy.engineering.redhat.com/rh-osbs/quay-quay-builder-qemu-rhcos@sha256:f62fc1b17808a28242f5cf86940cf46298d56293429c17c0bb1d11a4bd8da17d
      registry-proxy.engineering.redhat.com/rh-osbs/quay-quay-builder-qemu-rhcos:v3.4.0-13

      How reproducible:

      Always

      Steps to Reproduce:
      1.Deploy Quay by operator

      2. Create project 'builder' in OCP
      3.Create build trigger
      4.Check build status

      Actual results:

      build job is stuck with internal error, build worker is running, but quay-build service is failed to start inside pod

      Expected results:

      build is completed with ephemeral build worker

      Additional info:

      FEATURE_BUILD_SUPPORT: True
      BUILDMAN_HOSTNAME: quay-test-quay-builder-quay.apps.preserve-dya.0114-mst.qe.rhcloud.com
      BUILD_MANAGER:
      - ephemeral
      - ALLOWED_WORKER_COUNT: 10
        ORCHESTRATOR_PREFIX: buildman/production/
        ORCHESTRATOR:
          REDIS_HOST: quay-test-quay-redis
        EXECUTORS:
        - EXECUTOR: kubernetes
          NAME: openshift
          BUILDER_NAMESPACE: quay-build
          DEBUG: true
          QUAY_USERNAME: root
          QUAY_PASSWORD: quayroot
          WORKER_IMAGE: brew.registry.redhat.io/rh-osbs/quay-quay-builder
          WORKER_TAG: v3.4.0-12
          SETUP_TIME: 180 # Time the instance has to start
          # Number of tries remaining the job needs to use this executor
          MINIMUM_RETRY_THRESHOLD: 1 
          # Container VM image (Kubernetes specific)
          BUILDER_VM_CONTAINER_IMAGE: brew.registry.redhat.io/rh-osbs/quay-quay-builder-qemu-rhcos:v3.4.0-13
          #    BUILDER_VM_CONTAINER_IMAGE: brew.registry.redhat.io/rh-osbs/quay-quay-builder-qemu-fedoracoreos:v3.4.0-8
          CONTAINER_RUNTIME: podman
          # Kubernetes resource options
          #VERIFY_TLS: false
          K8S_API_SERVER: api.dyan-bm18.qe.devcluster.openshift.com:6443
          VOLUME_SIZE: 8G
          KUBERNETES_DISTRIBUTION: openshift
          CONTAINER_MEMORY_LIMITS: 5120Mi
          CONTAINER_CPU_LIMITS: 1000m
          #CONTAINER_MEMORY_REQUEST: 3968Mi
          #CONTAINER_CPU_REQUEST: 500m
          NODE_SELECTOR_LABEL_KEY: node-role.kubernetes.io/worker
          NODE_SELECTOR_LABEL_VALUE: ' '
          SERVICE_ACCOUNT_NAME: quay-builder
          SERVICE_ACCOUNT_TOKEN: eyJhbGciOiJSUzI1NiIsImtpZCI6IlNlMFNPby1nS29WS09MRjcwYnd6UjdNdm9OWHFwcmtsMXFuN0dMdTJSN1kifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJxdWF5LWJ1aWxkIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZWNyZXQubmFtZSI6InF1YXktYnVpbGRlci10b2tlbi1yZmdoNSIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJxdWF5LWJ1aWxkZXIiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC51aWQiOiJmNjJmYjAxNS0yMTcwLTRlMzMtOWIyZi1lZDEwZTU3NWY3MmIiLCJzdWIiOiJzeXN0ZW06c2VydmljZWFjY291bnQ6cXVheS1idWlsZDpxdWF5LWJ1aWxkZXIifQ.occqQpt2OK5taHf_vVJhF-fwWbU6r4tBl2EFsP6A524G_V2zCdCmJZLKD6JPk7_1_XsY3FH9CYdrRaKEuwH68j62rzB6JVxo44l9UvZuKjdNyrd2uXbCvZeJ7rOuq5ETDVRrGANhK8STHiNubZa7eH7-OfrVUuDYXZI7cgxBuoxcn03WPYl7bhfCZ67_ewR4SZZTvm7wtTsaKW9bPa277y5Ut45nvaJuf8PoORp4hCp3auT3Nf_K4f2F4ZaSerXgEJN96wdLSMHqQjf0KOfqLcr01JUnwNY8vqA3xPO3CNhdal4YfSvsxHvxwoJgQ7-2QKqWEml9SDDThLrHfWVB0A
          SSH_AUTHORIZED_ KEYS:
            - ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUq7W38xCZ9WGSWCvustaMGMT04tRohw6AKGzI7P7xql5lhCAReyt72n9qWQRZsE1YiCSQuTfXI1oc8NpSM7+lMLwj12G8z3I1YT31JHr9LLYg/XIcExkzfBI920CaS82VqmKOpI9+ARHSJBdIbKRI0f5Y+u4xbc5UzKC

        1. builder0118.log
          104 kB
          Dongbo Yan
        2. quay_34_app_pod.logs
          2.99 MB
          luffy zhang

              sleesinc Kenny Lee Sin Cheong
              rhn-support-dyan Dongbo Yan
              Dongbo Yan Dongbo Yan
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: