Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-3359

Quay 3.7.0 can't start build job by uploading Dockerfile

XMLWordPrintable

    • False
    • None
    • False

      Description:

      This is an issue found when use Quay 3.7.0 to build image by uploading Dockerfile, the error message is "Could not start build", checked the Http response header, quay returned 400 error code, get error "file_id or archive_url required", refer to the Quay config.yaml used.

      Question: which quay config can resolve this issue? **

      buildlogsarchiver stdout | 2022-03-07 09:36:01,359 [62] [ERROR] [workers.worker] Operation raised exception
      buildlogsarchiver stdout | Traceback (most recent call last):
      buildlogsarchiver stdout |   File "/quay-registry/workers/worker.py", line 87, in _operation_func
      buildlogsarchiver stdout |     return operation_func()
      buildlogsarchiver stdout |   File "/quay-registry/workers/buildlogsarchiver/buildlogsarchiver.py", line 57, in _archive_redis_buildlogs
      buildlogsarchiver stdout |     log_archive.store_file(
      buildlogsarchiver stdout |   File "/quay-registry/data/userfiles.py", line 114, in store_file
      buildlogsarchiver stdout |     self._storage.stream_write(
      buildlogsarchiver stdout |   File "/quay-registry/storage/distributedstorage.py", line 24, in wrapper
      buildlogsarchiver stdout |     storage = self._storages[random.sample(locations, 1)[0]]
      buildlogsarchiver stdout | KeyError: 'local_us'
      buildlogsarchiver stdout | 2022-03-07 09:36:01,359 [62] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-03-07 09:36:31 UTC)" executed successfully 

      Here the required 3 storage location are set to use the value 'default'

      DISTRIBUTED_STORAGE_CONFIG:
        default:
        - S3Storage
        - host: s3.us-east-2.amazonaws.com
          s3_access_key: ******
          s3_bucket: quay360
          s3_secret_key: ******
          storage_path: /quay360
      DISTRIBUTED_STORAGE_DEFAULT_LOCATIONS:
      - default
      DISTRIBUTED_STORAGE_PREFERENCE:
      - default
      USERFILES_LOCATION: default 

      Quay Image: quay-operator-bundle-container-v3.7.0-24

      Build image by uploading Dockerfile was failed:

      Quay config.yaml:

      ALLOW_PULLS_WITHOUT_STRICT_LOGGING: false
      ALLOWED_OCI_ARTIFACT_TYPES:
        application/vnd.cncf.helm.config.v1+json:
        - application/tar+gzip
        application/vnd.oci.image.layer.v1.tar+gzip+encrypted:
        - application/vnd.oci.image.layer.v1.tar+gzip+encrypted
      AUTHENTICATION_TYPE: Database
      AVATAR_KIND: local
      BROWSER_API_CALLS_XHR_ONLY: false
      BUILDLOGS_REDIS:
        host: quay360-quay-redis
        port: 6379
      CREATE_REPOSITORY_ON_PUSH_PUBLIC: true
      DATABASE_SECRET_KEY: ltVZK3uffKeGyG6C3Xn7en8bjExCivYd4SYbObmEX1c22dtcLfcGv1eNAr4dDPV3W17rUbBQYi1lrX52
      DB_CONNECTION_ARGS:
        autorollback: true
        threadlocals: true
      DB_URI: postgresql://quay360-quay-database:aYRVWtFrLLkLX5R5J1P2HPjj6xWmL92p8fW7e2R2I6keGIoMidlHlzLkbyPg0iNFRjs4cpSmU7o7g9gq@quay360-quay-database:5432/quay360-quay-database
      DEFAULT_TAG_EXPIRATION: 4w
      DISTRIBUTED_STORAGE_CONFIG:
        default:
        - S3Storage
        - host: s3.us-east-2.amazonaws.com
          s3_access_key: ******
          s3_bucket: quay360
          s3_secret_key: ******
          storage_path: /quay360
      DISTRIBUTED_STORAGE_DEFAULT_LOCATIONS:
      - default
      DISTRIBUTED_STORAGE_PREFERENCE:
      - default
      ENTERPRISE_LOGO_URL: /static/img/quay-horizontal-color.svg
      EXTERNAL_TLS_TERMINATION: false
      FEATURE_ACTION_LOG_ROTATION: false
      FEATURE_ANONYMOUS_ACCESS: true
      FEATURE_APP_SPECIFIC_TOKENS: true
      FEATURE_BITBUCKET_BUILD: false
      FEATURE_BLACKLISTED_EMAILS: false
      FEATURE_BUILD_SUPPORT: true
      FEATURE_CHANGE_TAG_EXPIRATION: true
      FEATURE_DIRECT_LOGIN: true
      FEATURE_EXTENDED_REPOSITORY_NAMES: true
      FEATURE_FIPS: false
      FEATURE_GENERAL_OCI_SUPPORT: true
      FEATURE_GITHUB_BUILD: true
      FEATURE_GITHUB_LOGIN: false
      FEATURE_GITLAB_BUILD: false
      FEATURE_GOOGLE_LOGIN: false
      FEATURE_HELM_OCI_SUPPORT: true
      FEATURE_INVITE_ONLY_USER_CREATION: false
      FEATURE_MAILING: false
      FEATURE_NONSUPERUSER_TEAM_SYNCING_SETUP: false
      FEATURE_PARTIAL_USER_AUTOCOMPLETE: true
      FEATURE_PROXY_STORAGE: false
      FEATURE_REPO_MIRROR: true
      FEATURE_SECURITY_NOTIFICATIONS: true
      FEATURE_SECURITY_SCANNER: true
      FEATURE_STORAGE_REPLICATION: false
      FEATURE_TEAM_SYNCING: false
      FEATURE_USER_CREATION: true
      FEATURE_USER_INITIALIZE: true
      FEATURE_USER_LAST_ACCESSED: true
      FEATURE_USER_LOG_ACCESS: false
      FEATURE_USER_METADATA: false
      FEATURE_USER_RENAME: false
      FEATURE_USERNAME_CONFIRMATION: true
      FRESH_LOGIN_TIMEOUT: 10m
      GITHUB_LOGIN_CONFIG: {}
      GITHUB_TRIGGER_CONFIG:
        API_ENDPOINT: https://api.github.com/
        CLIENT_ID: ******
        CLIENT_SECRET: ******
        GITHUB_ENDPOINT: https://github.com/
      GITLAB_TRIGGER_KIND: {}
      LDAP_ALLOW_INSECURE_FALLBACK: false
      LDAP_EMAIL_ATTR: mail
      LDAP_UID_ATTR: uid
      LDAP_URI: ldap://localhost
      LOGS_MODEL: database
      LOGS_MODEL_CONFIG: {}
      MAIL_DEFAULT_SENDER: support@quay.io
      MAIL_PORT: 587
      MAIL_USE_AUTH: false
      MAIL_USE_TLS: false
      PREFERRED_URL_SCHEME: https
      REGISTRY_TITLE: Quay
      REGISTRY_TITLE_SHORT: Quay
      REPO_MIRROR_INTERVAL: 30
      REPO_MIRROR_TLS_VERIFY: true
      SEARCH_MAX_RESULT_PAGE_COUNT: 10
      SEARCH_RESULTS_PER_PAGE: 10
      SECRET_KEY: 0CSuP71RNBckdvcmlgYwwxoT6hMMyXi0soEKUWrB31d9vzRqImN-hvmWCO1avgNljWvwUcYj1B4AHrkz
      SECURITY_SCANNER_INDEXING_INTERVAL: 30
      SECURITY_SCANNER_V4_ENDPOINT: http://quay360-clair-app.quay360.svc.cluster.local
      SECURITY_SCANNER_V4_NAMESPACE_WHITELIST:
      - admin
      SECURITY_SCANNER_V4_PSK: VG1vT0t5bjRrN2tHdlhvaTFhNTkydkRzVTBBYjJLeWk=
      SERVER_HOSTNAME: quay360.apps.quay-perf-796.perfscale.devcluster.openshift.com
      SETUP_COMPLETE: true
      SUPER_USERS:
      - quay
      - admin
      TAG_EXPIRATION_OPTIONS:
      - 2w
      - 4w
      - 8w
      TEAM_RESYNC_STALE_TIME: 60m
      TESTING: false
      USER_EVENTS_REDIS:
        host: quay360-quay-redis
        port: 6379
      USER_RECOVERY_TOKEN_LIFETIME: 30m
      USERFILES_LOCATION: default
      BUILDMAN_HOSTNAME: quay360-quay-builder-quay360.apps.quay-perf-796.perfscale.devcluster.openshift.com:443
      BUILD_MANAGER:
        - ephemeral
        - ALLOWED_WORKER_COUNT: 1
          ORCHESTRATOR_PREFIX: buildman/production/
          ORCHESTRATOR:
            REDIS_HOST: quay360-quay-redis
            REDIS_PASSWORD: ""
            REDIS_SSL: false
            REDIS_SKIP_KEYSPACE_EVENT_SETUP: false
          EXECUTORS:
            - EXECUTOR: kubernetesPodman
              NAME: openshift
              BUILDER_NAMESPACE: builder
              DEBUG: true
              SETUP_TIME: 180
              MINIMUM_RETRY_THRESHOLD: 1
              IMAGE_PULL_SECRET_NAME: builder370
              BUILDER_CONTAINER_IMAGE: brew.registry.redhat.io/rh-osbs/quay-quay-builder-rhel8:v3.7.0-13
              # Kubernetes resource options
              K8S_API_SERVER: api.quay-perf-796.perfscale.devcluster.openshift.com:6443
              K8S_API_TLS_CA: /conf/stack/extra_ca_cert_ocp_perf_ca.crt
              VOLUME_SIZE: 8G
              KUBERNETES_DISTRIBUTION: openshift
              CONTAINER_MEMORY_LIMITS: 300Mi
              CONTAINER_CPU_LIMITS: 1000m
              CONTAINER_MEMORY_REQUEST: 300Mi
              CONTAINER_CPU_REQUEST: 500m
              NODE_SELECTOR_LABEL_KEY: ""
              NODE_SELECTOR_LABEL_VALUE: ""
              SERVICE_ACCOUNT_NAME: quay-builder
              SERVICE_ACCOUNT_TOKEN: eyJhbGciOiJSUzI1NiIsImtpZCI6ImhPNFB0bFdkUmJRTmZRN1Vpd0wtakFtTHhFbHRBRGExZ1lfUEhlRldSV0kifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJidWlsZGVyIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZWNyZXQubmFtZSI6InF1YXktYnVpbGRlci10b2tlbi04NTJwYiIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJxdWF5LWJ1aWxkZXIiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC51aWQiOiIyYzlmOWM4OC1hMmQxLTQwMTgtODc0NC05ZGVlMjJhMzY5MDAiLCJzdWIiOiJzeXN0ZW06c2VydmljZWFjY291bnQ6YnVpbGRlcjpxdWF5LWJ1aWxkZXIifQ.kzFGvt2kgzeWwh1-FFvnZ1nbfuPJALppHue4oosetuS4sl3BukOYa9gA26J9xDI1XStBMadhptbbVEYZkfK4Q61yJI0M1BE55DT5HHCCh5u-vMTJ1bO1U5jZfo0yH_ghZyDMTTH43Lnp2BZW1SdVGgQmQ2sAcqLkyB5p_h1_s8hBldlCRCFagim-hrOLjuMROflEaKILdmEA9sXXufhvSEzFbHYHTbyliTdiqdMi8er8R7GXqSsWFINN355xxt46FFFAq152bSvOyZPI-GVlJBpS4-l8AeWNpaeguUll2qK9vh15oEueYQltL0uP90RGZgPeGTgowZriTJQkHMUgJC8lEqgvga4tkJkYWZHAj9b4LXwBPNUSlOMI8TjXfo4vMvOxieVFTP_Vw984srmwquxRpX7Q9ThFOMmDNPmCF0VgpXF4KEOIpqzizm8b1BZq_4WGeubgmXxFFwNrzgWmM2qw-73S0_fu3NziOwU48amXF1L2yjlQJH3JHOF0IHtL4oIBjvcsFxRoJ8CJH8xjFkiQ7epIXEdxpJ88Uy6mlFGsFcZkui09q03VBXLkUhhiNRyEAKZDgJ_Vc1KOo5In97-L2Vg6iSE1uQmrUBlCQcV7jH3w9f6n2Cu6ASe6k7xh9tlOX-VGTzeYwN4VIhcdnOLm6fnwdoGqo1wKKNnQLag 

        1. image-2022-03-07-17-41-44-799.png
          516 kB
          luffy zhang
        2. quay370_app_pod1.logs
          127 kB
          luffy zhang
        3. quay370_app_pod2.logs
          12.37 MB
          luffy zhang
        4. Screenshot from 2022-05-06 16-18-55.png
          272 kB
          Weihua Hu

              rhn-support-stevsmit Steven Smith
              lzha1981 luffy zhang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: