Details
-
Bug
-
Resolution: Unresolved
-
Major
-
None
-
quay-v3.6.8, quay-v3.6.9, quay-v3.7.6
-
False
-
None
-
False
-
0
Description
Description of problem:
When try to trigger build on bare metal + ocp 4.9 environment, build failed.
The quay-builder-qemu-rhcos-rhel8 pod can not start correctly on OCP 4.9.
Version-Release number of selected component (if applicable):
quay 3.6.8 3.6.9 3.7.6
WORKER_IMAGE: brew.registry.redhat.io/rh-osbs/quay-quay-builder-rhel8:v3.6.9 or v3.6.9 or v3.7.6
BUILDER_VM_CONTAINER_IMAGE: brew.registry.redhat.io/rh-osbs/quay-quay-builder-qemu-rhcos-rhel8:v3.6.9 or v3.6.9 or v3.7.6
How reproducible:
always
Steps to Reproduce:
1. set up builder environment on openstack bare metal machine + ocp4.9
2. deploy quay on any supported ocp cluster, such as ocp 4.11
3. configure builder as
FEATURE_GITHUB_BUILD: true GITHUB_TRIGGER_CONFIG: API_ENDPOINT: https://api.github.com/ CLIENT_ID: 2ddf...d CLIENT_SECRET: 7d...c8 GITHUB_ENDPOINT: https://github.com/ ....... BUILD_MANAGER: - ephemeral - ALLOWED_WORKER_COUNT: 3 EXECUTORS: - BUILDER_NAMESPACE: builder BUILDER_VM_CONTAINER_IMAGE: brew.registry.redhat.io/rh-osbs/quay-quay-builder-qemu-rhcos-rhel8:v3.6.9 CONTAINER_CPU_LIMITS: 1000m CONTAINER_CPU_REQUEST: 500m CONTAINER_MEMORY_LIMITS: 5120Mi CONTAINER_MEMORY_REQUEST: 3968Mi CONTAINER_RUNTIME: podman DEBUG: true EXECUTOR: kubernetes K8S_API_SERVER: api.whu49bm21.qe.devcluster.openshift.com:6443 K8S_API_TLS_CA: /conf/stack/extra_ca_cert_build_cluster.crt KUBERNETES_DISTRIBUTION: openshift MINIMUM_RETRY_THRESHOLD: 0 NODE_SELECTOR_LABEL_KEY: type NODE_SELECTOR_LABEL_VALUE: builder QUAY_PASSWORD: ey....cc8 QUAY_USERNAME: '|76db....1956' SERVICE_ACCOUNT_NAME: quay-builder SERVICE_ACCOUNT_TOKEN: eyJh....hWwA SETUP_TIME: 180 SSH_AUTHORIZED_KEYS: - ssh-rsa AA....orkmachine VOLUME_SIZE: 8G WORKER_IMAGE: brew.registry.redhat.io/rh-osbs/quay-quay-builder-rhel8 WORKER_TAG: v3.6.9 JOB_REGISTRATION_TIMEOUT: 600 ORCHESTRATOR: REDIS_HOST: quayregistry-quay-redis REDIS_PASSWORD: "" REDIS_SKIP_KEYSPACE_EVENT_SETUP: false REDIS_SSL: false ORCHESTRATOR_PREFIX: buildman/production/ BUILDLOGS_REDIS: host: quayregistry-quay-redis port: 6379 BUILDMAN_HOSTNAME: quayregistry-quay-builder-quay-enterprise.apps.whu411osp04.0802-9xm.qe.rhcloud.com:443
3. trigger build
Actual results:
The build process failed. the quay-builder-qemu-rhcos-rhel8 pod can not start correctly.
Got quay-builder-qemu-rhcos-rhel8 pod log
++ grep 'virtual size' ++ tr -d '()' ++ cut -d ' ' -f 5 + MIN_IMAGE_SIZE_BYTES=17179869184 ++ numfmt --from=iec 8G + VM_VOLUME_SIZE_BYTES=8589934592 + '[' 8589934592 -gt 17179869184 ']' + /usr/libexec/qemu-kvm -enable-kvm -cpu host -nographic -drive if=virtio,file=/userdata/coreos_production_qemu_image.qcow2 -fw_cfg name=opt/com.coreos/config,file=/userdata/user_data -m 4G -machine accel=kvm -net nic,model=virtio -net user,hostfwd=tcp::2222-:22 -smp 2 KVM: entry failed, hardware error 0x8 EAX=00000000 EBX=00000000 ECX=00000000 EDX=00080660 ESI=00000000 EDI=00000000 EBP=00000000 ESP=00000000 EIP=0000fff0 EFL=00000002 [-------] CPL=0 II=0 A20=1 SMM=0 HLT=0 ES =0000 00000000 0000ffff 00009300 CS =f000 ffff0000 0000ffff 00009b00 SS =0000 00000000 0000ffff 00009300 DS =0000 00000000 0000ffff 00009300 FS =0000 00000000 0000ffff 00009300 GS =0000 00000000 0000ffff 00009300 LDT=0000 00000000 0000ffff 00008200 TR =0000 00000000 0000ffff 00008b00 GDT= 00000000 0000ffff IDT= 00000000 0000ffff CR0=60000010 CR2=00000000 CR3=00000000 CR4=00000000 DR0=0000000000000000 DR1=0000000000000000 DR2=0000000000000000 DR3=0000000000000000 DR6=00000000ffff0ff0 DR7=0000000000000400 EFER=0000000000000000 Code=04 66 41 eb f1 66 83 c9 ff 66 89 c8 66 5b 66 5e 66 5f 66 c3 <ea> 5b e0 00 f0 30 36 2f 32 33 2f 39 39 00 fc 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
Expected results:
the quay-builder-qemu-rhcos-rhel8 pod should start correctly. the build process should complete successfully.
Additional info:
The same builder configuration can work well on bare metal + ocp 4.10 , ocp 4.11 and ocp 4.8.
