Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-10840

quay-builder-v3-17 start failed for ERROR: podman socket not found, exiting

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False

      Description of problem:

      Enable quay 3.17.0 builder feature, the quay builder pod failed to start for `podman socket not found` error.

      % oc get all -n virtual-builds                                              
Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
NAME                                                   READY   STATUS   RESTARTS   AGE
pod/eb2dfaf2-102b-4110-93cb-dbc4dedc4d38-hjhzp-4r2zl   0/1     Error    0          2m38s
pod/eb2dfaf2-102b-4110-93cb-dbc4dedc4d38-hjhzp-gsxwq   0/1     Error    0          3m7s


NAME                                                   STATUS   COMPLETIONS   DURATION   AGE
job.batch/eb2dfaf2-102b-4110-93cb-dbc4dedc4d38-hjhzp   Failed   0/1           3m10s      3m10s
       % oc logs eb2dfaf2-102b-4110-93cb-dbc4dedc4d38-hjhzp-gsxwq -n virtual-builds
[INFO]: CA_CERT found, writing out to /certs/cacert.crt
[INFO]: Waiting for podman to start. Checking again in 3s...
time="2026-03-05T13:21:04Z" level=info msg="podman filtering at log level debug"
time="2026-03-05T13:21:04Z" level=debug msg="Called service.PersistentPreRunE(podman --log-level=debug system service --time 0)"
time="2026-03-05T13:21:04Z" level=info msg="Setting parallel job count to 49"
time="2026-03-05T13:21:04Z" level=debug msg="Using conmon: \"/usr/bin/conmon\""
time="2026-03-05T13:21:04Z" level=info msg="Using sqlite as database backend"
time="2026-03-05T13:21:04Z" level=debug msg="systemd-logind: dial unix /var/run/dbus/system_bus_socket: connect: no such file or directory"
time="2026-03-05T13:21:04Z" level=debug msg="Using graph driver vfs"
time="2026-03-05T13:21:04Z" level=debug msg="Using graph root /home/podman/.local/share/containers/storage"
time="2026-03-05T13:21:04Z" level=debug msg="Using run root /tmp/storage-run-1000/containers"
time="2026-03-05T13:21:04Z" level=debug msg="Using static dir /home/podman/.local/share/containers/storage/libpod"
time="2026-03-05T13:21:04Z" level=debug msg="Using tmp dir /tmp/storage-run-1000/libpod/tmp"
time="2026-03-05T13:21:04Z" level=debug msg="Using volume path /home/podman/.local/share/containers/storage/volumes"
time="2026-03-05T13:21:04Z" level=debug msg="Using transient store: false"
time="2026-03-05T13:21:04Z" level=debug msg="Not configuring container store"
time="2026-03-05T13:21:04Z" level=debug msg="Initializing event backend file"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime runj initialization failed: no valid executable found for OCI runtime runj: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime runsc initialization failed: no valid executable found for OCI runtime runsc: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime youki initialization failed: no valid executable found for OCI runtime youki: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime ocijail initialization failed: no valid executable found for OCI runtime ocijail: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime runc initialization failed: no valid executable found for OCI runtime runc: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime kata initialization failed: no valid executable found for OCI runtime kata: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime krun initialization failed: no valid executable found for OCI runtime krun: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime crun-vm initialization failed: no valid executable found for OCI runtime crun-vm: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime crun-wasm initialization failed: no valid executable found for OCI runtime crun-wasm: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Using OCI runtime \"/usr/bin/crun\""
time="2026-03-05T13:21:04Z" level=info msg="podman filtering at log level debug"
time="2026-03-05T13:21:04Z" level=debug msg="Called service.PersistentPreRunE(podman --log-level=debug system service --time 0)"
time="2026-03-05T13:21:04Z" level=info msg="Setting parallel job count to 49"
time="2026-03-05T13:21:04Z" level=debug msg="Using conmon: \"/usr/bin/conmon\""
time="2026-03-05T13:21:04Z" level=info msg="Using sqlite as database backend"
time="2026-03-05T13:21:04Z" level=debug msg="systemd-logind: dial unix /var/run/dbus/system_bus_socket: connect: no such file or directory"
time="2026-03-05T13:21:04Z" level=debug msg="Using graph driver vfs"
time="2026-03-05T13:21:04Z" level=debug msg="Using graph root /home/podman/.local/share/containers/storage"
time="2026-03-05T13:21:04Z" level=debug msg="Using run root /tmp/storage-run-1000/containers"
time="2026-03-05T13:21:04Z" level=debug msg="Using static dir /home/podman/.local/share/containers/storage/libpod"
time="2026-03-05T13:21:04Z" level=debug msg="Using tmp dir /tmp/storage-run-1000/libpod/tmp"
time="2026-03-05T13:21:04Z" level=debug msg="Using volume path /home/podman/.local/share/containers/storage/volumes"
time="2026-03-05T13:21:04Z" level=debug msg="Using transient store: false"
time="2026-03-05T13:21:04Z" level=debug msg="[graphdriver] trying provided driver \"vfs\""
time="2026-03-05T13:21:04Z" level=debug msg="Initializing event backend file"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime crun-wasm initialization failed: no valid executable found for OCI runtime crun-wasm: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime runc initialization failed: no valid executable found for OCI runtime runc: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime runj initialization failed: no valid executable found for OCI runtime runj: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime kata initialization failed: no valid executable found for OCI runtime kata: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime runsc initialization failed: no valid executable found for OCI runtime runsc: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime youki initialization failed: no valid executable found for OCI runtime youki: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime ocijail initialization failed: no valid executable found for OCI runtime ocijail: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime crun-vm initialization failed: no valid executable found for OCI runtime crun-vm: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Configured OCI runtime krun initialization failed: no valid executable found for OCI runtime krun: invalid argument"
time="2026-03-05T13:21:04Z" level=debug msg="Using OCI runtime \"/usr/bin/crun\""
time="2026-03-05T13:21:04Z" level=debug msg="Successfully loaded 1 networks"
time="2026-03-05T13:21:04Z" level=debug msg="Initialized SHM lock manager at path /libpod_rootless_lock_1000"
time="2026-03-05T13:21:04Z" level=debug msg="Podman detected system restart - performing state refresh"
time="2026-03-05T13:21:04Z" level=debug msg="Could not move to subcgroup: mkdir /sys/fs/cgroup/init: read-only file system"
time="2026-03-05T13:21:04Z" level=debug msg="Could not move to subcgroup: mkdir /sys/fs/cgroup/init: read-only file system"
time="2026-03-05T13:21:04Z" level=debug msg="registered SIGHUP watcher for config"
time="2026-03-05T13:21:04Z" level=info msg="API service listening on \"/tmp/storage-run-1000/podman/podman.sock\". URI: \"unix:///tmp/storage-run-1000/podman/podman.sock\""
time="2026-03-05T13:21:04Z" level=debug msg="CORS Headers were not set"
time="2026-03-05T13:21:04Z" level=debug msg="waiting for SIGHUP to reload configuration"
time="2026-03-05T13:21:04Z" level=debug msg="API service(s) shutting down, idle for 0s"
time="2026-03-05T13:21:04Z" level=debug msg="API service shutdown request ignored as timeout Duration is UnlimitedService"
[INFO]: Waiting for podman to start. Checking again in 3s...
[INFO]: Waiting for podman to start. Checking again in 3s...
[INFO]: Waiting for podman to start. Checking again in 3s...
[INFO]: Waiting for podman to start. Checking again in 3s...
[ERROR]: podman socket not found, exiting

      Version-Release number of selected component (if applicable):

      //image-rbac-proxy.apps.stone-prd-rh01.pg1f.p1.openshiftapps.com/redhat-user-workloads/quay-eng-tenant/quay-builder-v3-17@sha256:2ae4c57a765b6d314f2e336d4df2e2e33343cb7596f72fd70dfc9a3e0a2e13e4
      ------------------------------
$ oc get $(oc get pod -l name=quay-operator-alm-owned -o name -n quay-enterprise) -o jsonpath='{.spec.containers[0].image}' -n quay-enterprise
registry.redhat.io/quay/quay-operator-rhel9@sha256:c3b128ea1e37cadeba371aef55788a1cb787e03062e20ae9dac758a11ad77aca
------------------------------
$ oc get $(oc get pod -l app=quay -o NAME -n quay-enterprise|head -n 1) -o jsonpath='{.spec.containers[0].image}' -n quay-enterprise
quay.io/rhwhu/quayimage:pr5303
------------------------------
$ oc get quayregistry -o jsonpath='{.items[0].status.currentVersion}'  -n quay-enterprise
3.17.0

       

              marckok Marcus Kok
              rhwhu Weihua Hu
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: