Uploaded image for project: 'openstack-k8s'
  1. openstack-k8s
  2. OSPK8-707

17.1 Deployments fail on configGenerator - packageManager failure

XMLWordPrintable

      Jobs that hit this issue :

      https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/DFG/view/ospk8s/view/downstream/job/DFG-ospk8s-osp-director-dev-tools-17.1_subnet/90/

      https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/DFG/view/ospk8s/view/downstream/job/DFG-ospk8s-osp-director-dev-tools-17.1_ipv6_tlse_subnet/27/

       

      debug of first 17.1_subnet job  failure :

       

      TASK [wait for config generator to finish] *************************************
      Sunday 09 July 2023  05:22:04 +0000 (0:00:00.078)       0:00:35.639 ***********
      ESC[0;31mfatal: [localhost]: FAILED! => {ESC[0m
      ESC[0;31m    "changed": true,ESC[0m
      ESC[0;31m    "cmd": "set -e\noc wait -n openstack osconfiggenerator default --for condition=Finished --timeout=\"1200s\"\n",ESC[0m
      ESC[0;31m    "delta": "0:20:00.139575",ESC[0m
      ESC[0;31m    "end": "2023-07-09 05:42:04.878268",ESC[0m
      ESC[0;31m    "rc": 1,ESC[0m
      ESC[0;31m    "start": "2023-07-09 05:22:04.738693"ESC[0m
      ESC[0;31m}ESC[0m
      ESC[0;31mESC[0m
      ESC[0;31mSTDERR:ESC[0m
      ESC[0;31mESC[0m
      ESC[0;31merror: timed out waiting for the condition on openstackconfiggenerators/defaultESC[0m
      ESC[0;31mESC[0m
      ESC[0;31mESC[0m
      ESC[0;31mMSG:ESC[0m
      ESC[0;31mESC[0m
      ESC[0;31mnon-zero return codeESC[0mopenshift-marketplace/core/configmaps.yaml:      ra1AdHkrAj80//ogaX3T7mH1urPnMNA3I4ZyYUUpSFlob3emLoG+B01vr87ERROR
      openshift-operator-lifecycle-manager/pods/package-server-manager-6c8cc4f578-qxwlc/package-server-manager-6c8cc4f578-qxwlc.yaml:
       stopped leading\"}\n2023-07-09T04:54:09.461Z\tERROR\tsetup\tproblem running
      openshift-operator-lifecycle-manager/pods/package-server-manager-6c8cc4f578-qxwlc/package-server-manager/package-server-manager/logs/pre
      vious.log:2023-07-09T04:54:09.461468258Z 2023-07-09T04:54:09.461Z       ERROR   setup   problem running manager {"error": "leader electi
      on lost"}
      openshift-operator-lifecycle-manager/core/pods.yaml:            stopped leading\"}\n2023-07-09T04:54:09.461Z\tERROR\tsetup\tproblem runn
      ing
      openstack/pods/osp-director-operator-controller-manager-57769ff44b-gz2rr/manager/manager/logs/current.log:2023-07-09T05:19:06.979730806Z
       2023-07-09T05:19:06.979Z       ERROR   controllers.OpenStackNetConfig  Update status   {"ObjectType": "*v1beta1.OpenStackNetConfig", "O
      bjectNamespace": "openstack", "ObjectName": "openstacknetconfig", "error": "OpenStackNetConfig.osp-director.openstack.org \"openstacknet
      config\" is invalid: status.hosts: Required value"}
      openstack/pods/osp-director-operator-controller-manager-57769ff44b-gz2rr/manager/manager/logs/current.log:2023-07-09T05:19:07.058510891Z
       2023-07-09T05:19:07.058Z       ERROR   controllers.OpenStackNet        Update status   {"ObjectType": "*v1beta1.OpenStackNet", "ObjectN
      amespace": "openstack", "ObjectName": "ctlplane", "error": "Operation cannot be fulfilled on openstacknets.osp-director.openstack.org \"
      ctlplane\": the object has been modified; please apply your changes to the latest version and try again"}
      openstack/pods/osp-director-operator-controller-manager-57769ff44b-gz2rr/manager/manager/logs/current.log:2023-07-09T05:19:07.188929968Z
       2023-07-09T05:19:07.188Z       ERROR   Reconciler error        {"controller": "openstacknetattachment", "controllerGroup": "osp-directo
      r.openstack.org", "controllerKind": "OpenStackNetAttachment", "OpenStackNetAttachment": {"name":"br-ctlplane-bridge","namespace":"openst
      ack"}, "namespace": "openstack", "name": "br-ctlplane-bridge", "reconcileID": "d079b96c-4baf-4ff1-a846-8b5967da5900", "error": "Operatio
      n cannot be fulfilled on nodenetworkconfigurationpolicies.nmstate.io \"br-ctlplane\": the object has been modified; please apply your ch
      anges to the latest version and try again"}
      openstack/pods/osp-director-operator-controller-manager-57769ff44b-gz2rr/manager/manager/logs/current.log:2023-07-09T05:19:07.252478389Z
       2023-07-09T05:19:07.252Z       ERROR   controllers.OpenStackNetConfig  Update status   {"ObjectType": "*v1beta1.OpenStackNetConfig", "O
      bjectNamespace": "openstack", "ObjectName": "openstacknetconfig", "error": "Operation cannot be fulfilled on openstacknetconfigs.osp-dir
      ector.openstack.org \"openstacknetconfig\": the object has been modified; please apply your changes to the latest version and try again"
      }
      openstack/pods/osp-director-operator-controller-manager-57769ff44b-gz2rr/manager/manager/logs/current.log:2023-07-09T05:21:02.034848343Z
       2023-07-09T05:21:02.034Z       ERROR   controllers.OpenStackControlPlane       Update status   {"ObjectType": "*v1beta2.OpenStackContro
      lPlane", "ObjectNamespace": "openstack", "ObjectName": "overcloud", "error": "Operation cannot be fulfilled on openstackcontrolplanes.os
      p-director.openstack.org \"overcloud\": the object has been modified; please apply your changes to the latest version and try again"}
      openstack/pods/osp-director-operator-controller-manager-57769ff44b-gz2rr/manager/manager/logs/current.log:2023-07-09T05:21:02.034848343Z
       2023-07-09T05:21:02.034Z       ERROR   Reconciler error        {"controller": "openstackcontrolplane", "controllerGroup": "osp-director
      .openstack.org", "controllerKind": "OpenStackControlPlane", "OpenStackControlPlane": {"name":"overcloud","namespace":"openstack"}, "name
      space": "openstack", "name": "overcloud", "reconcileID": "1d647e9b-09e0-44b0-8bf1-b25eed4b689b", "error": "Failed to get  redis  *v1beta
      2.OpenStackControlPlane openstack/overcloud: OpenStackIPSet.osp-director.openstack.org \"redis\" not found"}
      openstack/pods/osp-director-operator-controller-manager-57769ff44b-gz2rr/manager/manager/logs/current.log:2023-07-09T05:21:02.340375362Z
       2023-07-09T05:21:02.340Z       ERROR   controllers.OpenStackNetConfig  Update status   {"ObjectType": "*v1beta1.OpenStackNetConfig", "O
      bjectNamespace": "openstack", "ObjectName": "openstacknetconfig", "error": "Operation cannot be fulfilled on openstacknetconfigs.osp-dir
      ector.openstack.org \"openstacknetconfig\": the object has been modified; please apply your changes to the latest version and try again"
      }
       

       

              Unassigned Unassigned
              pkomarov pini komarov
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: