Uploaded image for project: 'Fast Datapath Product'
  1. Fast Datapath Product
  2. FDP-2908

[Investigation spike] Customer unable to create VMs on Openstack cluster due to OVN transition states

    • Icon: Task Task
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • OVN
    • None
    • False
    • False
    • rhel-9
    • None
    • rhel-net-ovn
    • ssg_networking
    • Customer Escalated

      https://issues.redhat.com/browse/OSPRH-23875 

      https://access.redhat.com/support/cases/#/case/04333479 

      OVN investigation of logs...

      Initial notes so far that are seen

      Lots of 2025-12-02T14:11:25.105Z|184542|vconn_stream|ERR|send: Broken pipe
      2025-12-02T14:11:25.105Z|184543|rconn|WARN|br-int<->unix#1014169: connection dropped (Broken pipe)
      2025-12-02T14:12:25.131Z|184544|vconn_stream|ERR|send: Broken pipe
      2025-12-02T14:12:25.131Z|184545|rconn|WARN|br-int<->unix#1014182: connection dropped (Broken pipe)
      2025-12-02T14:12:59.901Z|184546|connmgr|INFO|br-int<->unix#1: 2880 flow_mods in the 7 s starting 10 s ago (1440 adds, 1440 deletes)
      2025-12-02T14:13:25.123Z|184547|vconn_stream|ERR|send: Broken pipe
      2025-12-02T14:13:25.123Z|184548|rconn|WARN|br-int<->unix#1014191: connection dropped (Broken pipe)
      2025-12-02T14:14:25.117Z|184549|vconn_stream|ERR|send: Broken pipe
      2025-12-02T14:14:25.118Z|184550|rconn|WARN|br-int<->unix#1014201: connection dropped (Broken pipe)
      2025-12-02T14:15:25.118Z|184551|vconn_stream|ERR|send: Broken pipe
      2025-12-02T14:15:25.118Z|184552|rconn|WARN|br-int<->unix#1014211: connection dropped (Broken pipe)
      2025-12-02T14:16:25.128Z|184553|vconn_stream|ERR|send: Broken pipe
      2025-12-02T14:16:25.128Z|184554|rconn|WARN|br-int<->unix#1014221: connection dropped (Broken pipe)
      2025-12-02T14:17:25.120Z|184555|vconn_stream|ERR|send: Broken pipe
      2025-12-02T14:17:25.120Z|184556|rconn|WARN|br-int<->unix#1014231: connection dropped (Broken pipe)

      are seen in the logs.  They span through most of the entire log files for openvswitch on both sos reports.  

       

      Also seeing quite a few 

      Not updating pb chassis for cr-lrp-59b6130b-1fe4-48d0-a497-d07279d20b35 now as sb is readonly

      """related to Neutron agents flapping due to OVN state transitions. Yatin Karel from the OSP Networking team is engaged and has requested some core OVN team assistance to help figure out why ovn took so long to recover."""

              ovnteam@redhat.com OVN Team
              ctrautma@redhat.com Christian Trautman
              OVN QE OVN QE
              Votes:
              1 Vote for this issue
              Watchers:
              11 Start watching this issue

                Created:
                Updated:
                Resolved: