Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-45674

HOLDOVER and FREERUN events are received when BC master interface is taken down

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Duplicate
    • Icon: Undefined Undefined
    • None
    • 4.15.z, 4.17.z, 4.16.z, 4.18
    • Networking / ptp
    • Moderate
    • None
    • False
    • Hide

      None

      Show
      None

      Description of problem:
      Boundary clock card is showing holdover/freerun events when boundary clock master interface is taken down.

      Note that no clock state change is observed via metrics as expected. The issue 

      Failed test report from automation log:

      [FAIL] PTP Events and Metrics - interface down [It] should have no effect when Boundary Clock master interface goes down and up [49734, test_id:49734]
      /var/lib/jenkins/workspace/ocp-far-edge-vran-tests/cnf-gotests/test/ran/ptp/tests/ptp_interfaces.go:163
      

      In this environment ens1f3 is the BC slave interface, and ens1f0 is the master interface connected to downstream slave at eno12409npx. 

      When ens1f0 is down, eno12409npx/master shows state change to HOLDOVER and then FREERUN, which is expected, however ens1fx/master interface is also showing state change to HOLDOVER and then FREERUN:

      time="2024-12-04T18:56:58Z" level=debug msg="event sent {\n    \"id\": \"6b39e59f-8e4c-420c-9e59-579ff6e12059\",\n    \"type\": \"event.sync.ptp-status.ptp-state-change\",\n    \"source\": \"/sync/ptp-status/lock-state\",\n    \"dataContentType\": \"application/json\",\n    \"time\": \"2024-12-04T18:56:58.232693823Z\",\n    \"data\": {\n      \"version\": \"1.0\",\n      \"values\": [\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/ens1fx/master\",\n          \"data_type\": \"notification\",\n          \"value_type\": \"enumeration\",\n          \"value\": \"FREERUN\"\n        }
      
      ,\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/ens1fx/master\",\n          \"data_type\": \"metric\",\n          \"value_type\": \"decimal64.3\",\n          \"value\": \"-9999999999999999\"\n        }
      
      \n      ]\n    }\n  }"

      These "event sent" events were logged after I took down ens1f0:

      oc logs -n openshift-ptp ds/linuxptp-daemon cloud-event-proxy -f | grep "event sent"
      time="2024-12-04T18:56:57Z" level=debug msg="event sent {\n    \"id\": \"6b39e59f-8e4c-420c-9e59-579ff6e12059\",\n    \"type\": \"event.sync.ptp-status.ptp-state-change\",\n    \"source\": \"/sync/ptp-status/lock-state\",\n    \"dataContentType\": \"application/json\",\n    \"time\": \"2024-12-04T18:56:57.575899186Z\",\n    \"data\": {\n      \"version\": \"1.0\",\n      \"values\": [\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/eno12409npx/master\",\n          \"data_type\": \"notification\",\n          \"value_type\": \"enumeration\",\n          \"value\": \"HOLDOVER\"\n        }
      
      ,\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/eno12409npx/master\",\n          \"data_type\": \"metric\",\n          \"value_type\": \"decimal64.3\",\n          \"value\": \"-8\"\n        }
      
      \n      ]\n    }\n  }"
      time="2024-12-04T18:56:57Z" level=debug msg="event sent {\n    \"id\": \"9fdf0ab4-96a9-4c4c-bd71-40ef31bd14d8\",\n    \"type\": \"event.sync.sync-status.synchronization-state-change\",\n    \"source\": \"/sync/sync-status/sync-state\",\n    \"dataContentType\": \"application/json\",\n    \"time\": \"2024-12-04T18:56:57.57683281Z\",\n    \"data\": {\n      \"version\": \"1.0\",\n      \"values\": [\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/eno12409npx/master\",\n          \"data_type\": \"notification\",\n          \"value_type\": \"enumeration\",\n          \"value\": \"HOLDOVER\"\n        }
      
      \n      ]\n    }\n  }"
      time="2024-12-04T18:56:58Z" level=debug msg="event sent {\n    \"id\": \"6b39e59f-8e4c-420c-9e59-579ff6e12059\",\n    \"type\": \"event.sync.ptp-status.ptp-state-change\",\n    \"source\": \"/sync/ptp-status/lock-state\",\n    \"dataContentType\": \"application/json\",\n    \"time\": \"2024-12-04T18:56:58.105329279Z\",\n    \"data\": {\n      \"version\": \"1.0\",\n      \"values\": [\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/ens1fx/master\",\n          \"data_type\": \"notification\",\n          \"value_type\": \"enumeration\",\n          \"value\": \"HOLDOVER\"\n        }
      
      ,\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/ens1fx/master\",\n          \"data_type\": \"metric\",\n          \"value_type\": \"decimal64.3\",\n          \"value\": \"-2\"\n        }
      
      \n      ]\n    }\n  }"
      time="2024-12-04T18:56:58Z" level=debug msg="event sent {\n    \"id\": \"6b39e59f-8e4c-420c-9e59-579ff6e12059\",\n    \"type\": \"event.sync.ptp-status.ptp-state-change\",\n    \"source\": \"/sync/ptp-status/lock-state\",\n    \"dataContentType\": \"application/json\",\n    \"time\": \"2024-12-04T18:56:58.232693823Z\",\n    \"data\": {\n      \"version\": \"1.0\",\n      \"values\": [\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/ens1fx/master\",\n          \"data_type\": \"notification\",\n          \"value_type\": \"enumeration\",\n          \"value\": \"FREERUN\"\n        }
      
      ,\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/ens1fx/master\",\n          \"data_type\": \"metric\",\n          \"value_type\": \"decimal64.3\",\n          \"value\": \"-9999999999999999\"\n        }
      
      \n      ]\n    }\n  }"
      time="2024-12-04T18:56:58Z" level=debug msg="event sent {\n    \"id\": \"9fdf0ab4-96a9-4c4c-bd71-40ef31bd14d8\",\n    \"type\": \"event.sync.sync-status.synchronization-state-change\",\n    \"source\": \"/sync/sync-status/sync-state\",\n    \"dataContentType\": \"application/json\",\n    \"time\": \"2024-12-04T18:56:58.232949135Z\",\n    \"data\": {\n      \"version\": \"1.0\",\n      \"values\": [\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/ens1fx/master\",\n          \"data_type\": \"notification\",\n          \"value_type\": \"enumeration\",\n          \"value\": \"FREERUN\"\n        }
      
      \n      ]\n    }\n  }"
      time="2024-12-04T18:56:58Z" level=debug msg="event sent {\n    \"id\": \"6b39e59f-8e4c-420c-9e59-579ff6e12059\",\n    \"type\": \"event.sync.ptp-status.ptp-state-change\",\n    \"source\": \"/sync/ptp-status/lock-state\",\n    \"dataContentType\": \"application/json\",\n    \"time\": \"2024-12-04T18:56:58.293182288Z\",\n    \"data\": {\n      \"version\": \"1.0\",\n      \"values\": [\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/ens1fx/master\",\n          \"data_type\": \"notification\",\n          \"value_type\": \"enumeration\",\n          \"value\": \"LOCKED\"\n        }
      
      ,\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/ens1fx/master\",\n          \"data_type\": \"metric\",\n          \"value_type\": \"decimal64.3\",\n          \"value\": \"9\"\n        }
      
      \n      ]\n    }\n  }"
      time="2024-12-04T18:56:58Z" level=debug msg="event sent {\n    \"id\": \"9fdf0ab4-96a9-4c4c-bd71-40ef31bd14d8\",\n    \"type\": \"event.sync.sync-status.synchronization-state-change\",\n    \"source\": \"/sync/sync-status/sync-state\",\n    \"dataContentType\": \"application/json\",\n    \"time\": \"2024-12-04T18:56:58.293360145Z\",\n    \"data\": {\n      \"version\": \"1.0\",\n      \"values\": [\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/ens1fx/master\",\n          \"data_type\": \"notification\",\n          \"value_type\": \"enumeration\",\n          \"value\": \"LOCKED\"\n        }
      
      \n      ]\n    }\n  }"
      time="2024-12-04T18:57:02Z" level=debug msg="event sent {\n    \"id\": \"6b39e59f-8e4c-420c-9e59-579ff6e12059\",\n    \"type\": \"event.sync.ptp-status.ptp-state-change\",\n    \"source\": \"/sync/ptp-status/lock-state\",\n    \"dataContentType\": \"application/json\",\n    \"time\": \"2024-12-04T18:57:02.577739212Z\",\n    \"data\": {\n      \"version\": \"1.0\",\n      \"values\": [\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/eno12409npx/master\",\n          \"data_type\": \"notification\",\n          \"value_type\": \"enumeration\",\n          \"value\": \"FREERUN\"\n        }
      
      ,\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2.redhat.com/eno12409npx/master\",\n          \"data_type\": \"metric\",\n          \"value_type\": \"decimal64.3\",\n          \"value\": \"-8\"\n        }
      
      \n      ]\n    }\n  }"
      time="2024-12-04T18:57:02Z" level=debug msg="event sent {\n    \"id\": \"9fdf0ab4-96a9-4c4c-bd71-40ef31bd14d8\",\n    \"type\": \"event.sync.sync-status.synchronization-state-change\",\n    \"source\": \"/sync/sync-status/sync-state\",\n    \"dataContentType\": \"application/json\",\n    \"time\": \"2024-12-04T18:57:02.578073974Z\",\n    \"data\": {\n      \"version\": \"1.0\",\n      \"values\": [\n        
      
      {\n          \"ResourceAddress\": \"/cluster/node/helix66.lab.eng.rdu2. \{code}
      
      Version-Release number of selected component (if applicable):
      {code:none}
          

      How reproducible:

      100%    

      Steps to Reproduce:

          1. Deploy SNO with BC master and slave
          2. Take down BC master interface
          3. Monitor linuxptp-daemon cloud-event-proxy for events
          

      Actual results:

          BC slave clock state is affected when BC master is taken down

      Expected results:

          Holdover/freerun events are received on BC card, when BC master is taken down    

      Additional info:

          

              josricha@redhat.com Joseph Richard
              bblock@redhat.com Bonnie Block
              Bonnie Block Bonnie Block
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: