-
Bug
-
Resolution: Done
-
Normal
-
None
-
rhel-9.5
-
None
-
None
-
Moderate
-
rhel-sst-cs-stacks
-
ssg_core_services
-
None
-
False
-
-
None
-
None
-
None
-
None
-
-
x86_64
-
None
What were you trying to do that didn't work?
when set fifo:10 and taskset ptp4l/phc2sys to same cpu, offset can't converge. the sync procress is GM system clock --> GM phc --> OC phc --> OC systemclock. I found OC phc show huge offset on ptp4l.
Please provide the package NVR for which bug is seen:
kernel version: 5.14.0-452.el9/5.14.0-433.el9
linuxptp:linuxptp-4.2-2.el9.x86_64
GM nic info:
[root@dell-per740-65 ~]# ethtool -i ens1f0
driver: ice
version: 5.14.0-452.el9.x86_64
firmware-version: 4.30 0x8001af35 1.3429.0
expansion-rom-version:
bus-info: 0000:3b:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
[root@dell-per740-65 ~]# ethtool -T ens1f0
Time stamping parameters for ens1f0:
Capabilities:
hardware-transmit
software-transmit
hardware-receive
software-receive
software-system-clock
hardware-raw-clock
PTP Hardware Clock: 4
Hardware Transmit Timestamp Modes:
off
on
Hardware Receive Filter Modes:
none
all
OC nic info:
[root@dell-per750-09 ~]# ethtool -i ens7f0
driver: ice
version: 5.14.0-452.el9.x86_64
firmware-version: 4.20 0x80017789 1.3346.0
expansion-rom-version:
bus-info: 0000:ca:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
[root@dell-per750-09 ~]# ethtool -T ens7f0
Time stamping parameters for ens7f0:
Capabilities:
hardware-transmit
software-transmit
hardware-receive
software-receive
software-system-clock
hardware-raw-clock
PTP Hardware Clock: 6
Hardware Transmit Timestamp Modes:
off
on
Hardware Receive Filter Modes:
none
all
How reproducible: 100%
Steps to reproduce
1 change ice-ptp irq's cpu affinity and thread priority.
GM
sysctl -w kernel.sched_rt_runtime_us=-1
pgrep -f ice-ptp | xargs -I {} taskset -pc 0,1,24,25 {}
pgrep -f ice-ptp | xargs -I {} chrt -f -p 10 {}
OC
sysctl -w kernel.sched_rt_runtime_us=-1
pgrep -f ice-ptp | xargs -I {} taskset -pc 0,1,32,33 {}
pgrep -f ice-ptp | xargs -I {} chrt -f -p 10 {}
2. configure ipv4 address and start ptp4l on each site
GM
[root@dell-per740-65 ~]# chrt -f 10 taskset 8 ptp4l -EH4 -m -i ens1f0 --priority1=127 --domainNumber 70 ptp4l[929.049]: selected /dev/ptp4 as PTP clock ptp4l[929.050]: port 1 (ens1f0): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[929.051]: port 0 (/var/run/ptp4l): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[929.051]: port 0 (/var/run/ptp4lro): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[936.738]: port 1 (ens1f0): LISTENING to MASTER on ANNOUNCE_RECEIPT_TIMEOUT_EXPIRES ptp4l[936.738]: selected local clock b49691.fffe.a59f68 as best master ptp4l[936.738]: port 1 (ens1f0): assuming the grand master role [root@dell-per740-65 ~]# chrt -f 10 taskset 8 phc2sys -a -rr -m -n 70 phc2sys[949.950]: reconfiguring after port state change phc2sys[949.951]: selecting ens1f0 for synchronization phc2sys[949.951]: selecting CLOCK_REALTIME as source clock phc2sys[949.951]: ens1f0 sys offset -14436558452243 s0 freq -0 delay 671 phc2sys[950.952]: ens1f0 sys offset -14436558456562 s1 freq -4318 delay 679 phc2sys[951.953]: ens1f0 sys offset -671612 s2 freq -675930 delay 675 phc2sys[952.954]: ens1f0 sys offset 123 s2 freq -205679 delay 678 phc2sys[953.966]: ens1f0 sys offset 201982 s2 freq -3783 delay 673 phc2sys[954.967]: ens1f0 sys offset 203866 s2 freq +58696 delay 672 phc2sys[955.968]: ens1f0 sys offset 140860 s2 freq +56849 delay 676 phc2sys[956.969]: ens1f0 sys offset 79649 s2 freq +37896 delay 675 phc2sys[957.969]: ens1f0 sys offset 37396 s2 freq +19538 delay 679 phc2sys[958.970]: ens1f0 sys offset 13500 s2 freq +6861 delay 674 phc2sys[959.971]: ens1f0 sys offset 2318 s2 freq -271 delay 673 phc2sys[960.972]: ens1f0 sys offset -1718 s2 freq -3612 delay 672 phc2sys[961.973]: ens1f0 sys offset -2433 s2 freq -4842 delay 668 phc2sys[962.974]: ens1f0 sys offset -1889 s2 freq -5028 delay 678 phc2sys[963.977]: ens1f0 sys offset -1178 s2 freq -4884 delay 676 phc2sys[964.977]: ens1f0 sys offset -606 s2 freq -4665 delay 676 phc2sys[965.978]: ens1f0 sys offset -244 s2 freq -4485 delay 671 phc2sys[966.979]: ens1f0 sys offset -66 s2 freq -4380 delay 675 phc2sys[967.980]: ens1f0 sys offset 1 s2 freq -4333 delay 671 phc2sys[968.985]: ens1f0 sys offset 29 s2 freq -4305 delay 679 phc2sys[969.986]: ens1f0 sys offset 84 s2 freq -4241 delay 676 phc2sys[970.987]: ens1f0 sys offset 72 s2 freq -4228 delay 678 phc2sys[971.988]: ens1f0 sys offset 37 s2 freq -4241 delay 673 phc2sys[972.989]: ens1f0 sys offset 41 s2 freq -4226 delay 681 phc2sys[973.990]: ens1f0 sys offset -5 s2 freq -4260 delay 672 phc2sys[974.991]: ens1f0 sys offset 17 s2 freq -4239 delay 674 phc2sys[975.991]: ens1f0 sys offset 1 s2 freq -4250 delay 680 phc2sys[976.992]: ens1f0 sys offset -13 s2 freq -4264 delay 675 phc2sys[977.993]: ens1f0 sys offset -4 s2 freq -4259 delay 676 phc2sys[978.994]: ens1f0 sys offset 9 s2 freq -4247 delay 670 phc2sys[979.995]: ens1f0 sys offset 18 s2 freq -4235 delay 672 phc2sys[980.996]: ens1f0 sys offset 3 s2 freq -4245 delay 674 phc2sys[981.997]: ens1f0 sys offset 2 s2 freq -4245 delay 686 phc2sys[982.997]: ens1f0 sys offset -5 s2 freq -4251 delay 680 phc2sys[983.998]: ens1f0 sys offset -13 s2 freq -4261 delay 671 phc2sys[985.005]: ens1f0 sys offset -5 s2 freq -4257 delay 670 phc2sys[986.006]: ens1f0 sys offset -1 s2 freq -4254 delay 671 phc2sys[987.007]: ens1f0 sys offset -7 s2 freq -4260 delay 673 phc2sys[988.008]: ens1f0 sys offset -5 s2 freq -4261 delay 672
OC
[root@dell-per750-09 ~]# chrt -f 10 taskset 8 ptp4l -EH4 -m -i ens7f0 --priority1=128 --domainNumber 70 ptp4l[1040.405]: selected /dev/ptp6 as PTP clock ptp4l[1040.406]: port 1 (ens7f0): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[1040.406]: port 0 (/var/run/ptp4l): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[1040.406]: port 0 (/var/run/ptp4lro): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[1040.559]: port 1 (ens7f0): new foreign master b49691.fffe.a59f68-1 ptp4l[1044.559]: selected best master clock b49691.fffe.a59f68 ptp4l[1044.559]: port 1 (ens7f0): LISTENING to UNCALIBRATED on RS_SLAVE ptp4l[1046.559]: master offset -182284168 s0 freq -0 path delay 1332 ptp4l[1047.560]: master offset -182287519 s1 freq -3351 path delay 1332 ptp4l[1048.560]: master offset 5 s2 freq -3346 path delay 1332 ptp4l[1048.560]: port 1 (ens7f0): UNCALIBRATED to SLAVE on MASTER_CLOCK_SELECTED ptp4l[1049.560]: master offset 321 s2 freq -3028 path delay 1007 ptp4l[1050.560]: master offset 8 s2 freq -3245 path delay 1007 ptp4l[1051.560]: master offset -78 s2 freq -3328 path delay 973 ptp4l[1052.560]: master offset -54 s2 freq -3328 path delay 939 ptp4l[1053.560]: master offset -71 s2 freq -3361 path delay 925 ptp4l[1054.560]: master offset -42 s2 freq -3353 path delay 911 ptp4l[1055.560]: master offset -14436557788390 s2 freq -100000000 path delay 911 ptp4l[1056.560]: master offset -14436458475869 s2 freq -100000000 path delay 911 ptp4l[1057.560]: master offset -14436358778555 s2 freq -100000000 path delay 911 ptp4l[1058.560]: master offset -14436258822278 s2 freq -100000000 path delay 906 ptp4l[1059.560]: master offset -14436158770419 s2 freq -100000000 path delay 906 ptp4l[1060.560]: master offset -14436058705427 s2 freq -100000000 path delay 898 ptp4l[1061.560]: master offset -14435958660721 s2 freq -100000000 path delay 893 ptp4l[1062.648]: master offset -14435835876749 s2 freq -100000000 path delay -22755390 ptp4l[1063.793]: master offset -14435735864244 s2 freq -100000000 path delay -22755390 ptp4l[1064.848]: master offset -14435635856684 s2 freq -100000000 path delay -22755390 ptp4l[1065.948]: master offset -14435524031788 s2 freq -100000000 path delay -34575773 ptp4l[1067.048]: master offset -14435424032561 s2 freq -100000000 path delay -34575773 ptp4l[1068.148]: master offset -14435324032331 s2 freq -100000000 path delay -34575773 ptp4l[1069.248]: master offset -14435231315951 s2 freq -100000000 path delay -27290312 ptp4l[1070.348]: master offset -14435137375087 s2 freq -100000000 path delay -21230533 ptp4l[1071.448]: master offset -14435037374119 s2 freq -100000000 path delay -21230533 ptp4l[1072.548]: master offset -14434939121132 s2 freq -100000000 path delay -19481963 ptp4l[1073.649]: master offset -14434837371987 s2 freq -100000000 path delay -21230533 ptp4l[1074.749]: master offset -14434734057960 s2 freq -100000000 path delay -24541206 ptp4l[1075.849]: master offset -14434637368397 s2 freq -100000000 path delay -21230533 ptp4l[1076.949]: master offset -14434537367090 s2 freq -100000000 path delay -21230533 ptp4l[1078.049]: master offset -14434437367511 s2 freq -100000000 path delay -21230533 ptp4l[1079.149]: master offset -14434334363139 s2 freq -100000000 path delay -24232390 ptp4l[1080.249]: master offset -14434234360614 s2 freq -100000000 path delay -24232390 ptp4l[1081.349]: master offset -14434131561873 s2 freq -100000000 path delay -27031181 ptp4l[1082.449]: master offset -14434031547091 s2 freq -100000000 path delay -27042761 ptp4l[1083.550]: master offset -14433929110147 s2 freq -100000000 path delay -29477957 ptp4l[1084.650]: master offset -14433831545187 s2 freq -100000000 path delay -27042761 ptp4l[1085.750]: master offset -14433725356884 s2 freq -100000000 path delay -33229533 ptp4l[1086.850]: master offset -14433631543849 s2 freq -100000000 path delay -27042761 ptp4l[1087.950]: master offset -14433532506369 s2 freq -100000000 path delay -26079403 ptp4l[1089.050]: master offset -14433432504945 s2 freq -100000000 path delay -26079403 ptp4l[1090.150]: master offset -14433332505052 s2 freq -100000000 path delay -26079403 ptp4l[1091.250]: master offset -14433234601637 s2 freq -100000000 path delay -23980538 ptp4l[1092.350]: master offset -14433134599686 s2 freq -100000000 path delay -23980538 ptp4l[1093.451]: master offset -14433034596832 s2 freq -100000000 path delay -23980538 ptp4l[1094.551]: master offset -14432934594469 s2 freq -100000000 path delay -23980538 ptp4l[1095.651]: master offset -14432834593145 s2 freq -100000000 path delay -23980538 ptp4l[1096.751]: master offset -14432737956109 s2 freq -100000000 path delay -20615492 ptp4l[1097.851]: master offset -14432637953786 s2 freq -100000000 path delay -20615492 ptp4l[1098.965]: master offset -14432537951204 s2 freq -100000000 path delay -20615492 ptp4l[1100.051]: master offset -14432442537649 s2 freq -100000000 path delay -16027496 ptp4l[1101.151]: master offset -14432342536157 s2 freq -100000000 path delay -16027496 ptp4l[1102.252]: master offset -14432245140322 s2 freq -100000000 path delay -13422213 ptp4l[1103.352]: master offset -14432145137997 s2 freq -100000000 path delay -13422213 ptp4l[1104.452]: master offset -14432037747679 s2 freq -100000000 path delay -20811916 ptp4l[1105.552]: master offset -14431937167800 s2 freq -100000000 path delay -21387595 ptp4l[1106.652]: master offset -14431837169064 s2 freq -100000000 path delay -21387595 [root@dell-per750-09 ~]# chrt -f 10 taskset 8 phc2sys -a -r -m -n 70 phc2sys[1060.688]: reconfiguring after port state change phc2sys[1060.688]: selecting ens7f0 as domain source clock phc2sys[1060.688]: selecting CLOCK_REALTIME for synchronization phc2sys[1060.688]: CLOCK_REALTIME phc offset 14436045803587 s0 freq -3677 delay 516 phc2sys[1061.688]: CLOCK_REALTIME phc offset 14435945807278 s1 freq -99995760 delay 606 phc2sys[1062.692]: CLOCK_REALTIME phc offset -4270 s2 freq -100000000 delay 666 phc2sys[1063.792]: CLOCK_REALTIME phc offset -30 s2 freq -99995790 delay 556 phc2sys[1064.821]: CLOCK_REALTIME phc offset 7 s2 freq -99995762 delay 659 phc2sys[1065.845]: CLOCK_REALTIME phc offset 11 s2 freq -99995756 delay 659 phc2sys[1066.935]: CLOCK_REALTIME phc offset 9 s2 freq -99995754 delay 664 phc2sys[1067.994]: CLOCK_REALTIME phc offset 8 s2 freq -99995753 delay 670 phc2sys[1069.030]: CLOCK_REALTIME phc offset 31 s2 freq -99995727 delay 656 phc2sys[1070.062]: CLOCK_REALTIME phc offset -19 s2 freq -99995768 delay 669 phc2sys[1071.072]: CLOCK_REALTIME phc offset 14 s2 freq -99995741 delay 567 phc2sys[1072.094]: CLOCK_REALTIME phc offset -9 s2 freq -99995759 delay 658 phc2sys[1073.149]: CLOCK_REALTIME phc offset 6 s2 freq -99995747 delay 657 phc2sys[1074.199]: CLOCK_REALTIME phc offset 19 s2 freq -99995732 delay 656 phc2sys[1075.200]: CLOCK_REALTIME phc offset 3 s2 freq -99995743 delay 660 phc2sys[1076.235]: CLOCK_REALTIME phc offset -5 s2 freq -99995750 delay 658 phc2sys[1077.258]: CLOCK_REALTIME phc offset -18 s2 freq -99995764 delay 660 phc2sys[1078.279]: CLOCK_REALTIME phc offset 1 s2 freq -99995751 delay 658 phc2sys[1079.292]: CLOCK_REALTIME phc offset 11 s2 freq -99995740 delay 659 phc2sys[1080.297]: CLOCK_REALTIME phc offset -9 s2 freq -99995757 delay 656 phc2sys[1081.299]: CLOCK_REALTIME phc offset -2 s2 freq -99995753 delay 656 phc2sys[1082.333]: CLOCK_REALTIME phc offset 25 s2 freq -99995726 delay 568 phc2sys[1083.396]: CLOCK_REALTIME phc offset 4 s2 freq -99995740 delay 578 phc2sys[1084.427]: CLOCK_REALTIME phc offset -22 s2 freq -99995765 delay 663 phc2sys[1085.504]: CLOCK_REALTIME phc offset -15 s2 freq -99995764 delay 667 phc2sys[1086.565]: CLOCK_REALTIME phc offset -12 s2 freq -99995766 delay 657 phc2sys[1087.621]: CLOCK_REALTIME phc offset 17 s2 freq -99995740 delay 660 phc2sys[1088.634]: CLOCK_REALTIME phc offset 5 s2 freq -99995747 delay 665 phc2sys[1089.692]: CLOCK_REALTIME phc offset -9 s2 freq -99995760 delay 657 phc2sys[1090.744]: CLOCK_REALTIME phc offset -6 s2 freq -99995759 delay 667 phc2sys[1091.758]: CLOCK_REALTIME phc offset 12 s2 freq -99995743 delay 661 phc2sys[1092.789]: CLOCK_REALTIME phc offset 21 s2 freq -99995731 delay 659 phc2sys[1093.822]: CLOCK_REALTIME phc offset -2 s2 freq -99995747 delay 566 phc2sys[1094.850]: CLOCK_REALTIME phc offset 1 s2 freq -99995745 delay 569 phc2sys[1095.866]: CLOCK_REALTIME phc offset -11 s2 freq -99995757 delay 659 phc2sys[1096.878]: CLOCK_REALTIME phc offset -6 s2 freq -99995755 delay 658 phc2sys[1097.880]: CLOCK_REALTIME phc offset -14 s2 freq -99995765 delay 656 phc2sys[1098.960]: CLOCK_REALTIME phc offset 28 s2 freq -99995727 delay 568 phc2sys[1100.024]: CLOCK_REALTIME phc offset -6 s2 freq -99995752 delay 654 phc2sys[1101.079]: CLOCK_REALTIME phc offset -1 s2 freq -99995749 delay 656 phc2sys[1102.128]: CLOCK_REALTIME phc offset 31 s2 freq -99995718 delay 524 phc2sys[1103.156]: CLOCK_REALTIME phc offset -28 s2 freq -99995767 delay 659 phc2sys[1104.237]: CLOCK_REALTIME phc offset -6 s2 freq -99995754 delay 670 phc2sys[1105.250]: CLOCK_REALTIME phc offset 28 s2 freq -99995721 delay 568 phc2sys[1106.319]: CLOCK_REALTIME phc offset -11 s2 freq -99995752 delay 569 phc2sys[1107.343]: CLOCK_REALTIME phc offset -2 s2 freq -99995746 delay 567 phc2sys[1108.372]: CLOCK_REALTIME phc offset 0 s2 freq -99995745 delay 660 phc2sys[1109.428]: CLOCK_REALTIME phc offset -1 s2 freq -99995746 delay 656 phc2sys[1110.528]: CLOCK_REALTIME phc offset -16 s2 freq -99995761 delay 669 phc2sys[1111.629]: CLOCK_REALTIME phc offset 14 s2 freq -99995736 delay 669 phc2sys[1112.646]: CLOCK_REALTIME phc offset -2 s2 freq -99995748 delay 568 phc2sys[1113.746]: CLOCK_REALTIME phc offset -18 s2 freq -99995764 delay 657 phc2sys[1114.846]: CLOCK_REALTIME phc offset 15 s2 freq -99995737 delay 658 phc2sys[1115.946]: CLOCK_REALTIME phc offset -8 s2 freq -99995755 delay 656 phc2sys[1116.992]: CLOCK_REALTIME phc offset 14 s2 freq -99995736 delay 567 phc2sys[1118.091]: CLOCK_REALTIME phc offset 7 s2 freq -99995739 delay 570 phc2sys[1119.189]: CLOCK_REALTIME phc offset -5 s2 freq -99995748 delay 570 ^Cphc2sys[1119.312]: CLOCK_REALTIME phc offset -5 s2 freq -99995750 delay 568
3 if keep the same cpu set and thread priority on GM, but don't tunning on OC site. It will work as well.
GM
[root@dell-per740-65 ~]chrt -f 10 taskset 8 ptp4l -EH4 -m -i ens1f0 --priority1=127 --domainNumber 70 ptp4l[1595.971]: selected /dev/ptp4 as PTP clock ptp4l[1595.972]: port 1 (ens1f0): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[1595.972]: port 0 (/var/run/ptp4l): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[1595.972]: port 0 (/var/run/ptp4lro): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[1603.662]: port 1 (ens1f0): LISTENING to MASTER on ANNOUNCE_RECEIPT_TIMEOUT_EXPIRES ptp4l[1603.662]: selected local clock b49691.fffe.a59f68 as best master ptp4l[1603.662]: port 1 (ens1f0): assuming the grand master role ptp4l[1604.393]: port 1 (ens1f0): new foreign master b49691.fffe.a59bf0-1 [root@dell-per740-65 ~]# phc2sys -a -rr -m -n 70 phc2sys[1598.385]: ens1f0 sys offset -83 s0 freq -4153 delay 665 phc2sys[1599.400]: ens1f0 sys offset -96 s2 freq -4166 delay 631 phc2sys[1600.401]: ens1f0 sys offset -64 s2 freq -4230 delay 681 phc2sys[1601.402]: ens1f0 sys offset 11 s2 freq -4174 delay 669 phc2sys[1602.403]: ens1f0 sys offset 11 s2 freq -4171 delay 672 phc2sys[1603.404]: ens1f0 sys offset 18 s2 freq -4160 delay 678 phc2sys[1604.404]: port b49691.fffe.a59f68-1 changed state phc2sys[1604.404]: reconfiguring after port state change phc2sys[1604.404]: selecting ens1f0 for synchronization phc2sys[1604.404]: selecting CLOCK_REALTIME as source clock phc2sys[1604.404]: ens1f0 sys offset 26 s0 freq -4160 delay 685 phc2sys[1605.419]: ens1f0 sys offset 42 s2 freq -4157 delay 672 phc2sys[1606.420]: ens1f0 sys offset 37 s2 freq -4120 delay 678 phc2sys[1607.421]: ens1f0 sys offset -21 s2 freq -4167 delay 669 phc2sys[1608.422]: ens1f0 sys offset -18 s2 freq -4170 delay 636 phc2sys[1609.422]: ens1f0 sys offset 10 s2 freq -4147 delay 674 phc2sys[1610.423]: ens1f0 sys offset 3 s2 freq -4151 delay 676 phc2sys[1611.424]: ens1f0 sys offset -6 s2 freq -4160 delay 683 phc2sys[1612.425]: ens1f0 sys offset -22 s2 freq -4177 delay 679 phc2sys[1613.442]: ens1f0 sys offset -8 s2 freq -4170 delay 671 phc2sys[1614.443]: ens1f0 sys offset -10 s2 freq -4174 delay 676 phc2sys[1615.445]: ens1f0 sys offset 5 s2 freq -4162 delay 672 phc2sys[1616.461]: ens1f0 sys offset 13 s2 freq -4153 delay 668 phc2sys[1617.469]: ens1f0 sys offset -4 s2 freq -4166 delay 680 phc2sys[1618.470]: ens1f0 sys offset 15 s2 freq -4148 delay 682 phc2sys[1619.471]: ens1f0 sys offset -10 s2 freq -4169 delay 670 phc2sys[1620.472]: ens1f0 sys offset -1 s2 freq -4163 delay 681 phc2sys[1621.473]: ens1f0 sys offset -17 s2 freq -4179 delay 672 phc2sys[1622.474]: ens1f0 sys offset 6 s2 freq -4161 delay 682 phc2sys[1623.474]: ens1f0 sys offset 18 s2 freq -4147 delay 676 phc2sys[1624.489]: ens1f0 sys offset 1 s2 freq -4159 delay 679 phc2sys[1625.493]: ens1f0 sys offset -13 s2 freq -4173 delay 675 phc2sys[1626.494]: ens1f0 sys offset 5 s2 freq -4158 delay 672 phc2sys[1627.494]: ens1f0 sys offset -6 s2 freq -4168 delay 681 phc2sys[1628.495]: ens1f0 sys offset 21 s2 freq -4143 delay 677 phc2sys[1629.509]: ens1f0 sys offset -11 s2 freq -4168 delay 672 phc2sys[1630.510]: ens1f0 sys offset 9 s2 freq -4152 delay 679 phc2sys[1631.511]: ens1f0 sys offset -12 s2 freq -4170 delay 685 phc2sys[1632.512]: ens1f0 sys offset -11 s2 freq -4173 delay 675 phc2sys[1633.513]: ens1f0 sys offset 21 s2 freq -4144 delay 672 phc2sys[1634.513]: ens1f0 sys offset -5 s2 freq -4164 delay 673 phc2sys[1635.514]: ens1f0 sys offset -5 s2 freq -4165 delay 670 phc2sys[1636.529]: ens1f0 sys offset -1 s2 freq -4163 delay 676 phc2sys[1637.532]: ens1f0 sys offset 15 s2 freq -4147 delay 675 phc2sys[1638.533]: ens1f0 sys offset -6 s2 freq -4163 delay 676 phc2sys[1639.534]: ens1f0 sys offset -15 s2 freq -4174 delay 669 phc2sys[1640.536]: ens1f0 sys offset 5 s2 freq -4159 delay 673 phc2sys[1641.549]: ens1f0 sys offset 8 s2 freq -4154 delay 675 phc2sys[1642.550]: ens1f0 sys offset 7 s2 freq -4153 delay 671 phc2sys[1643.551]: ens1f0 sys offset -6 s2 freq -4164 delay 677 phc2sys[1644.552]: ens1f0 sys offset 0 s2 freq -4160 delay 678 phc2sys[1645.553]: ens1f0 sys offset 4 s2 freq -4156 delay 679 phc2sys[1646.553]: ens1f0 sys offset -1 s2 freq -4159 delay 679 phc2sys[1647.554]: ens1f0 sys offset -23 s2 freq -4182 delay 675 phc2sys[1648.569]: ens1f0 sys offset 17 s2 freq -4149 delay 680 phc2sys[1649.570]: ens1f0 sys offset 4 s2 freq -4156 delay 672 phc2sys[1650.571]: ens1f0 sys offset -1 s2 freq -4160 delay 678 phc2sys[1651.572]: ens1f0 sys offset 0 s2 freq -4160 delay 677 phc2sys[1652.573]: ens1f0 sys offset -9 s2 freq -4169 delay 669 phc2sys[1653.573]: ens1f0 sys offset 3 s2 freq -4159 delay 680 phc2sys[1654.574]: ens1f0 sys offset 14 s2 freq -4147 delay 677 phc2sys[1655.589]: ens1f0 sys offset 1 s2 freq -4156 delay 679 phc2sys[1656.590]: ens1f0 sys offset -20 s2 freq -4177 delay 676 phc2sys[1657.591]: ens1f0 sys offset 13 s2 freq -4150 delay 673 phc2sys[1658.592]: ens1f0 sys offset -1 s2 freq -4160 delay 671
OC
[root@dell-per750-09 ~]# ptp4l -EH4 -m -i ens7f0 --priority1=128 --domainNumber 70 ptp4l[1739.793]: selected /dev/ptp6 as PTP clock ptp4l[1739.794]: port 1 (ens7f0): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[1739.794]: port 0 (/var/run/ptp4l): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[1739.794]: port 0 (/var/run/ptp4lro): INITIALIZING to LISTENING on INIT_COMPLETE ptp4l[1745.428]: port 1 (ens7f0): new foreign master b49691.fffe.a59f68-1 ptp4l[1746.170]: port 1 (ens7f0): LISTENING to MASTER on ANNOUNCE_RECEIPT_TIMEOUT_EXPIRES ptp4l[1746.170]: selected local clock b49691.fffe.a59bf0 as best master ptp4l[1746.171]: port 1 (ens7f0): assuming the grand master role ptp4l[1749.445]: selected best master clock b49691.fffe.a59f68 ptp4l[1749.445]: port 1 (ens7f0): MASTER to UNCALIBRATED on RS_SLAVE ptp4l[1751.445]: master offset 519892797 s0 freq -19845654 path delay -2674441 ptp4l[1752.451]: master offset 542270591 s1 freq +2530403 path delay -5212591 ptp4l[1753.455]: master offset -2402439 s2 freq +127964 path delay -5212591 ptp4l[1753.455]: port 1 (ens7f0): UNCALIBRATED to SLAVE on MASTER_CLOCK_SELECTED ptp4l[1754.451]: master offset -5101738 s2 freq -3292067 path delay -2674441 ptp4l[1755.451]: master offset -1838561 s2 freq -1559411 path delay -2674441 ptp4l[1756.458]: master offset -1444368 s2 freq -1716787 path delay -1506416 ptp4l[1757.456]: master offset -730158 s2 freq -1435887 path delay -512877 ptp4l[1758.458]: master offset 700024 s2 freq -224752 path delay -512877 ptp4l[1759.464]: master offset 836653 s2 freq +121884 path delay -425634 ptp4l[1760.460]: master offset 463557 s2 freq -216 path delay -178390 ptp4l[1761.459]: master offset 455523 s2 freq +130817 path delay -178390 ptp4l[1762.463]: master offset 136930 s2 freq -51119 path delay 2501 ptp4l[1763.458]: master offset 178740 s2 freq +31770 path delay 2501 ptp4l[1764.458]: master offset 126821 s2 freq +33473 path delay 15531 ptp4l[1765.462]: master offset 88875 s2 freq +33573 path delay 12458 ptp4l[1766.458]: master offset 47756 s2 freq +19117 path delay 12458 ptp4l[1767.457]: master offset 20996 s2 freq +6683 path delay 12471 ptp4l[1768.462]: master offset 6691 s2 freq -1323 path delay 12471 ptp4l[1769.458]: master offset 5173 s2 freq -834 path delay 7684 ptp4l[1770.457]: master offset -1131 s2 freq -5586 path delay 7267 ptp4l[1771.462]: master offset -3104 s2 freq -7898 path delay 7267 ptp4l[1772.458]: master offset -2219 s2 freq -7944 path delay 6703 ptp4l[1773.458]: master offset -1213 s2 freq -7604 path delay 6100 ptp4l[1774.462]: master offset 403 s2 freq -6352 path delay 4524 ptp4l[1775.458]: master offset 1822 s2 freq -4812 path delay 1909 ptp4l[1776.458]: master offset -888 s2 freq -6975 path delay 1909 ptp4l[1777.463]: master offset -659 s2 freq -7013 path delay 1092 ptp4l[1778.458]: master offset -1195 s2 freq -7746 path delay 1092 ptp4l[1779.458]: master offset -827 s2 freq -7737 path delay 908 ptp4l[1780.462]: master offset -595 s2 freq -7753 path delay 863 ptp4l[1781.458]: master offset -392 s2 freq -7728 path delay 863 ptp4l[1782.458]: master offset -221 s2 freq -7675 path delay 863 ptp4l[1783.462]: master offset -108 s2 freq -7628 path delay 871 ptp4l[1784.458]: master offset -12 s2 freq -7565 path delay 863 ptp4l[1785.458]: master offset 18 s2 freq -7538 path delay 863 ptp4l[1786.462]: master offset -2 s2 freq -7553 path delay 863 ptp4l[1787.458]: master offset -2 s2 freq -7554 path delay 863 ptp4l[1788.458]: master offset 6 s2 freq -7546 path delay 863 ptp4l[1789.463]: master offset -10 s2 freq -7560 path delay 876 ptp4l[1790.458]: master offset -28 s2 freq -7581 path delay 889 ptp4l[1791.458]: master offset 18 s2 freq -7544 path delay 889 ptp4l[1792.462]: master offset 10 s2 freq -7546 path delay 896 ptp4l[1793.458]: master offset 0 s2 freq -7553 path delay 899 ptp4l[1794.458]: master offset 12 s2 freq -7541 path delay 899 ptp4l[1795.463]: master offset -16 s2 freq -7566 path delay 899 ptp4l[1796.458]: master offset 5 s2 freq -7550 path delay 898 ptp4l[1797.458]: master offset 13 s2 freq -7540 path delay 898 ptp4l[1798.463]: master offset 13 s2 freq -7536 path delay 898 ptp4l[1799.458]: master offset -22 s2 freq -7567 path delay 898 ptp4l[1800.458]: master offset 20 s2 freq -7532 path delay 897 ptp4l[1801.462]: master offset 5 s2 freq -7541 path delay 897 ptp4l[1802.458]: master offset -32 s2 freq -7576 path delay 899 ptp4l[1803.458]: master offset -5 s2 freq -7559 path delay 895 ptp4l[1804.462]: master offset 28 s2 freq -7527 path delay 895 ptp4l[1805.458]: master offset -1 s2 freq -7548 path delay 897 ptp4l[1806.458]: master offset -16 s2 freq -7563 path delay 897 ptp4l[1807.463]: master offset 21 s2 freq -7531 path delay 892 ptp4l[1808.458]: master offset -10 s2 freq -7556 path delay 892 ptp4l[1809.458]: master offset 5 s2 freq -7544 path delay 892 ptp4l[1810.462]: master offset 19 s2 freq -7528 path delay 892 ptp4l[1811.458]: master offset 13 s2 freq -7529 path delay 892 ptp4l[1812.458]: master offset -1 s2 freq -7539 path delay 892 ptp4l[1813.462]: master offset -3 s2 freq -7541 path delay 894 [root@dell-per750-09 ~]# phc2sys -a -r -m -n 70 phc2sys[1746.674]: port b49691.fffe.a59bf0-1 changed state phc2sys[1746.674]: reconfiguring after port state change phc2sys[1746.674]: selecting ens7f0 for synchronization phc2sys[1749.674]: port b49691.fffe.a59bf0-1 changed state phc2sys[1749.674]: reconfiguring after port state change phc2sys[1749.674]: source clock not ready, waiting... phc2sys[1753.675]: port b49691.fffe.a59bf0-1 changed state phc2sys[1753.675]: reconfiguring after port state change phc2sys[1753.675]: selecting ens7f0 as domain source clock phc2sys[1753.675]: selecting CLOCK_REALTIME for synchronization phc2sys[1753.675]: CLOCK_REALTIME phc offset 426819256 s0 freq -3602 delay 575 phc2sys[1754.675]: CLOCK_REALTIME phc offset 426188854 s1 freq -633951 delay 575 phc2sys[1755.675]: CLOCK_REALTIME phc offset -2265791 s2 freq -2899742 delay 662 phc2sys[1756.676]: CLOCK_REALTIME phc offset -958839 s2 freq -2272527 delay 576 phc2sys[1757.679]: CLOCK_REALTIME phc offset -336820 s2 freq -1938160 delay 576 phc2sys[1758.681]: CLOCK_REALTIME phc offset 438882 s2 freq -1263504 delay 658 phc2sys[1759.682]: CLOCK_REALTIME phc offset 1557053 s2 freq -13668 delay 667 phc2sys[1760.682]: CLOCK_REALTIME phc offset 1669375 s2 freq +565769 delay 658 phc2sys[1761.682]: CLOCK_REALTIME phc offset 1136170 s2 freq +533377 delay 572 phc2sys[1762.682]: CLOCK_REALTIME phc offset 697338 s2 freq +435396 delay 575 phc2sys[1763.682]: CLOCK_REALTIME phc offset 232997 s2 freq +180256 delay 658 phc2sys[1764.682]: CLOCK_REALTIME phc offset 88733 s2 freq +105891 delay 656 phc2sys[1765.682]: CLOCK_REALTIME phc offset 20202 s2 freq +63980 delay 577 phc2sys[1766.683]: CLOCK_REALTIME phc offset -9579 s2 freq +40260 delay 576 phc2sys[1767.683]: CLOCK_REALTIME phc offset -29652 s2 freq +17313 delay 575 phc2sys[1768.683]: CLOCK_REALTIME phc offset -38171 s2 freq -101 delay 575 phc2sys[1769.683]: CLOCK_REALTIME phc offset -35434 s2 freq -8816 delay 660 phc2sys[1770.683]: CLOCK_REALTIME phc offset -24641 s2 freq -8653 delay 662 phc2sys[1771.683]: CLOCK_REALTIME phc offset -18194 s2 freq -9598 delay 667 phc2sys[1772.683]: CLOCK_REALTIME phc offset -12642 s2 freq -9504 delay 656 phc2sys[1773.683]: CLOCK_REALTIME phc offset -7115 s2 freq -7770 delay 587 phc2sys[1774.683]: CLOCK_REALTIME phc offset -2815 s2 freq -5604 delay 660 phc2sys[1775.683]: CLOCK_REALTIME phc offset 675 s2 freq -2959 delay 658 phc2sys[1776.684]: CLOCK_REALTIME phc offset 2200 s2 freq -1231 delay 666 phc2sys[1777.684]: CLOCK_REALTIME phc offset 325 s2 freq -2446 delay 575 phc2sys[1778.684]: CLOCK_REALTIME phc offset -538 s2 freq -3212 delay 577 phc2sys[1779.684]: CLOCK_REALTIME phc offset -1179 s2 freq -4014 delay 575 phc2sys[1780.684]: CLOCK_REALTIME phc offset -1059 s2 freq -4248 delay 658 phc2sys[1781.684]: CLOCK_REALTIME phc offset -671 s2 freq -4178 delay 658 phc2sys[1782.684]: CLOCK_REALTIME phc offset -333 s2 freq -4041 delay 656 phc2sys[1783.684]: CLOCK_REALTIME phc offset -85 s2 freq -3893 delay 660 phc2sys[1784.684]: CLOCK_REALTIME phc offset 65 s2 freq -3768 delay 666 phc2sys[1785.684]: CLOCK_REALTIME phc offset 144 s2 freq -3670 delay 656 phc2sys[1786.685]: CLOCK_REALTIME phc offset 138 s2 freq -3633 delay 665 phc2sys[1787.685]: CLOCK_REALTIME phc offset 93 s2 freq -3636 delay 662 phc2sys[1788.685]: CLOCK_REALTIME phc offset 29 s2 freq -3672 delay 657 phc2sys[1789.685]: CLOCK_REALTIME phc offset 33 s2 freq -3660 delay 574 phc2sys[1790.685]: CLOCK_REALTIME phc offset -13 s2 freq -3696 delay 575 phc2sys[1791.685]: CLOCK_REALTIME phc offset -14 s2 freq -3701 delay 662 phc2sys[1792.685]: CLOCK_REALTIME phc offset 1 s2 freq -3690 delay 656 phc2sys[1793.685]: CLOCK_REALTIME phc offset 20 s2 freq -3671 delay 666 phc2sys[1794.685]: CLOCK_REALTIME phc offset -5 s2 freq -3690 delay 660 phc2sys[1795.686]: CLOCK_REALTIME phc offset 10 s2 freq -3676 delay 668 phc2sys[1796.686]: CLOCK_REALTIME phc offset 14 s2 freq -3669 delay 666 phc2sys[1797.686]: CLOCK_REALTIME phc offset 6 s2 freq -3673 delay 657 phc2sys[1798.686]: CLOCK_REALTIME phc offset 5 s2 freq -3672 delay 656 phc2sys[1799.686]: CLOCK_REALTIME phc offset -5 s2 freq -3681 delay 658 phc2sys[1800.686]: CLOCK_REALTIME phc offset -4 s2 freq -3681 delay 575 phc2sys[1801.686]: CLOCK_REALTIME phc offset 6 s2 freq -3672 delay 577 phc2sys[1802.686]: CLOCK_REALTIME phc offset -29 s2 freq -3706 delay 667 phc2sys[1803.686]: CLOCK_REALTIME phc offset -18 s2 freq -3703 delay 657 phc2sys[1804.686]: CLOCK_REALTIME phc offset 4 s2 freq -3687 delay 658 phc2sys[1805.687]: CLOCK_REALTIME phc offset 26 s2 freq -3663 delay 666 phc2sys[1806.687]: CLOCK_REALTIME phc offset 1 s2 freq -3681 delay 662 phc2sys[1807.687]: CLOCK_REALTIME phc offset 11 s2 freq -3670 delay 659 phc2sys[1808.687]: CLOCK_REALTIME phc offset 1 s2 freq -3677 delay 667 phc2sys[1809.687]: CLOCK_REALTIME phc offset -12 s2 freq -3690 delay 661 phc2sys[1810.687]: CLOCK_REALTIME phc offset -3 s2 freq -3684 delay 659 phc2sys[1811.687]: CLOCK_REALTIME phc offset 48 s2 freq -3634 delay 577 phc2sys[1812.687]: CLOCK_REALTIME phc offset 4 s2 freq -3664 delay 660 phc2sys[1813.687]: CLOCK_REALTIME phc offset -22 s2 freq -3689 delay 658 phc2sys[1814.687]: CLOCK_REALTIME phc offset -12 s2 freq -3685 delay 659 phc2sys[1815.688]: CLOCK_REALTIME phc offset 0 s2 freq -3677 delay 657 ^Cphc2sys[1816.500]: CLOCK_REALTIME phc offset 13 s2 freq -3664 delay 574
Expected results
Base on https://bugzilla.redhat.com/show_bug.cgi?id=2136038#c57 and https://docs.openshift.com/container-platform/4.9/networking/using-ptp.html#cnf-configuring-fifo-priority-scheduling-for-ptp_using-ptp
tunning ptp4l and phc2sys is neccessary if test nic belong to ice.
Actual results
Add fifo:10 and taskset 8 on OC site, let offset can't converge
