Collaborate with the SDN Team on the spike to check if we can support Path MTU (PMTU) Discovery (PMTUD) to hybrid adapt the MTU according to the target, the same way EC2 works on Local Zone nodes communicating with nodes in the region:

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/network_mtu.html#path_mtu_discovery

"Path MTU Discovery (PMTUD) is used to determine the path MTU between two devices. The path MTU is the maximum packet size that's supported on the path between the originating host and the receiving host. When there is a difference in the MTU size in the network between two hosts, PMTUD enables the receiving host to respond to the originating host with an ICMP message. This ICMP message instructs the originating host to use the lowest MTU size along the network path and to resend the request. Without this negotiation, packet drop can occur because the request is too large for the receiving host to accept."

References:

• https://issues.redhat.com/browse/OCPBU-303
• https://issues.redhat.com/browse/SDN-3857