https://issues.redhat.com/browse/NETOBSERV-617


Without setting GRPC_MESSAGE_MAX_FLOWS: 



time="2023-02-21T21:41:35Z" level=debug msg="sending 8972 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:41:50Z" level=debug msg="sending 10000 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:41:50Z" level=debug msg="sending 1728 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:42:04Z" level=debug msg="sending 1 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:42:05Z" level=debug msg="sending 6018 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:42:20Z" level=debug msg="sending 5364 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:42:35Z" level=debug msg="sending 5912 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:42:50Z" level=debug msg="sending 5614 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:43:05Z" level=debug msg="sending 5786 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:43:20Z" level=debug msg="sending 5414 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:43:35Z" level=debug msg="sending 5656 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:43:50Z" level=debug msg="sending 6706 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:44:05Z" level=debug msg="sending 5620 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:44:20Z" level=debug msg="sending 6014 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:44:34Z" level=debug msg="sending 1 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:44:35Z" level=debug msg="sending 7760 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:44:50Z" level=debug msg="sending 9012 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:45:05Z" level=debug msg="sending 6760 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:45:20Z" level=debug msg="sending 5444 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:45:35Z" level=debug msg="sending 5614 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:45:50Z" level=debug msg="sending 5538 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:46:05Z" level=debug msg="sending 5722 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:46:20Z" level=debug msg="sending 5570 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:46:35Z" level=debug msg="sending 5692 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:46:50Z" level=debug msg="sending 5512 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:47:05Z" level=debug msg="sending 6852 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:47:20Z" level=debug msg="sending 5350 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:47:35Z" level=debug msg="sending 5900 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:47:50Z" level=debug msg="sending 7900 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:48:04Z" level=debug msg="sending 1 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:48:05Z" level=debug msg="sending 10000 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:48:05Z" level=debug msg="sending 162 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:48:20Z" level=debug msg="sending 5312 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:48:35Z" level=debug msg="sending 5700 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:48:50Z" level=debug msg="sending 5590 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:49:05Z" level=debug msg="sending 5741 records" collector="10.0.186.242:2055" component=exporter/GRPCProto


time="2023-02-21T21:49:20Z" level=debug msg="sending 5326 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:49:35Z" level=debug msg="sending 5580 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:49:50Z" level=debug msg="sending 5570 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:50:05Z" level=debug msg="sending 5624 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:50:20Z" level=debug msg="sending 6492 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:50:35Z" level=debug msg="sending 5570 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:50:50Z" level=debug msg="sending 7728 records" collector="10.0.186.242:2055" component=exporter/GRPCProto

After setting to say, 500:

$ oc get flowcollector -o jsonpath='{.items[].spec.agent.ebpf.debug}'
{"env":{"GRPC_MESSAGE_MAX_FLOWS":"500"}}


Flow records are being sent at about 500 records but being sent much more frequently as opposed to 15 seconds above with default of 10000:

$ oc logs pod/netobserv-ebpf-agent-2bwxd -f | egrep -i sending
time="2023-02-21T21:52:38Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:38Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:38Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:38Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:38Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:38Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:38Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:38Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:38Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:38Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:38Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:38Z" level=debug msg="sending 263 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:53Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:53Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:53Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:53Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:53Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:53Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:53Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto
time="2023-02-21T21:52:53Z" level=debug msg="sending 500 records" collector="10.0.186.242:2055" component=exporter/GRPCProto