Test program which, given a list of IP addresses and ports, tries all permutations by sending messages and expecting replies (multiple programs might have to be started).
Flags ports/destinations from which no replies are received.
Perhaps this can be done as a protocol, which probes ports at startup, and fails startup if not all ports are open. When successful, it removes itself .