MGDSTRM-10069 may not have fully accounted for difference between haproxy connections and kafka connections - that is haproxy has to make both a front end and a backend connection for each kafka connection.  it's not clear that the global max connections applies only to front end connections.  Empirical testing suggested that it does.  If that's the case we're actually only meeting half the peak demand with the current settings.