We have a separate processing flow for large customers that may bottleneck the pipeline. That processing flow is currently gated with the use of an unleash flag.

This task is to automate which processing flow customers are sent to based off the metric of how many files need to be processed for the customers. That way customers with a large set of files can automatically be directed to the large customer flow. 

Additionally we may want to think of a file limit, to prevent an extreme large customer from being sent directly to pipeline. Perhaps this goes to penalty box and raises an alert.

Start with any manifest more than 100 files go to the XL queue, but we should also make this a configurable env var