We have our test cases in the upstream repository. The test cases and jobs work fine which tests upstream version with operator built off the latest upstream branch. However since new features are added to the upstream and the test cases updated/added simultaneously, some of the tests fail when jobs are run for a shipped operator version, which is expected.

Our operators have only one main branch and we productize the downstream builds by cutting off the branch commit instead of using a cutoff branch. This task is to use a operator repo commit which will have compatible test cases for use with downstream builds.