In catalog-operator/catalog-operator/logs/current.log and olm-operator/olm-operator/logs/current.log of must-gather of QE e2e tests, found many similar error 'failed: Operation cannot be fulfilled on'

024-07-27T17:25:44.310321003Z E0727 17:25:44.310280       1 queueinformer_operator.go:319] sync {"update" "e2e-test-storage-lso-f54jp/local-storage-operator.v4.16.0-202407111006"} failed: error transitioning ClusterServiceVersion: install strategy failed: deployments.apps "local-storage-operator" is forbidden: unable to create new content in namespace e2e-test-storage-lso-f54jp because it is being terminated and error updating CSV status: error updating ClusterServiceVersion status: Operation cannot be fulfilled on clusterserviceversions.operators.coreos.com "local-storage-operator.v4.16.0-202407111006": the object has been modified; please apply your changes to the latest version and try again


    

Cluster profile: aws rosa with sts and private + proxy
4.17.0-0.nightly-2024-07-27-061512
    

once

    

   There are no specific steps, just errors found when retrieving logs of must-gather from our automation case.

    

Searched many error messages,
$ grep -nr 'E0727.*queueinformer_operator.go.*fulfill' | wc -l
145

There are some potential problems that update process fetches the latest version of the resource before making changes. This may have a conflict caused by using stale data, see below, updating the object security-profiles-operator/security-profiles-operator-sub multiple times, the update attempt is using an outdated resourceVersion, leading to a conflict.

openshift-operator-lifecycle-manager/pods/catalog-operator-7db7bd75c5-wzmvl/catalog-operator/catalog-operator/logs/current.log:11701:2024-07-27T17:06:29.348495016Z E0727 17:06:29.348433       1 queueinformer_operator.go:319] sync {"update" "security-profiles-operator/security-profiles-operator-sub"} failed: Operation cannot be fulfilled on subscriptions.operators.coreos.com "security-profiles-operator-sub": the object has been modified; please apply your changes to the latest version and try again
openshift-operator-lifecycle-manager/pods/catalog-operator-7db7bd75c5-wzmvl/catalog-operator/catalog-operator/logs/current.log:11729:2024-07-27T17:06:33.908953353Z E0727 17:06:33.907964       1 queueinformer_operator.go:319] sync {"update" "security-profiles-operator/security-profiles-operator-sub"} failed: Operation cannot be fulfilled on subscriptions.operators.coreos.com "security-profiles-operator-sub": the object has been modified; please apply your changes to the latest version and try again
openshift-operator-lifecycle-manager/pods/catalog-operator-7db7bd75c5-wzmvl/catalog-operator/catalog-operator/logs/current.log:11778:2024-07-27T17:06:41.038648409Z E0727 17:06:41.035570       1 queueinformer_operator.go:319] sync {"update" "security-profiles-operator/security-profiles-operator-sub"} failed: Operation cannot be fulfilled on subscriptions.operators.coreos.com "security-profiles-operator-sub": the object has been modified; please apply your changes to the latest version and try again
openshift-operator-lifecycle-manager/pods/catalog-operator-7db7bd75c5-wzmvl/catalog-operator/catalog-operator/logs/current.log:11885:2024-07-27T17:06:53.776207218Z E0727 17:06:53.776183       1 queueinformer_operator.go:319] sync {"update" "security-profiles-operator/security-profiles-operator-sub"} failed: Operation cannot be fulfilled on subscriptions.operators.coreos.com "security-profiles-operator-sub": the object has been modified; please apply your changes to the latest version and try again
openshift-operator-lifecycle-manager/pods/catalog-operator-7db7bd75c5-wzmvl/catalog-operator/catalog-operator/logs/current.log:11903:2024-07-27T17:06:58.251232158Z E0727 17:06:58.251198       1 queueinformer_operator.go:319] sync {"update" "security-profiles-operator/security-profiles-operator-sub"} failed: Operation cannot be fulfilled on subscriptions.operators.coreos.com "security-profiles-operator-sub": the object has been modified; please apply your changes to the latest version and try again
openshift-operator-lifecycle-manager/pods/catalog-operator-7db7bd75c5-wzmvl/catalog-operator/catalog-operator/logs/current.log:11953:2024-07-27T17:07:09.931059354Z E0727 17:07:09.931033       1 queueinformer_operator.go:319] sync {"update" "security-profiles-operator/security-profiles-operator-sub"} failed: Operation cannot be fulfilled on subscriptions.operators.coreos.com "security-profiles-operator-sub": the object has been modified; please apply your changes to the latest version and try again


    

    Reduce conflicts during updating the objects.