When trying to switch a default cluster to enable techpreviewnoupgrade, logs in the MCO display that the machineosconfig CRD cannot be found (i.e. it was not created). 

    

OCP 4.16, 4.17, 4.18
    

always
    

1. create a default cluster
2. patch the featuregate cluster to `TechPreviewNoUpgrade`
3. observe error logs in the MCO
    

❯ oc logs machine-config-operator-7c6759df46-47bkw 
Defaulted container "machine-config-operator" out of: machine-config-operator, kube-rbac-proxy
I0812 22:27:21.738993       1 start.go:52] Version: 4.16.0-0.nightly-arm64-2024-08-12-170518 (Raw: machine-config-daemon-4.6.0-202006240615.p0-2920-g101bd711-dirty, Hash: 101bd711546104fb22a363ed6f605a23e0ffaa33)
I0812 22:27:21.739586       1 leaderelection.go:121] The leader election gives 4 retries and allows for 30s of clock skew. The kube-apiserver downtime tolerance is 78s. Worst non-graceful lease acquisition is 2m43s. Worst graceful lease acquisition is {26s}.
I0812 22:27:21.739881       1 metrics.go:92] Registering Prometheus metrics
I0812 22:27:21.739909       1 metrics.go:99] Starting metrics listener on 127.0.0.1:8797
I0812 22:27:21.790294       1 leaderelection.go:250] attempting to acquire leader lease openshift-machine-config-operator/machine-config...
I0812 22:30:20.994510       1 leaderelection.go:260] successfully acquired lease openshift-machine-config-operator/machine-config
I0812 22:30:21.011450       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
I0812 22:30:21.022657       1 start.go:129] FeatureGates initialized: knownFeatureGates=[AdminNetworkPolicy AlibabaPlatform AutomatedEtcdBackup AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CSIDriverSharedResource ChunkSizeMiB CloudDualStackNodeIPs ClusterAPIInstall ClusterAPIInstallAWS ClusterAPIInstallAzure ClusterAPIInstallGCP ClusterAPIInstallIBMCloud ClusterAPIInstallNutanix ClusterAPIInstallOpenStack ClusterAPIInstallPowerVS ClusterAPIInstallVSphere DNSNameResolver DisableKubeletCloudCredentialProviders DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example ExternalCloudProvider ExternalCloudProviderAzure ExternalCloudProviderExternal ExternalCloudProviderGCP ExternalOIDC ExternalRouteCertificate GCPClusterHostedDNS GCPLabelsTags GatewayAPI HardwareSpeed ImagePolicy InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InstallAlternateInfrastructureAWS KMSv1 MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes ManagedBootImages MaxUnavailableStatefulSet MetricsCollectionProfiles MetricsServer MixedCPUsAllocation NetworkDiagnosticsConfig NetworkLiveMigration NewOLM NodeDisruptionPolicy NodeSwap OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding ServiceAccountTokenNodeBindingValidation ServiceAccountTokenPodNodeInfo SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy VolumeGroupSnapshot]
I0812 22:30:21.022737       1 event.go:377] Event(v1.ObjectReference{Kind:"Node", Namespace:"openshift-machine-config-operator", Name:"ip-10-0-126-202.us-west-1.compute.internal", UID:"c4fb93ec-b9d1-4085-80cb-818794be7f55", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdminNetworkPolicy", "AlibabaPlatform", "AutomatedEtcdBackup", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CSIDriverSharedResource", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ClusterAPIInstallAWS", "ClusterAPIInstallGCP", "ClusterAPIInstallNutanix", "ClusterAPIInstallOpenStack", "ClusterAPIInstallPowerVS", "ClusterAPIInstallVSphere", "DNSNameResolver", "DisableKubeletCloudCredentialProviders", "DynamicResourceAllocation", "EtcdBackendQuota", "Example", "ExternalCloudProvider", "ExternalCloudProviderAzure", "ExternalCloudProviderExternal", "ExternalCloudProviderGCP", "ExternalOIDC", "ExternalRouteCertificate", "GCPClusterHostedDNS", "GCPLabelsTags", "HardwareSpeed", "ImagePolicy", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InstallAlternateInfrastructureAWS", "KMSv1", "MachineAPIProviderOpenStack", "MachineConfigNodes", "ManagedBootImages", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MetricsServer", "MixedCPUsAllocation", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NewOLM", "NodeDisruptionPolicy", "NodeSwap", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "ServiceAccountTokenNodeBindingValidation", "ServiceAccountTokenPodNodeInfo", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy", "VolumeGroupSnapshot"}, Disabled:[]v1.FeatureGateName{"ClusterAPIInstall", "ClusterAPIInstallAzure", "ClusterAPIInstallIBMCloud", "EventedPLEG", "GatewayAPI", "MachineAPIOperatorDisableMachineHealthCheckController"}}
I0812 22:30:21.047407       1 operator.go:375] On-cluster layering featuregate enabled, starting MachineOSConfig informer
W0812 22:30:21.051778       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:30:21.051875       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
I0812 22:30:21.402139       1 operator.go:422] Change observed to kube-apiserver-server-ca
W0812 22:30:21.861173       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:30:21.861207       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:30:24.457381       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:30:24.457425       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:30:27.723537       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:30:27.723567       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:30:37.362512       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:30:37.362547       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:30:53.127133       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:30:53.127262       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:31:36.252196       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:31:36.252227       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:32:11.725821       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:32:11.725852       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:33:11.635771       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:33:11.635805       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:33:54.782234       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:33:54.782359       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:34:28.065239       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:34:28.065275       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:34:59.485916       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:34:59.485950       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:35:54.716868       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:35:54.716898       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
W0812 22:36:41.600550       1 reflector.go:547] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)
E0812 22:36:41.600584       1 reflector.go:150] github.com/openshift/machine-config-operator/pkg/operator/operator.go:383: Failed to watch *v1alpha1.MachineOSConfig: failed to list *v1alpha1.MachineOSConfig: the server could not find the requested resource (get machineosconfigs.machineconfiguration.openshift.io)

featuregate patch progression should complete, with all necessary crd's created