Sep 10 16:02:44.073574 ip-10-0-135-80 systemd[1]: Starting Kubernetes Kubelet... Sep 10 16:02:44.511039 ip-10-0-135-80 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 16:02:44.511039 ip-10-0-135-80 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 16:02:44.511039 ip-10-0-135-80 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 16:02:44.511039 ip-10-0-135-80 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 16:02:44.511039 ip-10-0-135-80 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 16:02:44.513336 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.513249 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 16:02:44.517194 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517180 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:44.517194 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517194 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517198 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517201 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517205 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517208 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517211 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517213 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517221 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517224 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517227 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517230 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517233 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517235 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517238 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517240 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517243 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517246 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517248 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517251 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517255 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:44.517255 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517259 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517262 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517265 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517269 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517272 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517274 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517277 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517280 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517283 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517286 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517288 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517291 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517294 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517296 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517299 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517302 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517305 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517320 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517323 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517326 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:44.517742 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517329 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517331 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517334 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517336 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517339 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517341 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517344 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517347 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517349 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517352 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517355 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517357 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517360 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517362 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517366 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517369 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517371 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517374 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517377 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517379 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:44.518233 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517382 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517385 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517387 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517390 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517393 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517395 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517398 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517400 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517402 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517405 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517408 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517411 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517414 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517417 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517421 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517424 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517427 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517430 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517433 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:44.518738 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517436 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517439 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517441 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517444 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517446 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517449 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517453 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517459 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517462 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517465 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517467 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517470 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517473 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517475 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517478 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517481 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517483 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517486 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.517488 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518168 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:44.519203 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518174 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518177 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518179 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518182 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518185 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518188 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518191 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518194 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518196 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518199 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518202 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518204 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518207 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518210 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518212 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518215 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518218 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518221 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518223 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:44.519702 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518226 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518228 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518231 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518234 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518236 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518239 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518242 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518244 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518247 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518249 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518252 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518255 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518257 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518260 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518262 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518265 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518267 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518270 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518275 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518277 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:44.520213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518280 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518282 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518285 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518287 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518290 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518293 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518296 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518298 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518301 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518304 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518321 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518324 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518326 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518329 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518332 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518334 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518339 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518344 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518346 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:44.520741 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518350 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518353 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518355 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518358 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518361 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518363 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518366 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518368 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518371 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518374 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518376 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518379 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518382 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518386 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518389 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518392 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518395 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518398 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518401 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518403 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:44.521213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518407 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518409 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518413 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518416 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518418 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518421 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518423 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518426 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518428 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518431 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518433 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518436 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518438 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518441 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518444 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518446 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518449 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518451 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518453 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518456 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:44.521724 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518822 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518827 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518831 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518835 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518839 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518842 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518845 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518848 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518851 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518854 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518857 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518860 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518863 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518866 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518868 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518871 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518873 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518876 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518879 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:44.522229 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518881 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518884 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518886 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518889 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518891 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518895 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518899 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518902 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518904 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518907 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518910 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518912 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518915 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518918 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518921 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518923 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518926 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518929 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518932 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:44.522709 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518935 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518938 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518941 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518943 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518946 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518949 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518951 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518954 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518956 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518959 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518961 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518964 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518966 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518969 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518972 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518975 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518977 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518980 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518982 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518985 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:44.523192 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518987 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518990 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518992 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518994 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518997 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.518999 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519002 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519004 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519006 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519009 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519011 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519014 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519017 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519019 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519021 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519024 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519026 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519029 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519032 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519035 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:44.523784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519038 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519040 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519043 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519045 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519048 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519050 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519053 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519055 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519059 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519062 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519065 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519067 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519070 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519072 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519075 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519078 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519080 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519083 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519085 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:44.524271 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519088 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519090 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519166 2556 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519212 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519219 2556 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519223 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519228 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519231 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519237 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519241 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519245 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519248 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519251 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519255 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519258 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519261 2556 flags.go:64] FLAG: --cgroup-root="" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519264 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519267 2556 flags.go:64] FLAG: --client-ca-file="" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519270 2556 flags.go:64] FLAG: --cloud-provider="external" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519272 2556 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519276 2556 flags.go:64] FLAG: --cluster-domain="" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519279 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519282 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519285 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 16:02:44.524774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519289 2556 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519292 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519295 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519298 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519301 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519304 2556 flags.go:64] FLAG: --contention-profiling="false" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519318 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519321 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519324 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519327 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519331 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519334 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519337 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519340 2556 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519343 2556 flags.go:64] FLAG: --enable-server="true" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519346 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519353 2556 flags.go:64] FLAG: --event-burst="100" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519356 2556 flags.go:64] FLAG: --event-qps="50" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519359 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519364 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519367 2556 flags.go:64] FLAG: --eviction-hard="" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519371 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519374 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519376 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519379 2556 flags.go:64] FLAG: --eviction-soft="" Sep 10 16:02:44.525403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519382 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519385 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519388 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519390 2556 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519393 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519396 2556 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519399 2556 flags.go:64] FLAG: --feature-gates="" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519403 2556 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519406 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519409 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519412 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519415 2556 flags.go:64] FLAG: --healthz-port="10248" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519418 2556 flags.go:64] FLAG: --help="false" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519421 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519424 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519427 2556 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519430 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519433 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519436 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519439 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519442 2556 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519444 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519447 2556 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 16:02:44.526014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519452 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519455 2556 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519458 2556 flags.go:64] FLAG: --kube-reserved="" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519463 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519465 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519469 2556 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519471 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519474 2556 flags.go:64] FLAG: --lock-file="" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519477 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519480 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519483 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519488 2556 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519490 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519493 2556 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519496 2556 flags.go:64] FLAG: --logging-format="text" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519499 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519502 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519504 2556 flags.go:64] FLAG: --manifest-url="" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519507 2556 flags.go:64] FLAG: --manifest-url-header="" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519511 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519514 2556 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519518 2556 flags.go:64] FLAG: --max-pods="110" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519520 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519523 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519526 2556 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 16:02:44.526611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519529 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519532 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519534 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519537 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519544 2556 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519547 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519550 2556 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519554 2556 flags.go:64] FLAG: --pod-cidr="" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519558 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519562 2556 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519565 2556 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519569 2556 flags.go:64] FLAG: --pods-per-core="0" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519572 2556 flags.go:64] FLAG: --port="10250" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519575 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519578 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06b466b36c8630baa" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519581 2556 flags.go:64] FLAG: --qos-reserved="" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519584 2556 flags.go:64] FLAG: --read-only-port="10255" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519587 2556 flags.go:64] FLAG: --register-node="true" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519590 2556 flags.go:64] FLAG: --register-with-taints="" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519593 2556 flags.go:64] FLAG: --registry-burst="10" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519596 2556 flags.go:64] FLAG: --registry-qps="5" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519599 2556 flags.go:64] FLAG: --reserved-cpus="" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519601 2556 flags.go:64] FLAG: --reserved-memory="" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519605 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519608 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 16:02:44.527256 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519611 2556 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519614 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519616 2556 flags.go:64] FLAG: --runonce="false" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519619 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519622 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519625 2556 flags.go:64] FLAG: --seccomp-default="false" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519628 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519630 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519633 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519636 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519640 2556 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519642 2556 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519645 2556 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519648 2556 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519652 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519655 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519658 2556 flags.go:64] FLAG: --system-cgroups="" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519661 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519667 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519670 2556 flags.go:64] FLAG: --tls-cert-file="" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519673 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519676 2556 flags.go:64] FLAG: --tls-min-version="" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519679 2556 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519682 2556 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519685 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 16:02:44.527889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519688 2556 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519691 2556 flags.go:64] FLAG: --v="2" Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519695 2556 flags.go:64] FLAG: --version="false" Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519699 2556 flags.go:64] FLAG: --vmodule="" Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519702 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.519706 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519829 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519833 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519836 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519839 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519842 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519844 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519847 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519849 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519852 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519854 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519857 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519861 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519864 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519867 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:44.528511 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519870 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519875 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519877 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519880 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519888 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519892 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519895 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519898 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519900 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519903 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519906 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519908 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519911 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519913 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519917 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519921 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519924 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519926 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519929 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:44.529036 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519932 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519934 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519937 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519940 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519943 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519945 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519948 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519951 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519953 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519956 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519958 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519961 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519963 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519966 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519969 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519972 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519975 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519977 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519987 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519989 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:44.529584 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519992 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519994 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.519997 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520000 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520002 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520005 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520007 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520010 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520012 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520015 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520017 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520020 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520022 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520025 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520027 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520030 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520032 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520043 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520047 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520051 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:44.530073 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520054 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520056 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520059 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520061 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520064 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520066 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520070 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520073 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520075 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520078 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520082 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520090 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520092 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520095 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520098 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520100 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520103 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520105 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520108 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520110 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:44.530577 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520113 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520115 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520118 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520120 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520123 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.520126 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.521192 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.529117 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.529134 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.530000 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.530010 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530073 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530078 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530082 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530085 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:44.531077 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530088 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530092 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530095 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530098 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530100 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530104 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530108 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530111 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530114 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530117 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530120 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530122 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530125 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530127 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530130 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530133 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530135 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530138 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530140 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530143 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:44.531474 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530145 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530148 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530151 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530153 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530156 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530165 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530168 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530170 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530173 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530175 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530178 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530181 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530183 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530186 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530188 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530190 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530193 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530196 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530198 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530200 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:44.531968 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530204 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530206 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530209 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530211 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530214 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530216 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530219 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530221 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530224 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530227 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530229 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530231 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530234 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530237 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530246 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530249 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530252 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530255 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530263 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530266 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:44.532526 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530268 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530271 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530273 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530276 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530278 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530281 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530284 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530288 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530292 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530294 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530297 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530301 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530304 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530318 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530321 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530324 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530327 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530329 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:44.533014 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530332 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530334 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530337 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530339 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530342 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530344 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530347 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530349 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530352 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530354 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530357 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530360 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530362 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530371 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530373 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530376 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:44.533597 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530378 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.530383 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530531 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530537 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530540 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530543 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530545 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530548 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530551 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530553 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530556 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530558 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530561 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530563 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:44.534099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530566 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530568 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530571 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530573 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530576 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530578 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530581 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530584 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530587 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530589 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530592 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530595 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530598 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530600 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530603 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530605 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530613 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530616 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530619 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:44.534549 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530622 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530625 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530628 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530631 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530634 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530636 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530640 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530644 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530648 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530651 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530654 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530657 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530659 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530662 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530665 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530668 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530670 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530672 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530675 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:44.535009 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530677 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530680 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530682 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530684 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530687 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530689 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530692 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530694 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530697 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530699 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530702 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530710 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530712 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530715 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530718 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530720 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530722 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530725 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530727 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530729 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:44.535486 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530732 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530734 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530737 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530740 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530742 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530744 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530747 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530749 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530752 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530754 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530756 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530759 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530761 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530764 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530767 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530769 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530772 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530774 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530777 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530779 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:44.535956 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530781 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530784 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530786 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530789 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530796 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530799 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530802 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530804 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:44.530807 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.530811 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.530919 2556 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.534944 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.535973 2556 server.go:1019] "Starting client certificate rotation" Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.536076 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 16:02:44.536449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.536109 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 16:02:44.539424 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.539409 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 16:02:44.541355 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.541328 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 16:02:44.550851 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.550835 2556 log.go:25] "Validated CRI v1 runtime API" Sep 10 16:02:44.555708 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.555690 2556 log.go:25] "Validated CRI v1 image API" Sep 10 16:02:44.556566 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.556550 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 16:02:44.562459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.562442 2556 fs.go:135] Filesystem UUIDs: map[737404f3-b953-4827-b033-f746b0fb6eb0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 dca45eb2-599c-423d-916f-167caa229378:/dev/nvme0n1p3] Sep 10 16:02:44.562459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.562458 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 16:02:44.568020 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.567907 2556 manager.go:216] Machine: {Timestamp:2026-09-10 16:02:44.566764857 +0000 UTC m=+0.366153170 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3009916 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d35acbb37d5d9de6393043808f23c SystemUUID:ec2d35ac-bb37-d5d9-de63-93043808f23c BootID:ac7e31a4-3925-4505-b82e-339ea3d619e8 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:29:06:88:7f:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:29:06:88:7f:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:19:cd:0b:10:4c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 16:02:44.568020 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.568011 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 16:02:44.568142 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.568081 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 16:02:44.570959 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.570916 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 16:02:44.571099 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.570959 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-80.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 16:02:44.572092 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.572082 2556 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 16:02:44.572130 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.572095 2556 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 16:02:44.572130 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.572102 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 16:02:44.572773 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.572763 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 16:02:44.573889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.573876 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 16:02:44.577925 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.577913 2556 state_mem.go:36] "Initialized new in-memory state store" Sep 10 16:02:44.578026 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.578017 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 16:02:44.578067 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.578044 2556 kubelet.go:486] "Attempting to sync node with API server" Sep 10 16:02:44.578067 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.578054 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 16:02:44.578067 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.578066 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 16:02:44.578172 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.578076 2556 kubelet.go:398] "Adding apiserver pod source" Sep 10 16:02:44.578172 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.578084 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 16:02:44.578488 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.578471 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 16:02:44.578488 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.578497 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 16:02:44.584549 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.584521 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 16:02:44.586117 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.586087 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 16:02:44.588204 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588187 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 16:02:44.588278 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588219 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 16:02:44.588398 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588386 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 16:02:44.588449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588405 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 16:02:44.588449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588415 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 16:02:44.588449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588422 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 16:02:44.588449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588430 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 16:02:44.588449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588436 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 16:02:44.588899 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588888 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 16:02:44.588929 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588900 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 16:02:44.588929 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588907 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 16:02:44.588929 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588913 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 16:02:44.588929 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588921 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 16:02:44.588929 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.588928 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 16:02:44.590555 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.590542 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 16:02:44.590555 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.590552 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 16:02:44.592262 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.592241 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-80.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 16:02:44.592368 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.592342 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 16:02:44.592410 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.592381 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 16:02:44.594419 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.594406 2556 server.go:1268] "Started kubelet" Sep 10 16:02:44.594497 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.594466 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 16:02:44.594608 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.594486 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 16:02:44.594608 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.594554 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 16:02:44.595242 ip-10-0-135-80 systemd[1]: Started Kubernetes Kubelet. Sep 10 16:02:44.595693 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.595677 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 16:02:44.597109 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.597097 2556 server.go:310] "Adding debug handlers to kubelet server" Sep 10 16:02:44.600128 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.599982 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 16:02:44.600815 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.600790 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 16:02:44.601409 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.601394 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 16:02:44.601506 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.601486 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-80.ec2.internal\" not found" Sep 10 16:02:44.602212 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602195 2556 factory.go:55] Registering systemd factory Sep 10 16:02:44.602290 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602223 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 16:02:44.602290 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602225 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 16:02:44.602290 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602239 2556 factory.go:223] Registration of the systemd container factory successfully Sep 10 16:02:44.602290 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602242 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 16:02:44.602502 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602372 2556 reconstruct.go:97] "Volume reconstruction finished" Sep 10 16:02:44.602502 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602380 2556 reconciler.go:29] "Reconciler: start to sync state" Sep 10 16:02:44.602502 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602436 2556 factory.go:153] Registering CRI-O factory Sep 10 16:02:44.602502 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602448 2556 factory.go:223] Registration of the crio container factory successfully Sep 10 16:02:44.602502 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602497 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 16:02:44.602729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602516 2556 factory.go:103] Registering Raw factory Sep 10 16:02:44.602729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602534 2556 manager.go:1196] Started watching for new ooms in manager Sep 10 16:02:44.602922 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.602908 2556 manager.go:349] Starting recovery of all containers Sep 10 16:02:44.611431 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.611406 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 16:02:44.616065 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.611707 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-80.ec2.internal.18d4011a55dee441 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-80.ec2.internal,UID:ip-10-0-135-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-80.ec2.internal,},FirstTimestamp:2026-09-10 16:02:44.594377793 +0000 UTC m=+0.393766106,LastTimestamp:2026-09-10 16:02:44.594377793 +0000 UTC m=+0.393766106,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-80.ec2.internal,}" Sep 10 16:02:44.616159 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.616103 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 16:02:44.618569 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.618544 2556 manager.go:354] Recovery completed Sep 10 16:02:44.624709 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.624694 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:44.626467 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.626442 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:44.626533 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.626477 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:44.626533 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.626489 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:44.627060 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.627043 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 16:02:44.627060 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.627058 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:44.627180 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.627058 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 16:02:44.627180 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.627120 2556 state_mem.go:36] "Initialized new in-memory state store" Sep 10 16:02:44.627786 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.627770 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:44.627864 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.627799 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:44.627864 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.627813 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:44.628981 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.628916 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-80.ec2.internal.18d4011a57c883a0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-80.ec2.internal,UID:ip-10-0-135-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-80.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-80.ec2.internal,},FirstTimestamp:2026-09-10 16:02:44.626465696 +0000 UTC m=+0.425854008,LastTimestamp:2026-09-10 16:02:44.626465696 +0000 UTC m=+0.425854008,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-80.ec2.internal,}" Sep 10 16:02:44.629272 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.629255 2556 policy_none.go:49] "None policy: Start" Sep 10 16:02:44.629367 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.629276 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 16:02:44.629367 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.629288 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 16:02:44.631411 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.631400 2556 policy_none.go:47] "Start" Sep 10 16:02:44.638630 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.638569 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-80.ec2.internal.18d4011a57c8c4ad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-80.ec2.internal,UID:ip-10-0-135-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-80.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-80.ec2.internal,},FirstTimestamp:2026-09-10 16:02:44.626482349 +0000 UTC m=+0.425870662,LastTimestamp:2026-09-10 16:02:44.626482349 +0000 UTC m=+0.425870662,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-80.ec2.internal,}" Sep 10 16:02:44.640412 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.640337 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-80.ec2.internal.18d4011a57c8f79d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-80.ec2.internal,UID:ip-10-0-135-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-80.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-80.ec2.internal,},FirstTimestamp:2026-09-10 16:02:44.626495389 +0000 UTC m=+0.425883704,LastTimestamp:2026-09-10 16:02:44.626495389 +0000 UTC m=+0.425883704,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-80.ec2.internal,}" Sep 10 16:02:44.651795 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.651721 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-80.ec2.internal.18d4011a57c883a0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-80.ec2.internal.18d4011a57c883a0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-80.ec2.internal,UID:ip-10-0-135-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-80.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-80.ec2.internal,},FirstTimestamp:2026-09-10 16:02:44.626465696 +0000 UTC m=+0.425854008,LastTimestamp:2026-09-10 16:02:44.627783902 +0000 UTC m=+0.427172217,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-80.ec2.internal,}" Sep 10 16:02:44.659854 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.659840 2556 manager.go:337] "Starting Device Plugin manager" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.659871 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.659880 2556 server.go:87] "Starting device plugin registration server" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.660171 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.660185 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.660281 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.660386 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.660399 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.660879 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.660925 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-80.ec2.internal\" not found" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.663915 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-80.ec2.internal.18d4011a57c8c4ad\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-80.ec2.internal.18d4011a57c8c4ad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-80.ec2.internal,UID:ip-10-0-135-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-80.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-80.ec2.internal,},FirstTimestamp:2026-09-10 16:02:44.626482349 +0000 UTC m=+0.425870662,LastTimestamp:2026-09-10 16:02:44.627805773 +0000 UTC m=+0.427194088,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-80.ec2.internal,}" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.667682 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.668855 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.668893 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.668909 2556 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.668948 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.671408 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ptnn2" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.673135 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Sep 10 16:02:44.679666 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.673191 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-80.ec2.internal.18d4011a57c8f79d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-80.ec2.internal.18d4011a57c8f79d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-80.ec2.internal,UID:ip-10-0-135-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-80.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-80.ec2.internal,},FirstTimestamp:2026-09-10 16:02:44.626495389 +0000 UTC m=+0.425883704,LastTimestamp:2026-09-10 16:02:44.627817929 +0000 UTC m=+0.427206247,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-80.ec2.internal,}" Sep 10 16:02:44.680474 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.680462 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ptnn2" Sep 10 16:02:44.680525 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.680431 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-80.ec2.internal.18d4011a5a6d28d4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-80.ec2.internal,UID:ip-10-0-135-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-135-80.ec2.internal,},FirstTimestamp:2026-09-10 16:02:44.670810324 +0000 UTC m=+0.470198638,LastTimestamp:2026-09-10 16:02:44.670810324 +0000 UTC m=+0.470198638,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-80.ec2.internal,}" Sep 10 16:02:44.761191 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.761113 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:44.761906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.761891 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:44.761972 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.761919 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:44.761972 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.761935 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:44.761972 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.761961 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.764508 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.764432 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-80.ec2.internal.18d4011a57c883a0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-80.ec2.internal.18d4011a57c883a0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-80.ec2.internal,UID:ip-10-0-135-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-80.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-80.ec2.internal,},FirstTimestamp:2026-09-10 16:02:44.626465696 +0000 UTC m=+0.425854008,LastTimestamp:2026-09-10 16:02:44.76190557 +0000 UTC m=+0.561293883,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-80.ec2.internal,}" Sep 10 16:02:44.769087 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.769062 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-80.ec2.internal"] Sep 10 16:02:44.769176 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.769135 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:44.769852 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.769838 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:44.769922 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.769862 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:44.769922 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.769871 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:44.771986 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.771974 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:44.772111 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.772094 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.772167 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.772126 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:44.772639 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.772625 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:44.772710 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.772654 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:44.772710 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.772666 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:44.772710 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.772632 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:44.772797 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.772726 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:44.772797 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.772736 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:44.774501 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.774483 2556 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-135-80.ec2.internal\" not found" node="ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.774763 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.774751 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.774799 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.774775 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:44.775351 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.775339 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:44.775414 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.775365 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:44.775414 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.775377 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:44.798842 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.798824 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-80.ec2.internal\" not found" node="ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.802783 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.802766 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-80.ec2.internal\" not found" node="ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.803833 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.803818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec889f4ef5088285a3c0b3f8da2f90fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal\" (UID: \"ec889f4ef5088285a3c0b3f8da2f90fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.803890 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.803840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2e82bddfbf53f2d90204713bbd4554d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-80.ec2.internal\" (UID: \"d2e82bddfbf53f2d90204713bbd4554d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.803890 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.803861 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec889f4ef5088285a3c0b3f8da2f90fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal\" (UID: \"ec889f4ef5088285a3c0b3f8da2f90fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.825010 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.824991 2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-80.ec2.internal\" not found" node="ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.904382 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.904349 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec889f4ef5088285a3c0b3f8da2f90fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal\" (UID: \"ec889f4ef5088285a3c0b3f8da2f90fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.904510 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.904386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec889f4ef5088285a3c0b3f8da2f90fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal\" (UID: \"ec889f4ef5088285a3c0b3f8da2f90fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.904510 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.904409 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2e82bddfbf53f2d90204713bbd4554d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-80.ec2.internal\" (UID: \"d2e82bddfbf53f2d90204713bbd4554d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.904510 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.904441 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2e82bddfbf53f2d90204713bbd4554d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-80.ec2.internal\" (UID: \"d2e82bddfbf53f2d90204713bbd4554d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.904510 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.904450 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec889f4ef5088285a3c0b3f8da2f90fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal\" (UID: \"ec889f4ef5088285a3c0b3f8da2f90fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.904510 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.904442 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec889f4ef5088285a3c0b3f8da2f90fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal\" (UID: \"ec889f4ef5088285a3c0b3f8da2f90fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.975504 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.975467 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:44.976532 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.976513 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:44.976641 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.976547 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:44.976641 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.976560 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:44.976641 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.976592 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.988327 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:44.988297 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-80.ec2.internal" Sep 10 16:02:44.988433 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:44.988335 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-80.ec2.internal\": node \"ip-10-0-135-80.ec2.internal\" not found" Sep 10 16:02:45.017009 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:45.016948 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-80.ec2.internal\" not found" Sep 10 16:02:45.102367 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.102338 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" Sep 10 16:02:45.106379 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.106358 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-80.ec2.internal" Sep 10 16:02:45.117836 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:45.117816 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-80.ec2.internal\" not found" Sep 10 16:02:45.218413 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:45.218380 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-80.ec2.internal\" not found" Sep 10 16:02:45.318931 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:45.318843 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-80.ec2.internal\" not found" Sep 10 16:02:45.419315 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:45.419283 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-80.ec2.internal\" not found" Sep 10 16:02:45.519453 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:45.519422 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-80.ec2.internal\" not found" Sep 10 16:02:45.535762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.535740 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 16:02:45.620269 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:45.620208 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-80.ec2.internal\" not found" Sep 10 16:02:45.678771 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.678745 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:02:45.683277 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.683248 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 15:57:45 +0000 UTC" deadline="2028-04-07 13:58:20.772016368 +0000 UTC" Sep 10 16:02:45.683277 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.683276 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13797h55m35.088744415s" Sep 10 16:02:45.707922 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.707897 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:45.709027 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.709006 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:45.709122 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.709045 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:45.709122 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.709061 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:45.720979 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:45.720943 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-80.ec2.internal\" not found" Sep 10 16:02:45.723687 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.723659 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:02:45.744854 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.744828 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:02:45.802782 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.802752 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" Sep 10 16:02:45.819593 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.819572 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 16:02:45.820656 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.820624 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-80.ec2.internal" Sep 10 16:02:45.824560 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:45.824531 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec889f4ef5088285a3c0b3f8da2f90fa.slice/crio-45fcaa2ad895de94742ba69e06e82c88e11dbafe3a92411291ec3cee11528c54 WatchSource:0}: Error finding container 45fcaa2ad895de94742ba69e06e82c88e11dbafe3a92411291ec3cee11528c54: Status 404 returned error can't find the container with id 45fcaa2ad895de94742ba69e06e82c88e11dbafe3a92411291ec3cee11528c54 Sep 10 16:02:45.832504 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.832479 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 16:02:45.833917 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:45.833902 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 16:02:46.220177 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.220140 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:02:46.579761 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.579729 2556 apiserver.go:52] "Watching apiserver" Sep 10 16:02:46.587246 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.587213 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 16:02:46.590959 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.590928 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wd54m","kube-system/konnectivity-agent-cxhhn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh","openshift-dns/node-resolver-w765k","openshift-image-registry/node-ca-lwff8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal","openshift-multus/multus-additional-cni-plugins-b9w99","openshift-ovn-kubernetes/ovnkube-node-xntds","kube-system/kube-apiserver-proxy-ip-10-0-135-80.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qf5tp","openshift-multus/multus-ckhkh","openshift-multus/network-metrics-daemon-2gr6r","openshift-network-diagnostics/network-check-target-pgmqd","openshift-network-operator/iptables-alerter-5k5qc"] Sep 10 16:02:46.593652 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.593626 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.596530 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.595963 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:02:46.596530 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.596263 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:02:46.596530 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.596440 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 16:02:46.596714 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.596559 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sc86q\"" Sep 10 16:02:46.598409 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.598307 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.599029 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.599009 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hz7jt\"" Sep 10 16:02:46.599408 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.599341 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 16:02:46.599500 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.599464 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 16:02:46.600362 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.600325 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 16:02:46.601591 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.600882 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cwkvq\"" Sep 10 16:02:46.601591 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.601197 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 16:02:46.601591 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.601403 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 16:02:46.602414 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.601851 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5k5qc" Sep 10 16:02:46.602414 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.602244 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 16:02:46.604513 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.603506 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lwff8" Sep 10 16:02:46.607697 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.605678 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 16:02:46.607697 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.605919 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cjf67\"" Sep 10 16:02:46.607697 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.606125 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:46.607697 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:46.606183 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:02:46.607697 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.606562 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 16:02:46.607697 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.606877 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 16:02:46.607697 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.607064 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:02:46.607697 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.607323 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 16:02:46.607697 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.607524 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 16:02:46.608215 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.607879 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tw2vn\"" Sep 10 16:02:46.608215 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.608194 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:46.608319 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:46.608265 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:02:46.610530 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.610514 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.613427 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.613406 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w765k" Sep 10 16:02:46.614532 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/216c8761-0aa5-4127-9c0e-ea65047bdefb-serviceca\") pod \"node-ca-lwff8\" (UID: \"216c8761-0aa5-4127-9c0e-ea65047bdefb\") " pod="openshift-image-registry/node-ca-lwff8" Sep 10 16:02:46.614532 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614276 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-sysctl-d\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.614532 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614305 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.614532 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614332 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-modprobe-d\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.614532 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614358 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-sysctl-conf\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.614532 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614394 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-run\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.614532 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614419 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scbfj\" (UniqueName: \"kubernetes.io/projected/216c8761-0aa5-4127-9c0e-ea65047bdefb-kube-api-access-scbfj\") pod \"node-ca-lwff8\" (UID: \"216c8761-0aa5-4127-9c0e-ea65047bdefb\") " pod="openshift-image-registry/node-ca-lwff8" Sep 10 16:02:46.614532 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614445 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-systemd\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.614532 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614507 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wm2x\" (UniqueName: \"kubernetes.io/projected/82536397-7411-40cc-a761-838e33d03786-kube-api-access-2wm2x\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.614532 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-socket-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.615089 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614564 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-registration-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.615089 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614608 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8661f55c-6d7f-4afb-8135-ecdc38f2d499-iptables-alerter-script\") pod \"iptables-alerter-5k5qc\" (UID: \"8661f55c-6d7f-4afb-8135-ecdc38f2d499\") " pod="openshift-network-operator/iptables-alerter-5k5qc" Sep 10 16:02:46.615089 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.614645 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-sys\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.615247 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.615221 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82536397-7411-40cc-a761-838e33d03786-tmp\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.615328 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.615313 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16abdb67-53a9-4a09-a6b8-7ca139d5555b-konnectivity-ca\") pod \"konnectivity-agent-cxhhn\" (UID: \"16abdb67-53a9-4a09-a6b8-7ca139d5555b\") " pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:02:46.615379 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.615348 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/216c8761-0aa5-4127-9c0e-ea65047bdefb-host\") pod \"node-ca-lwff8\" (UID: \"216c8761-0aa5-4127-9c0e-ea65047bdefb\") " pod="openshift-image-registry/node-ca-lwff8" Sep 10 16:02:46.615431 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.615404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-var-lib-kubelet\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.615507 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.615494 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16abdb67-53a9-4a09-a6b8-7ca139d5555b-agent-certs\") pod \"konnectivity-agent-cxhhn\" (UID: \"16abdb67-53a9-4a09-a6b8-7ca139d5555b\") " pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:02:46.615543 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.615519 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8661f55c-6d7f-4afb-8135-ecdc38f2d499-host-slash\") pod \"iptables-alerter-5k5qc\" (UID: \"8661f55c-6d7f-4afb-8135-ecdc38f2d499\") " pod="openshift-network-operator/iptables-alerter-5k5qc" Sep 10 16:02:46.615813 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.615789 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 16:02:46.615911 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.615884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxghf\" (UniqueName: \"kubernetes.io/projected/8661f55c-6d7f-4afb-8135-ecdc38f2d499-kube-api-access-zxghf\") pod \"iptables-alerter-5k5qc\" (UID: \"8661f55c-6d7f-4afb-8135-ecdc38f2d499\") " pod="openshift-network-operator/iptables-alerter-5k5qc" Sep 10 16:02:46.615993 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.615937 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-kubernetes\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.616094 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.615972 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-lib-modules\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.616203 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.616112 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.616203 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.616147 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-device-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.616203 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.616167 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.616625 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.616595 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xmv4\" (UniqueName: \"kubernetes.io/projected/acf9cb90-d31a-4d25-af00-6a8d45acedf6-kube-api-access-6xmv4\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.616731 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.616643 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-sysconfig\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.616791 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.616679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82536397-7411-40cc-a761-838e33d03786-etc-tuned\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.616841 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.616809 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-host\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.616893 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.616842 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-sys-fs\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.617226 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.617202 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 16:02:46.618858 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.618835 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w8hmh\"" Sep 10 16:02:46.618968 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.618865 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 16:02:46.619029 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.618985 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h44x4\"" Sep 10 16:02:46.619086 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.619062 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 16:02:46.619335 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.619316 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 16:02:46.619801 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.619781 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 16:02:46.620781 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.619976 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 16:02:46.620781 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.620010 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 16:02:46.620781 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.620538 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 16:02:46.620781 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.620659 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 16:02:46.621010 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.620991 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 16:02:46.621599 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.621572 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.624950 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.624929 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 16:02:46.625092 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.625050 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:46.625165 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:46.625119 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:02:46.625913 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.625878 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 16:02:46.626345 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.626326 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f8mdj\"" Sep 10 16:02:46.626652 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.626628 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 16:02:46.627229 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.627203 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 16:02:46.627817 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.627754 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hqk4x\"" Sep 10 16:02:46.665725 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.665504 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7dt7c" Sep 10 16:02:46.675652 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.675601 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" event={"ID":"ec889f4ef5088285a3c0b3f8da2f90fa","Type":"ContainerStarted","Data":"45fcaa2ad895de94742ba69e06e82c88e11dbafe3a92411291ec3cee11528c54"} Sep 10 16:02:46.677283 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.677256 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7dt7c" Sep 10 16:02:46.679311 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.679283 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-80.ec2.internal" event={"ID":"d2e82bddfbf53f2d90204713bbd4554d","Type":"ContainerStarted","Data":"98c001d6ceb8e338e1630d33ad5f9e6f0eb3fc76c9ba1573ecd0ca1ce36d1264"} Sep 10 16:02:46.703763 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.703674 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 16:02:46.717114 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717081 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whtxz\" (UniqueName: \"kubernetes.io/projected/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-kube-api-access-whtxz\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:46.717233 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717120 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-multus-conf-dir\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.717233 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn87s\" (UniqueName: \"kubernetes.io/projected/272e68f6-e885-42a2-9154-c94d2384e419-kube-api-access-kn87s\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.717233 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-run-ovn\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.717233 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717197 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.717493 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717235 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-kubernetes\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.717493 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717260 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-lib-modules\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.717493 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717292 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.717493 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717334 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-device-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.717493 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717357 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/272e68f6-e885-42a2-9154-c94d2384e419-cni-binary-copy\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.717493 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-run-multus-certs\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.717493 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16470165-f773-4358-9757-6070c156d07e-hosts-file\") pod \"node-resolver-w765k\" (UID: \"16470165-f773-4358-9757-6070c156d07e\") " pod="openshift-dns/node-resolver-w765k" Sep 10 16:02:46.717493 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717421 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82536397-7411-40cc-a761-838e33d03786-etc-tuned\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.717493 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717441 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-sys-fs\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.717493 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717465 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.717493 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717491 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-lib-modules\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717514 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-device-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717491 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-run-netns\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717573 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-cni-bin\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717602 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717628 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be74c874-a20b-4dec-88f7-d74e27aadc0d-ovnkube-config\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717653 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be74c874-a20b-4dec-88f7-d74e27aadc0d-env-overrides\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717673 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-kubernetes\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717677 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be74c874-a20b-4dec-88f7-d74e27aadc0d-ovn-node-metrics-cert\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717724 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/216c8761-0aa5-4127-9c0e-ea65047bdefb-serviceca\") pod \"node-ca-lwff8\" (UID: \"216c8761-0aa5-4127-9c0e-ea65047bdefb\") " pod="openshift-image-registry/node-ca-lwff8" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717750 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbm5b\" (UniqueName: \"kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b\") pod \"network-check-target-pgmqd\" (UID: \"adb082dd-4d72-4f3a-8ec2-16b37a7d3375\") " pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717771 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717770 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-run-k8s-cni-cncf-io\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717807 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-var-lib-cni-multus\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717829 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-sys-fs\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717837 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-system-cni-dir\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.718084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717858 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-run-systemd\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717879 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-dbus\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717901 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717924 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-modprobe-d\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717943 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-run\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717966 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-var-lib-cni-bin\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.717989 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-var-lib-kubelet\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718020 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-var-lib-openvswitch\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718075 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-systemd\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718095 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wm2x\" (UniqueName: \"kubernetes.io/projected/82536397-7411-40cc-a761-838e33d03786-kube-api-access-2wm2x\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-registration-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718137 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8661f55c-6d7f-4afb-8135-ecdc38f2d499-iptables-alerter-script\") pod \"iptables-alerter-5k5qc\" (UID: \"8661f55c-6d7f-4afb-8135-ecdc38f2d499\") " pod="openshift-network-operator/iptables-alerter-5k5qc" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718156 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16470165-f773-4358-9757-6070c156d07e-tmp-dir\") pod \"node-resolver-w765k\" (UID: \"16470165-f773-4358-9757-6070c156d07e\") " pod="openshift-dns/node-resolver-w765k" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718175 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-log-socket\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-sys\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16abdb67-53a9-4a09-a6b8-7ca139d5555b-konnectivity-ca\") pod \"konnectivity-agent-cxhhn\" (UID: \"16abdb67-53a9-4a09-a6b8-7ca139d5555b\") " pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:02:46.718910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718238 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-hostroot\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718260 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-slash\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-run-openvswitch\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718308 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-cni-netd\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718326 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/216c8761-0aa5-4127-9c0e-ea65047bdefb-serviceca\") pod \"node-ca-lwff8\" (UID: \"216c8761-0aa5-4127-9c0e-ea65047bdefb\") " pod="openshift-image-registry/node-ca-lwff8" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718418 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8661f55c-6d7f-4afb-8135-ecdc38f2d499-host-slash\") pod \"iptables-alerter-5k5qc\" (UID: \"8661f55c-6d7f-4afb-8135-ecdc38f2d499\") " pod="openshift-network-operator/iptables-alerter-5k5qc" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718599 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-registration-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718660 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-sys\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718331 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8661f55c-6d7f-4afb-8135-ecdc38f2d499-host-slash\") pod \"iptables-alerter-5k5qc\" (UID: \"8661f55c-6d7f-4afb-8135-ecdc38f2d499\") " pod="openshift-network-operator/iptables-alerter-5k5qc" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718691 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxghf\" (UniqueName: \"kubernetes.io/projected/8661f55c-6d7f-4afb-8135-ecdc38f2d499-kube-api-access-zxghf\") pod \"iptables-alerter-5k5qc\" (UID: \"8661f55c-6d7f-4afb-8135-ecdc38f2d499\") " pod="openshift-network-operator/iptables-alerter-5k5qc" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718709 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-cnibin\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718717 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-run\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsg9j\" (UniqueName: \"kubernetes.io/projected/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-kube-api-access-zsg9j\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718765 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xmv4\" (UniqueName: \"kubernetes.io/projected/acf9cb90-d31a-4d25-af00-6a8d45acedf6-kube-api-access-6xmv4\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718769 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-systemd\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-sysconfig\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-multus-cni-dir\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.719762 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-cnibin\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718869 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-host\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718894 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-etc-kubernetes\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718435 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718976 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8661f55c-6d7f-4afb-8135-ecdc38f2d499-iptables-alerter-script\") pod \"iptables-alerter-5k5qc\" (UID: \"8661f55c-6d7f-4afb-8135-ecdc38f2d499\") " pod="openshift-network-operator/iptables-alerter-5k5qc" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.718466 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-modprobe-d\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719056 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-systemd-units\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719090 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-sysctl-d\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719141 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-run-netns\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-node-log\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btbf7\" (UniqueName: \"kubernetes.io/projected/be74c874-a20b-4dec-88f7-d74e27aadc0d-kube-api-access-btbf7\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719259 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-sysctl-conf\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719288 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-multus-socket-dir-parent\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/272e68f6-e885-42a2-9154-c94d2384e419-multus-daemon-config\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719375 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719427 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-kubelet\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.720729 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scbfj\" (UniqueName: \"kubernetes.io/projected/216c8761-0aa5-4127-9c0e-ea65047bdefb-kube-api-access-scbfj\") pod \"node-ca-lwff8\" (UID: \"216c8761-0aa5-4127-9c0e-ea65047bdefb\") " pod="openshift-image-registry/node-ca-lwff8" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719516 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-socket-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719543 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719571 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-etc-openvswitch\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719636 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82536397-7411-40cc-a761-838e33d03786-tmp\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-system-cni-dir\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719794 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t7p4\" (UniqueName: \"kubernetes.io/projected/16470165-f773-4358-9757-6070c156d07e-kube-api-access-4t7p4\") pod \"node-resolver-w765k\" (UID: \"16470165-f773-4358-9757-6070c156d07e\") " pod="openshift-dns/node-resolver-w765k" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/be74c874-a20b-4dec-88f7-d74e27aadc0d-ovnkube-script-lib\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-kubelet-config\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/216c8761-0aa5-4127-9c0e-ea65047bdefb-host\") pod \"node-ca-lwff8\" (UID: \"216c8761-0aa5-4127-9c0e-ea65047bdefb\") " pod="openshift-image-registry/node-ca-lwff8" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719923 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-var-lib-kubelet\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719928 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16abdb67-53a9-4a09-a6b8-7ca139d5555b-konnectivity-ca\") pod \"konnectivity-agent-cxhhn\" (UID: \"16abdb67-53a9-4a09-a6b8-7ca139d5555b\") " pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16abdb67-53a9-4a09-a6b8-7ca139d5555b-agent-certs\") pod \"konnectivity-agent-cxhhn\" (UID: \"16abdb67-53a9-4a09-a6b8-7ca139d5555b\") " pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.719990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-sysconfig\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.720090 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.720084 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-sysctl-d\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.721571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.720109 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acf9cb90-d31a-4d25-af00-6a8d45acedf6-socket-dir\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.722209 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.720159 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-host\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.722209 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.720310 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-etc-sysctl-conf\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.722209 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.720506 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/216c8761-0aa5-4127-9c0e-ea65047bdefb-host\") pod \"node-ca-lwff8\" (UID: \"216c8761-0aa5-4127-9c0e-ea65047bdefb\") " pod="openshift-image-registry/node-ca-lwff8" Sep 10 16:02:46.722209 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.720540 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82536397-7411-40cc-a761-838e33d03786-var-lib-kubelet\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.724629 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.724590 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82536397-7411-40cc-a761-838e33d03786-tmp\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.724847 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.724802 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82536397-7411-40cc-a761-838e33d03786-etc-tuned\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.724847 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.724835 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16abdb67-53a9-4a09-a6b8-7ca139d5555b-agent-certs\") pod \"konnectivity-agent-cxhhn\" (UID: \"16abdb67-53a9-4a09-a6b8-7ca139d5555b\") " pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:02:46.728419 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.728312 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxghf\" (UniqueName: \"kubernetes.io/projected/8661f55c-6d7f-4afb-8135-ecdc38f2d499-kube-api-access-zxghf\") pod \"iptables-alerter-5k5qc\" (UID: \"8661f55c-6d7f-4afb-8135-ecdc38f2d499\") " pod="openshift-network-operator/iptables-alerter-5k5qc" Sep 10 16:02:46.728419 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.728376 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xmv4\" (UniqueName: \"kubernetes.io/projected/acf9cb90-d31a-4d25-af00-6a8d45acedf6-kube-api-access-6xmv4\") pod \"aws-ebs-csi-driver-node-npxvh\" (UID: \"acf9cb90-d31a-4d25-af00-6a8d45acedf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.730434 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.730375 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wm2x\" (UniqueName: \"kubernetes.io/projected/82536397-7411-40cc-a761-838e33d03786-kube-api-access-2wm2x\") pod \"tuned-qf5tp\" (UID: \"82536397-7411-40cc-a761-838e33d03786\") " pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.731708 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.731676 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scbfj\" (UniqueName: \"kubernetes.io/projected/216c8761-0aa5-4127-9c0e-ea65047bdefb-kube-api-access-scbfj\") pod \"node-ca-lwff8\" (UID: \"216c8761-0aa5-4127-9c0e-ea65047bdefb\") " pod="openshift-image-registry/node-ca-lwff8" Sep 10 16:02:46.821213 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-multus-socket-dir-parent\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.821423 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821221 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/272e68f6-e885-42a2-9154-c94d2384e419-multus-daemon-config\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.821423 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.821423 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821275 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-kubelet\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.821423 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821302 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:46.821423 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-etc-openvswitch\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.821423 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:46.821423 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-system-cni-dir\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.821423 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821420 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t7p4\" (UniqueName: \"kubernetes.io/projected/16470165-f773-4358-9757-6070c156d07e-kube-api-access-4t7p4\") pod \"node-resolver-w765k\" (UID: \"16470165-f773-4358-9757-6070c156d07e\") " pod="openshift-dns/node-resolver-w765k" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821444 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/be74c874-a20b-4dec-88f7-d74e27aadc0d-ovnkube-script-lib\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821469 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-kubelet-config\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821499 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whtxz\" (UniqueName: \"kubernetes.io/projected/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-kube-api-access-whtxz\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821526 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-multus-conf-dir\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821552 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn87s\" (UniqueName: \"kubernetes.io/projected/272e68f6-e885-42a2-9154-c94d2384e419-kube-api-access-kn87s\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-run-ovn\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821602 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/272e68f6-e885-42a2-9154-c94d2384e419-cni-binary-copy\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821658 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-run-multus-certs\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821686 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16470165-f773-4358-9757-6070c156d07e-hosts-file\") pod \"node-resolver-w765k\" (UID: \"16470165-f773-4358-9757-6070c156d07e\") " pod="openshift-dns/node-resolver-w765k" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-run-netns\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821762 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-cni-bin\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.821783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821789 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821815 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be74c874-a20b-4dec-88f7-d74e27aadc0d-ovnkube-config\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821852 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be74c874-a20b-4dec-88f7-d74e27aadc0d-env-overrides\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be74c874-a20b-4dec-88f7-d74e27aadc0d-ovn-node-metrics-cert\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821913 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbm5b\" (UniqueName: \"kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b\") pod \"network-check-target-pgmqd\" (UID: \"adb082dd-4d72-4f3a-8ec2-16b37a7d3375\") " pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821939 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-run-k8s-cni-cncf-io\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821966 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-var-lib-cni-multus\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.821994 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-system-cni-dir\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-run-systemd\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822043 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-dbus\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822098 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-var-lib-cni-bin\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822125 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-var-lib-kubelet\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822147 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822152 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822211 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-var-lib-openvswitch\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822245 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16470165-f773-4358-9757-6070c156d07e-tmp-dir\") pod \"node-resolver-w765k\" (UID: \"16470165-f773-4358-9757-6070c156d07e\") " pod="openshift-dns/node-resolver-w765k" Sep 10 16:02:46.822459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-log-socket\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822299 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-hostroot\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-slash\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822349 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-run-openvswitch\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-cni-netd\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822418 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-cnibin\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822444 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsg9j\" (UniqueName: \"kubernetes.io/projected/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-kube-api-access-zsg9j\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-multus-cni-dir\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822503 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-cnibin\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822530 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-etc-kubernetes\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822556 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-systemd-units\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822585 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-run-netns\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822610 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-node-log\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btbf7\" (UniqueName: \"kubernetes.io/projected/be74c874-a20b-4dec-88f7-d74e27aadc0d-kube-api-access-btbf7\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822838 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.823267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.822973 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-multus-socket-dir-parent\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.823987 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.823408 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/272e68f6-e885-42a2-9154-c94d2384e419-cni-binary-copy\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.823987 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.823481 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-run-multus-certs\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.823987 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.823529 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16470165-f773-4358-9757-6070c156d07e-hosts-file\") pod \"node-resolver-w765k\" (UID: \"16470165-f773-4358-9757-6070c156d07e\") " pod="openshift-dns/node-resolver-w765k" Sep 10 16:02:46.823987 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.823575 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/272e68f6-e885-42a2-9154-c94d2384e419-multus-daemon-config\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.823987 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.823668 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.823987 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.823724 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-run-netns\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.823987 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.823765 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-cni-bin\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.823987 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.823815 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.824347 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.824024 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.824347 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.824083 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-kubelet\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.824347 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:46.824153 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:46.824347 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:46.824223 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs podName:117f519b-c0a5-4892-ad17-5d8ec8bd5f9b nodeName:}" failed. No retries permitted until 2026-09-10 16:02:47.324194201 +0000 UTC m=+3.123582502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs") pod "network-metrics-daemon-2gr6r" (UID: "117f519b-c0a5-4892-ad17-5d8ec8bd5f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:46.824347 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.824264 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-etc-openvswitch\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.824347 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.824325 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be74c874-a20b-4dec-88f7-d74e27aadc0d-ovnkube-config\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.824347 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:46.824344 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:46.824663 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:46.824398 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret podName:d651ea1e-c120-4cdc-8d53-b2c3014cb09f nodeName:}" failed. No retries permitted until 2026-09-10 16:02:47.324370374 +0000 UTC m=+3.123758682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret") pod "global-pull-secret-syncer-wd54m" (UID: "d651ea1e-c120-4cdc-8d53-b2c3014cb09f") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:46.824663 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.824455 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-system-cni-dir\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.824775 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.824679 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be74c874-a20b-4dec-88f7-d74e27aadc0d-env-overrides\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.825084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.825062 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/be74c874-a20b-4dec-88f7-d74e27aadc0d-ovnkube-script-lib\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.825212 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.825121 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-kubelet-config\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:46.825353 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.825331 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-multus-conf-dir\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.825609 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-run-ovn\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.825658 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-var-lib-openvswitch\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.825921 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16470165-f773-4358-9757-6070c156d07e-tmp-dir\") pod \"node-resolver-w765k\" (UID: \"16470165-f773-4358-9757-6070c156d07e\") " pod="openshift-dns/node-resolver-w765k" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.825992 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-run-k8s-cni-cncf-io\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.825998 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-log-socket\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826020 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-hostroot\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826047 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-slash\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826073 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-var-lib-cni-multus\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826080 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-run-openvswitch\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826104 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-host-cni-netd\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826120 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-system-cni-dir\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-cnibin\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826172 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-run-systemd\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826334 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-dbus\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826502 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-systemd-units\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826574 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-var-lib-kubelet\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826607 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-multus-cni-dir\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.826829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826629 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.827737 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826641 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-run-netns\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.827737 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826664 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-cnibin\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.827737 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826668 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-host-var-lib-cni-bin\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.827737 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826702 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/272e68f6-e885-42a2-9154-c94d2384e419-etc-kubernetes\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.827737 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.826774 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/be74c874-a20b-4dec-88f7-d74e27aadc0d-node-log\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.830671 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.830615 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be74c874-a20b-4dec-88f7-d74e27aadc0d-ovn-node-metrics-cert\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.832106 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.832086 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btbf7\" (UniqueName: \"kubernetes.io/projected/be74c874-a20b-4dec-88f7-d74e27aadc0d-kube-api-access-btbf7\") pod \"ovnkube-node-xntds\" (UID: \"be74c874-a20b-4dec-88f7-d74e27aadc0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.834875 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.834824 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t7p4\" (UniqueName: \"kubernetes.io/projected/16470165-f773-4358-9757-6070c156d07e-kube-api-access-4t7p4\") pod \"node-resolver-w765k\" (UID: \"16470165-f773-4358-9757-6070c156d07e\") " pod="openshift-dns/node-resolver-w765k" Sep 10 16:02:46.835994 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.835971 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn87s\" (UniqueName: \"kubernetes.io/projected/272e68f6-e885-42a2-9154-c94d2384e419-kube-api-access-kn87s\") pod \"multus-ckhkh\" (UID: \"272e68f6-e885-42a2-9154-c94d2384e419\") " pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.836159 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:46.836138 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:02:46.836242 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:46.836165 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:02:46.836242 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:46.836188 2556 projected.go:196] Error preparing data for projected volume kube-api-access-jbm5b for pod openshift-network-diagnostics/network-check-target-pgmqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:46.836354 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:46.836253 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b podName:adb082dd-4d72-4f3a-8ec2-16b37a7d3375 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:47.33623687 +0000 UTC m=+3.135625176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jbm5b" (UniqueName: "kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b") pod "network-check-target-pgmqd" (UID: "adb082dd-4d72-4f3a-8ec2-16b37a7d3375") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:46.837066 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.837042 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whtxz\" (UniqueName: \"kubernetes.io/projected/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-kube-api-access-whtxz\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:46.837731 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.837706 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsg9j\" (UniqueName: \"kubernetes.io/projected/1f650bc2-5f43-4a32-9e3d-48fb84687f8b-kube-api-access-zsg9j\") pod \"multus-additional-cni-plugins-b9w99\" (UID: \"1f650bc2-5f43-4a32-9e3d-48fb84687f8b\") " pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:46.909296 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.909240 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" Sep 10 16:02:46.918286 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.918256 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:02:46.927463 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.927440 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" Sep 10 16:02:46.937432 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.937402 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5k5qc" Sep 10 16:02:46.952517 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.952493 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lwff8" Sep 10 16:02:46.961355 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.961325 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ckhkh" Sep 10 16:02:46.969279 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.969256 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w765k" Sep 10 16:02:46.978218 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.978191 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:02:46.984118 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:46.984094 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b9w99" Sep 10 16:02:47.327235 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:47.327198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:47.327449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:47.327248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:47.327449 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:47.327348 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:47.327449 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:47.327421 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs podName:117f519b-c0a5-4892-ad17-5d8ec8bd5f9b nodeName:}" failed. No retries permitted until 2026-09-10 16:02:48.327404701 +0000 UTC m=+4.126793015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs") pod "network-metrics-daemon-2gr6r" (UID: "117f519b-c0a5-4892-ad17-5d8ec8bd5f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:47.327449 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:47.327432 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:47.327690 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:47.327496 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret podName:d651ea1e-c120-4cdc-8d53-b2c3014cb09f nodeName:}" failed. No retries permitted until 2026-09-10 16:02:48.327478875 +0000 UTC m=+4.126867177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret") pod "global-pull-secret-syncer-wd54m" (UID: "d651ea1e-c120-4cdc-8d53-b2c3014cb09f") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:47.428639 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:47.428562 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbm5b\" (UniqueName: \"kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b\") pod \"network-check-target-pgmqd\" (UID: \"adb082dd-4d72-4f3a-8ec2-16b37a7d3375\") " pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:47.428786 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:47.428745 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:02:47.428786 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:47.428771 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:02:47.428786 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:47.428782 2556 projected.go:196] Error preparing data for projected volume kube-api-access-jbm5b for pod openshift-network-diagnostics/network-check-target-pgmqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:47.428887 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:47.428841 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b podName:adb082dd-4d72-4f3a-8ec2-16b37a7d3375 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:48.428821123 +0000 UTC m=+4.228209442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbm5b" (UniqueName: "kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b") pod "network-check-target-pgmqd" (UID: "adb082dd-4d72-4f3a-8ec2-16b37a7d3375") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:47.669665 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:47.669580 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:47.670077 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:47.669721 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:02:47.682327 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:47.682271 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:57:47 +0000 UTC" deadline="2028-02-25 21:34:42.170064205 +0000 UTC" Sep 10 16:02:47.682327 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:47.682303 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12797h31m54.487765088s" Sep 10 16:02:47.806864 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:47.806820 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216c8761_0aa5_4127_9c0e_ea65047bdefb.slice/crio-dec87a4a8985591f924056910d5c5c02f39ccd472fa19b3e788b1bdc57a7dd48 WatchSource:0}: Error finding container dec87a4a8985591f924056910d5c5c02f39ccd472fa19b3e788b1bdc57a7dd48: Status 404 returned error can't find the container with id dec87a4a8985591f924056910d5c5c02f39ccd472fa19b3e788b1bdc57a7dd48 Sep 10 16:02:47.814031 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:47.814004 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf9cb90_d31a_4d25_af00_6a8d45acedf6.slice/crio-5204162f18cdbf782acaa633dc66b99ded05efa4078ebb7afd023c4333377836 WatchSource:0}: Error finding container 5204162f18cdbf782acaa633dc66b99ded05efa4078ebb7afd023c4333377836: Status 404 returned error can't find the container with id 5204162f18cdbf782acaa633dc66b99ded05efa4078ebb7afd023c4333377836 Sep 10 16:02:47.814820 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:47.814799 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f650bc2_5f43_4a32_9e3d_48fb84687f8b.slice/crio-75b7e90fc56e42932b1c51a6bfdad87e87d8d9eb5b461a788acdaa232860c439 WatchSource:0}: Error finding container 75b7e90fc56e42932b1c51a6bfdad87e87d8d9eb5b461a788acdaa232860c439: Status 404 returned error can't find the container with id 75b7e90fc56e42932b1c51a6bfdad87e87d8d9eb5b461a788acdaa232860c439 Sep 10 16:02:47.816295 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:47.816265 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82536397_7411_40cc_a761_838e33d03786.slice/crio-563ebbc821847e06889b5d5047f4401cc99c59bb744915a67bbe5b1be8783632 WatchSource:0}: Error finding container 563ebbc821847e06889b5d5047f4401cc99c59bb744915a67bbe5b1be8783632: Status 404 returned error can't find the container with id 563ebbc821847e06889b5d5047f4401cc99c59bb744915a67bbe5b1be8783632 Sep 10 16:02:47.817313 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:47.817286 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod272e68f6_e885_42a2_9154_c94d2384e419.slice/crio-38d7fc9217ea545dfaa991d1ead918df8226d9b72ba11655d317f1c42480edf8 WatchSource:0}: Error finding container 38d7fc9217ea545dfaa991d1ead918df8226d9b72ba11655d317f1c42480edf8: Status 404 returned error can't find the container with id 38d7fc9217ea545dfaa991d1ead918df8226d9b72ba11655d317f1c42480edf8 Sep 10 16:02:47.819156 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:47.819076 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16470165_f773_4358_9757_6070c156d07e.slice/crio-1474a7d7a0cedd44d23535417138d24e54fe751a7775b71144dceda75386f031 WatchSource:0}: Error finding container 1474a7d7a0cedd44d23535417138d24e54fe751a7775b71144dceda75386f031: Status 404 returned error can't find the container with id 1474a7d7a0cedd44d23535417138d24e54fe751a7775b71144dceda75386f031 Sep 10 16:02:47.820090 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:47.820065 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8661f55c_6d7f_4afb_8135_ecdc38f2d499.slice/crio-ef66d1f2c2da0268bd1137d150a26783f4c7bc5ccb26f89dc7f33a734ca5097c WatchSource:0}: Error finding container ef66d1f2c2da0268bd1137d150a26783f4c7bc5ccb26f89dc7f33a734ca5097c: Status 404 returned error can't find the container with id ef66d1f2c2da0268bd1137d150a26783f4c7bc5ccb26f89dc7f33a734ca5097c Sep 10 16:02:47.821485 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:47.821458 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16abdb67_53a9_4a09_a6b8_7ca139d5555b.slice/crio-65b4c8e55081d0b2e9843b08c932bc716734a83f9c9afd9460aa92d2a298559d WatchSource:0}: Error finding container 65b4c8e55081d0b2e9843b08c932bc716734a83f9c9afd9460aa92d2a298559d: Status 404 returned error can't find the container with id 65b4c8e55081d0b2e9843b08c932bc716734a83f9c9afd9460aa92d2a298559d Sep 10 16:02:47.822111 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:02:47.821972 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe74c874_a20b_4dec_88f7_d74e27aadc0d.slice/crio-7a9cf7444c69b3e3a03d02a4095d0caa8acd37debb8ad0ef02b51c5f4d85b9e6 WatchSource:0}: Error finding container 7a9cf7444c69b3e3a03d02a4095d0caa8acd37debb8ad0ef02b51c5f4d85b9e6: Status 404 returned error can't find the container with id 7a9cf7444c69b3e3a03d02a4095d0caa8acd37debb8ad0ef02b51c5f4d85b9e6 Sep 10 16:02:48.337168 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.337132 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:48.337371 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.337185 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:48.337371 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:48.337302 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:48.337506 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:48.337390 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs podName:117f519b-c0a5-4892-ad17-5d8ec8bd5f9b nodeName:}" failed. No retries permitted until 2026-09-10 16:02:50.337369204 +0000 UTC m=+6.136757526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs") pod "network-metrics-daemon-2gr6r" (UID: "117f519b-c0a5-4892-ad17-5d8ec8bd5f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:48.337733 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:48.337310 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:48.337813 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:48.337777 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret podName:d651ea1e-c120-4cdc-8d53-b2c3014cb09f nodeName:}" failed. No retries permitted until 2026-09-10 16:02:50.337759711 +0000 UTC m=+6.137148021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret") pod "global-pull-secret-syncer-wd54m" (UID: "d651ea1e-c120-4cdc-8d53-b2c3014cb09f") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:48.438317 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.438266 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbm5b\" (UniqueName: \"kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b\") pod \"network-check-target-pgmqd\" (UID: \"adb082dd-4d72-4f3a-8ec2-16b37a7d3375\") " pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:48.438520 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:48.438501 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:02:48.438520 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:48.438521 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:02:48.438643 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:48.438534 2556 projected.go:196] Error preparing data for projected volume kube-api-access-jbm5b for pod openshift-network-diagnostics/network-check-target-pgmqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:48.438643 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:48.438591 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b podName:adb082dd-4d72-4f3a-8ec2-16b37a7d3375 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:50.438573062 +0000 UTC m=+6.237961368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbm5b" (UniqueName: "kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b") pod "network-check-target-pgmqd" (UID: "adb082dd-4d72-4f3a-8ec2-16b37a7d3375") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:48.671638 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.671557 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:48.672596 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:48.671716 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:02:48.672596 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.672205 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:48.672596 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:48.672298 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:02:48.682894 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.682829 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:57:47 +0000 UTC" deadline="2028-03-05 02:34:38.075074973 +0000 UTC" Sep 10 16:02:48.682894 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.682881 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12994h31m49.392197932s" Sep 10 16:02:48.710312 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.710278 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-80.ec2.internal" event={"ID":"d2e82bddfbf53f2d90204713bbd4554d","Type":"ContainerStarted","Data":"395eb32495e64094d531d8c7187c2a55752c2657b5e779f9bc632367ecad1e60"} Sep 10 16:02:48.715770 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.715719 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cxhhn" event={"ID":"16abdb67-53a9-4a09-a6b8-7ca139d5555b","Type":"ContainerStarted","Data":"65b4c8e55081d0b2e9843b08c932bc716734a83f9c9afd9460aa92d2a298559d"} Sep 10 16:02:48.722888 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.722854 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5k5qc" event={"ID":"8661f55c-6d7f-4afb-8135-ecdc38f2d499","Type":"ContainerStarted","Data":"ef66d1f2c2da0268bd1137d150a26783f4c7bc5ccb26f89dc7f33a734ca5097c"} Sep 10 16:02:48.732297 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.732267 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" event={"ID":"be74c874-a20b-4dec-88f7-d74e27aadc0d","Type":"ContainerStarted","Data":"7a9cf7444c69b3e3a03d02a4095d0caa8acd37debb8ad0ef02b51c5f4d85b9e6"} Sep 10 16:02:48.742263 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.742236 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w765k" event={"ID":"16470165-f773-4358-9757-6070c156d07e","Type":"ContainerStarted","Data":"1474a7d7a0cedd44d23535417138d24e54fe751a7775b71144dceda75386f031"} Sep 10 16:02:48.753411 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.753383 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ckhkh" event={"ID":"272e68f6-e885-42a2-9154-c94d2384e419","Type":"ContainerStarted","Data":"38d7fc9217ea545dfaa991d1ead918df8226d9b72ba11655d317f1c42480edf8"} Sep 10 16:02:48.761648 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.761621 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" event={"ID":"82536397-7411-40cc-a761-838e33d03786","Type":"ContainerStarted","Data":"563ebbc821847e06889b5d5047f4401cc99c59bb744915a67bbe5b1be8783632"} Sep 10 16:02:48.777988 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.777944 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9w99" event={"ID":"1f650bc2-5f43-4a32-9e3d-48fb84687f8b","Type":"ContainerStarted","Data":"75b7e90fc56e42932b1c51a6bfdad87e87d8d9eb5b461a788acdaa232860c439"} Sep 10 16:02:48.788161 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.788132 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" event={"ID":"acf9cb90-d31a-4d25-af00-6a8d45acedf6","Type":"ContainerStarted","Data":"5204162f18cdbf782acaa633dc66b99ded05efa4078ebb7afd023c4333377836"} Sep 10 16:02:48.794530 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.794506 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lwff8" event={"ID":"216c8761-0aa5-4127-9c0e-ea65047bdefb","Type":"ContainerStarted","Data":"dec87a4a8985591f924056910d5c5c02f39ccd472fa19b3e788b1bdc57a7dd48"} Sep 10 16:02:48.797918 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.797884 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec889f4ef5088285a3c0b3f8da2f90fa" containerID="5cf7c38756b11389002f55f6dcea90d311144f3bf474fcfa4f218c9c2db64127" exitCode=0 Sep 10 16:02:48.798021 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.797927 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" event={"ID":"ec889f4ef5088285a3c0b3f8da2f90fa","Type":"ContainerDied","Data":"5cf7c38756b11389002f55f6dcea90d311144f3bf474fcfa4f218c9c2db64127"} Sep 10 16:02:48.818584 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:48.818515 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-80.ec2.internal" podStartSLOduration=2.818494381 podStartE2EDuration="2.818494381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:48.728857628 +0000 UTC m=+4.528245954" watchObservedRunningTime="2026-09-10 16:02:48.818494381 +0000 UTC m=+4.617882710" Sep 10 16:02:49.669511 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:49.669475 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:49.669770 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:49.669740 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:02:49.817362 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:49.817274 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" event={"ID":"ec889f4ef5088285a3c0b3f8da2f90fa","Type":"ContainerStarted","Data":"245def246f487160a9bcfe33b5127f1e8c33cd490051de0a5b2ba03dd6585ed2"} Sep 10 16:02:49.835019 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:49.834961 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-80.ec2.internal" podStartSLOduration=3.83494197 podStartE2EDuration="3.83494197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:49.834051745 +0000 UTC m=+5.633440074" watchObservedRunningTime="2026-09-10 16:02:49.83494197 +0000 UTC m=+5.634330297" Sep 10 16:02:50.355819 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:50.355775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:50.356015 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:50.355836 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:50.356015 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:50.356007 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:50.356141 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:50.356078 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret podName:d651ea1e-c120-4cdc-8d53-b2c3014cb09f nodeName:}" failed. No retries permitted until 2026-09-10 16:02:54.356057294 +0000 UTC m=+10.155445623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret") pod "global-pull-secret-syncer-wd54m" (UID: "d651ea1e-c120-4cdc-8d53-b2c3014cb09f") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:50.356626 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:50.356605 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:50.356724 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:50.356662 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs podName:117f519b-c0a5-4892-ad17-5d8ec8bd5f9b nodeName:}" failed. No retries permitted until 2026-09-10 16:02:54.356646572 +0000 UTC m=+10.156034880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs") pod "network-metrics-daemon-2gr6r" (UID: "117f519b-c0a5-4892-ad17-5d8ec8bd5f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:50.457135 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:50.457094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbm5b\" (UniqueName: \"kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b\") pod \"network-check-target-pgmqd\" (UID: \"adb082dd-4d72-4f3a-8ec2-16b37a7d3375\") " pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:50.457360 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:50.457303 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:02:50.457360 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:50.457325 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:02:50.457360 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:50.457339 2556 projected.go:196] Error preparing data for projected volume kube-api-access-jbm5b for pod openshift-network-diagnostics/network-check-target-pgmqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:50.457553 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:50.457419 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b podName:adb082dd-4d72-4f3a-8ec2-16b37a7d3375 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:54.457395526 +0000 UTC m=+10.256783842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbm5b" (UniqueName: "kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b") pod "network-check-target-pgmqd" (UID: "adb082dd-4d72-4f3a-8ec2-16b37a7d3375") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:50.670606 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:50.670505 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:50.670786 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:50.670650 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:02:50.673045 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:50.673021 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:50.673164 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:50.673145 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:02:51.669780 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:51.669735 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:51.670261 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:51.669869 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:02:52.671082 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:52.671040 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:52.671561 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:52.671173 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:02:52.671848 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:52.671683 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:52.671848 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:52.671820 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:02:53.669661 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:53.669614 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:53.669850 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:53.669771 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:02:54.393373 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:54.392541 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:54.393373 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:54.392599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:54.393373 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:54.392757 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:54.393373 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:54.392824 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret podName:d651ea1e-c120-4cdc-8d53-b2c3014cb09f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:02.392803098 +0000 UTC m=+18.192191403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret") pod "global-pull-secret-syncer-wd54m" (UID: "d651ea1e-c120-4cdc-8d53-b2c3014cb09f") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:54.393373 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:54.393279 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:54.393373 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:54.393333 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs podName:117f519b-c0a5-4892-ad17-5d8ec8bd5f9b nodeName:}" failed. No retries permitted until 2026-09-10 16:03:02.393314959 +0000 UTC m=+18.192703290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs") pod "network-metrics-daemon-2gr6r" (UID: "117f519b-c0a5-4892-ad17-5d8ec8bd5f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:54.493594 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:54.493537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbm5b\" (UniqueName: \"kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b\") pod \"network-check-target-pgmqd\" (UID: \"adb082dd-4d72-4f3a-8ec2-16b37a7d3375\") " pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:54.493816 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:54.493795 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:02:54.493886 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:54.493818 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:02:54.493886 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:54.493831 2556 projected.go:196] Error preparing data for projected volume kube-api-access-jbm5b for pod openshift-network-diagnostics/network-check-target-pgmqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:54.493993 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:54.493944 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b podName:adb082dd-4d72-4f3a-8ec2-16b37a7d3375 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:02.493873061 +0000 UTC m=+18.293261378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbm5b" (UniqueName: "kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b") pod "network-check-target-pgmqd" (UID: "adb082dd-4d72-4f3a-8ec2-16b37a7d3375") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:54.670125 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:54.670047 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:54.670125 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:54.670030 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:54.670342 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:54.670173 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:02:54.670524 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:54.670491 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:02:55.669599 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:55.669559 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:55.670075 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:55.669697 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:02:56.670156 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:56.670079 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:56.670156 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:56.670090 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:56.670700 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:56.670220 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:02:56.670700 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:56.670284 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:02:57.669636 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:57.669604 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:57.669800 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:57.669701 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:02:58.669740 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:58.669701 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:02:58.670175 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:58.669701 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:02:58.670175 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:58.669839 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:02:58.670175 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:58.669920 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:02:59.669087 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:02:59.669053 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:02:59.669249 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:02:59.669177 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:03:00.669428 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:00.669393 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:00.669828 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:00.669393 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:00.669828 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:00.669561 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:03:00.669828 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:00.669623 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:03:01.669475 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:01.669435 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:01.669980 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:01.669575 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:03:02.452161 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:02.452068 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:02.452161 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:02.452116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:02.452405 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:02.452228 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:02.452405 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:02.452231 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:02.452405 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:02.452292 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret podName:d651ea1e-c120-4cdc-8d53-b2c3014cb09f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:18.452273235 +0000 UTC m=+34.251661552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret") pod "global-pull-secret-syncer-wd54m" (UID: "d651ea1e-c120-4cdc-8d53-b2c3014cb09f") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:02.452405 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:02.452327 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs podName:117f519b-c0a5-4892-ad17-5d8ec8bd5f9b nodeName:}" failed. No retries permitted until 2026-09-10 16:03:18.45230114 +0000 UTC m=+34.251689458 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs") pod "network-metrics-daemon-2gr6r" (UID: "117f519b-c0a5-4892-ad17-5d8ec8bd5f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:02.552754 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:02.552721 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbm5b\" (UniqueName: \"kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b\") pod \"network-check-target-pgmqd\" (UID: \"adb082dd-4d72-4f3a-8ec2-16b37a7d3375\") " pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:02.552927 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:02.552853 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:02.552927 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:02.552868 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:02.552927 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:02.552876 2556 projected.go:196] Error preparing data for projected volume kube-api-access-jbm5b for pod openshift-network-diagnostics/network-check-target-pgmqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:02.552927 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:02.552922 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b podName:adb082dd-4d72-4f3a-8ec2-16b37a7d3375 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:18.552908848 +0000 UTC m=+34.352297148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbm5b" (UniqueName: "kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b") pod "network-check-target-pgmqd" (UID: "adb082dd-4d72-4f3a-8ec2-16b37a7d3375") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:02.669547 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:02.669513 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:02.669947 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:02.669626 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:03:02.669947 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:02.669655 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:02.669947 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:02.669735 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:03:03.669758 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:03.669729 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:03.670206 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:03.669850 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:03:04.670746 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:04.670716 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:04.671215 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:04.670796 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:03:04.671215 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:04.670879 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:04.671215 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:04.670970 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:03:05.669866 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:05.669837 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:05.670027 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:05.669943 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:03:05.866189 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:05.866152 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" event={"ID":"82536397-7411-40cc-a761-838e33d03786","Type":"ContainerStarted","Data":"b491dba2c46c77fa862525b3b4aafca400800c39cdc48f5ea3b78c5a606fa9f6"} Sep 10 16:03:05.887405 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:05.887022 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qf5tp" podStartSLOduration=2.974046823 podStartE2EDuration="20.887000326s" totalImagesPullingTime="17.912953503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:05.886260157 +0000 UTC m=+21.685648480" watchObservedRunningTime="2026-09-10 16:03:05.887000326 +0000 UTC m=+21.686388649" Sep 10 16:03:06.670318 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.669970 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:06.670498 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.669979 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:06.670498 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:06.670444 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:03:06.670498 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:06.670484 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:03:06.870411 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.870369 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ckhkh" event={"ID":"272e68f6-e885-42a2-9154-c94d2384e419","Type":"ContainerStarted","Data":"2c7b4fec9d4bd6875420f7220519e0acdccf6d0e173e48d5c94e01245429a610"} Sep 10 16:03:06.872068 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.872039 2556 generic.go:356] "Generic (PLEG): container finished" podID="1f650bc2-5f43-4a32-9e3d-48fb84687f8b" containerID="80fdd4b11fdf94e730f73e60514f0d2e5378a89be3843dc3e9d847d50bdf917b" exitCode=0 Sep 10 16:03:06.872191 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.872120 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9w99" event={"ID":"1f650bc2-5f43-4a32-9e3d-48fb84687f8b","Type":"ContainerDied","Data":"80fdd4b11fdf94e730f73e60514f0d2e5378a89be3843dc3e9d847d50bdf917b"} Sep 10 16:03:06.874051 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.874029 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" event={"ID":"acf9cb90-d31a-4d25-af00-6a8d45acedf6","Type":"ContainerStarted","Data":"0c68a75191e0a98ba2baea79dae8f21fb9ed8a8756fb0ec0ba02c60a2d0ec191"} Sep 10 16:03:06.875598 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.875574 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lwff8" event={"ID":"216c8761-0aa5-4127-9c0e-ea65047bdefb","Type":"ContainerStarted","Data":"83fd6139c3cbd46516da7266f11d4aa1653cb025d42d28237b9ad6dc7ab5c0a6"} Sep 10 16:03:06.877206 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.877183 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cxhhn" event={"ID":"16abdb67-53a9-4a09-a6b8-7ca139d5555b","Type":"ContainerStarted","Data":"8f70cb212b30e3419e5bc77037628e4b2cd7d70b0facbbb2940188d1248436d2"} Sep 10 16:03:06.880287 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.880263 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" event={"ID":"be74c874-a20b-4dec-88f7-d74e27aadc0d","Type":"ContainerStarted","Data":"42f9daa4d709c6d1485f0aa2a9c10dd18acd327f1c7cd204a2544459ebdcae67"} Sep 10 16:03:06.880389 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.880348 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" event={"ID":"be74c874-a20b-4dec-88f7-d74e27aadc0d","Type":"ContainerStarted","Data":"5ca7edbd0e3741633484afec87bb5513dfa337cf22c86857b81fd39d9627b356"} Sep 10 16:03:06.880433 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.880400 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" event={"ID":"be74c874-a20b-4dec-88f7-d74e27aadc0d","Type":"ContainerStarted","Data":"e7919092e03151784b1e666ce4530a888360c3c0b9f8be14a0611e7fdbfbd0d0"} Sep 10 16:03:06.880473 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.880449 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" event={"ID":"be74c874-a20b-4dec-88f7-d74e27aadc0d","Type":"ContainerStarted","Data":"55eae6e8303e6df4942d512950c0c242b9a4a421147422930d81bc06482082aa"} Sep 10 16:03:06.880521 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.880495 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" event={"ID":"be74c874-a20b-4dec-88f7-d74e27aadc0d","Type":"ContainerStarted","Data":"4bfc84877af18a9652e0e970353e12dc42fc16533d708a136d330f272c1aee26"} Sep 10 16:03:06.880573 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.880526 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" event={"ID":"be74c874-a20b-4dec-88f7-d74e27aadc0d","Type":"ContainerStarted","Data":"fe0abd84e99a493e48d55d31c18113425c6d83ad1463ae6677afd85df5161b41"} Sep 10 16:03:06.885242 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.885212 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w765k" event={"ID":"16470165-f773-4358-9757-6070c156d07e","Type":"ContainerStarted","Data":"7068a578f49ff6a56130f907e407c7791792de13b59720ea7cb63f1dbe2ba66e"} Sep 10 16:03:06.909520 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.909470 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lwff8" podStartSLOduration=3.989489303 podStartE2EDuration="21.909458458s" totalImagesPullingTime="17.919969155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:06.90945017 +0000 UTC m=+22.708838497" watchObservedRunningTime="2026-09-10 16:03:06.909458458 +0000 UTC m=+22.708846784" Sep 10 16:03:06.909856 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.909831 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ckhkh" podStartSLOduration=3.938994623 podStartE2EDuration="21.909825025s" totalImagesPullingTime="17.970830402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:06.891705409 +0000 UTC m=+22.691093730" watchObservedRunningTime="2026-09-10 16:03:06.909825025 +0000 UTC m=+22.709213348" Sep 10 16:03:06.925971 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:06.925861 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w765k" podStartSLOduration=3.017306146 podStartE2EDuration="20.925849728s" totalImagesPullingTime="17.908543582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:06.925667138 +0000 UTC m=+22.725055464" watchObservedRunningTime="2026-09-10 16:03:06.925849728 +0000 UTC m=+22.725238049" Sep 10 16:03:07.002423 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:07.002364 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cxhhn" podStartSLOduration=7.705112542 podStartE2EDuration="22.002349128s" totalImagesPullingTime="14.297236586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:07.002329747 +0000 UTC m=+22.801718068" watchObservedRunningTime="2026-09-10 16:03:07.002349128 +0000 UTC m=+22.801737460" Sep 10 16:03:07.385670 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:07.385642 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 16:03:07.670019 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:07.669936 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:07.670177 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:07.670066 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:03:07.670524 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:07.670445 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T16:03:07.385657724Z","UUID":"7d2709de-067d-423e-ade1-60855b93ad6f","Handler":null,"Name":"","Endpoint":""} Sep 10 16:03:07.672171 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:07.672148 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 16:03:07.672292 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:07.672183 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 16:03:07.889877 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:07.889835 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" event={"ID":"acf9cb90-d31a-4d25-af00-6a8d45acedf6","Type":"ContainerStarted","Data":"f7f57f9882c1aaf5a6998822546741ca223255ecc27271ba4199acfe197e23fd"} Sep 10 16:03:07.891542 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:07.891509 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5k5qc" event={"ID":"8661f55c-6d7f-4afb-8135-ecdc38f2d499","Type":"ContainerStarted","Data":"d96c45f545d6ca3dbfb6aed80573e752e3c28de96614cf723240cca5d484255d"} Sep 10 16:03:08.669598 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:08.669524 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:08.669740 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:08.669691 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:03:08.669818 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:08.669743 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:08.669876 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:08.669856 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:03:08.898350 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:08.898230 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" event={"ID":"be74c874-a20b-4dec-88f7-d74e27aadc0d","Type":"ContainerStarted","Data":"0abdf16b7fceafb2f7d092baa4b5375961ef3871adeb97e3ef220204bcdaa185"} Sep 10 16:03:08.900739 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:08.900711 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" event={"ID":"acf9cb90-d31a-4d25-af00-6a8d45acedf6","Type":"ContainerStarted","Data":"c711a03930b2726a162e4bf8865632b2fdcf3a455dc68f71ed275aabf1fd128b"} Sep 10 16:03:08.927796 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:08.927710 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-npxvh" podStartSLOduration=3.81816721 podStartE2EDuration="23.927692933s" totalImagesPullingTime="20.109525723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:08.927200881 +0000 UTC m=+24.726589204" watchObservedRunningTime="2026-09-10 16:03:08.927692933 +0000 UTC m=+24.727081257" Sep 10 16:03:08.928384 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:08.928358 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5k5qc" podStartSLOduration=6.046886007 podStartE2EDuration="23.928347541s" totalImagesPullingTime="17.881461534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:07.912230536 +0000 UTC m=+23.711618887" watchObservedRunningTime="2026-09-10 16:03:08.928347541 +0000 UTC m=+24.727735867" Sep 10 16:03:09.594327 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:09.594286 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:03:09.594999 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:09.594974 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:03:09.669546 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:09.669516 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:09.669713 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:09.669629 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:03:09.903797 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:09.903696 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:03:09.904232 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:09.903983 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cxhhn" Sep 10 16:03:10.670063 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:10.670031 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:10.670063 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:10.670052 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:10.670281 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:10.670138 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:03:10.670281 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:10.670258 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:03:11.670116 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:11.669943 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:11.670784 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:11.670191 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:03:11.912048 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:11.912018 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" event={"ID":"be74c874-a20b-4dec-88f7-d74e27aadc0d","Type":"ContainerStarted","Data":"4be87c37c7122138ddbaafbdb3be5b0ff4b49eccd44df0e146e94a58bacd589f"} Sep 10 16:03:11.912298 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:11.912258 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:03:11.912426 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:11.912356 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:03:11.914177 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:11.914148 2556 generic.go:356] "Generic (PLEG): container finished" podID="1f650bc2-5f43-4a32-9e3d-48fb84687f8b" containerID="77ccee9e4cbb70d636439bcce6dc177ab25fa8b5b5c7ac451a49d50112ce8b5a" exitCode=0 Sep 10 16:03:11.914279 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:11.914223 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9w99" event={"ID":"1f650bc2-5f43-4a32-9e3d-48fb84687f8b","Type":"ContainerDied","Data":"77ccee9e4cbb70d636439bcce6dc177ab25fa8b5b5c7ac451a49d50112ce8b5a"} Sep 10 16:03:11.928569 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:11.928545 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:03:11.928704 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:11.928635 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:03:11.945166 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:11.945126 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" podStartSLOduration=7.993588286 podStartE2EDuration="25.945110121s" totalImagesPullingTime="17.951521835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:11.944139353 +0000 UTC m=+27.743527674" watchObservedRunningTime="2026-09-10 16:03:11.945110121 +0000 UTC m=+27.744498482" Sep 10 16:03:12.669906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:12.669856 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:12.670136 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:12.669863 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:12.670136 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:12.669991 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:03:12.670490 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:12.670143 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:03:12.918727 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:12.918699 2556 generic.go:356] "Generic (PLEG): container finished" podID="1f650bc2-5f43-4a32-9e3d-48fb84687f8b" containerID="979dc354aa3ab728e480e0b950d9d20d2ba0c22abe8ff01a0a7e9cdf722e2634" exitCode=0 Sep 10 16:03:12.918849 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:12.918759 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9w99" event={"ID":"1f650bc2-5f43-4a32-9e3d-48fb84687f8b","Type":"ContainerDied","Data":"979dc354aa3ab728e480e0b950d9d20d2ba0c22abe8ff01a0a7e9cdf722e2634"} Sep 10 16:03:12.918849 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:12.918844 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 10 16:03:13.477485 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:13.477323 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:03:13.586355 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:13.586305 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wd54m"] Sep 10 16:03:13.586468 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:13.586454 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:13.586603 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:13.586578 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:03:13.589268 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:13.589245 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pgmqd"] Sep 10 16:03:13.589383 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:13.589359 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:13.589473 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:13.589455 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:03:13.593268 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:13.593247 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2gr6r"] Sep 10 16:03:13.593393 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:13.593369 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:13.593507 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:13.593486 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:03:13.923403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:13.923371 2556 generic.go:356] "Generic (PLEG): container finished" podID="1f650bc2-5f43-4a32-9e3d-48fb84687f8b" containerID="e62a1a83d4993febf59faebe219ba3e06389cd4c13197f1f18e2a0c8e62da983" exitCode=0 Sep 10 16:03:13.923736 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:13.923455 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9w99" event={"ID":"1f650bc2-5f43-4a32-9e3d-48fb84687f8b","Type":"ContainerDied","Data":"e62a1a83d4993febf59faebe219ba3e06389cd4c13197f1f18e2a0c8e62da983"} Sep 10 16:03:14.669967 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:14.669943 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:14.670093 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:14.670028 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:03:15.669409 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:15.669376 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:15.669861 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:15.669380 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:15.669861 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:15.669495 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:03:15.669861 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:15.669540 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:03:16.669981 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:16.669949 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:16.670404 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:16.670072 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgmqd" podUID="adb082dd-4d72-4f3a-8ec2-16b37a7d3375" Sep 10 16:03:17.669735 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:17.669705 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:17.669928 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:17.669820 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gr6r" podUID="117f519b-c0a5-4892-ad17-5d8ec8bd5f9b" Sep 10 16:03:17.669928 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:17.669884 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:17.670044 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:17.669989 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wd54m" podUID="d651ea1e-c120-4cdc-8d53-b2c3014cb09f" Sep 10 16:03:18.470385 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.470340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:18.470597 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.470399 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:18.470597 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.470484 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:18.470597 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.470558 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs podName:117f519b-c0a5-4892-ad17-5d8ec8bd5f9b nodeName:}" failed. No retries permitted until 2026-09-10 16:03:50.470540552 +0000 UTC m=+66.269928856 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs") pod "network-metrics-daemon-2gr6r" (UID: "117f519b-c0a5-4892-ad17-5d8ec8bd5f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:18.470597 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.470559 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:18.470771 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.470620 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret podName:d651ea1e-c120-4cdc-8d53-b2c3014cb09f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:50.470602732 +0000 UTC m=+66.269991039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret") pod "global-pull-secret-syncer-wd54m" (UID: "d651ea1e-c120-4cdc-8d53-b2c3014cb09f") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:18.486504 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.486482 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-80.ec2.internal" event="NodeReady" Sep 10 16:03:18.486649 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.486620 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 16:03:18.522852 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.522779 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66b679487c-2gc4p"] Sep 10 16:03:18.570596 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.570564 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66b679487c-2gc4p"] Sep 10 16:03:18.570772 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.570608 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t92md"] Sep 10 16:03:18.570772 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.570717 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.570772 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.570740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbm5b\" (UniqueName: \"kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b\") pod \"network-check-target-pgmqd\" (UID: \"adb082dd-4d72-4f3a-8ec2-16b37a7d3375\") " pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:18.570937 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.570916 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:18.570985 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.570940 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:18.570985 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.570954 2556 projected.go:196] Error preparing data for projected volume kube-api-access-jbm5b for pod openshift-network-diagnostics/network-check-target-pgmqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:18.571083 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.571009 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b podName:adb082dd-4d72-4f3a-8ec2-16b37a7d3375 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:50.570991571 +0000 UTC m=+66.370379885 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbm5b" (UniqueName: "kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b") pod "network-check-target-pgmqd" (UID: "adb082dd-4d72-4f3a-8ec2-16b37a7d3375") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:18.572887 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.572863 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 16:03:18.573026 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.573009 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 16:03:18.573026 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.573013 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8xcjl\"" Sep 10 16:03:18.573138 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.573076 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 16:03:18.578823 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.578804 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 16:03:18.591019 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.590979 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tdbnf"] Sep 10 16:03:18.592514 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.592411 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.594792 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.594766 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 16:03:18.594894 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.594769 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-snhng\"" Sep 10 16:03:18.594894 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.594768 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 16:03:18.605085 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.605062 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tdbnf"] Sep 10 16:03:18.605189 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.605093 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t92md"] Sep 10 16:03:18.605241 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.605193 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tdbnf" Sep 10 16:03:18.607584 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.607565 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tj7w7\"" Sep 10 16:03:18.607584 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.607564 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 16:03:18.607731 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.607657 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 16:03:18.607865 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.607841 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 16:03:18.669471 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.669451 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:18.671470 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.671906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671475 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.671906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-certificates\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.671906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671526 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwnx4\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-kube-api-access-wwnx4\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.671906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671551 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-image-registry-private-configuration\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.671906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671567 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-installation-pull-secrets\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.671906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671594 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-bound-sa-token\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.671906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671658 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-ca-trust-extracted\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.671906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671709 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-trusted-ca\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.671906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671757 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05e2242e-492b-4358-8d86-e14a214ba5a0-config-volume\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.671906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671787 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05e2242e-492b-4358-8d86-e14a214ba5a0-tmp-dir\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.671906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671846 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft62w\" (UniqueName: \"kubernetes.io/projected/05e2242e-492b-4358-8d86-e14a214ba5a0-kube-api-access-ft62w\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.672500 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.671932 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 16:03:18.672500 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.672007 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4mwj\"" Sep 10 16:03:18.672500 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.672257 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 16:03:18.772813 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.772785 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.772948 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.772817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-certificates\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.772948 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.772839 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwnx4\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-kube-api-access-wwnx4\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.772948 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.772873 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-image-registry-private-configuration\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.772948 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.772894 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6ddv\" (UniqueName: \"kubernetes.io/projected/ac0843a0-3970-488d-bff6-a0a66d7bddb3-kube-api-access-l6ddv\") pod \"ingress-canary-tdbnf\" (UID: \"ac0843a0-3970-488d-bff6-a0a66d7bddb3\") " pod="openshift-ingress-canary/ingress-canary-tdbnf" Sep 10 16:03:18.772948 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.772912 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-installation-pull-secrets\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.772948 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.772935 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-bound-sa-token\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.773251 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.772957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac0843a0-3970-488d-bff6-a0a66d7bddb3-cert\") pod \"ingress-canary-tdbnf\" (UID: \"ac0843a0-3970-488d-bff6-a0a66d7bddb3\") " pod="openshift-ingress-canary/ingress-canary-tdbnf" Sep 10 16:03:18.773251 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.773073 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:18.773251 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.773078 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-ca-trust-extracted\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.773251 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.773150 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls podName:05e2242e-492b-4358-8d86-e14a214ba5a0 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:19.273128216 +0000 UTC m=+35.072516546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls") pod "dns-default-t92md" (UID: "05e2242e-492b-4358-8d86-e14a214ba5a0") : secret "dns-default-metrics-tls" not found Sep 10 16:03:18.773251 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.773181 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-trusted-ca\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.773251 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.773230 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05e2242e-492b-4358-8d86-e14a214ba5a0-config-volume\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.773543 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.773254 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05e2242e-492b-4358-8d86-e14a214ba5a0-tmp-dir\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.773543 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.773280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft62w\" (UniqueName: \"kubernetes.io/projected/05e2242e-492b-4358-8d86-e14a214ba5a0-kube-api-access-ft62w\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.773543 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.773362 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.773543 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.773392 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-ca-trust-extracted\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.773543 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.773457 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:18.773543 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.773469 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66b679487c-2gc4p: secret "image-registry-tls" not found Sep 10 16:03:18.773543 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:18.773509 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls podName:d1117a52-1e07-4fb2-b2cc-2a1d57ca109f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:19.273495786 +0000 UTC m=+35.072884100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls") pod "image-registry-66b679487c-2gc4p" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f") : secret "image-registry-tls" not found Sep 10 16:03:18.773543 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.773527 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-certificates\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.773862 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.773670 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05e2242e-492b-4358-8d86-e14a214ba5a0-tmp-dir\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.773960 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.773938 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05e2242e-492b-4358-8d86-e14a214ba5a0-config-volume\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.774066 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.774051 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-trusted-ca\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.776957 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.776938 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-installation-pull-secrets\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.777039 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.776958 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-image-registry-private-configuration\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.782516 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.782490 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft62w\" (UniqueName: \"kubernetes.io/projected/05e2242e-492b-4358-8d86-e14a214ba5a0-kube-api-access-ft62w\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:18.782617 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.782536 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwnx4\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-kube-api-access-wwnx4\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.782698 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.782678 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-bound-sa-token\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:18.874217 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.874188 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6ddv\" (UniqueName: \"kubernetes.io/projected/ac0843a0-3970-488d-bff6-a0a66d7bddb3-kube-api-access-l6ddv\") pod \"ingress-canary-tdbnf\" (UID: \"ac0843a0-3970-488d-bff6-a0a66d7bddb3\") " pod="openshift-ingress-canary/ingress-canary-tdbnf" Sep 10 16:03:18.874365 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.874224 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac0843a0-3970-488d-bff6-a0a66d7bddb3-cert\") pod \"ingress-canary-tdbnf\" (UID: \"ac0843a0-3970-488d-bff6-a0a66d7bddb3\") " pod="openshift-ingress-canary/ingress-canary-tdbnf" Sep 10 16:03:18.876384 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.876363 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac0843a0-3970-488d-bff6-a0a66d7bddb3-cert\") pod \"ingress-canary-tdbnf\" (UID: \"ac0843a0-3970-488d-bff6-a0a66d7bddb3\") " pod="openshift-ingress-canary/ingress-canary-tdbnf" Sep 10 16:03:18.881988 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.881965 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6ddv\" (UniqueName: \"kubernetes.io/projected/ac0843a0-3970-488d-bff6-a0a66d7bddb3-kube-api-access-l6ddv\") pod \"ingress-canary-tdbnf\" (UID: \"ac0843a0-3970-488d-bff6-a0a66d7bddb3\") " pod="openshift-ingress-canary/ingress-canary-tdbnf" Sep 10 16:03:18.914169 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:18.914148 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tdbnf" Sep 10 16:03:19.277516 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:19.277347 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:19.277611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:19.277532 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:19.277611 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:19.277488 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:19.277611 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:19.277597 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66b679487c-2gc4p: secret "image-registry-tls" not found Sep 10 16:03:19.277744 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:19.277645 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:19.277744 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:19.277685 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls podName:05e2242e-492b-4358-8d86-e14a214ba5a0 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:20.277672082 +0000 UTC m=+36.077060395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls") pod "dns-default-t92md" (UID: "05e2242e-492b-4358-8d86-e14a214ba5a0") : secret "dns-default-metrics-tls" not found Sep 10 16:03:19.277744 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:19.277697 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls podName:d1117a52-1e07-4fb2-b2cc-2a1d57ca109f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:20.277691546 +0000 UTC m=+36.077079847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls") pod "image-registry-66b679487c-2gc4p" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f") : secret "image-registry-tls" not found Sep 10 16:03:19.359772 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:19.359703 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tdbnf"] Sep 10 16:03:19.363886 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:03:19.363862 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac0843a0_3970_488d_bff6_a0a66d7bddb3.slice/crio-501cbb69c4b5eb5ec4df03128aa30d12c6b12d033b066f153098685c14538cd4 WatchSource:0}: Error finding container 501cbb69c4b5eb5ec4df03128aa30d12c6b12d033b066f153098685c14538cd4: Status 404 returned error can't find the container with id 501cbb69c4b5eb5ec4df03128aa30d12c6b12d033b066f153098685c14538cd4 Sep 10 16:03:19.669857 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:19.669769 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:19.670025 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:19.669947 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:19.672415 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:19.672394 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 16:03:19.673042 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:19.672877 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 16:03:19.673115 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:19.673102 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wstvg\"" Sep 10 16:03:19.939032 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:19.938963 2556 generic.go:356] "Generic (PLEG): container finished" podID="1f650bc2-5f43-4a32-9e3d-48fb84687f8b" containerID="8445f292934e7785a374bdefcb4ef150694bf512b194032eb3d19376070d22be" exitCode=0 Sep 10 16:03:19.939171 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:19.939039 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9w99" event={"ID":"1f650bc2-5f43-4a32-9e3d-48fb84687f8b","Type":"ContainerDied","Data":"8445f292934e7785a374bdefcb4ef150694bf512b194032eb3d19376070d22be"} Sep 10 16:03:19.940284 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:19.940258 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tdbnf" event={"ID":"ac0843a0-3970-488d-bff6-a0a66d7bddb3","Type":"ContainerStarted","Data":"501cbb69c4b5eb5ec4df03128aa30d12c6b12d033b066f153098685c14538cd4"} Sep 10 16:03:20.284803 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:20.284732 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:20.284803 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:20.284784 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:20.285036 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:20.284903 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:20.285036 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:20.284925 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66b679487c-2gc4p: secret "image-registry-tls" not found Sep 10 16:03:20.285036 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:20.284990 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls podName:d1117a52-1e07-4fb2-b2cc-2a1d57ca109f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:22.284970615 +0000 UTC m=+38.084358930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls") pod "image-registry-66b679487c-2gc4p" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f") : secret "image-registry-tls" not found Sep 10 16:03:20.285036 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:20.285001 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:20.285247 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:20.285061 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls podName:05e2242e-492b-4358-8d86-e14a214ba5a0 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:22.285040144 +0000 UTC m=+38.084428445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls") pod "dns-default-t92md" (UID: "05e2242e-492b-4358-8d86-e14a214ba5a0") : secret "dns-default-metrics-tls" not found Sep 10 16:03:20.946866 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:20.946828 2556 generic.go:356] "Generic (PLEG): container finished" podID="1f650bc2-5f43-4a32-9e3d-48fb84687f8b" containerID="fc73457aebb9526f7f436aa2989bff81c51846207aa46a485b4eb99c4aa0a925" exitCode=0 Sep 10 16:03:20.947462 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:20.946884 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9w99" event={"ID":"1f650bc2-5f43-4a32-9e3d-48fb84687f8b","Type":"ContainerDied","Data":"fc73457aebb9526f7f436aa2989bff81c51846207aa46a485b4eb99c4aa0a925"} Sep 10 16:03:21.952526 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:21.952339 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9w99" event={"ID":"1f650bc2-5f43-4a32-9e3d-48fb84687f8b","Type":"ContainerStarted","Data":"06c3c5e32989374e0819532c713b0df7be5513a57ecf3db489fdcfbb81f4b8b9"} Sep 10 16:03:21.975128 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:21.975087 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b9w99" podStartSLOduration=7.032325462 podStartE2EDuration="35.975072505s" totalImagesPullingTime="28.942747043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:21.97443699 +0000 UTC m=+37.773825312" watchObservedRunningTime="2026-09-10 16:03:21.975072505 +0000 UTC m=+37.774460827" Sep 10 16:03:22.299984 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:22.299956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:22.300107 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:22.299994 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:22.300107 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:22.300097 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:22.300211 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:22.300103 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:22.300211 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:22.300118 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66b679487c-2gc4p: secret "image-registry-tls" not found Sep 10 16:03:22.300211 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:22.300145 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls podName:05e2242e-492b-4358-8d86-e14a214ba5a0 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:26.300129302 +0000 UTC m=+42.099517604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls") pod "dns-default-t92md" (UID: "05e2242e-492b-4358-8d86-e14a214ba5a0") : secret "dns-default-metrics-tls" not found Sep 10 16:03:22.300211 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:22.300161 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls podName:d1117a52-1e07-4fb2-b2cc-2a1d57ca109f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:26.300154953 +0000 UTC m=+42.099543252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls") pod "image-registry-66b679487c-2gc4p" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f") : secret "image-registry-tls" not found Sep 10 16:03:22.956495 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:22.956284 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tdbnf" event={"ID":"ac0843a0-3970-488d-bff6-a0a66d7bddb3","Type":"ContainerStarted","Data":"d34df003ab47960338cd6a2982bea2d4113ec5305f7ad195a865967f54df1f83"} Sep 10 16:03:22.972614 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:22.972570 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tdbnf" podStartSLOduration=2.135247534 podStartE2EDuration="4.972555244s" totalImagesPullingTime="2.83730771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:22.971396961 +0000 UTC m=+38.770785284" watchObservedRunningTime="2026-09-10 16:03:22.972555244 +0000 UTC m=+38.771943566" Sep 10 16:03:26.330719 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:26.330677 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:26.330719 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:26.330719 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:26.331162 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:26.330834 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:26.331162 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:26.330854 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66b679487c-2gc4p: secret "image-registry-tls" not found Sep 10 16:03:26.331162 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:26.330918 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls podName:d1117a52-1e07-4fb2-b2cc-2a1d57ca109f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:34.330901842 +0000 UTC m=+50.130290142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls") pod "image-registry-66b679487c-2gc4p" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f") : secret "image-registry-tls" not found Sep 10 16:03:26.331162 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:26.330918 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:26.331162 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:26.330978 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls podName:05e2242e-492b-4358-8d86-e14a214ba5a0 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:34.330961147 +0000 UTC m=+50.130349472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls") pod "dns-default-t92md" (UID: "05e2242e-492b-4358-8d86-e14a214ba5a0") : secret "dns-default-metrics-tls" not found Sep 10 16:03:34.386891 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:34.386844 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:34.386891 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:34.386893 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:34.387418 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:34.387002 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:34.387418 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:34.387023 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:34.387418 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:34.387045 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66b679487c-2gc4p: secret "image-registry-tls" not found Sep 10 16:03:34.387418 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:34.387064 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls podName:05e2242e-492b-4358-8d86-e14a214ba5a0 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:50.387050571 +0000 UTC m=+66.186438871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls") pod "dns-default-t92md" (UID: "05e2242e-492b-4358-8d86-e14a214ba5a0") : secret "dns-default-metrics-tls" not found Sep 10 16:03:34.387418 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:34.387104 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls podName:d1117a52-1e07-4fb2-b2cc-2a1d57ca109f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:50.38708608 +0000 UTC m=+66.186474398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls") pod "image-registry-66b679487c-2gc4p" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f") : secret "image-registry-tls" not found Sep 10 16:03:44.935517 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:44.935486 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xntds" Sep 10 16:03:45.551381 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.551348 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn"] Sep 10 16:03:45.553855 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.553836 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" Sep 10 16:03:45.555906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.555878 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 10 16:03:45.556457 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.556430 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 10 16:03:45.556592 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.556473 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 10 16:03:45.556592 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.556490 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m2c5q\"" Sep 10 16:03:45.556592 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.556579 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-skhvl"] Sep 10 16:03:45.557234 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.557217 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:03:45.558248 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.558232 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.559947 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.559929 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 16:03:45.560052 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.560004 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 10 16:03:45.560206 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.560193 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 10 16:03:45.560549 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.560535 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 16:03:45.560751 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.560737 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jmbcx\"" Sep 10 16:03:45.567509 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.567488 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 10 16:03:45.569442 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.569423 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn"] Sep 10 16:03:45.573582 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.573561 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-skhvl"] Sep 10 16:03:45.666035 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.666013 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/554d1b9b-4837-4114-a33c-98db1f43e749-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-nl8gn\" (UID: \"554d1b9b-4837-4114-a33c-98db1f43e749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" Sep 10 16:03:45.666133 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.666041 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/554d1b9b-4837-4114-a33c-98db1f43e749-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-nl8gn\" (UID: \"554d1b9b-4837-4114-a33c-98db1f43e749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" Sep 10 16:03:45.666133 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.666059 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p45vm\" (UniqueName: \"kubernetes.io/projected/554d1b9b-4837-4114-a33c-98db1f43e749-kube-api-access-p45vm\") pod \"kube-storage-version-migrator-operator-8d7dd4675-nl8gn\" (UID: \"554d1b9b-4837-4114-a33c-98db1f43e749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" Sep 10 16:03:45.666133 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.666084 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e8743a-479c-4888-b402-d6aeb605871a-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.666133 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.666106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e3e8743a-479c-4888-b402-d6aeb605871a-snapshots\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.666133 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.666129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e8743a-479c-4888-b402-d6aeb605871a-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.666325 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.666173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3e8743a-479c-4888-b402-d6aeb605871a-serving-cert\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.666325 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.666197 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8w9g\" (UniqueName: \"kubernetes.io/projected/e3e8743a-479c-4888-b402-d6aeb605871a-kube-api-access-l8w9g\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.666325 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.666218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e8743a-479c-4888-b402-d6aeb605871a-tmp\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.756211 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.756186 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9"] Sep 10 16:03:45.758075 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.758057 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" Sep 10 16:03:45.761106 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.761085 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 10 16:03:45.761231 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.761214 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:03:45.761408 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.761389 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 10 16:03:45.761569 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.761553 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wx9lz\"" Sep 10 16:03:45.762154 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.762140 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 10 16:03:45.767096 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.767063 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e8743a-479c-4888-b402-d6aeb605871a-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.767211 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.767145 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3e8743a-479c-4888-b402-d6aeb605871a-serving-cert\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.767211 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.767172 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8w9g\" (UniqueName: \"kubernetes.io/projected/e3e8743a-479c-4888-b402-d6aeb605871a-kube-api-access-l8w9g\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.767211 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.767209 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e8743a-479c-4888-b402-d6aeb605871a-tmp\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.767438 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.767407 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/554d1b9b-4837-4114-a33c-98db1f43e749-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-nl8gn\" (UID: \"554d1b9b-4837-4114-a33c-98db1f43e749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" Sep 10 16:03:45.767558 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.767449 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/554d1b9b-4837-4114-a33c-98db1f43e749-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-nl8gn\" (UID: \"554d1b9b-4837-4114-a33c-98db1f43e749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" Sep 10 16:03:45.767558 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.767482 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p45vm\" (UniqueName: \"kubernetes.io/projected/554d1b9b-4837-4114-a33c-98db1f43e749-kube-api-access-p45vm\") pod \"kube-storage-version-migrator-operator-8d7dd4675-nl8gn\" (UID: \"554d1b9b-4837-4114-a33c-98db1f43e749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" Sep 10 16:03:45.767558 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.767508 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e8743a-479c-4888-b402-d6aeb605871a-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.767558 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.767531 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e3e8743a-479c-4888-b402-d6aeb605871a-snapshots\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.768334 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.767564 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e8743a-479c-4888-b402-d6aeb605871a-tmp\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.768334 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.768024 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/554d1b9b-4837-4114-a33c-98db1f43e749-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-nl8gn\" (UID: \"554d1b9b-4837-4114-a33c-98db1f43e749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" Sep 10 16:03:45.768334 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.768105 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9"] Sep 10 16:03:45.768334 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.768178 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e3e8743a-479c-4888-b402-d6aeb605871a-snapshots\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.768563 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.768507 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e8743a-479c-4888-b402-d6aeb605871a-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.768675 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.768631 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e8743a-479c-4888-b402-d6aeb605871a-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.770972 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.770938 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/554d1b9b-4837-4114-a33c-98db1f43e749-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-nl8gn\" (UID: \"554d1b9b-4837-4114-a33c-98db1f43e749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" Sep 10 16:03:45.771080 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.771058 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3e8743a-479c-4888-b402-d6aeb605871a-serving-cert\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.777916 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.777892 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p45vm\" (UniqueName: \"kubernetes.io/projected/554d1b9b-4837-4114-a33c-98db1f43e749-kube-api-access-p45vm\") pod \"kube-storage-version-migrator-operator-8d7dd4675-nl8gn\" (UID: \"554d1b9b-4837-4114-a33c-98db1f43e749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" Sep 10 16:03:45.780574 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.780556 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8w9g\" (UniqueName: \"kubernetes.io/projected/e3e8743a-479c-4888-b402-d6aeb605871a-kube-api-access-l8w9g\") pod \"insights-operator-76bcd6ccf5-skhvl\" (UID: \"e3e8743a-479c-4888-b402-d6aeb605871a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.865524 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.865478 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" Sep 10 16:03:45.868575 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.868557 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24455229-cdf7-491a-9960-f321de7c3601-serving-cert\") pod \"service-ca-operator-859f94c4b-mfjc9\" (UID: \"24455229-cdf7-491a-9960-f321de7c3601\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" Sep 10 16:03:45.868657 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.868590 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7wfm\" (UniqueName: \"kubernetes.io/projected/24455229-cdf7-491a-9960-f321de7c3601-kube-api-access-p7wfm\") pod \"service-ca-operator-859f94c4b-mfjc9\" (UID: \"24455229-cdf7-491a-9960-f321de7c3601\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" Sep 10 16:03:45.868714 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.868675 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24455229-cdf7-491a-9960-f321de7c3601-config\") pod \"service-ca-operator-859f94c4b-mfjc9\" (UID: \"24455229-cdf7-491a-9960-f321de7c3601\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" Sep 10 16:03:45.870587 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.870565 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" Sep 10 16:03:45.969425 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.969399 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24455229-cdf7-491a-9960-f321de7c3601-config\") pod \"service-ca-operator-859f94c4b-mfjc9\" (UID: \"24455229-cdf7-491a-9960-f321de7c3601\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" Sep 10 16:03:45.969730 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.969466 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24455229-cdf7-491a-9960-f321de7c3601-serving-cert\") pod \"service-ca-operator-859f94c4b-mfjc9\" (UID: \"24455229-cdf7-491a-9960-f321de7c3601\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" Sep 10 16:03:45.969730 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.969484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7wfm\" (UniqueName: \"kubernetes.io/projected/24455229-cdf7-491a-9960-f321de7c3601-kube-api-access-p7wfm\") pod \"service-ca-operator-859f94c4b-mfjc9\" (UID: \"24455229-cdf7-491a-9960-f321de7c3601\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" Sep 10 16:03:45.969900 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.969880 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24455229-cdf7-491a-9960-f321de7c3601-config\") pod \"service-ca-operator-859f94c4b-mfjc9\" (UID: \"24455229-cdf7-491a-9960-f321de7c3601\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" Sep 10 16:03:45.971474 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.971458 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24455229-cdf7-491a-9960-f321de7c3601-serving-cert\") pod \"service-ca-operator-859f94c4b-mfjc9\" (UID: \"24455229-cdf7-491a-9960-f321de7c3601\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" Sep 10 16:03:45.977126 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:45.977107 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7wfm\" (UniqueName: \"kubernetes.io/projected/24455229-cdf7-491a-9960-f321de7c3601-kube-api-access-p7wfm\") pod \"service-ca-operator-859f94c4b-mfjc9\" (UID: \"24455229-cdf7-491a-9960-f321de7c3601\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" Sep 10 16:03:46.066910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:46.066890 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" Sep 10 16:03:46.137267 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:46.137206 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn"] Sep 10 16:03:46.140346 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:46.140295 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-skhvl"] Sep 10 16:03:46.141213 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:03:46.141155 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554d1b9b_4837_4114_a33c_98db1f43e749.slice/crio-a5cde3b6fa733ff115c3927df57de67cdd19ef11d4448b7325903bc0178dadf6 WatchSource:0}: Error finding container a5cde3b6fa733ff115c3927df57de67cdd19ef11d4448b7325903bc0178dadf6: Status 404 returned error can't find the container with id a5cde3b6fa733ff115c3927df57de67cdd19ef11d4448b7325903bc0178dadf6 Sep 10 16:03:46.143030 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:03:46.142981 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e8743a_479c_4888_b402_d6aeb605871a.slice/crio-5803a3d217d2d5894f45bc864d455953be341d128938200c68ce68b5858314c0 WatchSource:0}: Error finding container 5803a3d217d2d5894f45bc864d455953be341d128938200c68ce68b5858314c0: Status 404 returned error can't find the container with id 5803a3d217d2d5894f45bc864d455953be341d128938200c68ce68b5858314c0 Sep 10 16:03:46.335422 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:46.335394 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9"] Sep 10 16:03:46.338414 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:03:46.338379 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24455229_cdf7_491a_9960_f321de7c3601.slice/crio-44048220408e889613e5b920298313df85388280dc28a7eae4a8a3db9153483f WatchSource:0}: Error finding container 44048220408e889613e5b920298313df85388280dc28a7eae4a8a3db9153483f: Status 404 returned error can't find the container with id 44048220408e889613e5b920298313df85388280dc28a7eae4a8a3db9153483f Sep 10 16:03:47.012872 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:47.012814 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" event={"ID":"24455229-cdf7-491a-9960-f321de7c3601","Type":"ContainerStarted","Data":"44048220408e889613e5b920298313df85388280dc28a7eae4a8a3db9153483f"} Sep 10 16:03:47.013988 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:47.013956 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" event={"ID":"e3e8743a-479c-4888-b402-d6aeb605871a","Type":"ContainerStarted","Data":"5803a3d217d2d5894f45bc864d455953be341d128938200c68ce68b5858314c0"} Sep 10 16:03:47.015233 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:47.015196 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" event={"ID":"554d1b9b-4837-4114-a33c-98db1f43e749","Type":"ContainerStarted","Data":"a5cde3b6fa733ff115c3927df57de67cdd19ef11d4448b7325903bc0178dadf6"} Sep 10 16:03:49.022357 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:49.022301 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" event={"ID":"24455229-cdf7-491a-9960-f321de7c3601","Type":"ContainerStarted","Data":"ee41b4c99400b7c89c535e3aa006688a2a389e09a2191cf372a5752ea9cea4d7"} Sep 10 16:03:49.042471 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:49.042415 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" podStartSLOduration=2.251102703 podStartE2EDuration="4.042367838s" totalImagesPullingTime="1.791265135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:49.041422942 +0000 UTC m=+64.840811278" watchObservedRunningTime="2026-09-10 16:03:49.042367838 +0000 UTC m=+64.841756157" Sep 10 16:03:50.026935 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.026895 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" event={"ID":"554d1b9b-4837-4114-a33c-98db1f43e749","Type":"ContainerStarted","Data":"0b5c6b71f751db6b2c5109e862abf8d13078839cb422123c39c7197c4c85bc6d"} Sep 10 16:03:50.046703 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.046657 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" podStartSLOduration=2.1451211900000002 podStartE2EDuration="5.046640626s" totalImagesPullingTime="2.901519436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:50.046121501 +0000 UTC m=+65.845509857" watchObservedRunningTime="2026-09-10 16:03:50.046640626 +0000 UTC m=+65.846028939" Sep 10 16:03:50.403866 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.403779 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:03:50.403866 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.403858 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:03:50.404179 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:50.403919 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:50.404179 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:50.403944 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66b679487c-2gc4p: secret "image-registry-tls" not found Sep 10 16:03:50.404179 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:50.404003 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:50.404179 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:50.404040 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls podName:d1117a52-1e07-4fb2-b2cc-2a1d57ca109f nodeName:}" failed. No retries permitted until 2026-09-10 16:04:22.404024422 +0000 UTC m=+98.203412721 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls") pod "image-registry-66b679487c-2gc4p" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f") : secret "image-registry-tls" not found Sep 10 16:03:50.404179 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:50.404055 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls podName:05e2242e-492b-4358-8d86-e14a214ba5a0 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:22.40404951 +0000 UTC m=+98.203437810 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls") pod "dns-default-t92md" (UID: "05e2242e-492b-4358-8d86-e14a214ba5a0") : secret "dns-default-metrics-tls" not found Sep 10 16:03:50.505269 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.505241 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:03:50.505445 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.505276 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:50.507500 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.507481 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 16:03:50.507579 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.507532 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 16:03:50.516198 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:50.516183 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 16:03:50.516266 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:50.516244 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs podName:117f519b-c0a5-4892-ad17-5d8ec8bd5f9b nodeName:}" failed. No retries permitted until 2026-09-10 16:04:54.516225546 +0000 UTC m=+130.315613851 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs") pod "network-metrics-daemon-2gr6r" (UID: "117f519b-c0a5-4892-ad17-5d8ec8bd5f9b") : secret "metrics-daemon-secret" not found Sep 10 16:03:50.518450 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.518425 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d651ea1e-c120-4cdc-8d53-b2c3014cb09f-original-pull-secret\") pod \"global-pull-secret-syncer-wd54m\" (UID: \"d651ea1e-c120-4cdc-8d53-b2c3014cb09f\") " pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:50.583777 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.583744 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wd54m" Sep 10 16:03:50.606213 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.606184 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbm5b\" (UniqueName: \"kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b\") pod \"network-check-target-pgmqd\" (UID: \"adb082dd-4d72-4f3a-8ec2-16b37a7d3375\") " pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:50.609771 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.609750 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 16:03:50.618924 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.618906 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 16:03:50.629237 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.629184 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbm5b\" (UniqueName: \"kubernetes.io/projected/adb082dd-4d72-4f3a-8ec2-16b37a7d3375-kube-api-access-jbm5b\") pod \"network-check-target-pgmqd\" (UID: \"adb082dd-4d72-4f3a-8ec2-16b37a7d3375\") " pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:50.779480 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.779452 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4mwj\"" Sep 10 16:03:50.788200 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.788179 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:50.857286 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:50.857259 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wd54m"] Sep 10 16:03:50.862773 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:03:50.862747 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd651ea1e_c120_4cdc_8d53_b2c3014cb09f.slice/crio-f79bde26dd21e4067849706562c0eb9d5d952354c52f966a6b5e070e9d9a7d34 WatchSource:0}: Error finding container f79bde26dd21e4067849706562c0eb9d5d952354c52f966a6b5e070e9d9a7d34: Status 404 returned error can't find the container with id f79bde26dd21e4067849706562c0eb9d5d952354c52f966a6b5e070e9d9a7d34 Sep 10 16:03:51.030385 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.030270 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" event={"ID":"e3e8743a-479c-4888-b402-d6aeb605871a","Type":"ContainerStarted","Data":"371d39f34cdc5357e8aca2464ec19ea8989b0817750780b7794a55671e84287c"} Sep 10 16:03:51.031536 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.031512 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wd54m" event={"ID":"d651ea1e-c120-4cdc-8d53-b2c3014cb09f","Type":"ContainerStarted","Data":"f79bde26dd21e4067849706562c0eb9d5d952354c52f966a6b5e070e9d9a7d34"} Sep 10 16:03:51.054737 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.054698 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" podStartSLOduration=2.04278135 podStartE2EDuration="6.05468471s" totalImagesPullingTime="4.01190336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:51.052355939 +0000 UTC m=+66.851744264" watchObservedRunningTime="2026-09-10 16:03:51.05468471 +0000 UTC m=+66.854073032" Sep 10 16:03:51.061450 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.061425 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pgmqd"] Sep 10 16:03:51.067759 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:03:51.067728 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb082dd_4d72_4f3a_8ec2_16b37a7d3375.slice/crio-136f66360791e758b6e44477512169fd2ca55d86b962434f3eb95b73f28cfd05 WatchSource:0}: Error finding container 136f66360791e758b6e44477512169fd2ca55d86b962434f3eb95b73f28cfd05: Status 404 returned error can't find the container with id 136f66360791e758b6e44477512169fd2ca55d86b962434f3eb95b73f28cfd05 Sep 10 16:03:51.176611 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.176574 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq"] Sep 10 16:03:51.179149 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.179133 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq" Sep 10 16:03:51.181362 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.181338 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fgspx\"" Sep 10 16:03:51.181529 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.181505 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 10 16:03:51.181633 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.181580 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 10 16:03:51.194917 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.194893 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq"] Sep 10 16:03:51.210420 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.210397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkjgs\" (UniqueName: \"kubernetes.io/projected/1df34404-694b-4634-95b1-1fa4195568a5-kube-api-access-fkjgs\") pod \"migrator-fdbb8fdff-zgpkq\" (UID: \"1df34404-694b-4634-95b1-1fa4195568a5\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq" Sep 10 16:03:51.311207 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.311125 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjgs\" (UniqueName: \"kubernetes.io/projected/1df34404-694b-4634-95b1-1fa4195568a5-kube-api-access-fkjgs\") pod \"migrator-fdbb8fdff-zgpkq\" (UID: \"1df34404-694b-4634-95b1-1fa4195568a5\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq" Sep 10 16:03:51.320687 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.320628 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkjgs\" (UniqueName: \"kubernetes.io/projected/1df34404-694b-4634-95b1-1fa4195568a5-kube-api-access-fkjgs\") pod \"migrator-fdbb8fdff-zgpkq\" (UID: \"1df34404-694b-4634-95b1-1fa4195568a5\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq" Sep 10 16:03:51.416083 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.416046 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pzp6b"] Sep 10 16:03:51.418530 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.418503 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.421728 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.421707 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 16:03:51.422050 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.422031 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 16:03:51.422402 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.422268 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ng9sv\"" Sep 10 16:03:51.437463 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.437127 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pzp6b"] Sep 10 16:03:51.495815 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.495783 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq" Sep 10 16:03:51.516301 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.516203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld476\" (UniqueName: \"kubernetes.io/projected/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-api-access-ld476\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.516301 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.516235 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b1d85c8-461a-4bf3-a076-e40679ceffd2-data-volume\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.516469 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.516402 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b1d85c8-461a-4bf3-a076-e40679ceffd2-crio-socket\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.516469 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.516455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.516550 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.516515 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.617055 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.616980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld476\" (UniqueName: \"kubernetes.io/projected/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-api-access-ld476\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.617055 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.617027 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b1d85c8-461a-4bf3-a076-e40679ceffd2-data-volume\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.617258 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.617097 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b1d85c8-461a-4bf3-a076-e40679ceffd2-crio-socket\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.617258 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.617126 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.617258 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.617154 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.617258 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.617205 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b1d85c8-461a-4bf3-a076-e40679ceffd2-crio-socket\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.617470 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:51.617281 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 16:03:51.617470 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:51.617303 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 16:03:51.617470 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:51.617385 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm podName:0b1d85c8-461a-4bf3-a076-e40679ceffd2 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:52.117363547 +0000 UTC m=+67.916751864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pzp6b" (UID: "0b1d85c8-461a-4bf3-a076-e40679ceffd2") : configmap "kube-rbac-proxy" not found Sep 10 16:03:51.617470 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:51.617404 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls podName:0b1d85c8-461a-4bf3-a076-e40679ceffd2 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:52.117394579 +0000 UTC m=+67.916782908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pzp6b" (UID: "0b1d85c8-461a-4bf3-a076-e40679ceffd2") : secret "insights-runtime-extractor-tls" not found Sep 10 16:03:51.617470 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.617421 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b1d85c8-461a-4bf3-a076-e40679ceffd2-data-volume\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.625992 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.625941 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld476\" (UniqueName: \"kubernetes.io/projected/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-api-access-ld476\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:51.778571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:51.778535 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq"] Sep 10 16:03:51.785042 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:03:51.785014 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df34404_694b_4634_95b1_1fa4195568a5.slice/crio-b79f4484caa09130557c76e615ec34366b5d4275550424fad86b65b4d778f60a WatchSource:0}: Error finding container b79f4484caa09130557c76e615ec34366b5d4275550424fad86b65b4d778f60a: Status 404 returned error can't find the container with id b79f4484caa09130557c76e615ec34366b5d4275550424fad86b65b4d778f60a Sep 10 16:03:52.036776 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.036726 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pgmqd" event={"ID":"adb082dd-4d72-4f3a-8ec2-16b37a7d3375","Type":"ContainerStarted","Data":"136f66360791e758b6e44477512169fd2ca55d86b962434f3eb95b73f28cfd05"} Sep 10 16:03:52.038207 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.038166 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq" event={"ID":"1df34404-694b-4634-95b1-1fa4195568a5","Type":"ContainerStarted","Data":"b79f4484caa09130557c76e615ec34366b5d4275550424fad86b65b4d778f60a"} Sep 10 16:03:52.122218 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.122163 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:52.122218 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.122213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:52.122498 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:52.122338 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 16:03:52.122498 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:52.122415 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls podName:0b1d85c8-461a-4bf3-a076-e40679ceffd2 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:53.122394705 +0000 UTC m=+68.921783022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pzp6b" (UID: "0b1d85c8-461a-4bf3-a076-e40679ceffd2") : secret "insights-runtime-extractor-tls" not found Sep 10 16:03:52.122887 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:52.122866 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 16:03:52.122991 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:52.122928 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm podName:0b1d85c8-461a-4bf3-a076-e40679ceffd2 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:53.122911105 +0000 UTC m=+68.922299408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pzp6b" (UID: "0b1d85c8-461a-4bf3-a076-e40679ceffd2") : configmap "kube-rbac-proxy" not found Sep 10 16:03:52.698868 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.698837 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-gnhqm"] Sep 10 16:03:52.701057 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.700972 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-gnhqm" Sep 10 16:03:52.703635 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.703369 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 10 16:03:52.703635 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.703456 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 10 16:03:52.705595 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.704374 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 10 16:03:52.705595 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.704634 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ztgbl\"" Sep 10 16:03:52.705595 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.704847 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 10 16:03:52.713573 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.712898 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-gnhqm"] Sep 10 16:03:52.727200 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.727166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whjc8\" (UniqueName: \"kubernetes.io/projected/ffaad33a-ec9b-45be-9c44-764a49b29b09-kube-api-access-whjc8\") pod \"service-ca-75d99c484-gnhqm\" (UID: \"ffaad33a-ec9b-45be-9c44-764a49b29b09\") " pod="openshift-service-ca/service-ca-75d99c484-gnhqm" Sep 10 16:03:52.727340 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.727241 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ffaad33a-ec9b-45be-9c44-764a49b29b09-signing-cabundle\") pod \"service-ca-75d99c484-gnhqm\" (UID: \"ffaad33a-ec9b-45be-9c44-764a49b29b09\") " pod="openshift-service-ca/service-ca-75d99c484-gnhqm" Sep 10 16:03:52.727340 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.727278 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ffaad33a-ec9b-45be-9c44-764a49b29b09-signing-key\") pod \"service-ca-75d99c484-gnhqm\" (UID: \"ffaad33a-ec9b-45be-9c44-764a49b29b09\") " pod="openshift-service-ca/service-ca-75d99c484-gnhqm" Sep 10 16:03:52.828064 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.828020 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whjc8\" (UniqueName: \"kubernetes.io/projected/ffaad33a-ec9b-45be-9c44-764a49b29b09-kube-api-access-whjc8\") pod \"service-ca-75d99c484-gnhqm\" (UID: \"ffaad33a-ec9b-45be-9c44-764a49b29b09\") " pod="openshift-service-ca/service-ca-75d99c484-gnhqm" Sep 10 16:03:52.828226 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.828094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ffaad33a-ec9b-45be-9c44-764a49b29b09-signing-cabundle\") pod \"service-ca-75d99c484-gnhqm\" (UID: \"ffaad33a-ec9b-45be-9c44-764a49b29b09\") " pod="openshift-service-ca/service-ca-75d99c484-gnhqm" Sep 10 16:03:52.828226 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.828125 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ffaad33a-ec9b-45be-9c44-764a49b29b09-signing-key\") pod \"service-ca-75d99c484-gnhqm\" (UID: \"ffaad33a-ec9b-45be-9c44-764a49b29b09\") " pod="openshift-service-ca/service-ca-75d99c484-gnhqm" Sep 10 16:03:52.829608 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.829580 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ffaad33a-ec9b-45be-9c44-764a49b29b09-signing-cabundle\") pod \"service-ca-75d99c484-gnhqm\" (UID: \"ffaad33a-ec9b-45be-9c44-764a49b29b09\") " pod="openshift-service-ca/service-ca-75d99c484-gnhqm" Sep 10 16:03:52.834036 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.832233 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ffaad33a-ec9b-45be-9c44-764a49b29b09-signing-key\") pod \"service-ca-75d99c484-gnhqm\" (UID: \"ffaad33a-ec9b-45be-9c44-764a49b29b09\") " pod="openshift-service-ca/service-ca-75d99c484-gnhqm" Sep 10 16:03:52.839913 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:52.839870 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whjc8\" (UniqueName: \"kubernetes.io/projected/ffaad33a-ec9b-45be-9c44-764a49b29b09-kube-api-access-whjc8\") pod \"service-ca-75d99c484-gnhqm\" (UID: \"ffaad33a-ec9b-45be-9c44-764a49b29b09\") " pod="openshift-service-ca/service-ca-75d99c484-gnhqm" Sep 10 16:03:53.016465 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:53.016368 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-gnhqm" Sep 10 16:03:53.131938 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:53.131498 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:53.131938 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:53.131533 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:53.131938 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:53.131627 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 16:03:53.131938 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:53.131667 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 16:03:53.131938 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:53.131686 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm podName:0b1d85c8-461a-4bf3-a076-e40679ceffd2 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:55.131672761 +0000 UTC m=+70.931061061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pzp6b" (UID: "0b1d85c8-461a-4bf3-a076-e40679ceffd2") : configmap "kube-rbac-proxy" not found Sep 10 16:03:53.131938 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:53.131734 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls podName:0b1d85c8-461a-4bf3-a076-e40679ceffd2 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:55.131714647 +0000 UTC m=+70.931102968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pzp6b" (UID: "0b1d85c8-461a-4bf3-a076-e40679ceffd2") : secret "insights-runtime-extractor-tls" not found Sep 10 16:03:53.307464 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:53.307394 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-gnhqm"] Sep 10 16:03:53.789525 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:53.789493 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w765k_16470165-f773-4358-9757-6070c156d07e/dns-node-resolver/0.log" Sep 10 16:03:54.046672 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:54.046632 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq" event={"ID":"1df34404-694b-4634-95b1-1fa4195568a5","Type":"ContainerStarted","Data":"6c41913a7c334d1bc297532bc1b040e31144427b6005fe9d36962e822865afb1"} Sep 10 16:03:54.046832 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:54.046695 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq" event={"ID":"1df34404-694b-4634-95b1-1fa4195568a5","Type":"ContainerStarted","Data":"9bb50adb3d1568888d9f6dfd031fefce665bd9948a7130a4e86b9f7a83794bd2"} Sep 10 16:03:54.073499 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:54.073442 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-zgpkq" podStartSLOduration=1.847599488 podStartE2EDuration="3.073420908s" totalImagesPullingTime="1.22582142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:54.072271402 +0000 UTC m=+69.871659725" watchObservedRunningTime="2026-09-10 16:03:54.073420908 +0000 UTC m=+69.872809234" Sep 10 16:03:54.217367 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:03:54.217304 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffaad33a_ec9b_45be_9c44_764a49b29b09.slice/crio-8c940781ba7a8515ebd03536d0e2cf0d98f5608de28cf7e452318aaffa0b3e45 WatchSource:0}: Error finding container 8c940781ba7a8515ebd03536d0e2cf0d98f5608de28cf7e452318aaffa0b3e45: Status 404 returned error can't find the container with id 8c940781ba7a8515ebd03536d0e2cf0d98f5608de28cf7e452318aaffa0b3e45 Sep 10 16:03:54.788938 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:54.788908 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lwff8_216c8761-0aa5-4127-9c0e-ea65047bdefb/node-ca/0.log" Sep 10 16:03:55.051228 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:55.051140 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-gnhqm" event={"ID":"ffaad33a-ec9b-45be-9c44-764a49b29b09","Type":"ContainerStarted","Data":"8c940781ba7a8515ebd03536d0e2cf0d98f5608de28cf7e452318aaffa0b3e45"} Sep 10 16:03:55.147631 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:55.147588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:55.147817 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:55.147641 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:55.147817 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:55.147755 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 16:03:55.147932 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:55.147829 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls podName:0b1d85c8-461a-4bf3-a076-e40679ceffd2 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:59.147811702 +0000 UTC m=+74.947200005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pzp6b" (UID: "0b1d85c8-461a-4bf3-a076-e40679ceffd2") : secret "insights-runtime-extractor-tls" not found Sep 10 16:03:55.147932 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:55.147766 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 16:03:55.147932 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:55.147872 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm podName:0b1d85c8-461a-4bf3-a076-e40679ceffd2 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:59.147862074 +0000 UTC m=+74.947250398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pzp6b" (UID: "0b1d85c8-461a-4bf3-a076-e40679ceffd2") : configmap "kube-rbac-proxy" not found Sep 10 16:03:55.589774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:55.589746 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tdbnf_ac0843a0-3970-488d-bff6-a0a66d7bddb3/serve-healthcheck-canary/0.log" Sep 10 16:03:55.789740 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:55.789709 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-zgpkq_1df34404-694b-4634-95b1-1fa4195568a5/migrator/0.log" Sep 10 16:03:55.989556 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:55.989523 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-zgpkq_1df34404-694b-4634-95b1-1fa4195568a5/graceful-termination/0.log" Sep 10 16:03:56.055581 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:56.055544 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-gnhqm" event={"ID":"ffaad33a-ec9b-45be-9c44-764a49b29b09","Type":"ContainerStarted","Data":"94cb653c01aa2c372c480bf8b7d6dea2cd0e6d5fec6b32d4358cdc412e901661"} Sep 10 16:03:56.057014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:56.056980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wd54m" event={"ID":"d651ea1e-c120-4cdc-8d53-b2c3014cb09f","Type":"ContainerStarted","Data":"30b3200305bd6ca7f1477256d927b1a38c1313f541b2cd0af99081f13bff5777"} Sep 10 16:03:56.058572 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:56.058548 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pgmqd" event={"ID":"adb082dd-4d72-4f3a-8ec2-16b37a7d3375","Type":"ContainerStarted","Data":"6a91e4f5d54bcf7975328a005e85d2989a3393894881bc4c509ea132dcbd28d2"} Sep 10 16:03:56.058659 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:56.058603 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:03:56.070859 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:56.070820 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-gnhqm" podStartSLOduration=4.070808848 podStartE2EDuration="4.070808848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:56.069986012 +0000 UTC m=+71.869374335" watchObservedRunningTime="2026-09-10 16:03:56.070808848 +0000 UTC m=+71.870197170" Sep 10 16:03:56.083582 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:56.083538 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wd54m" podStartSLOduration=65.295380064 podStartE2EDuration="1m10.083525798s" totalImagesPullingTime="4.788145734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:56.083284495 +0000 UTC m=+71.882672818" watchObservedRunningTime="2026-09-10 16:03:56.083525798 +0000 UTC m=+71.882914117" Sep 10 16:03:56.099783 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:56.099733 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pgmqd" podStartSLOduration=66.52167438 podStartE2EDuration="1m11.099721538s" totalImagesPullingTime="4.578047158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:56.09852842 +0000 UTC m=+71.897916745" watchObservedRunningTime="2026-09-10 16:03:56.099721538 +0000 UTC m=+71.899109860" Sep 10 16:03:56.191228 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:56.191192 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-nl8gn_554d1b9b-4837-4114-a33c-98db1f43e749/kube-storage-version-migrator-operator/0.log" Sep 10 16:03:59.176529 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:59.176494 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:59.176907 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:03:59.176598 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:03:59.176907 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:59.176610 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 16:03:59.176907 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:59.176688 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 16:03:59.176907 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:59.176690 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm podName:0b1d85c8-461a-4bf3-a076-e40679ceffd2 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:07.176673832 +0000 UTC m=+82.976062137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pzp6b" (UID: "0b1d85c8-461a-4bf3-a076-e40679ceffd2") : configmap "kube-rbac-proxy" not found Sep 10 16:03:59.176907 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:03:59.176739 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls podName:0b1d85c8-461a-4bf3-a076-e40679ceffd2 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:07.176726685 +0000 UTC m=+82.976114986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pzp6b" (UID: "0b1d85c8-461a-4bf3-a076-e40679ceffd2") : secret "insights-runtime-extractor-tls" not found Sep 10 16:04:07.238343 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:07.238180 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:04:07.238343 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:07.238295 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:04:07.238944 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:07.238914 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b1d85c8-461a-4bf3-a076-e40679ceffd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:04:07.240596 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:07.240577 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b1d85c8-461a-4bf3-a076-e40679ceffd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pzp6b\" (UID: \"0b1d85c8-461a-4bf3-a076-e40679ceffd2\") " pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:04:07.330212 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:07.330182 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pzp6b" Sep 10 16:04:07.607358 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:07.607258 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pzp6b"] Sep 10 16:04:07.610114 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:04:07.610087 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1d85c8_461a_4bf3_a076_e40679ceffd2.slice/crio-ecd90904b29b7f54c29f8dd1e100fea981514abda2c8ac4e06d3f2505cf7dc8e WatchSource:0}: Error finding container ecd90904b29b7f54c29f8dd1e100fea981514abda2c8ac4e06d3f2505cf7dc8e: Status 404 returned error can't find the container with id ecd90904b29b7f54c29f8dd1e100fea981514abda2c8ac4e06d3f2505cf7dc8e Sep 10 16:04:08.104534 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:08.104500 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pzp6b" event={"ID":"0b1d85c8-461a-4bf3-a076-e40679ceffd2","Type":"ContainerStarted","Data":"4721eb69c7905a8915695f1ea9f75f19f57485adc439da1fb5d18b5f713562bc"} Sep 10 16:04:08.104700 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:08.104556 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pzp6b" event={"ID":"0b1d85c8-461a-4bf3-a076-e40679ceffd2","Type":"ContainerStarted","Data":"ecd90904b29b7f54c29f8dd1e100fea981514abda2c8ac4e06d3f2505cf7dc8e"} Sep 10 16:04:09.110471 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:09.110426 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pzp6b" event={"ID":"0b1d85c8-461a-4bf3-a076-e40679ceffd2","Type":"ContainerStarted","Data":"159f08891b2c8765ac590f704bbd806a3deff82f37c6f1bf9b55319dc76acabe"} Sep 10 16:04:10.117186 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:10.117151 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pzp6b" event={"ID":"0b1d85c8-461a-4bf3-a076-e40679ceffd2","Type":"ContainerStarted","Data":"daa10a48cd4dd82449669f09785d6c6af43d0dee5b0e55fb17ddedc7fd34faf6"} Sep 10 16:04:10.136679 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:10.136632 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pzp6b" podStartSLOduration=17.267464276 podStartE2EDuration="19.136616395s" totalImagesPullingTime="1.869152119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:10.13585882 +0000 UTC m=+85.935247142" watchObservedRunningTime="2026-09-10 16:04:10.136616395 +0000 UTC m=+85.936004733" Sep 10 16:04:13.378722 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.378686 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r"] Sep 10 16:04:13.380702 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.380684 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r" Sep 10 16:04:13.382459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.382433 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf"] Sep 10 16:04:13.384192 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.384170 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.386508 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.386489 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-tj8mj\"" Sep 10 16:04:13.386641 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.386490 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 10 16:04:13.386799 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.386780 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 16:04:13.386906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.386818 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 16:04:13.386906 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.386886 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 10 16:04:13.387020 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.386925 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 10 16:04:13.387020 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.386968 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 10 16:04:13.387020 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.387005 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 16:04:13.387377 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.387359 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 10 16:04:13.404370 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.404347 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r"] Sep 10 16:04:13.424297 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.424271 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf"] Sep 10 16:04:13.485405 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.485373 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4mcg\" (UniqueName: \"kubernetes.io/projected/1782f2e3-25e5-4f29-929f-34986dbdffc6-kube-api-access-p4mcg\") pod \"managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r\" (UID: \"1782f2e3-25e5-4f29-929f-34986dbdffc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r" Sep 10 16:04:13.485591 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.485417 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c05d0f-5f52-4a14-b038-72a36a9d6737-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.485591 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.485441 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.485591 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.485467 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l92lt\" (UniqueName: \"kubernetes.io/projected/19c05d0f-5f52-4a14-b038-72a36a9d6737-kube-api-access-l92lt\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.485591 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.485510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-ca\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.485591 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.485551 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.485591 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.485589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-hub\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.485818 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.485638 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1782f2e3-25e5-4f29-929f-34986dbdffc6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r\" (UID: \"1782f2e3-25e5-4f29-929f-34986dbdffc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r" Sep 10 16:04:13.586733 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.586696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1782f2e3-25e5-4f29-929f-34986dbdffc6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r\" (UID: \"1782f2e3-25e5-4f29-929f-34986dbdffc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r" Sep 10 16:04:13.586915 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.586783 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4mcg\" (UniqueName: \"kubernetes.io/projected/1782f2e3-25e5-4f29-929f-34986dbdffc6-kube-api-access-p4mcg\") pod \"managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r\" (UID: \"1782f2e3-25e5-4f29-929f-34986dbdffc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r" Sep 10 16:04:13.586915 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.586817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c05d0f-5f52-4a14-b038-72a36a9d6737-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.586915 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.586840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.586915 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.586867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l92lt\" (UniqueName: \"kubernetes.io/projected/19c05d0f-5f52-4a14-b038-72a36a9d6737-kube-api-access-l92lt\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.587121 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.586916 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-ca\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.587121 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.586959 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.587121 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.587007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-hub\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.587628 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.587598 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c05d0f-5f52-4a14-b038-72a36a9d6737-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.589540 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.589516 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-hub\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.589673 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.589587 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.589673 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.589651 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1782f2e3-25e5-4f29-929f-34986dbdffc6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r\" (UID: \"1782f2e3-25e5-4f29-929f-34986dbdffc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r" Sep 10 16:04:13.589794 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.589766 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-ca\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.589914 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.589892 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19c05d0f-5f52-4a14-b038-72a36a9d6737-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.608845 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.608818 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l92lt\" (UniqueName: \"kubernetes.io/projected/19c05d0f-5f52-4a14-b038-72a36a9d6737-kube-api-access-l92lt\") pod \"cluster-proxy-proxy-agent-7979dddc54-94nvf\" (UID: \"19c05d0f-5f52-4a14-b038-72a36a9d6737\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.610957 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.610937 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4mcg\" (UniqueName: \"kubernetes.io/projected/1782f2e3-25e5-4f29-929f-34986dbdffc6-kube-api-access-p4mcg\") pod \"managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r\" (UID: \"1782f2e3-25e5-4f29-929f-34986dbdffc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r" Sep 10 16:04:13.719111 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.719005 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r" Sep 10 16:04:13.723156 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.723139 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" Sep 10 16:04:13.990284 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.990261 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r"] Sep 10 16:04:13.992870 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:04:13.992832 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1782f2e3_25e5_4f29_929f_34986dbdffc6.slice/crio-92ed984718c602c6e6480996b95e90bc5573e480d07d83781d1d9e81f62de726 WatchSource:0}: Error finding container 92ed984718c602c6e6480996b95e90bc5573e480d07d83781d1d9e81f62de726: Status 404 returned error can't find the container with id 92ed984718c602c6e6480996b95e90bc5573e480d07d83781d1d9e81f62de726 Sep 10 16:04:13.993178 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:13.993157 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf"] Sep 10 16:04:13.996962 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:04:13.996935 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19c05d0f_5f52_4a14_b038_72a36a9d6737.slice/crio-bba947c2c5c844820aee84b64e07bfb0d484ff409c48c0fb96f1c00bfa25e60a WatchSource:0}: Error finding container bba947c2c5c844820aee84b64e07bfb0d484ff409c48c0fb96f1c00bfa25e60a: Status 404 returned error can't find the container with id bba947c2c5c844820aee84b64e07bfb0d484ff409c48c0fb96f1c00bfa25e60a Sep 10 16:04:14.130786 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:14.130754 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" event={"ID":"19c05d0f-5f52-4a14-b038-72a36a9d6737","Type":"ContainerStarted","Data":"bba947c2c5c844820aee84b64e07bfb0d484ff409c48c0fb96f1c00bfa25e60a"} Sep 10 16:04:14.131886 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:14.131865 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r" event={"ID":"1782f2e3-25e5-4f29-929f-34986dbdffc6","Type":"ContainerStarted","Data":"92ed984718c602c6e6480996b95e90bc5573e480d07d83781d1d9e81f62de726"} Sep 10 16:04:18.148742 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:18.148657 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r" event={"ID":"1782f2e3-25e5-4f29-929f-34986dbdffc6","Type":"ContainerStarted","Data":"6516429a1421fef730b2a8bffd36a4ba1bb6d41ecaeb3800dfc7feb079bb6700"} Sep 10 16:04:18.150677 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:18.150654 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" event={"ID":"19c05d0f-5f52-4a14-b038-72a36a9d6737","Type":"ContainerStarted","Data":"17c725fa7f3bb2cd8004e40686f16e0c9fe873201248ace038d390f9bdf9f39b"} Sep 10 16:04:18.150802 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:18.150684 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" event={"ID":"19c05d0f-5f52-4a14-b038-72a36a9d6737","Type":"ContainerStarted","Data":"d454995f8e334860b58f52e457de2f8e2b9959fb8b107c3314e888ff13f64ee3"} Sep 10 16:04:18.150802 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:18.150696 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" event={"ID":"19c05d0f-5f52-4a14-b038-72a36a9d6737","Type":"ContainerStarted","Data":"90dcead88463412bf094bb69c51b4d19e54fdd47190adb95f702599393ddd6fb"} Sep 10 16:04:18.164332 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:18.164278 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd8dfd56d-fdd7r" podStartSLOduration=1.262459428 podStartE2EDuration="5.164264321s" totalImagesPullingTime="3.901804893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:18.162822101 +0000 UTC m=+93.962210422" watchObservedRunningTime="2026-09-10 16:04:18.164264321 +0000 UTC m=+93.963652642" Sep 10 16:04:18.182554 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:18.182509 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7979dddc54-94nvf" podStartSLOduration=1.269354954 podStartE2EDuration="5.182493158s" totalImagesPullingTime="3.913138204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:18.181870237 +0000 UTC m=+93.981258550" watchObservedRunningTime="2026-09-10 16:04:18.182493158 +0000 UTC m=+93.981881485" Sep 10 16:04:22.467749 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:22.467708 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:04:22.468131 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:22.467767 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:04:22.470241 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:22.470211 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e2242e-492b-4358-8d86-e14a214ba5a0-metrics-tls\") pod \"dns-default-t92md\" (UID: \"05e2242e-492b-4358-8d86-e14a214ba5a0\") " pod="openshift-dns/dns-default-t92md" Sep 10 16:04:22.470356 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:22.470283 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") pod \"image-registry-66b679487c-2gc4p\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:04:22.485340 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:22.485304 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8xcjl\"" Sep 10 16:04:22.494059 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:22.494041 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:04:22.505650 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:22.505630 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-snhng\"" Sep 10 16:04:22.513525 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:22.513505 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t92md" Sep 10 16:04:22.785851 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:22.785820 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66b679487c-2gc4p"] Sep 10 16:04:22.788519 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:04:22.788490 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1117a52_1e07_4fb2_b2cc_2a1d57ca109f.slice/crio-4bc38daee3258d0b494aed36b179e605da8c7d987d771feaa6b10ac7d1fd2cd4 WatchSource:0}: Error finding container 4bc38daee3258d0b494aed36b179e605da8c7d987d771feaa6b10ac7d1fd2cd4: Status 404 returned error can't find the container with id 4bc38daee3258d0b494aed36b179e605da8c7d987d771feaa6b10ac7d1fd2cd4 Sep 10 16:04:22.811943 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:22.811918 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t92md"] Sep 10 16:04:22.815272 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:04:22.815251 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e2242e_492b_4358_8d86_e14a214ba5a0.slice/crio-2e9c17b23358f7243898b68afb3f941df69b95c8ca0459254fe915ddbfc2aacf WatchSource:0}: Error finding container 2e9c17b23358f7243898b68afb3f941df69b95c8ca0459254fe915ddbfc2aacf: Status 404 returned error can't find the container with id 2e9c17b23358f7243898b68afb3f941df69b95c8ca0459254fe915ddbfc2aacf Sep 10 16:04:23.167839 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:23.167756 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t92md" event={"ID":"05e2242e-492b-4358-8d86-e14a214ba5a0","Type":"ContainerStarted","Data":"2e9c17b23358f7243898b68afb3f941df69b95c8ca0459254fe915ddbfc2aacf"} Sep 10 16:04:23.169227 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:23.169200 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" event={"ID":"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f","Type":"ContainerStarted","Data":"420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9"} Sep 10 16:04:23.169348 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:23.169244 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" event={"ID":"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f","Type":"ContainerStarted","Data":"4bc38daee3258d0b494aed36b179e605da8c7d987d771feaa6b10ac7d1fd2cd4"} Sep 10 16:04:23.169348 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:23.169342 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:04:25.177210 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:25.177171 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t92md" event={"ID":"05e2242e-492b-4358-8d86-e14a214ba5a0","Type":"ContainerStarted","Data":"01a45c3e31c3f6bf969fa8ffe40c02e79e9bbdb46de7505815a56b7cbea7c3cf"} Sep 10 16:04:25.177599 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:25.177255 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t92md" event={"ID":"05e2242e-492b-4358-8d86-e14a214ba5a0","Type":"ContainerStarted","Data":"f8aa697721dd8abc756fc4cb7d017a8f0f41912c412b623d45cc0a191befa03b"} Sep 10 16:04:25.177599 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:25.177300 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t92md" Sep 10 16:04:25.194324 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:25.194273 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t92md" podStartSLOduration=65.282764146 podStartE2EDuration="1m7.194260218s" totalImagesPullingTime="1.911496072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:25.193540843 +0000 UTC m=+100.992929165" watchObservedRunningTime="2026-09-10 16:04:25.194260218 +0000 UTC m=+100.993648540" Sep 10 16:04:25.194666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:25.194644 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" podStartSLOduration=99.194635503 podStartE2EDuration="1m39.194635503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:23.188228161 +0000 UTC m=+98.987616495" watchObservedRunningTime="2026-09-10 16:04:25.194635503 +0000 UTC m=+100.994023825" Sep 10 16:04:27.063997 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:27.063968 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pgmqd" Sep 10 16:04:32.425399 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.425360 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s8hfx"] Sep 10 16:04:32.428177 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.428159 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.430730 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.430701 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 16:04:32.430853 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.430744 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 16:04:32.430853 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.430781 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h8l7j\"" Sep 10 16:04:32.431352 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.431297 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 16:04:32.431352 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.431338 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 16:04:32.431519 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.431353 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 16:04:32.431519 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.431385 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 16:04:32.543715 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.543685 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.543902 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.543724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5c9385b-d679-4983-81a9-47c30ca80af5-root\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.543902 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.543745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jf7\" (UniqueName: \"kubernetes.io/projected/f5c9385b-d679-4983-81a9-47c30ca80af5-kube-api-access-r2jf7\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.543902 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.543821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-tls\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.543902 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.543845 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c9385b-d679-4983-81a9-47c30ca80af5-metrics-client-ca\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.543902 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.543862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.543902 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.543886 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-wtmp\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.544202 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.543941 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-textfile\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.544202 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.543982 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c9385b-d679-4983-81a9-47c30ca80af5-sys\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.644589 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.644557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jf7\" (UniqueName: \"kubernetes.io/projected/f5c9385b-d679-4983-81a9-47c30ca80af5-kube-api-access-r2jf7\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.644754 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.644600 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-tls\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.644754 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.644618 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c9385b-d679-4983-81a9-47c30ca80af5-metrics-client-ca\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.644754 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.644633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.644754 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.644662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-wtmp\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.644754 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.644686 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-textfile\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.644754 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.644708 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c9385b-d679-4983-81a9-47c30ca80af5-sys\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.645055 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.644758 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.645055 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.644799 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5c9385b-d679-4983-81a9-47c30ca80af5-root\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.645055 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.644866 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5c9385b-d679-4983-81a9-47c30ca80af5-root\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.645055 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.644916 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c9385b-d679-4983-81a9-47c30ca80af5-sys\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.645055 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.645032 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-wtmp\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.645271 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.645168 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-textfile\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.645377 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.645354 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c9385b-d679-4983-81a9-47c30ca80af5-metrics-client-ca\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.645487 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.645463 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.647037 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.647014 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-tls\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.647347 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.647330 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5c9385b-d679-4983-81a9-47c30ca80af5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.652100 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.652074 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jf7\" (UniqueName: \"kubernetes.io/projected/f5c9385b-d679-4983-81a9-47c30ca80af5-kube-api-access-r2jf7\") pod \"node-exporter-s8hfx\" (UID: \"f5c9385b-d679-4983-81a9-47c30ca80af5\") " pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.737964 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:32.737933 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8hfx" Sep 10 16:04:32.747603 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:04:32.747575 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c9385b_d679_4983_81a9_47c30ca80af5.slice/crio-076e470da8b834f428514c4e9fd15dd4f548602142a53e3da44e9959c02b089b WatchSource:0}: Error finding container 076e470da8b834f428514c4e9fd15dd4f548602142a53e3da44e9959c02b089b: Status 404 returned error can't find the container with id 076e470da8b834f428514c4e9fd15dd4f548602142a53e3da44e9959c02b089b Sep 10 16:04:33.205238 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:33.205156 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8hfx" event={"ID":"f5c9385b-d679-4983-81a9-47c30ca80af5","Type":"ContainerStarted","Data":"076e470da8b834f428514c4e9fd15dd4f548602142a53e3da44e9959c02b089b"} Sep 10 16:04:35.183006 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:35.182973 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t92md" Sep 10 16:04:35.482184 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:35.482119 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66b679487c-2gc4p"] Sep 10 16:04:36.219474 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:36.219436 2556 generic.go:356] "Generic (PLEG): container finished" podID="f5c9385b-d679-4983-81a9-47c30ca80af5" containerID="460e6f56afa1918bc0598911c175943948a9b510cc1dc08ef2010bb0c374d65e" exitCode=0 Sep 10 16:04:36.219955 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:36.219531 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8hfx" event={"ID":"f5c9385b-d679-4983-81a9-47c30ca80af5","Type":"ContainerDied","Data":"460e6f56afa1918bc0598911c175943948a9b510cc1dc08ef2010bb0c374d65e"} Sep 10 16:04:37.225710 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:37.225679 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8hfx" event={"ID":"f5c9385b-d679-4983-81a9-47c30ca80af5","Type":"ContainerStarted","Data":"78a1ca2420d7f2392695b60ecf8580ee606c84f89f0b9f09ceaf1009e569ddf5"} Sep 10 16:04:37.226102 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:37.225738 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8hfx" event={"ID":"f5c9385b-d679-4983-81a9-47c30ca80af5","Type":"ContainerStarted","Data":"0bfe09b5fc720992cb3085c9f39465db61d16999c25f8ff42dc069562823e6d4"} Sep 10 16:04:37.247653 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:37.247603 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s8hfx" podStartSLOduration=2.736680865 podStartE2EDuration="5.247588008s" totalImagesPullingTime="2.44939961s" totalInitContainerRuntime="61.507533ms" isStatefulPod=true podCreationTimestamp="2026-09-10 16:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:37.24635592 +0000 UTC m=+113.045744241" watchObservedRunningTime="2026-09-10 16:04:37.247588008 +0000 UTC m=+113.046976370" Sep 10 16:04:45.487966 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:45.487937 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:04:54.604437 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:54.604402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:04:54.606714 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:54.606683 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/117f519b-c0a5-4892-ad17-5d8ec8bd5f9b-metrics-certs\") pod \"network-metrics-daemon-2gr6r\" (UID: \"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b\") " pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:04:54.782218 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:54.782187 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wstvg\"" Sep 10 16:04:54.790214 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:54.790197 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gr6r" Sep 10 16:04:55.063021 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:55.062989 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2gr6r"] Sep 10 16:04:55.065784 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:04:55.065756 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117f519b_c0a5_4892_ad17_5d8ec8bd5f9b.slice/crio-25b64c5e5a6a1321536c351ea3db4cb799d1298d4ac372a50d03f5a155471252 WatchSource:0}: Error finding container 25b64c5e5a6a1321536c351ea3db4cb799d1298d4ac372a50d03f5a155471252: Status 404 returned error can't find the container with id 25b64c5e5a6a1321536c351ea3db4cb799d1298d4ac372a50d03f5a155471252 Sep 10 16:04:55.285735 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:55.285698 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2gr6r" event={"ID":"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b","Type":"ContainerStarted","Data":"25b64c5e5a6a1321536c351ea3db4cb799d1298d4ac372a50d03f5a155471252"} Sep 10 16:04:56.290991 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:56.290906 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2gr6r" event={"ID":"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b","Type":"ContainerStarted","Data":"b8d4af89a7c2ae6b57440cae02da03a00f990fcfa8d8942525d0a37a50272a70"} Sep 10 16:04:56.290991 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:56.290962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2gr6r" event={"ID":"117f519b-c0a5-4892-ad17-5d8ec8bd5f9b","Type":"ContainerStarted","Data":"f503fabf4868704dd69b24c15e53455fe32ae6c162600454a7d107805e009526"} Sep 10 16:04:56.311601 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:04:56.311223 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2gr6r" podStartSLOduration=130.348965983 podStartE2EDuration="2m11.311201779s" totalImagesPullingTime="962.235796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:56.309257473 +0000 UTC m=+132.108645796" watchObservedRunningTime="2026-09-10 16:04:56.311201779 +0000 UTC m=+132.110590105" Sep 10 16:05:00.500788 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.500740 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" podUID="d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" containerName="registry" containerID="cri-o://420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9" gracePeriod=30 Sep 10 16:05:00.745544 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.745521 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:05:00.852036 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.851963 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-installation-pull-secrets\") pod \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " Sep 10 16:05:00.852036 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.852008 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwnx4\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-kube-api-access-wwnx4\") pod \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " Sep 10 16:05:00.852036 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.852036 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-certificates\") pod \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " Sep 10 16:05:00.852283 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.852065 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-ca-trust-extracted\") pod \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " Sep 10 16:05:00.852283 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.852093 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") pod \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " Sep 10 16:05:00.852283 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.852124 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-bound-sa-token\") pod \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " Sep 10 16:05:00.852442 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.852289 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-trusted-ca\") pod \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " Sep 10 16:05:00.852442 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.852362 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-image-registry-private-configuration\") pod \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\" (UID: \"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f\") " Sep 10 16:05:00.852545 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.852446 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:05:00.852629 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.852603 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-certificates\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:05:00.852758 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.852733 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:05:00.854675 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.854644 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:05:00.854822 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.854793 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-kube-api-access-wwnx4" (OuterVolumeSpecName: "kube-api-access-wwnx4") pod "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f"). InnerVolumeSpecName "kube-api-access-wwnx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:05:00.854935 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.854820 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:05:00.854982 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.854929 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:05:00.854982 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.854945 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:05:00.860665 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.860644 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" (UID: "d1117a52-1e07-4fb2-b2cc-2a1d57ca109f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:05:00.953407 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.953365 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwnx4\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-kube-api-access-wwnx4\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:05:00.953407 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.953404 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-ca-trust-extracted\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:05:00.953407 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.953415 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-registry-tls\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:05:00.953407 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.953424 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-bound-sa-token\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:05:00.953639 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.953434 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-trusted-ca\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:05:00.953639 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.953442 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-image-registry-private-configuration\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:05:00.953639 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:00.953451 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f-installation-pull-secrets\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:05:01.309550 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:01.309511 2556 generic.go:356] "Generic (PLEG): container finished" podID="d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" containerID="420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9" exitCode=0 Sep 10 16:05:01.309733 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:01.309563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" event={"ID":"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f","Type":"ContainerDied","Data":"420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9"} Sep 10 16:05:01.309733 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:01.309573 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" Sep 10 16:05:01.309733 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:01.309605 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66b679487c-2gc4p" event={"ID":"d1117a52-1e07-4fb2-b2cc-2a1d57ca109f","Type":"ContainerDied","Data":"4bc38daee3258d0b494aed36b179e605da8c7d987d771feaa6b10ac7d1fd2cd4"} Sep 10 16:05:01.309733 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:01.309632 2556 scope.go:117] "RemoveContainer" containerID="420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9" Sep 10 16:05:01.317782 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:01.317763 2556 scope.go:117] "RemoveContainer" containerID="420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9" Sep 10 16:05:01.318070 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:05:01.318051 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9\": container with ID starting with 420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9 not found: ID does not exist" containerID="420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9" Sep 10 16:05:01.318118 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:01.318080 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9"} err="failed to get container status \"420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9\": rpc error: code = NotFound desc = could not find container \"420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9\": container with ID starting with 420aa7dd1f471658d974e7c5e7d6fd0b88e2dd21382775a0a4ece19a0f42a6f9 not found: ID does not exist" Sep 10 16:05:01.329882 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:01.329861 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66b679487c-2gc4p"] Sep 10 16:05:01.333778 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:01.333759 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66b679487c-2gc4p"] Sep 10 16:05:02.674909 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:02.674879 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" path="/var/lib/kubelet/pods/d1117a52-1e07-4fb2-b2cc-2a1d57ca109f/volumes" Sep 10 16:05:04.323120 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:04.323088 2556 generic.go:356] "Generic (PLEG): container finished" podID="24455229-cdf7-491a-9960-f321de7c3601" containerID="ee41b4c99400b7c89c535e3aa006688a2a389e09a2191cf372a5752ea9cea4d7" exitCode=0 Sep 10 16:05:04.323490 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:04.323163 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" event={"ID":"24455229-cdf7-491a-9960-f321de7c3601","Type":"ContainerDied","Data":"ee41b4c99400b7c89c535e3aa006688a2a389e09a2191cf372a5752ea9cea4d7"} Sep 10 16:05:04.323533 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:04.323499 2556 scope.go:117] "RemoveContainer" containerID="ee41b4c99400b7c89c535e3aa006688a2a389e09a2191cf372a5752ea9cea4d7" Sep 10 16:05:05.328650 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:05.328616 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mfjc9" event={"ID":"24455229-cdf7-491a-9960-f321de7c3601","Type":"ContainerStarted","Data":"2a994c14f21cea8315911919017be057be66721bb685976b98fc3d60a1f8bd81"} Sep 10 16:05:10.347455 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:10.347372 2556 generic.go:356] "Generic (PLEG): container finished" podID="554d1b9b-4837-4114-a33c-98db1f43e749" containerID="0b5c6b71f751db6b2c5109e862abf8d13078839cb422123c39c7197c4c85bc6d" exitCode=0 Sep 10 16:05:10.347795 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:10.347451 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" event={"ID":"554d1b9b-4837-4114-a33c-98db1f43e749","Type":"ContainerDied","Data":"0b5c6b71f751db6b2c5109e862abf8d13078839cb422123c39c7197c4c85bc6d"} Sep 10 16:05:10.347833 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:10.347803 2556 scope.go:117] "RemoveContainer" containerID="0b5c6b71f751db6b2c5109e862abf8d13078839cb422123c39c7197c4c85bc6d" Sep 10 16:05:11.353505 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:11.353476 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-nl8gn" event={"ID":"554d1b9b-4837-4114-a33c-98db1f43e749","Type":"ContainerStarted","Data":"2d47f6dfcfaa9c61c992278dbf6aed1cc1690b62a73587016d26b1eaa82e500e"} Sep 10 16:05:16.372596 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:16.372558 2556 generic.go:356] "Generic (PLEG): container finished" podID="e3e8743a-479c-4888-b402-d6aeb605871a" containerID="371d39f34cdc5357e8aca2464ec19ea8989b0817750780b7794a55671e84287c" exitCode=0 Sep 10 16:05:16.373077 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:16.372616 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" event={"ID":"e3e8743a-479c-4888-b402-d6aeb605871a","Type":"ContainerDied","Data":"371d39f34cdc5357e8aca2464ec19ea8989b0817750780b7794a55671e84287c"} Sep 10 16:05:16.373077 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:16.373022 2556 scope.go:117] "RemoveContainer" containerID="371d39f34cdc5357e8aca2464ec19ea8989b0817750780b7794a55671e84287c" Sep 10 16:05:17.378544 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:05:17.378510 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-skhvl" event={"ID":"e3e8743a-479c-4888-b402-d6aeb605871a","Type":"ContainerStarted","Data":"5f41155b61b04c5d8eed1b8da020f1e3fd8a8e4055bed5016bc25baf29d9b00f"} Sep 10 16:07:44.623397 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:44.623371 2556 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 16:07:52.326853 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.326819 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kw7gc"] Sep 10 16:07:52.329013 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.327053 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" containerName="registry" Sep 10 16:07:52.329013 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.327063 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" containerName="registry" Sep 10 16:07:52.329013 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.327108 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1117a52-1e07-4fb2-b2cc-2a1d57ca109f" containerName="registry" Sep 10 16:07:52.329809 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.329792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kw7gc" Sep 10 16:07:52.332050 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.332031 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 16:07:52.332173 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.332032 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 16:07:52.332173 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.332074 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7zgj7\"" Sep 10 16:07:52.340675 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.340654 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kw7gc"] Sep 10 16:07:52.431266 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.431231 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd589b7c-c2bc-4826-bf82-80edde1eb135-bound-sa-token\") pod \"cert-manager-55b4d954d5-kw7gc\" (UID: \"dd589b7c-c2bc-4826-bf82-80edde1eb135\") " pod="cert-manager/cert-manager-55b4d954d5-kw7gc" Sep 10 16:07:52.431426 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.431294 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mv2j\" (UniqueName: \"kubernetes.io/projected/dd589b7c-c2bc-4826-bf82-80edde1eb135-kube-api-access-2mv2j\") pod \"cert-manager-55b4d954d5-kw7gc\" (UID: \"dd589b7c-c2bc-4826-bf82-80edde1eb135\") " pod="cert-manager/cert-manager-55b4d954d5-kw7gc" Sep 10 16:07:52.531669 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.531633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mv2j\" (UniqueName: \"kubernetes.io/projected/dd589b7c-c2bc-4826-bf82-80edde1eb135-kube-api-access-2mv2j\") pod \"cert-manager-55b4d954d5-kw7gc\" (UID: \"dd589b7c-c2bc-4826-bf82-80edde1eb135\") " pod="cert-manager/cert-manager-55b4d954d5-kw7gc" Sep 10 16:07:52.531812 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.531698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd589b7c-c2bc-4826-bf82-80edde1eb135-bound-sa-token\") pod \"cert-manager-55b4d954d5-kw7gc\" (UID: \"dd589b7c-c2bc-4826-bf82-80edde1eb135\") " pod="cert-manager/cert-manager-55b4d954d5-kw7gc" Sep 10 16:07:52.539714 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.539690 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd589b7c-c2bc-4826-bf82-80edde1eb135-bound-sa-token\") pod \"cert-manager-55b4d954d5-kw7gc\" (UID: \"dd589b7c-c2bc-4826-bf82-80edde1eb135\") " pod="cert-manager/cert-manager-55b4d954d5-kw7gc" Sep 10 16:07:52.540257 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.540234 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mv2j\" (UniqueName: \"kubernetes.io/projected/dd589b7c-c2bc-4826-bf82-80edde1eb135-kube-api-access-2mv2j\") pod \"cert-manager-55b4d954d5-kw7gc\" (UID: \"dd589b7c-c2bc-4826-bf82-80edde1eb135\") " pod="cert-manager/cert-manager-55b4d954d5-kw7gc" Sep 10 16:07:52.638190 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.638142 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kw7gc" Sep 10 16:07:52.904634 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.904606 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kw7gc"] Sep 10 16:07:52.907151 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:07:52.907123 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd589b7c_c2bc_4826_bf82_80edde1eb135.slice/crio-4c5285ca298acc2e639e423d2d06926ba1ddad8c451f8cf6e936a26ab2101726 WatchSource:0}: Error finding container 4c5285ca298acc2e639e423d2d06926ba1ddad8c451f8cf6e936a26ab2101726: Status 404 returned error can't find the container with id 4c5285ca298acc2e639e423d2d06926ba1ddad8c451f8cf6e936a26ab2101726 Sep 10 16:07:52.908902 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:52.908887 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 16:07:53.897761 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:53.897715 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kw7gc" event={"ID":"dd589b7c-c2bc-4826-bf82-80edde1eb135","Type":"ContainerStarted","Data":"4c5285ca298acc2e639e423d2d06926ba1ddad8c451f8cf6e936a26ab2101726"} Sep 10 16:07:56.909372 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:56.909333 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kw7gc" event={"ID":"dd589b7c-c2bc-4826-bf82-80edde1eb135","Type":"ContainerStarted","Data":"86208402e0ed5b626e4df117753dbf7c71d52424c3a614599327e5b406dcb5b0"} Sep 10 16:07:56.928661 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:07:56.928615 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kw7gc" podStartSLOduration=1.749409049 podStartE2EDuration="4.928601414s" totalImagesPullingTime="3.179192365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:07:56.927411705 +0000 UTC m=+312.726800037" watchObservedRunningTime="2026-09-10 16:07:56.928601414 +0000 UTC m=+312.727989736" Sep 10 16:08:11.183797 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.183765 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n"] Sep 10 16:08:11.189795 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.189775 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.191995 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.191965 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 16:08:11.191995 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.191984 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 16:08:11.192161 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.192034 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 16:08:11.192161 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.192085 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 16:08:11.192619 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.192603 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-784hl\"" Sep 10 16:08:11.203302 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.201510 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n"] Sep 10 16:08:11.255360 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.255327 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.255517 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.255367 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-manifests\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.255517 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.255389 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-tmp\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.255517 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.255483 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.255647 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.255517 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb74x\" (UniqueName: \"kubernetes.io/projected/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-kube-api-access-hb74x\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.356638 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.356603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-tmp\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.356822 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.356650 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.356822 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.356666 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb74x\" (UniqueName: \"kubernetes.io/projected/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-kube-api-access-hb74x\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.356822 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.356694 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.356822 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.356745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-manifests\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.357145 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.357117 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-manifests\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.359110 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.359088 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-tmp\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.359209 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.359136 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.359265 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.359224 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.365750 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.365729 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb74x\" (UniqueName: \"kubernetes.io/projected/8d1ce0f9-72d1-40fc-bd4e-e152876c88ed-kube-api-access-hb74x\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-qws7n\" (UID: \"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.500801 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.500768 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:11.780467 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.780443 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n"] Sep 10 16:08:11.782928 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:08:11.782890 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1ce0f9_72d1_40fc_bd4e_e152876c88ed.slice/crio-6c24de37401c0c21dd6b0fe8be0968a1843352376ef237805af5bfd4aba0c850 WatchSource:0}: Error finding container 6c24de37401c0c21dd6b0fe8be0968a1843352376ef237805af5bfd4aba0c850: Status 404 returned error can't find the container with id 6c24de37401c0c21dd6b0fe8be0968a1843352376ef237805af5bfd4aba0c850 Sep 10 16:08:11.964199 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:11.964167 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" event={"ID":"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed","Type":"ContainerStarted","Data":"6c24de37401c0c21dd6b0fe8be0968a1843352376ef237805af5bfd4aba0c850"} Sep 10 16:08:15.980725 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:15.980642 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" event={"ID":"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed","Type":"ContainerStarted","Data":"95a9ea22df0742b785918e02e910f0d61c59241ff9730cb2e56a38d6caf617b1"} Sep 10 16:08:16.986135 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:16.986099 2556 generic.go:356] "Generic (PLEG): container finished" podID="8d1ce0f9-72d1-40fc-bd4e-e152876c88ed" containerID="95a9ea22df0742b785918e02e910f0d61c59241ff9730cb2e56a38d6caf617b1" exitCode=0 Sep 10 16:08:16.986613 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:16.986170 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" event={"ID":"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed","Type":"ContainerDied","Data":"95a9ea22df0742b785918e02e910f0d61c59241ff9730cb2e56a38d6caf617b1"} Sep 10 16:08:18.995419 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:18.995381 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" event={"ID":"8d1ce0f9-72d1-40fc-bd4e-e152876c88ed","Type":"ContainerStarted","Data":"01ac22a48fbf824487a222d0f93155c50f4830936fd5d1ab9f2114930e277ade"} Sep 10 16:08:18.995869 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:18.995490 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:19.017352 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:19.017293 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" podStartSLOduration=1.870283168 podStartE2EDuration="8.017279467s" totalImagesPullingTime="5.08283349s" totalInitContainerRuntime="1.064162809s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:19.01642208 +0000 UTC m=+334.815810396" watchObservedRunningTime="2026-09-10 16:08:19.017279467 +0000 UTC m=+334.816667790" Sep 10 16:08:30.001740 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:30.001708 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-qws7n" Sep 10 16:08:31.954080 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:31.954050 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb"] Sep 10 16:08:31.959868 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:31.959852 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" Sep 10 16:08:31.962178 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:31.962157 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 16:08:31.962881 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:31.962860 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 16:08:31.962881 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:31.962878 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 16:08:31.963027 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:31.962889 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-p9gqn\"" Sep 10 16:08:31.963027 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:31.962934 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 16:08:31.977238 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:31.977217 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb"] Sep 10 16:08:32.001039 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:32.001016 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnj8x\" (UniqueName: \"kubernetes.io/projected/697c0074-3d43-4e8d-b054-392f1ff5e2ec-kube-api-access-lnj8x\") pod \"kube-auth-proxy-5468b79cc4-7rnsb\" (UID: \"697c0074-3d43-4e8d-b054-392f1ff5e2ec\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" Sep 10 16:08:32.001124 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:32.001043 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/697c0074-3d43-4e8d-b054-392f1ff5e2ec-tmp\") pod \"kube-auth-proxy-5468b79cc4-7rnsb\" (UID: \"697c0074-3d43-4e8d-b054-392f1ff5e2ec\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" Sep 10 16:08:32.001124 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:32.001081 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/697c0074-3d43-4e8d-b054-392f1ff5e2ec-tls-certs\") pod \"kube-auth-proxy-5468b79cc4-7rnsb\" (UID: \"697c0074-3d43-4e8d-b054-392f1ff5e2ec\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" Sep 10 16:08:32.101733 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:32.101707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/697c0074-3d43-4e8d-b054-392f1ff5e2ec-tmp\") pod \"kube-auth-proxy-5468b79cc4-7rnsb\" (UID: \"697c0074-3d43-4e8d-b054-392f1ff5e2ec\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" Sep 10 16:08:32.101873 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:32.101749 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/697c0074-3d43-4e8d-b054-392f1ff5e2ec-tls-certs\") pod \"kube-auth-proxy-5468b79cc4-7rnsb\" (UID: \"697c0074-3d43-4e8d-b054-392f1ff5e2ec\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" Sep 10 16:08:32.101873 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:32.101795 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnj8x\" (UniqueName: \"kubernetes.io/projected/697c0074-3d43-4e8d-b054-392f1ff5e2ec-kube-api-access-lnj8x\") pod \"kube-auth-proxy-5468b79cc4-7rnsb\" (UID: \"697c0074-3d43-4e8d-b054-392f1ff5e2ec\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" Sep 10 16:08:32.103956 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:32.103932 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/697c0074-3d43-4e8d-b054-392f1ff5e2ec-tmp\") pod \"kube-auth-proxy-5468b79cc4-7rnsb\" (UID: \"697c0074-3d43-4e8d-b054-392f1ff5e2ec\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" Sep 10 16:08:32.104149 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:32.104132 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/697c0074-3d43-4e8d-b054-392f1ff5e2ec-tls-certs\") pod \"kube-auth-proxy-5468b79cc4-7rnsb\" (UID: \"697c0074-3d43-4e8d-b054-392f1ff5e2ec\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" Sep 10 16:08:32.119571 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:32.119549 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnj8x\" (UniqueName: \"kubernetes.io/projected/697c0074-3d43-4e8d-b054-392f1ff5e2ec-kube-api-access-lnj8x\") pod \"kube-auth-proxy-5468b79cc4-7rnsb\" (UID: \"697c0074-3d43-4e8d-b054-392f1ff5e2ec\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" Sep 10 16:08:32.268930 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:32.268910 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" Sep 10 16:08:32.552040 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:32.551998 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb"] Sep 10 16:08:32.554614 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:08:32.554576 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697c0074_3d43_4e8d_b054_392f1ff5e2ec.slice/crio-cdba92f7d79d882092a2eec9291b4b2272733ad97682fe2868b8b9f7aeea093d WatchSource:0}: Error finding container cdba92f7d79d882092a2eec9291b4b2272733ad97682fe2868b8b9f7aeea093d: Status 404 returned error can't find the container with id cdba92f7d79d882092a2eec9291b4b2272733ad97682fe2868b8b9f7aeea093d Sep 10 16:08:33.046607 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:33.046572 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" event={"ID":"697c0074-3d43-4e8d-b054-392f1ff5e2ec","Type":"ContainerStarted","Data":"cdba92f7d79d882092a2eec9291b4b2272733ad97682fe2868b8b9f7aeea093d"} Sep 10 16:08:36.060011 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:36.059976 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" event={"ID":"697c0074-3d43-4e8d-b054-392f1ff5e2ec","Type":"ContainerStarted","Data":"65ac6bb3732aa494b8001c66d17fcb4887e7cd06b9621e26796037576f855356"} Sep 10 16:08:36.077195 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:36.077137 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5468b79cc4-7rnsb" podStartSLOduration=2.093792289 podStartE2EDuration="5.077121023s" totalImagesPullingTime="2.983328734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:36.07557386 +0000 UTC m=+351.874962202" watchObservedRunningTime="2026-09-10 16:08:36.077121023 +0000 UTC m=+351.876509345" Sep 10 16:08:39.464777 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.464688 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h"] Sep 10 16:08:39.467186 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.467167 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.469107 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.469085 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 16:08:39.469213 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.469085 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gd7gr\"" Sep 10 16:08:39.478364 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.478339 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h"] Sep 10 16:08:39.559630 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.559599 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.559821 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.559648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.559821 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.559671 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.559821 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.559726 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.559821 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.559761 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77464713-70bf-4c4e-a25d-0f2778a70a12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.559821 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.559780 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.559821 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.559807 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.560128 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.559851 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.560128 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.559871 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rpbt\" (UniqueName: \"kubernetes.io/projected/77464713-70bf-4c4e-a25d-0f2778a70a12-kube-api-access-8rpbt\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661049 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661016 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661186 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661186 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rpbt\" (UniqueName: \"kubernetes.io/projected/77464713-70bf-4c4e-a25d-0f2778a70a12-kube-api-access-8rpbt\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661277 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661193 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661339 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661277 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661381 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661344 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661412 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661469 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661413 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77464713-70bf-4c4e-a25d-0f2778a70a12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661469 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661440 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661721 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661688 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661818 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661720 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661883 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661811 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.661883 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.661826 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.662126 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.662108 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77464713-70bf-4c4e-a25d-0f2778a70a12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.663735 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.663716 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.663973 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.663945 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.671165 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.671143 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77464713-70bf-4c4e-a25d-0f2778a70a12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.673825 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.673801 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rpbt\" (UniqueName: \"kubernetes.io/projected/77464713-70bf-4c4e-a25d-0f2778a70a12-kube-api-access-8rpbt\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h\" (UID: \"77464713-70bf-4c4e-a25d-0f2778a70a12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:39.779918 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:39.779890 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:40.053445 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:40.053363 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h"] Sep 10 16:08:40.060402 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:08:40.060367 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77464713_70bf_4c4e_a25d_0f2778a70a12.slice/crio-8c3d8dd75b5db11125e59b5a3c3fc6598865e7f120ab35206e00c24b00cc7495 WatchSource:0}: Error finding container 8c3d8dd75b5db11125e59b5a3c3fc6598865e7f120ab35206e00c24b00cc7495: Status 404 returned error can't find the container with id 8c3d8dd75b5db11125e59b5a3c3fc6598865e7f120ab35206e00c24b00cc7495 Sep 10 16:08:40.074860 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:40.074823 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" event={"ID":"77464713-70bf-4c4e-a25d-0f2778a70a12","Type":"ContainerStarted","Data":"8c3d8dd75b5db11125e59b5a3c3fc6598865e7f120ab35206e00c24b00cc7495"} Sep 10 16:08:42.636897 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.636860 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ccb5l"] Sep 10 16:08:42.647792 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.647745 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:42.649903 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.649842 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ccb5l"] Sep 10 16:08:42.651305 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.651250 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-59b6d\"" Sep 10 16:08:42.651305 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.651298 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 10 16:08:42.687645 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.687611 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq4l8\" (UniqueName: \"kubernetes.io/projected/210470c3-d3c4-47ec-9800-478e43e12e5e-kube-api-access-pq4l8\") pod \"odh-model-controller-7998c67dc4-ccb5l\" (UID: \"210470c3-d3c4-47ec-9800-478e43e12e5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:42.687645 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.687655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/210470c3-d3c4-47ec-9800-478e43e12e5e-cert\") pod \"odh-model-controller-7998c67dc4-ccb5l\" (UID: \"210470c3-d3c4-47ec-9800-478e43e12e5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:42.788589 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.788553 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq4l8\" (UniqueName: \"kubernetes.io/projected/210470c3-d3c4-47ec-9800-478e43e12e5e-kube-api-access-pq4l8\") pod \"odh-model-controller-7998c67dc4-ccb5l\" (UID: \"210470c3-d3c4-47ec-9800-478e43e12e5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:42.788744 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.788597 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/210470c3-d3c4-47ec-9800-478e43e12e5e-cert\") pod \"odh-model-controller-7998c67dc4-ccb5l\" (UID: \"210470c3-d3c4-47ec-9800-478e43e12e5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:42.788790 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:08:42.788754 2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 10 16:08:42.788833 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:08:42.788822 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/210470c3-d3c4-47ec-9800-478e43e12e5e-cert podName:210470c3-d3c4-47ec-9800-478e43e12e5e nodeName:}" failed. No retries permitted until 2026-09-10 16:08:43.28880131 +0000 UTC m=+359.088189616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/210470c3-d3c4-47ec-9800-478e43e12e5e-cert") pod "odh-model-controller-7998c67dc4-ccb5l" (UID: "210470c3-d3c4-47ec-9800-478e43e12e5e") : secret "odh-model-controller-webhook-cert" not found Sep 10 16:08:42.799295 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.799271 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq4l8\" (UniqueName: \"kubernetes.io/projected/210470c3-d3c4-47ec-9800-478e43e12e5e-kube-api-access-pq4l8\") pod \"odh-model-controller-7998c67dc4-ccb5l\" (UID: \"210470c3-d3c4-47ec-9800-478e43e12e5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:42.809884 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.809842 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 16:08:42.809955 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.809934 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 16:08:42.809987 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:42.809972 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 16:08:43.090570 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.090539 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" event={"ID":"77464713-70bf-4c4e-a25d-0f2778a70a12","Type":"ContainerStarted","Data":"a09889cc35baf07432c112f781e431cc21c644a8268f8383f92e309c05d50ba5"} Sep 10 16:08:43.112319 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.112232 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" podStartSLOduration=1.364797385 podStartE2EDuration="4.11221214s" totalImagesPullingTime="2.747414755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:43.110191345 +0000 UTC m=+358.909579690" watchObservedRunningTime="2026-09-10 16:08:43.11221214 +0000 UTC m=+358.911600463" Sep 10 16:08:43.233619 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.233579 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tr9p2"] Sep 10 16:08:43.237078 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.237061 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" Sep 10 16:08:43.239132 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.239110 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 10 16:08:43.239484 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.239468 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-m9gqb\"" Sep 10 16:08:43.247422 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.247399 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tr9p2"] Sep 10 16:08:43.292736 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.292693 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/703c0e7f-1029-4511-978e-c676c7d1d1bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-tr9p2\" (UID: \"703c0e7f-1029-4511-978e-c676c7d1d1bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" Sep 10 16:08:43.292883 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.292767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbp62\" (UniqueName: \"kubernetes.io/projected/703c0e7f-1029-4511-978e-c676c7d1d1bb-kube-api-access-cbp62\") pod \"model-serving-api-54d89bd5fc-tr9p2\" (UID: \"703c0e7f-1029-4511-978e-c676c7d1d1bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" Sep 10 16:08:43.292883 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.292798 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/210470c3-d3c4-47ec-9800-478e43e12e5e-cert\") pod \"odh-model-controller-7998c67dc4-ccb5l\" (UID: \"210470c3-d3c4-47ec-9800-478e43e12e5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:43.293396 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:08:43.293008 2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 10 16:08:43.293396 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:08:43.293072 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/210470c3-d3c4-47ec-9800-478e43e12e5e-cert podName:210470c3-d3c4-47ec-9800-478e43e12e5e nodeName:}" failed. No retries permitted until 2026-09-10 16:08:44.293052735 +0000 UTC m=+360.092441045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/210470c3-d3c4-47ec-9800-478e43e12e5e-cert") pod "odh-model-controller-7998c67dc4-ccb5l" (UID: "210470c3-d3c4-47ec-9800-478e43e12e5e") : secret "odh-model-controller-webhook-cert" not found Sep 10 16:08:43.393884 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.393799 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/703c0e7f-1029-4511-978e-c676c7d1d1bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-tr9p2\" (UID: \"703c0e7f-1029-4511-978e-c676c7d1d1bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" Sep 10 16:08:43.393884 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.393863 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbp62\" (UniqueName: \"kubernetes.io/projected/703c0e7f-1029-4511-978e-c676c7d1d1bb-kube-api-access-cbp62\") pod \"model-serving-api-54d89bd5fc-tr9p2\" (UID: \"703c0e7f-1029-4511-978e-c676c7d1d1bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" Sep 10 16:08:43.394056 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:08:43.393940 2556 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 10 16:08:43.394056 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:08:43.393999 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/703c0e7f-1029-4511-978e-c676c7d1d1bb-tls-certs podName:703c0e7f-1029-4511-978e-c676c7d1d1bb nodeName:}" failed. No retries permitted until 2026-09-10 16:08:43.893986001 +0000 UTC m=+359.693374301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/703c0e7f-1029-4511-978e-c676c7d1d1bb-tls-certs") pod "model-serving-api-54d89bd5fc-tr9p2" (UID: "703c0e7f-1029-4511-978e-c676c7d1d1bb") : secret "model-serving-api-tls" not found Sep 10 16:08:43.404452 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.404428 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbp62\" (UniqueName: \"kubernetes.io/projected/703c0e7f-1029-4511-978e-c676c7d1d1bb-kube-api-access-cbp62\") pod \"model-serving-api-54d89bd5fc-tr9p2\" (UID: \"703c0e7f-1029-4511-978e-c676c7d1d1bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" Sep 10 16:08:43.780668 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.780634 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:43.784858 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.784836 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:43.896736 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.896701 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/703c0e7f-1029-4511-978e-c676c7d1d1bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-tr9p2\" (UID: \"703c0e7f-1029-4511-978e-c676c7d1d1bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" Sep 10 16:08:43.899137 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:43.899106 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/703c0e7f-1029-4511-978e-c676c7d1d1bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-tr9p2\" (UID: \"703c0e7f-1029-4511-978e-c676c7d1d1bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" Sep 10 16:08:44.094011 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:44.093931 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:44.094977 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:44.094958 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h" Sep 10 16:08:44.148817 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:44.148791 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" Sep 10 16:08:44.299633 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:44.299595 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/210470c3-d3c4-47ec-9800-478e43e12e5e-cert\") pod \"odh-model-controller-7998c67dc4-ccb5l\" (UID: \"210470c3-d3c4-47ec-9800-478e43e12e5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:44.301930 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:44.301900 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/210470c3-d3c4-47ec-9800-478e43e12e5e-cert\") pod \"odh-model-controller-7998c67dc4-ccb5l\" (UID: \"210470c3-d3c4-47ec-9800-478e43e12e5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:44.415769 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:44.415746 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tr9p2"] Sep 10 16:08:44.418037 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:08:44.417998 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod703c0e7f_1029_4511_978e_c676c7d1d1bb.slice/crio-d439fdc1df16c35c818828e3ab2c3ec4a237d1b780b3f11acd23c06778eb7e5f WatchSource:0}: Error finding container d439fdc1df16c35c818828e3ab2c3ec4a237d1b780b3f11acd23c06778eb7e5f: Status 404 returned error can't find the container with id d439fdc1df16c35c818828e3ab2c3ec4a237d1b780b3f11acd23c06778eb7e5f Sep 10 16:08:44.465586 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:44.465566 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:44.731110 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:44.731042 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ccb5l"] Sep 10 16:08:44.734070 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:08:44.734044 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210470c3_d3c4_47ec_9800_478e43e12e5e.slice/crio-c338c59df4017736685ab6405fb96b9e46bcc6f030f8d21d2560669008670df2 WatchSource:0}: Error finding container c338c59df4017736685ab6405fb96b9e46bcc6f030f8d21d2560669008670df2: Status 404 returned error can't find the container with id c338c59df4017736685ab6405fb96b9e46bcc6f030f8d21d2560669008670df2 Sep 10 16:08:45.100004 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:45.099953 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" event={"ID":"703c0e7f-1029-4511-978e-c676c7d1d1bb","Type":"ContainerStarted","Data":"d439fdc1df16c35c818828e3ab2c3ec4a237d1b780b3f11acd23c06778eb7e5f"} Sep 10 16:08:45.101364 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:45.101337 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" event={"ID":"210470c3-d3c4-47ec-9800-478e43e12e5e","Type":"ContainerStarted","Data":"c338c59df4017736685ab6405fb96b9e46bcc6f030f8d21d2560669008670df2"} Sep 10 16:08:48.116600 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:48.116558 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" event={"ID":"210470c3-d3c4-47ec-9800-478e43e12e5e","Type":"ContainerStarted","Data":"a9403a811db6d518b05cddd3613aa520d6893c1133d4c02627b5cf32e2483898"} Sep 10 16:08:48.117028 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:48.116636 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:48.118042 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:48.118023 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" event={"ID":"703c0e7f-1029-4511-978e-c676c7d1d1bb","Type":"ContainerStarted","Data":"1bded518a503ae0bee49b4c9af2301962703cc4763dc534ddcfea9bf1f23e97a"} Sep 10 16:08:48.118141 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:48.118129 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" Sep 10 16:08:48.135840 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:48.135794 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" podStartSLOduration=3.19681089 podStartE2EDuration="6.135781761s" totalImagesPullingTime="2.938970871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:48.135568902 +0000 UTC m=+363.934957223" watchObservedRunningTime="2026-09-10 16:08:48.135781761 +0000 UTC m=+363.935170083" Sep 10 16:08:48.156077 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:48.156027 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" podStartSLOduration=1.9498465729999999 podStartE2EDuration="5.156014195s" totalImagesPullingTime="3.206167622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:48.154282675 +0000 UTC m=+363.953670997" watchObservedRunningTime="2026-09-10 16:08:48.156014195 +0000 UTC m=+363.955402517" Sep 10 16:08:49.599047 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.599011 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj"] Sep 10 16:08:49.602215 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.602198 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.604498 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.604475 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 16:08:49.604781 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.604756 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 16:08:49.605020 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.605003 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 16:08:49.605082 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.605011 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wpqv9\"" Sep 10 16:08:49.615554 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.615530 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj"] Sep 10 16:08:49.650171 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.650149 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ed5582be-e38d-46ca-8de9-7e85bdcb6305-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.650265 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.650180 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.650265 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.650214 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.650367 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.650351 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.650402 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.650384 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5582be-e38d-46ca-8de9-7e85bdcb6305-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.650435 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.650410 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8brr\" (UniqueName: \"kubernetes.io/projected/ed5582be-e38d-46ca-8de9-7e85bdcb6305-kube-api-access-m8brr\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.650464 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.650426 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.750844 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.750813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ed5582be-e38d-46ca-8de9-7e85bdcb6305-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.750844 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.750847 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.751033 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.750873 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.751033 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.750922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.751033 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.750941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5582be-e38d-46ca-8de9-7e85bdcb6305-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.751033 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.750972 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8brr\" (UniqueName: \"kubernetes.io/projected/ed5582be-e38d-46ca-8de9-7e85bdcb6305-kube-api-access-m8brr\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.751033 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.750995 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.751696 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.751650 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.753187 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.753152 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5582be-e38d-46ca-8de9-7e85bdcb6305-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.753272 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.753219 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.753593 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.753574 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.753659 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.753639 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ed5582be-e38d-46ca-8de9-7e85bdcb6305-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.758807 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.758785 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5582be-e38d-46ca-8de9-7e85bdcb6305-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.759232 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.759212 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8brr\" (UniqueName: \"kubernetes.io/projected/ed5582be-e38d-46ca-8de9-7e85bdcb6305-kube-api-access-m8brr\") pod \"istiod-openshift-gateway-5677ccb49b-gv4bj\" (UID: \"ed5582be-e38d-46ca-8de9-7e85bdcb6305\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:49.911572 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:49.911499 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:50.187699 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:50.187626 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj"] Sep 10 16:08:50.190722 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:08:50.190697 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5582be_e38d_46ca_8de9_7e85bdcb6305.slice/crio-2c32e9049e00be7bba993a9aa71ba021080064f1081c6bebb1b800ab3d2940d6 WatchSource:0}: Error finding container 2c32e9049e00be7bba993a9aa71ba021080064f1081c6bebb1b800ab3d2940d6: Status 404 returned error can't find the container with id 2c32e9049e00be7bba993a9aa71ba021080064f1081c6bebb1b800ab3d2940d6 Sep 10 16:08:51.132871 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:51.132837 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" event={"ID":"ed5582be-e38d-46ca-8de9-7e85bdcb6305","Type":"ContainerStarted","Data":"2c32e9049e00be7bba993a9aa71ba021080064f1081c6bebb1b800ab3d2940d6"} Sep 10 16:08:52.911874 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:52.911840 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 16:08:52.912133 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:52.911913 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 16:08:53.142061 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:53.142030 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" event={"ID":"ed5582be-e38d-46ca-8de9-7e85bdcb6305","Type":"ContainerStarted","Data":"497457aad64c8b426c7e845bfe52e8d0ef3144ed0ae07d340df695c23a9af4af"} Sep 10 16:08:53.142262 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:53.142234 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:53.143678 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:53.143653 2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-gv4bj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 16:08:53.143802 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:53.143708 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" podUID="ed5582be-e38d-46ca-8de9-7e85bdcb6305" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 16:08:53.190685 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:53.190612 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" podStartSLOduration=1.472236916 podStartE2EDuration="4.190598752s" totalImagesPullingTime="2.718361836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:53.187910877 +0000 UTC m=+368.987299199" watchObservedRunningTime="2026-09-10 16:08:53.190598752 +0000 UTC m=+368.989987073" Sep 10 16:08:54.146486 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:54.146454 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv4bj" Sep 10 16:08:59.123842 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:59.123810 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-ccb5l" Sep 10 16:08:59.125948 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:08:59.125929 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tr9p2" Sep 10 16:10:07.919245 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:07.919164 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr"] Sep 10 16:10:07.922108 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:07.922089 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:07.924619 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:07.924594 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 16:10:07.924720 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:07.924702 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 16:10:07.924849 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:07.924826 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tc2g4\"" Sep 10 16:10:07.938573 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:07.938550 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr"] Sep 10 16:10:08.035824 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:08.035788 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06a5823b-3997-4d1e-bcd4-bee926df83db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" (UID: \"06a5823b-3997-4d1e-bcd4-bee926df83db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:08.035824 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:08.035828 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxkhm\" (UniqueName: \"kubernetes.io/projected/06a5823b-3997-4d1e-bcd4-bee926df83db-kube-api-access-fxkhm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" (UID: \"06a5823b-3997-4d1e-bcd4-bee926df83db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:08.136850 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:08.136818 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06a5823b-3997-4d1e-bcd4-bee926df83db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" (UID: \"06a5823b-3997-4d1e-bcd4-bee926df83db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:08.136850 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:08.136854 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxkhm\" (UniqueName: \"kubernetes.io/projected/06a5823b-3997-4d1e-bcd4-bee926df83db-kube-api-access-fxkhm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" (UID: \"06a5823b-3997-4d1e-bcd4-bee926df83db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:08.137248 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:08.137230 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06a5823b-3997-4d1e-bcd4-bee926df83db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" (UID: \"06a5823b-3997-4d1e-bcd4-bee926df83db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:08.145910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:08.145886 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxkhm\" (UniqueName: \"kubernetes.io/projected/06a5823b-3997-4d1e-bcd4-bee926df83db-kube-api-access-fxkhm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" (UID: \"06a5823b-3997-4d1e-bcd4-bee926df83db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:08.232214 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:08.232139 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:08.510116 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:08.510092 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr"] Sep 10 16:10:08.512421 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:10:08.512393 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a5823b_3997_4d1e_bcd4_bee926df83db.slice/crio-818c2315be7ee4b05ffb913b772da8c5dd10039e4f873f4012623d8d746ba423 WatchSource:0}: Error finding container 818c2315be7ee4b05ffb913b772da8c5dd10039e4f873f4012623d8d746ba423: Status 404 returned error can't find the container with id 818c2315be7ee4b05ffb913b772da8c5dd10039e4f873f4012623d8d746ba423 Sep 10 16:10:09.451504 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:09.451470 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" event={"ID":"06a5823b-3997-4d1e-bcd4-bee926df83db","Type":"ContainerStarted","Data":"818c2315be7ee4b05ffb913b772da8c5dd10039e4f873f4012623d8d746ba423"} Sep 10 16:10:13.471560 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:13.471520 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" event={"ID":"06a5823b-3997-4d1e-bcd4-bee926df83db","Type":"ContainerStarted","Data":"b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125"} Sep 10 16:10:13.472011 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:13.471646 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:13.492132 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:13.492083 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" podStartSLOduration=2.360447467 podStartE2EDuration="6.492068723s" totalImagesPullingTime="4.131621256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:13.490946373 +0000 UTC m=+449.290334694" watchObservedRunningTime="2026-09-10 16:10:13.492068723 +0000 UTC m=+449.291457058" Sep 10 16:10:24.477039 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:24.477010 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:25.638759 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.638725 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h"] Sep 10 16:10:25.642022 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.642005 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:25.656149 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.656126 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h"] Sep 10 16:10:25.776161 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.776107 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h"] Sep 10 16:10:25.776387 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:25.776366 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-fwmq8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" podUID="a6aff8c4-4035-4cda-9d95-ddc8611abf7a" Sep 10 16:10:25.783530 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.783511 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bk76h\" (UID: \"a6aff8c4-4035-4cda-9d95-ddc8611abf7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:25.783578 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.783554 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwmq8\" (UniqueName: \"kubernetes.io/projected/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-kube-api-access-fwmq8\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bk76h\" (UID: \"a6aff8c4-4035-4cda-9d95-ddc8611abf7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:25.869665 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.869633 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf"] Sep 10 16:10:25.872836 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.872821 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:25.884692 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.884669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwmq8\" (UniqueName: \"kubernetes.io/projected/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-kube-api-access-fwmq8\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bk76h\" (UID: \"a6aff8c4-4035-4cda-9d95-ddc8611abf7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:25.884772 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.884731 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bk76h\" (UID: \"a6aff8c4-4035-4cda-9d95-ddc8611abf7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:25.885020 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.885001 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bk76h\" (UID: \"a6aff8c4-4035-4cda-9d95-ddc8611abf7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:25.894175 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.894124 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf"] Sep 10 16:10:25.898178 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.898156 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwmq8\" (UniqueName: \"kubernetes.io/projected/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-kube-api-access-fwmq8\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bk76h\" (UID: \"a6aff8c4-4035-4cda-9d95-ddc8611abf7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:25.985589 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.985554 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-xwcsf\" (UID: \"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:25.985589 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:25.985589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pptsx\" (UniqueName: \"kubernetes.io/projected/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-kube-api-access-pptsx\") pod \"kuadrant-operator-controller-manager-5f685c496f-xwcsf\" (UID: \"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:26.086763 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.086727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-xwcsf\" (UID: \"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:26.086763 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.086763 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pptsx\" (UniqueName: \"kubernetes.io/projected/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-kube-api-access-pptsx\") pod \"kuadrant-operator-controller-manager-5f685c496f-xwcsf\" (UID: \"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:26.087121 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.087096 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-xwcsf\" (UID: \"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:26.104934 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.104910 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pptsx\" (UniqueName: \"kubernetes.io/projected/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-kube-api-access-pptsx\") pod \"kuadrant-operator-controller-manager-5f685c496f-xwcsf\" (UID: \"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:26.182368 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.182272 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:26.469257 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.469230 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf"] Sep 10 16:10:26.471099 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:10:26.471073 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e2c3bc_b8d3_41b4_8832_e3a99b3d0b33.slice/crio-7aa3f7de7d3f7472f07caccfac4bd1348b024450ac78e2724d2f33fecce46834 WatchSource:0}: Error finding container 7aa3f7de7d3f7472f07caccfac4bd1348b024450ac78e2724d2f33fecce46834: Status 404 returned error can't find the container with id 7aa3f7de7d3f7472f07caccfac4bd1348b024450ac78e2724d2f33fecce46834 Sep 10 16:10:26.527365 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.527340 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" event={"ID":"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33","Type":"ContainerStarted","Data":"dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961"} Sep 10 16:10:26.527552 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.527396 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" event={"ID":"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33","Type":"ContainerStarted","Data":"7aa3f7de7d3f7472f07caccfac4bd1348b024450ac78e2724d2f33fecce46834"} Sep 10 16:10:26.527552 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.527428 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:26.527552 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.527436 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:26.533321 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.533289 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:26.549339 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.549253 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" podStartSLOduration=1.5492333440000001 podStartE2EDuration="1.549233344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:26.548455987 +0000 UTC m=+462.347844310" watchObservedRunningTime="2026-09-10 16:10:26.549233344 +0000 UTC m=+462.348621669" Sep 10 16:10:26.662583 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.662552 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf"] Sep 10 16:10:26.678102 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.678074 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf"] Sep 10 16:10:26.684661 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.684637 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h"] Sep 10 16:10:26.687582 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.687562 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6"] Sep 10 16:10:26.687851 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.687839 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33" containerName="manager" Sep 10 16:10:26.687914 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.687853 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33" containerName="manager" Sep 10 16:10:26.687914 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.687896 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33" containerName="manager" Sep 10 16:10:26.690825 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.690801 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:26.691614 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.691593 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-extensions-socket-volume\") pod \"a6aff8c4-4035-4cda-9d95-ddc8611abf7a\" (UID: \"a6aff8c4-4035-4cda-9d95-ddc8611abf7a\") " Sep 10 16:10:26.691691 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.691659 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwmq8\" (UniqueName: \"kubernetes.io/projected/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-kube-api-access-fwmq8\") pod \"a6aff8c4-4035-4cda-9d95-ddc8611abf7a\" (UID: \"a6aff8c4-4035-4cda-9d95-ddc8611abf7a\") " Sep 10 16:10:26.691887 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.691861 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a6aff8c4-4035-4cda-9d95-ddc8611abf7a" (UID: "a6aff8c4-4035-4cda-9d95-ddc8611abf7a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:10:26.692416 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.692346 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-extensions-socket-volume\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:10:26.694227 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.694204 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h"] Sep 10 16:10:26.694464 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.694433 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-kube-api-access-fwmq8" (OuterVolumeSpecName: "kube-api-access-fwmq8") pod "a6aff8c4-4035-4cda-9d95-ddc8611abf7a" (UID: "a6aff8c4-4035-4cda-9d95-ddc8611abf7a"). InnerVolumeSpecName "kube-api-access-fwmq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:10:26.707870 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.707848 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6"] Sep 10 16:10:26.713668 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.713642 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr"] Sep 10 16:10:26.713872 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.713849 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" containerName="manager" containerID="cri-o://b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125" gracePeriod=2 Sep 10 16:10:26.728525 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.728495 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr"] Sep 10 16:10:26.738700 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:26.738657 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:26.754415 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.754386 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl"] Sep 10 16:10:26.755014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.754930 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" containerName="manager" Sep 10 16:10:26.755014 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.754950 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" containerName="manager" Sep 10 16:10:26.755184 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.755052 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" containerName="manager" Sep 10 16:10:26.758228 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.758138 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:26.760220 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:26.760194 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:26.774173 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.774088 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl"] Sep 10 16:10:26.793008 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.792981 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d7a5578-858d-46d4-8576-a5b4c9a08510-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-nq5t6\" (UID: \"4d7a5578-858d-46d4-8576-a5b4c9a08510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:26.793114 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.793011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr6tl\" (UniqueName: \"kubernetes.io/projected/4d7a5578-858d-46d4-8576-a5b4c9a08510-kube-api-access-pr6tl\") pod \"kuadrant-operator-controller-manager-5f685c496f-nq5t6\" (UID: \"4d7a5578-858d-46d4-8576-a5b4c9a08510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:26.793155 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.793114 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwmq8\" (UniqueName: \"kubernetes.io/projected/a6aff8c4-4035-4cda-9d95-ddc8611abf7a-kube-api-access-fwmq8\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:10:26.893854 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.893817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d7a5578-858d-46d4-8576-a5b4c9a08510-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-nq5t6\" (UID: \"4d7a5578-858d-46d4-8576-a5b4c9a08510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:26.893854 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.893851 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr6tl\" (UniqueName: \"kubernetes.io/projected/4d7a5578-858d-46d4-8576-a5b4c9a08510-kube-api-access-pr6tl\") pod \"kuadrant-operator-controller-manager-5f685c496f-nq5t6\" (UID: \"4d7a5578-858d-46d4-8576-a5b4c9a08510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:26.894026 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.893896 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c7dcab8-cae6-49b1-968d-de6025dacaa4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-kgbkl\" (UID: \"3c7dcab8-cae6-49b1-968d-de6025dacaa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:26.894026 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.893956 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5bck\" (UniqueName: \"kubernetes.io/projected/3c7dcab8-cae6-49b1-968d-de6025dacaa4-kube-api-access-t5bck\") pod \"kuadrant-operator-controller-manager-76f8f686bf-kgbkl\" (UID: \"3c7dcab8-cae6-49b1-968d-de6025dacaa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:26.894220 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.894188 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d7a5578-858d-46d4-8576-a5b4c9a08510-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-nq5t6\" (UID: \"4d7a5578-858d-46d4-8576-a5b4c9a08510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:26.905686 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.905660 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr6tl\" (UniqueName: \"kubernetes.io/projected/4d7a5578-858d-46d4-8576-a5b4c9a08510-kube-api-access-pr6tl\") pod \"kuadrant-operator-controller-manager-5f685c496f-nq5t6\" (UID: \"4d7a5578-858d-46d4-8576-a5b4c9a08510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:26.941678 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.941657 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:26.943547 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:26.943524 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:26.994782 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.994753 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5bck\" (UniqueName: \"kubernetes.io/projected/3c7dcab8-cae6-49b1-968d-de6025dacaa4-kube-api-access-t5bck\") pod \"kuadrant-operator-controller-manager-76f8f686bf-kgbkl\" (UID: \"3c7dcab8-cae6-49b1-968d-de6025dacaa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:26.994912 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.994859 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c7dcab8-cae6-49b1-968d-de6025dacaa4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-kgbkl\" (UID: \"3c7dcab8-cae6-49b1-968d-de6025dacaa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:26.995352 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:26.995302 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c7dcab8-cae6-49b1-968d-de6025dacaa4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-kgbkl\" (UID: \"3c7dcab8-cae6-49b1-968d-de6025dacaa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:27.001225 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.001200 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:27.007077 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.007056 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5bck\" (UniqueName: \"kubernetes.io/projected/3c7dcab8-cae6-49b1-968d-de6025dacaa4-kube-api-access-t5bck\") pod \"kuadrant-operator-controller-manager-76f8f686bf-kgbkl\" (UID: \"3c7dcab8-cae6-49b1-968d-de6025dacaa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:27.087459 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.087427 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:27.095481 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.095460 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06a5823b-3997-4d1e-bcd4-bee926df83db-extensions-socket-volume\") pod \"06a5823b-3997-4d1e-bcd4-bee926df83db\" (UID: \"06a5823b-3997-4d1e-bcd4-bee926df83db\") " Sep 10 16:10:27.095556 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.095541 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxkhm\" (UniqueName: \"kubernetes.io/projected/06a5823b-3997-4d1e-bcd4-bee926df83db-kube-api-access-fxkhm\") pod \"06a5823b-3997-4d1e-bcd4-bee926df83db\" (UID: \"06a5823b-3997-4d1e-bcd4-bee926df83db\") " Sep 10 16:10:27.095948 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.095927 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a5823b-3997-4d1e-bcd4-bee926df83db-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "06a5823b-3997-4d1e-bcd4-bee926df83db" (UID: "06a5823b-3997-4d1e-bcd4-bee926df83db"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:10:27.097657 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.097634 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a5823b-3997-4d1e-bcd4-bee926df83db-kube-api-access-fxkhm" (OuterVolumeSpecName: "kube-api-access-fxkhm") pod "06a5823b-3997-4d1e-bcd4-bee926df83db" (UID: "06a5823b-3997-4d1e-bcd4-bee926df83db"). InnerVolumeSpecName "kube-api-access-fxkhm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:10:27.196549 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.196519 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06a5823b-3997-4d1e-bcd4-bee926df83db-extensions-socket-volume\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:10:27.196549 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.196546 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxkhm\" (UniqueName: \"kubernetes.io/projected/06a5823b-3997-4d1e-bcd4-bee926df83db-kube-api-access-fxkhm\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:10:27.279036 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.279008 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6"] Sep 10 16:10:27.281400 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:10:27.281372 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7a5578_858d_46d4_8576_a5b4c9a08510.slice/crio-dd879e219316773a8e4f8f15d85b19b4d185c7f970cbe84710d809bf2c7a48ff WatchSource:0}: Error finding container dd879e219316773a8e4f8f15d85b19b4d185c7f970cbe84710d809bf2c7a48ff: Status 404 returned error can't find the container with id dd879e219316773a8e4f8f15d85b19b4d185c7f970cbe84710d809bf2c7a48ff Sep 10 16:10:27.364153 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.364119 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl"] Sep 10 16:10:27.367007 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:10:27.366985 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7dcab8_cae6_49b1_968d_de6025dacaa4.slice/crio-e8f9578f8783d2d229c94978e0c675d9946f7a01199857bd8d5fc7d6f4a8e92a WatchSource:0}: Error finding container e8f9578f8783d2d229c94978e0c675d9946f7a01199857bd8d5fc7d6f4a8e92a: Status 404 returned error can't find the container with id e8f9578f8783d2d229c94978e0c675d9946f7a01199857bd8d5fc7d6f4a8e92a Sep 10 16:10:27.533590 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.533508 2556 generic.go:356] "Generic (PLEG): container finished" podID="06a5823b-3997-4d1e-bcd4-bee926df83db" containerID="b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125" exitCode=0 Sep 10 16:10:27.533590 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.533576 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:27.533797 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.533611 2556 scope.go:117] "RemoveContainer" containerID="b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125" Sep 10 16:10:27.535534 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.535503 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" event={"ID":"4d7a5578-858d-46d4-8576-a5b4c9a08510","Type":"ContainerStarted","Data":"e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7"} Sep 10 16:10:27.535741 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.535556 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" event={"ID":"4d7a5578-858d-46d4-8576-a5b4c9a08510","Type":"ContainerStarted","Data":"dd879e219316773a8e4f8f15d85b19b4d185c7f970cbe84710d809bf2c7a48ff"} Sep 10 16:10:27.535741 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.535588 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:27.535891 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:27.535826 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:27.537298 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.537272 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" event={"ID":"3c7dcab8-cae6-49b1-968d-de6025dacaa4","Type":"ContainerStarted","Data":"fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143"} Sep 10 16:10:27.537447 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.537355 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" event={"ID":"3c7dcab8-cae6-49b1-968d-de6025dacaa4","Type":"ContainerStarted","Data":"e8f9578f8783d2d229c94978e0c675d9946f7a01199857bd8d5fc7d6f4a8e92a"} Sep 10 16:10:27.537447 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.537426 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:27.537561 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.537454 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:27.537561 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:27.537454 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:27.537561 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:27.537506 2556 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" container="manager" Sep 10 16:10:27.543454 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.543356 2556 scope.go:117] "RemoveContainer" containerID="b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125" Sep 10 16:10:27.543809 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:27.543783 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125\": container with ID starting with b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125 not found: ID does not exist" containerID="b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125" Sep 10 16:10:27.543900 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.543817 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125"} err="failed to get container status \"b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125\": rpc error: code = NotFound desc = could not find container \"b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125\": container with ID starting with b40e5ce9594cc5da9df2153db8876c65d9933d0389978608747284b82919f125 not found: ID does not exist" Sep 10 16:10:27.558518 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.558469 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" podStartSLOduration=1.558457462 podStartE2EDuration="1.558457462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:10:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:27.557561814 +0000 UTC m=+463.356950136" watchObservedRunningTime="2026-09-10 16:10:27.558457462 +0000 UTC m=+463.357845784" Sep 10 16:10:27.560469 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:27.560446 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:27.562092 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:27.562064 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-bk76h\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="a6aff8c4-4035-4cda-9d95-ddc8611abf7a" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:27.580990 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:27.580753 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" podStartSLOduration=1.580739478 podStartE2EDuration="1.580739478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:10:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:27.580433996 +0000 UTC m=+463.379822314" watchObservedRunningTime="2026-09-10 16:10:27.580739478 +0000 UTC m=+463.380127800" Sep 10 16:10:27.582048 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:27.582025 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-xwcsf\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:28.545717 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:28.545674 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" podUID="c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33" containerName="manager" containerID="cri-o://dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961" gracePeriod=2 Sep 10 16:10:28.547971 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:28.547943 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-xwcsf\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:28.549514 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:28.549489 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-4pdpr\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4pdpr" Sep 10 16:10:28.550936 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:28.550914 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-bk76h\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="a6aff8c4-4035-4cda-9d95-ddc8611abf7a" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bk76h" Sep 10 16:10:28.677291 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:28.677256 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06a5823b-3997-4d1e-bcd4-bee926df83db" path="/var/lib/kubelet/pods/06a5823b-3997-4d1e-bcd4-bee926df83db/volumes" Sep 10 16:10:28.677805 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:28.677784 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6aff8c4-4035-4cda-9d95-ddc8611abf7a" path="/var/lib/kubelet/pods/a6aff8c4-4035-4cda-9d95-ddc8611abf7a/volumes" Sep 10 16:10:28.780345 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:28.780322 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:28.912579 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:28.912504 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-extensions-socket-volume\") pod \"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33\" (UID: \"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33\") " Sep 10 16:10:28.912579 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:28.912559 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pptsx\" (UniqueName: \"kubernetes.io/projected/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-kube-api-access-pptsx\") pod \"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33\" (UID: \"c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33\") " Sep 10 16:10:28.912823 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:28.912795 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33" (UID: "c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:10:28.914766 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:28.914742 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-kube-api-access-pptsx" (OuterVolumeSpecName: "kube-api-access-pptsx") pod "c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33" (UID: "c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33"). InnerVolumeSpecName "kube-api-access-pptsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:10:29.013596 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:29.013571 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-extensions-socket-volume\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:10:29.013596 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:29.013592 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pptsx\" (UniqueName: \"kubernetes.io/projected/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33-kube-api-access-pptsx\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:10:29.551665 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:29.551624 2556 generic.go:356] "Generic (PLEG): container finished" podID="c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33" containerID="dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961" exitCode=2 Sep 10 16:10:29.552047 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:29.551695 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:29.552047 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:29.551730 2556 scope.go:117] "RemoveContainer" containerID="dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961" Sep 10 16:10:29.560290 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:29.560270 2556 scope.go:117] "RemoveContainer" containerID="dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961" Sep 10 16:10:29.560563 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:29.560544 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961\": container with ID starting with dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961 not found: ID does not exist" containerID="dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961" Sep 10 16:10:29.560602 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:29.560572 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961"} err="failed to get container status \"dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961\": rpc error: code = NotFound desc = could not find container \"dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961\": container with ID starting with dbe6817fc6b78bb89bf412fcb0089c3aa312de78ed68c9782ef0094922069961 not found: ID does not exist" Sep 10 16:10:29.566005 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:29.565985 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-xwcsf\" is forbidden: User \"system:node:ip-10-0-135-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-80.ec2.internal' and this object" podUID="c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xwcsf" Sep 10 16:10:30.680889 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:30.680857 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33" path="/var/lib/kubelet/pods/c4e2c3bc-b8d3-41b4-8832-e3a99b3d0b33/volumes" Sep 10 16:10:38.547963 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:38.547929 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:38.548354 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:38.547998 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:38.658916 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:38.658883 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl"] Sep 10 16:10:38.659094 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:38.659070 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" podUID="3c7dcab8-cae6-49b1-968d-de6025dacaa4" containerName="manager" containerID="cri-o://fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143" gracePeriod=10 Sep 10 16:10:38.896998 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:38.896972 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:38.993697 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:38.993670 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c7dcab8-cae6-49b1-968d-de6025dacaa4-extensions-socket-volume\") pod \"3c7dcab8-cae6-49b1-968d-de6025dacaa4\" (UID: \"3c7dcab8-cae6-49b1-968d-de6025dacaa4\") " Sep 10 16:10:38.993898 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:38.993709 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5bck\" (UniqueName: \"kubernetes.io/projected/3c7dcab8-cae6-49b1-968d-de6025dacaa4-kube-api-access-t5bck\") pod \"3c7dcab8-cae6-49b1-968d-de6025dacaa4\" (UID: \"3c7dcab8-cae6-49b1-968d-de6025dacaa4\") " Sep 10 16:10:38.994129 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:38.994098 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7dcab8-cae6-49b1-968d-de6025dacaa4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3c7dcab8-cae6-49b1-968d-de6025dacaa4" (UID: "3c7dcab8-cae6-49b1-968d-de6025dacaa4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:10:38.995832 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:38.995812 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7dcab8-cae6-49b1-968d-de6025dacaa4-kube-api-access-t5bck" (OuterVolumeSpecName: "kube-api-access-t5bck") pod "3c7dcab8-cae6-49b1-968d-de6025dacaa4" (UID: "3c7dcab8-cae6-49b1-968d-de6025dacaa4"). InnerVolumeSpecName "kube-api-access-t5bck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:10:39.094770 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.094689 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c7dcab8-cae6-49b1-968d-de6025dacaa4-extensions-socket-volume\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:10:39.094770 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.094718 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5bck\" (UniqueName: \"kubernetes.io/projected/3c7dcab8-cae6-49b1-968d-de6025dacaa4-kube-api-access-t5bck\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:10:39.130060 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.130031 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5"] Sep 10 16:10:39.130375 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.130361 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7dcab8-cae6-49b1-968d-de6025dacaa4" containerName="manager" Sep 10 16:10:39.130449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.130376 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7dcab8-cae6-49b1-968d-de6025dacaa4" containerName="manager" Sep 10 16:10:39.130449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.130439 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7dcab8-cae6-49b1-968d-de6025dacaa4" containerName="manager" Sep 10 16:10:39.133346 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.133326 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" Sep 10 16:10:39.237407 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.237377 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5"] Sep 10 16:10:39.296478 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.296450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64e9abcb-d155-4c39-baa7-3b6bf3022069-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qwjz5\" (UID: \"64e9abcb-d155-4c39-baa7-3b6bf3022069\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" Sep 10 16:10:39.296594 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.296504 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4x4f\" (UniqueName: \"kubernetes.io/projected/64e9abcb-d155-4c39-baa7-3b6bf3022069-kube-api-access-c4x4f\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qwjz5\" (UID: \"64e9abcb-d155-4c39-baa7-3b6bf3022069\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" Sep 10 16:10:39.396849 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.396775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4x4f\" (UniqueName: \"kubernetes.io/projected/64e9abcb-d155-4c39-baa7-3b6bf3022069-kube-api-access-c4x4f\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qwjz5\" (UID: \"64e9abcb-d155-4c39-baa7-3b6bf3022069\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" Sep 10 16:10:39.396953 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.396848 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64e9abcb-d155-4c39-baa7-3b6bf3022069-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qwjz5\" (UID: \"64e9abcb-d155-4c39-baa7-3b6bf3022069\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" Sep 10 16:10:39.397253 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.397232 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64e9abcb-d155-4c39-baa7-3b6bf3022069-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qwjz5\" (UID: \"64e9abcb-d155-4c39-baa7-3b6bf3022069\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" Sep 10 16:10:39.427496 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.427467 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4x4f\" (UniqueName: \"kubernetes.io/projected/64e9abcb-d155-4c39-baa7-3b6bf3022069-kube-api-access-c4x4f\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qwjz5\" (UID: \"64e9abcb-d155-4c39-baa7-3b6bf3022069\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" Sep 10 16:10:39.443266 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.443244 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" Sep 10 16:10:39.598403 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.598373 2556 generic.go:356] "Generic (PLEG): container finished" podID="3c7dcab8-cae6-49b1-968d-de6025dacaa4" containerID="fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143" exitCode=0 Sep 10 16:10:39.598824 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.598417 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" event={"ID":"3c7dcab8-cae6-49b1-968d-de6025dacaa4","Type":"ContainerDied","Data":"fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143"} Sep 10 16:10:39.598824 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.598431 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" Sep 10 16:10:39.598824 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.598464 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl" event={"ID":"3c7dcab8-cae6-49b1-968d-de6025dacaa4","Type":"ContainerDied","Data":"e8f9578f8783d2d229c94978e0c675d9946f7a01199857bd8d5fc7d6f4a8e92a"} Sep 10 16:10:39.598824 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.598480 2556 scope.go:117] "RemoveContainer" containerID="fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143" Sep 10 16:10:39.606670 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.606654 2556 scope.go:117] "RemoveContainer" containerID="fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143" Sep 10 16:10:39.606997 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:39.606976 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143\": container with ID starting with fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143 not found: ID does not exist" containerID="fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143" Sep 10 16:10:39.607082 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.607002 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143"} err="failed to get container status \"fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143\": rpc error: code = NotFound desc = could not find container \"fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143\": container with ID starting with fbf21af56659ef11e54bb578bd1f131bb2fe2b89008abf8a1e2300ccb309f143 not found: ID does not exist" Sep 10 16:10:39.632468 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.632447 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl"] Sep 10 16:10:39.638369 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.638350 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-kgbkl"] Sep 10 16:10:39.775276 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:39.775254 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5"] Sep 10 16:10:39.777180 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:10:39.777152 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e9abcb_d155_4c39_baa7_3b6bf3022069.slice/crio-4185fb7a0a50a11ae21e5ed8b8b20d186b42c7e37aab62ba929ac6dbf75c4fca WatchSource:0}: Error finding container 4185fb7a0a50a11ae21e5ed8b8b20d186b42c7e37aab62ba929ac6dbf75c4fca: Status 404 returned error can't find the container with id 4185fb7a0a50a11ae21e5ed8b8b20d186b42c7e37aab62ba929ac6dbf75c4fca Sep 10 16:10:40.605602 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:40.605568 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" event={"ID":"64e9abcb-d155-4c39-baa7-3b6bf3022069","Type":"ContainerStarted","Data":"2844f9ebaef7e2ee4cf27c7eca2ffa2cc75a7b77b36fa186ed3101e513c1d233"} Sep 10 16:10:40.605958 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:40.605642 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" event={"ID":"64e9abcb-d155-4c39-baa7-3b6bf3022069","Type":"ContainerStarted","Data":"4185fb7a0a50a11ae21e5ed8b8b20d186b42c7e37aab62ba929ac6dbf75c4fca"} Sep 10 16:10:40.605958 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:40.605665 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" Sep 10 16:10:40.634619 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:40.634569 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" podStartSLOduration=1.634555163 podStartE2EDuration="1.634555163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:10:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:40.633344235 +0000 UTC m=+476.432732553" watchObservedRunningTime="2026-09-10 16:10:40.634555163 +0000 UTC m=+476.433943484" Sep 10 16:10:40.674261 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:40.674227 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c7dcab8-cae6-49b1-968d-de6025dacaa4" path="/var/lib/kubelet/pods/3c7dcab8-cae6-49b1-968d-de6025dacaa4/volumes" Sep 10 16:10:51.611579 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:51.611546 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qwjz5" Sep 10 16:10:51.672077 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:51.672045 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6"] Sep 10 16:10:51.672346 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:51.672300 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" podUID="4d7a5578-858d-46d4-8576-a5b4c9a08510" containerName="manager" containerID="cri-o://e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7" gracePeriod=10 Sep 10 16:10:51.912051 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:51.912024 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:51.991129 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:51.991094 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr6tl\" (UniqueName: \"kubernetes.io/projected/4d7a5578-858d-46d4-8576-a5b4c9a08510-kube-api-access-pr6tl\") pod \"4d7a5578-858d-46d4-8576-a5b4c9a08510\" (UID: \"4d7a5578-858d-46d4-8576-a5b4c9a08510\") " Sep 10 16:10:51.991129 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:51.991134 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d7a5578-858d-46d4-8576-a5b4c9a08510-extensions-socket-volume\") pod \"4d7a5578-858d-46d4-8576-a5b4c9a08510\" (UID: \"4d7a5578-858d-46d4-8576-a5b4c9a08510\") " Sep 10 16:10:51.991564 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:51.991543 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d7a5578-858d-46d4-8576-a5b4c9a08510-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4d7a5578-858d-46d4-8576-a5b4c9a08510" (UID: "4d7a5578-858d-46d4-8576-a5b4c9a08510"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:10:51.993148 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:51.993118 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d7a5578-858d-46d4-8576-a5b4c9a08510-kube-api-access-pr6tl" (OuterVolumeSpecName: "kube-api-access-pr6tl") pod "4d7a5578-858d-46d4-8576-a5b4c9a08510" (UID: "4d7a5578-858d-46d4-8576-a5b4c9a08510"). InnerVolumeSpecName "kube-api-access-pr6tl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:10:52.091910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:52.091879 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d7a5578-858d-46d4-8576-a5b4c9a08510-extensions-socket-volume\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:10:52.091910 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:52.091903 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr6tl\" (UniqueName: \"kubernetes.io/projected/4d7a5578-858d-46d4-8576-a5b4c9a08510-kube-api-access-pr6tl\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:10:52.661909 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:52.661876 2556 generic.go:356] "Generic (PLEG): container finished" podID="4d7a5578-858d-46d4-8576-a5b4c9a08510" containerID="e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7" exitCode=0 Sep 10 16:10:52.661909 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:52.661914 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" Sep 10 16:10:52.662346 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:52.661946 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" event={"ID":"4d7a5578-858d-46d4-8576-a5b4c9a08510","Type":"ContainerDied","Data":"e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7"} Sep 10 16:10:52.662346 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:52.661993 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6" event={"ID":"4d7a5578-858d-46d4-8576-a5b4c9a08510","Type":"ContainerDied","Data":"dd879e219316773a8e4f8f15d85b19b4d185c7f970cbe84710d809bf2c7a48ff"} Sep 10 16:10:52.662346 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:52.662014 2556 scope.go:117] "RemoveContainer" containerID="e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7" Sep 10 16:10:52.672237 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:52.672150 2556 scope.go:117] "RemoveContainer" containerID="e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7" Sep 10 16:10:52.672715 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:10:52.672687 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7\": container with ID starting with e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7 not found: ID does not exist" containerID="e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7" Sep 10 16:10:52.672806 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:52.672721 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7"} err="failed to get container status \"e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7\": rpc error: code = NotFound desc = could not find container \"e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7\": container with ID starting with e006ef12cd3a4e908de7cb81ccfbf448d8fb7181298f5c5c66fefbe0ab5247b7 not found: ID does not exist" Sep 10 16:10:52.684757 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:52.684735 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6"] Sep 10 16:10:52.689555 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:52.689535 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nq5t6"] Sep 10 16:10:54.674346 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:54.674302 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d7a5578-858d-46d4-8576-a5b4c9a08510" path="/var/lib/kubelet/pods/4d7a5578-858d-46d4-8576-a5b4c9a08510/volumes" Sep 10 16:10:55.275648 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.275615 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6"] Sep 10 16:10:55.276065 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.276051 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d7a5578-858d-46d4-8576-a5b4c9a08510" containerName="manager" Sep 10 16:10:55.276108 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.276069 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7a5578-858d-46d4-8576-a5b4c9a08510" containerName="manager" Sep 10 16:10:55.276145 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.276137 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d7a5578-858d-46d4-8576-a5b4c9a08510" containerName="manager" Sep 10 16:10:55.278937 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.278914 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.281896 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.281877 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hmm2x\"" Sep 10 16:10:55.296993 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.296969 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6"] Sep 10 16:10:55.316943 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.316915 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.317065 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.316957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jclg2\" (UniqueName: \"kubernetes.io/projected/a03b952c-88c7-4a86-8b67-a5de38d56066-kube-api-access-jclg2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.317124 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.317060 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.317124 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.317103 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.317224 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.317143 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.317224 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.317172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.317224 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.317200 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.317404 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.317275 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.317404 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.317346 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a03b952c-88c7-4a86-8b67-a5de38d56066-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.418115 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.418081 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.418115 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.418117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a03b952c-88c7-4a86-8b67-a5de38d56066-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.418381 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.418154 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.418381 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.418178 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jclg2\" (UniqueName: \"kubernetes.io/projected/a03b952c-88c7-4a86-8b67-a5de38d56066-kube-api-access-jclg2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.418381 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.418228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.418381 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.418356 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.418607 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.418405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.418607 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.418427 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.418607 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.418452 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.419214 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.419109 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.419387 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.419260 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a03b952c-88c7-4a86-8b67-a5de38d56066-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.419387 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.419326 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.419818 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.419631 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.423323 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.420084 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.424753 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.424728 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.429892 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.429857 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.430203 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.430181 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a03b952c-88c7-4a86-8b67-a5de38d56066-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.430826 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.430802 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jclg2\" (UniqueName: \"kubernetes.io/projected/a03b952c-88c7-4a86-8b67-a5de38d56066-kube-api-access-jclg2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-plkw6\" (UID: \"a03b952c-88c7-4a86-8b67-a5de38d56066\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.589036 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.588952 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:55.870478 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.870138 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6"] Sep 10 16:10:55.872723 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:10:55.872691 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03b952c_88c7_4a86_8b67_a5de38d56066.slice/crio-1a66d03408f55c8339c8e686480427d764c6a4b42eb4a599582aebc2cc52795e WatchSource:0}: Error finding container 1a66d03408f55c8339c8e686480427d764c6a4b42eb4a599582aebc2cc52795e: Status 404 returned error can't find the container with id 1a66d03408f55c8339c8e686480427d764c6a4b42eb4a599582aebc2cc52795e Sep 10 16:10:55.874934 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.874903 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 16:10:55.875024 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.874966 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 16:10:55.875024 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:55.874995 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 16:10:56.681982 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:56.681943 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" event={"ID":"a03b952c-88c7-4a86-8b67-a5de38d56066","Type":"ContainerStarted","Data":"afe424ae6f3dea879b4c985958abd4af26018b2fd2a68af50f287e368588f3b4"} Sep 10 16:10:56.682157 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:56.682002 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" event={"ID":"a03b952c-88c7-4a86-8b67-a5de38d56066","Type":"ContainerStarted","Data":"1a66d03408f55c8339c8e686480427d764c6a4b42eb4a599582aebc2cc52795e"} Sep 10 16:10:56.706392 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:56.706347 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" podStartSLOduration=1.706331378 podStartE2EDuration="1.706331378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:56.705111859 +0000 UTC m=+492.504500180" watchObservedRunningTime="2026-09-10 16:10:56.706331378 +0000 UTC m=+492.505719706" Sep 10 16:10:57.590031 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:57.589992 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:57.594497 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:57.594476 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:57.686321 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:57.686271 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:10:57.687050 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:10:57.687030 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:11:10.582586 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.582552 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6pvw8"] Sep 10 16:11:10.584941 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.584925 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:10.587417 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.587394 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 16:11:10.587529 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.587397 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j5jtb\"" Sep 10 16:11:10.601320 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.601273 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6pvw8"] Sep 10 16:11:10.641207 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.641170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdp2q\" (UniqueName: \"kubernetes.io/projected/ff194c72-674a-432a-b833-92d35822e058-kube-api-access-sdp2q\") pod \"limitador-limitador-8588749977-6pvw8\" (UID: \"ff194c72-674a-432a-b833-92d35822e058\") " pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:10.641207 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.641209 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff194c72-674a-432a-b833-92d35822e058-config-file\") pod \"limitador-limitador-8588749977-6pvw8\" (UID: \"ff194c72-674a-432a-b833-92d35822e058\") " pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:10.663622 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.663596 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6pvw8"] Sep 10 16:11:10.742350 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.742302 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdp2q\" (UniqueName: \"kubernetes.io/projected/ff194c72-674a-432a-b833-92d35822e058-kube-api-access-sdp2q\") pod \"limitador-limitador-8588749977-6pvw8\" (UID: \"ff194c72-674a-432a-b833-92d35822e058\") " pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:10.742521 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.742373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff194c72-674a-432a-b833-92d35822e058-config-file\") pod \"limitador-limitador-8588749977-6pvw8\" (UID: \"ff194c72-674a-432a-b833-92d35822e058\") " pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:10.743227 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.743203 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff194c72-674a-432a-b833-92d35822e058-config-file\") pod \"limitador-limitador-8588749977-6pvw8\" (UID: \"ff194c72-674a-432a-b833-92d35822e058\") " pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:10.752703 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.752671 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdp2q\" (UniqueName: \"kubernetes.io/projected/ff194c72-674a-432a-b833-92d35822e058-kube-api-access-sdp2q\") pod \"limitador-limitador-8588749977-6pvw8\" (UID: \"ff194c72-674a-432a-b833-92d35822e058\") " pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:10.897813 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:10.897730 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:11.183452 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:11.183381 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6pvw8"] Sep 10 16:11:11.188563 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:11:11.188526 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff194c72_674a_432a_b833_92d35822e058.slice/crio-bb9f5f8ff84336571280e846bc0d93d7fe432997710ca29817c585e0b8a4f59d WatchSource:0}: Error finding container bb9f5f8ff84336571280e846bc0d93d7fe432997710ca29817c585e0b8a4f59d: Status 404 returned error can't find the container with id bb9f5f8ff84336571280e846bc0d93d7fe432997710ca29817c585e0b8a4f59d Sep 10 16:11:11.743705 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:11.743659 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" event={"ID":"ff194c72-674a-432a-b833-92d35822e058","Type":"ContainerStarted","Data":"bb9f5f8ff84336571280e846bc0d93d7fe432997710ca29817c585e0b8a4f59d"} Sep 10 16:11:12.749565 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:12.749521 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" event={"ID":"ff194c72-674a-432a-b833-92d35822e058","Type":"ContainerStarted","Data":"62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315"} Sep 10 16:11:12.749956 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:12.749621 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:12.769793 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:12.769748 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" podStartSLOduration=1.526803753 podStartE2EDuration="2.769735333s" totalImagesPullingTime="1.24293158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:11:12.768894501 +0000 UTC m=+508.568282848" watchObservedRunningTime="2026-09-10 16:11:12.769735333 +0000 UTC m=+508.569123655" Sep 10 16:11:23.754820 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:23.754786 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:26.219258 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.219215 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6pvw8"] Sep 10 16:11:26.219696 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.219444 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" podUID="ff194c72-674a-432a-b833-92d35822e058" containerName="limitador" containerID="cri-o://62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315" gracePeriod=30 Sep 10 16:11:26.755034 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.755010 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:26.808122 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.808039 2556 generic.go:356] "Generic (PLEG): container finished" podID="ff194c72-674a-432a-b833-92d35822e058" containerID="62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315" exitCode=0 Sep 10 16:11:26.808122 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.808077 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" Sep 10 16:11:26.808122 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.808095 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" event={"ID":"ff194c72-674a-432a-b833-92d35822e058","Type":"ContainerDied","Data":"62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315"} Sep 10 16:11:26.808355 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.808146 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6pvw8" event={"ID":"ff194c72-674a-432a-b833-92d35822e058","Type":"ContainerDied","Data":"bb9f5f8ff84336571280e846bc0d93d7fe432997710ca29817c585e0b8a4f59d"} Sep 10 16:11:26.808355 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.808171 2556 scope.go:117] "RemoveContainer" containerID="62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315" Sep 10 16:11:26.816101 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.816082 2556 scope.go:117] "RemoveContainer" containerID="62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315" Sep 10 16:11:26.816388 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:11:26.816363 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315\": container with ID starting with 62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315 not found: ID does not exist" containerID="62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315" Sep 10 16:11:26.816495 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.816392 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315"} err="failed to get container status \"62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315\": rpc error: code = NotFound desc = could not find container \"62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315\": container with ID starting with 62e5771d16c848a25a9e04320495f68dca5b25eefaa4d73cbc2b26db2f98f315 not found: ID does not exist" Sep 10 16:11:26.880173 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.880150 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdp2q\" (UniqueName: \"kubernetes.io/projected/ff194c72-674a-432a-b833-92d35822e058-kube-api-access-sdp2q\") pod \"ff194c72-674a-432a-b833-92d35822e058\" (UID: \"ff194c72-674a-432a-b833-92d35822e058\") " Sep 10 16:11:26.880289 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.880183 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff194c72-674a-432a-b833-92d35822e058-config-file\") pod \"ff194c72-674a-432a-b833-92d35822e058\" (UID: \"ff194c72-674a-432a-b833-92d35822e058\") " Sep 10 16:11:26.880591 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.880563 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff194c72-674a-432a-b833-92d35822e058-config-file" (OuterVolumeSpecName: "config-file") pod "ff194c72-674a-432a-b833-92d35822e058" (UID: "ff194c72-674a-432a-b833-92d35822e058"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:11:26.882539 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.882503 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff194c72-674a-432a-b833-92d35822e058-kube-api-access-sdp2q" (OuterVolumeSpecName: "kube-api-access-sdp2q") pod "ff194c72-674a-432a-b833-92d35822e058" (UID: "ff194c72-674a-432a-b833-92d35822e058"). InnerVolumeSpecName "kube-api-access-sdp2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:11:26.981195 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.981166 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdp2q\" (UniqueName: \"kubernetes.io/projected/ff194c72-674a-432a-b833-92d35822e058-kube-api-access-sdp2q\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:11:26.981195 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:26.981193 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff194c72-674a-432a-b833-92d35822e058-config-file\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:11:27.130348 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:27.130304 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6pvw8"] Sep 10 16:11:27.134277 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:27.134254 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6pvw8"] Sep 10 16:11:28.675814 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:28.675778 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff194c72-674a-432a-b833-92d35822e058" path="/var/lib/kubelet/pods/ff194c72-674a-432a-b833-92d35822e058/volumes" Sep 10 16:11:29.779549 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.779510 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-49mmz"] Sep 10 16:11:29.779984 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.779813 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff194c72-674a-432a-b833-92d35822e058" containerName="limitador" Sep 10 16:11:29.779984 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.779825 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff194c72-674a-432a-b833-92d35822e058" containerName="limitador" Sep 10 16:11:29.779984 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.779907 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff194c72-674a-432a-b833-92d35822e058" containerName="limitador" Sep 10 16:11:29.784155 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.784135 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" Sep 10 16:11:29.786521 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.786498 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 16:11:29.786652 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.786544 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 10 16:11:29.786758 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.786738 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 10 16:11:29.787254 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.787237 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4hpc6\"" Sep 10 16:11:29.803288 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.803258 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-49mmz"] Sep 10 16:11:29.907615 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.907580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb6bq\" (UniqueName: \"kubernetes.io/projected/0b0bd93d-ba9c-4002-98aa-367ec9954592-kube-api-access-fb6bq\") pod \"postgres-69fb4594cf-49mmz\" (UID: \"0b0bd93d-ba9c-4002-98aa-367ec9954592\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" Sep 10 16:11:29.907775 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:29.907697 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b0bd93d-ba9c-4002-98aa-367ec9954592-data\") pod \"postgres-69fb4594cf-49mmz\" (UID: \"0b0bd93d-ba9c-4002-98aa-367ec9954592\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" Sep 10 16:11:30.008065 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:30.008035 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb6bq\" (UniqueName: \"kubernetes.io/projected/0b0bd93d-ba9c-4002-98aa-367ec9954592-kube-api-access-fb6bq\") pod \"postgres-69fb4594cf-49mmz\" (UID: \"0b0bd93d-ba9c-4002-98aa-367ec9954592\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" Sep 10 16:11:30.008211 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:30.008106 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b0bd93d-ba9c-4002-98aa-367ec9954592-data\") pod \"postgres-69fb4594cf-49mmz\" (UID: \"0b0bd93d-ba9c-4002-98aa-367ec9954592\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" Sep 10 16:11:30.008471 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:30.008452 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b0bd93d-ba9c-4002-98aa-367ec9954592-data\") pod \"postgres-69fb4594cf-49mmz\" (UID: \"0b0bd93d-ba9c-4002-98aa-367ec9954592\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" Sep 10 16:11:30.018091 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:30.018060 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb6bq\" (UniqueName: \"kubernetes.io/projected/0b0bd93d-ba9c-4002-98aa-367ec9954592-kube-api-access-fb6bq\") pod \"postgres-69fb4594cf-49mmz\" (UID: \"0b0bd93d-ba9c-4002-98aa-367ec9954592\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" Sep 10 16:11:30.094902 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:30.094825 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" Sep 10 16:11:30.372800 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:30.372727 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-49mmz"] Sep 10 16:11:30.375945 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:11:30.375917 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b0bd93d_ba9c_4002_98aa_367ec9954592.slice/crio-dd88c030810555c8eae9c6401fd09a06fb59b9ad69fe55e28d3dc03ff9f935c4 WatchSource:0}: Error finding container dd88c030810555c8eae9c6401fd09a06fb59b9ad69fe55e28d3dc03ff9f935c4: Status 404 returned error can't find the container with id dd88c030810555c8eae9c6401fd09a06fb59b9ad69fe55e28d3dc03ff9f935c4 Sep 10 16:11:30.827265 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:30.827227 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" event={"ID":"0b0bd93d-ba9c-4002-98aa-367ec9954592","Type":"ContainerStarted","Data":"dd88c030810555c8eae9c6401fd09a06fb59b9ad69fe55e28d3dc03ff9f935c4"} Sep 10 16:11:35.853671 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:35.853635 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" event={"ID":"0b0bd93d-ba9c-4002-98aa-367ec9954592","Type":"ContainerStarted","Data":"588803ea7a0669948c68ef6f05312b75dce44f2ba1f37eb291c4e33013f840cf"} Sep 10 16:11:35.854049 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:35.853737 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" Sep 10 16:11:35.875830 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:35.875780 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" podStartSLOduration=2.221168269 podStartE2EDuration="6.875767645s" totalImagesPullingTime="4.654599376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:11:35.875414423 +0000 UTC m=+531.674802763" watchObservedRunningTime="2026-09-10 16:11:35.875767645 +0000 UTC m=+531.675155994" Sep 10 16:11:41.885838 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:41.885810 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49mmz" Sep 10 16:11:49.690231 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.690196 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79fc44874f-2rfdx"] Sep 10 16:11:49.704339 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.704295 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:49.706975 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.706953 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 10 16:11:49.707679 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.707662 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 10 16:11:49.708055 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.708034 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vmthm\"" Sep 10 16:11:49.710972 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.710952 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 10 16:11:49.711569 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.711545 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79fc44874f-2rfdx"] Sep 10 16:11:49.768829 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.768788 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-metrics-certs\") pod \"maas-controller-79fc44874f-2rfdx\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:49.768992 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.768841 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert\") pod \"maas-controller-79fc44874f-2rfdx\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:49.768992 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.768882 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdc2t\" (UniqueName: \"kubernetes.io/projected/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-kube-api-access-jdc2t\") pod \"maas-controller-79fc44874f-2rfdx\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:49.869884 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.869851 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert\") pod \"maas-controller-79fc44874f-2rfdx\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:49.870051 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.869889 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdc2t\" (UniqueName: \"kubernetes.io/projected/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-kube-api-access-jdc2t\") pod \"maas-controller-79fc44874f-2rfdx\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:49.870051 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.869988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-metrics-certs\") pod \"maas-controller-79fc44874f-2rfdx\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:49.870051 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:11:49.870005 2556 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 16:11:49.870177 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:11:49.870072 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert podName:07ad4570-9ff1-4173-b7a7-8ab6c61df6ad nodeName:}" failed. No retries permitted until 2026-09-10 16:11:50.370052296 +0000 UTC m=+546.169440615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert") pod "maas-controller-79fc44874f-2rfdx" (UID: "07ad4570-9ff1-4173-b7a7-8ab6c61df6ad") : secret "maas-controller-webhook-cert" not found Sep 10 16:11:49.872479 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.872458 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-metrics-certs\") pod \"maas-controller-79fc44874f-2rfdx\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:49.881473 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.881447 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdc2t\" (UniqueName: \"kubernetes.io/projected/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-kube-api-access-jdc2t\") pod \"maas-controller-79fc44874f-2rfdx\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:49.927675 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.927641 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d4dc9b4c8-9gplw"] Sep 10 16:11:49.930160 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.930137 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:49.955538 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.955447 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4dc9b4c8-9gplw"] Sep 10 16:11:49.970637 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.970604 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-webhook-cert\") pod \"maas-controller-5d4dc9b4c8-9gplw\" (UID: \"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3\") " pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:49.970778 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.970682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjkl\" (UniqueName: \"kubernetes.io/projected/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-kube-api-access-hxjkl\") pod \"maas-controller-5d4dc9b4c8-9gplw\" (UID: \"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3\") " pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:49.970778 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:49.970736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-metrics-certs\") pod \"maas-controller-5d4dc9b4c8-9gplw\" (UID: \"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3\") " pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:50.071656 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:50.071614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjkl\" (UniqueName: \"kubernetes.io/projected/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-kube-api-access-hxjkl\") pod \"maas-controller-5d4dc9b4c8-9gplw\" (UID: \"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3\") " pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:50.071656 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:50.071661 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-metrics-certs\") pod \"maas-controller-5d4dc9b4c8-9gplw\" (UID: \"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3\") " pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:50.071893 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:50.071708 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-webhook-cert\") pod \"maas-controller-5d4dc9b4c8-9gplw\" (UID: \"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3\") " pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:50.071893 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:11:50.071811 2556 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 16:11:50.071893 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:11:50.071886 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-webhook-cert podName:5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3 nodeName:}" failed. No retries permitted until 2026-09-10 16:11:50.571866273 +0000 UTC m=+546.371254580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-webhook-cert") pod "maas-controller-5d4dc9b4c8-9gplw" (UID: "5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3") : secret "maas-controller-webhook-cert" not found Sep 10 16:11:50.074118 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:50.074087 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-metrics-certs\") pod \"maas-controller-5d4dc9b4c8-9gplw\" (UID: \"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3\") " pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:50.082501 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:50.082475 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjkl\" (UniqueName: \"kubernetes.io/projected/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-kube-api-access-hxjkl\") pod \"maas-controller-5d4dc9b4c8-9gplw\" (UID: \"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3\") " pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:50.374962 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:50.374934 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert\") pod \"maas-controller-79fc44874f-2rfdx\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:50.375127 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:11:50.375075 2556 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 16:11:50.375169 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:11:50.375142 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert podName:07ad4570-9ff1-4173-b7a7-8ab6c61df6ad nodeName:}" failed. No retries permitted until 2026-09-10 16:11:51.375125025 +0000 UTC m=+547.174513335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert") pod "maas-controller-79fc44874f-2rfdx" (UID: "07ad4570-9ff1-4173-b7a7-8ab6c61df6ad") : secret "maas-controller-webhook-cert" not found Sep 10 16:11:50.576492 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:50.576456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-webhook-cert\") pod \"maas-controller-5d4dc9b4c8-9gplw\" (UID: \"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3\") " pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:50.578854 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:50.578831 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3-webhook-cert\") pod \"maas-controller-5d4dc9b4c8-9gplw\" (UID: \"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3\") " pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:50.840809 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:50.840778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:51.115602 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:51.115518 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4dc9b4c8-9gplw"] Sep 10 16:11:51.118202 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:11:51.118171 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8f8f2a_1d30_4f98_a35e_7ed9a30223f3.slice/crio-9d7491a2eb7cfb60db0a0a4198fb58b60fc994d02708fc9b6ad2f51ad3bb2ed9 WatchSource:0}: Error finding container 9d7491a2eb7cfb60db0a0a4198fb58b60fc994d02708fc9b6ad2f51ad3bb2ed9: Status 404 returned error can't find the container with id 9d7491a2eb7cfb60db0a0a4198fb58b60fc994d02708fc9b6ad2f51ad3bb2ed9 Sep 10 16:11:51.383610 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:51.383529 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert\") pod \"maas-controller-79fc44874f-2rfdx\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:51.385905 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:51.385876 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert\") pod \"maas-controller-79fc44874f-2rfdx\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:51.515408 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:51.515377 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:51.793817 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:51.793774 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79fc44874f-2rfdx"] Sep 10 16:11:51.799998 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:11:51.799966 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ad4570_9ff1_4173_b7a7_8ab6c61df6ad.slice/crio-c0cf7c15bd9c431183e7e93b89f01b3f7a8e9a579e4d5a4960097520493a4acb WatchSource:0}: Error finding container c0cf7c15bd9c431183e7e93b89f01b3f7a8e9a579e4d5a4960097520493a4acb: Status 404 returned error can't find the container with id c0cf7c15bd9c431183e7e93b89f01b3f7a8e9a579e4d5a4960097520493a4acb Sep 10 16:11:51.924975 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:51.924888 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fc44874f-2rfdx" event={"ID":"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad","Type":"ContainerStarted","Data":"c0cf7c15bd9c431183e7e93b89f01b3f7a8e9a579e4d5a4960097520493a4acb"} Sep 10 16:11:51.926684 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:51.926649 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" event={"ID":"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3","Type":"ContainerStarted","Data":"9d7491a2eb7cfb60db0a0a4198fb58b60fc994d02708fc9b6ad2f51ad3bb2ed9"} Sep 10 16:11:53.937084 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:53.937041 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fc44874f-2rfdx" event={"ID":"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad","Type":"ContainerStarted","Data":"912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909"} Sep 10 16:11:53.937518 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:53.937203 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:11:53.938609 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:53.938591 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" event={"ID":"5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3","Type":"ContainerStarted","Data":"ee5e43993dadb572fe2a3df27475766cfbc713e7dbc20c2a5e2e12eb9778da3c"} Sep 10 16:11:53.938681 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:53.938662 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:11:53.959656 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:53.959613 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79fc44874f-2rfdx" podStartSLOduration=2.927322249 podStartE2EDuration="4.959600972s" totalImagesPullingTime="2.032278723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:11:53.95645678 +0000 UTC m=+549.755845104" watchObservedRunningTime="2026-09-10 16:11:53.959600972 +0000 UTC m=+549.758989293" Sep 10 16:11:53.996677 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:11:53.996636 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" podStartSLOduration=2.292016863 podStartE2EDuration="4.996620133s" totalImagesPullingTime="2.70460327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:11:53.994899699 +0000 UTC m=+549.794288020" watchObservedRunningTime="2026-09-10 16:11:53.996620133 +0000 UTC m=+549.796008455" Sep 10 16:12:04.947020 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:04.946981 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:12:04.947580 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:04.947062 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d4dc9b4c8-9gplw" Sep 10 16:12:05.017498 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.017465 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79fc44874f-2rfdx"] Sep 10 16:12:05.017688 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.017632 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-79fc44874f-2rfdx" podUID="07ad4570-9ff1-4173-b7a7-8ab6c61df6ad" containerName="manager" containerID="cri-o://912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909" gracePeriod=30 Sep 10 16:12:05.261283 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.261256 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:12:05.402554 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.402518 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert\") pod \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " Sep 10 16:12:05.402724 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.402573 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-metrics-certs\") pod \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " Sep 10 16:12:05.402724 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.402619 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdc2t\" (UniqueName: \"kubernetes.io/projected/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-kube-api-access-jdc2t\") pod \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\" (UID: \"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad\") " Sep 10 16:12:05.404877 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.404844 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "07ad4570-9ff1-4173-b7a7-8ab6c61df6ad" (UID: "07ad4570-9ff1-4173-b7a7-8ab6c61df6ad"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:12:05.404986 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.404884 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "07ad4570-9ff1-4173-b7a7-8ab6c61df6ad" (UID: "07ad4570-9ff1-4173-b7a7-8ab6c61df6ad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:12:05.404986 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.404898 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-kube-api-access-jdc2t" (OuterVolumeSpecName: "kube-api-access-jdc2t") pod "07ad4570-9ff1-4173-b7a7-8ab6c61df6ad" (UID: "07ad4570-9ff1-4173-b7a7-8ab6c61df6ad"). InnerVolumeSpecName "kube-api-access-jdc2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:12:05.503608 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.503539 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdc2t\" (UniqueName: \"kubernetes.io/projected/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-kube-api-access-jdc2t\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:12:05.503608 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.503564 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-webhook-cert\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:12:05.503608 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.503573 2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad-metrics-certs\") on node \"ip-10-0-135-80.ec2.internal\" DevicePath \"\"" Sep 10 16:12:05.992899 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.992867 2556 generic.go:356] "Generic (PLEG): container finished" podID="07ad4570-9ff1-4173-b7a7-8ab6c61df6ad" containerID="912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909" exitCode=0 Sep 10 16:12:05.993345 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.992924 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fc44874f-2rfdx" Sep 10 16:12:05.993345 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.992954 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fc44874f-2rfdx" event={"ID":"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad","Type":"ContainerDied","Data":"912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909"} Sep 10 16:12:05.993345 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.993010 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fc44874f-2rfdx" event={"ID":"07ad4570-9ff1-4173-b7a7-8ab6c61df6ad","Type":"ContainerDied","Data":"c0cf7c15bd9c431183e7e93b89f01b3f7a8e9a579e4d5a4960097520493a4acb"} Sep 10 16:12:05.993345 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:05.993034 2556 scope.go:117] "RemoveContainer" containerID="912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909" Sep 10 16:12:06.001904 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:06.001890 2556 scope.go:117] "RemoveContainer" containerID="912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909" Sep 10 16:12:06.002161 ip-10-0-135-80 kubenswrapper[2556]: E0910 16:12:06.002141 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909\": container with ID starting with 912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909 not found: ID does not exist" containerID="912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909" Sep 10 16:12:06.002223 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:06.002167 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909"} err="failed to get container status \"912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909\": rpc error: code = NotFound desc = could not find container \"912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909\": container with ID starting with 912e85f2c81aeee0eff5cc8fa98f450ccac481c860bc2dd6735a95ebf81d6909 not found: ID does not exist" Sep 10 16:12:06.016203 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:06.016179 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79fc44874f-2rfdx"] Sep 10 16:12:06.024230 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:06.024210 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79fc44874f-2rfdx"] Sep 10 16:12:06.674708 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:06.674673 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07ad4570-9ff1-4173-b7a7-8ab6c61df6ad" path="/var/lib/kubelet/pods/07ad4570-9ff1-4173-b7a7-8ab6c61df6ad/volumes" Sep 10 16:12:29.083635 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.083597 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b958dd778-9d42b"] Sep 10 16:12:29.084006 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.083920 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ad4570-9ff1-4173-b7a7-8ab6c61df6ad" containerName="manager" Sep 10 16:12:29.084006 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.083932 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ad4570-9ff1-4173-b7a7-8ab6c61df6ad" containerName="manager" Sep 10 16:12:29.084006 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.084005 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="07ad4570-9ff1-4173-b7a7-8ab6c61df6ad" containerName="manager" Sep 10 16:12:29.088322 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.088288 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.091030 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.091007 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 10 16:12:29.091030 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.091024 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9j8tz\"" Sep 10 16:12:29.091193 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.091042 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 10 16:12:29.105202 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.105179 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b958dd778-9d42b"] Sep 10 16:12:29.198787 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.198757 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q96vw\" (UniqueName: \"kubernetes.io/projected/cc09cf37-3789-40b6-9dc7-c9b1aa093248-kube-api-access-q96vw\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.198958 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.198796 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc09cf37-3789-40b6-9dc7-c9b1aa093248-openshift-service-ca\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.198958 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.198829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc09cf37-3789-40b6-9dc7-c9b1aa093248-metrics-certs\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.198958 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.198894 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc09cf37-3789-40b6-9dc7-c9b1aa093248-maas-api-tls\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.300027 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.299992 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q96vw\" (UniqueName: \"kubernetes.io/projected/cc09cf37-3789-40b6-9dc7-c9b1aa093248-kube-api-access-q96vw\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.300027 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.300030 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc09cf37-3789-40b6-9dc7-c9b1aa093248-openshift-service-ca\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.300231 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.300054 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc09cf37-3789-40b6-9dc7-c9b1aa093248-metrics-certs\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.300231 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.300089 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc09cf37-3789-40b6-9dc7-c9b1aa093248-maas-api-tls\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.300817 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.300789 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc09cf37-3789-40b6-9dc7-c9b1aa093248-openshift-service-ca\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.302558 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.302526 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc09cf37-3789-40b6-9dc7-c9b1aa093248-maas-api-tls\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.302645 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.302576 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc09cf37-3789-40b6-9dc7-c9b1aa093248-metrics-certs\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.308226 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.308205 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q96vw\" (UniqueName: \"kubernetes.io/projected/cc09cf37-3789-40b6-9dc7-c9b1aa093248-kube-api-access-q96vw\") pod \"maas-api-6b958dd778-9d42b\" (UID: \"cc09cf37-3789-40b6-9dc7-c9b1aa093248\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.400692 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.400627 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:29.611956 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.611917 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wsq8m"] Sep 10 16:12:29.615137 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.615121 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" Sep 10 16:12:29.618058 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.618035 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 16:12:29.618197 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.618133 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jn2d7\"" Sep 10 16:12:29.630896 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.630874 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wsq8m"] Sep 10 16:12:29.680048 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.680023 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b958dd778-9d42b"] Sep 10 16:12:29.682128 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:12:29.682096 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc09cf37_3789_40b6_9dc7_c9b1aa093248.slice/crio-d7546a96f6b750efb7b0cf7716aeb58962a50a6d3b027a5c88bdc6ffe207c149 WatchSource:0}: Error finding container d7546a96f6b750efb7b0cf7716aeb58962a50a6d3b027a5c88bdc6ffe207c149: Status 404 returned error can't find the container with id d7546a96f6b750efb7b0cf7716aeb58962a50a6d3b027a5c88bdc6ffe207c149 Sep 10 16:12:29.703028 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.703005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q2hk\" (UniqueName: \"kubernetes.io/projected/7736e29d-d5bb-411d-9b38-52775e16f935-kube-api-access-8q2hk\") pod \"payload-processing-5b54b7fbb7-wsq8m\" (UID: \"7736e29d-d5bb-411d-9b38-52775e16f935\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" Sep 10 16:12:29.703133 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.703062 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7736e29d-d5bb-411d-9b38-52775e16f935-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wsq8m\" (UID: \"7736e29d-d5bb-411d-9b38-52775e16f935\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" Sep 10 16:12:29.804384 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.804347 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q2hk\" (UniqueName: \"kubernetes.io/projected/7736e29d-d5bb-411d-9b38-52775e16f935-kube-api-access-8q2hk\") pod \"payload-processing-5b54b7fbb7-wsq8m\" (UID: \"7736e29d-d5bb-411d-9b38-52775e16f935\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" Sep 10 16:12:29.804555 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.804402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7736e29d-d5bb-411d-9b38-52775e16f935-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wsq8m\" (UID: \"7736e29d-d5bb-411d-9b38-52775e16f935\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" Sep 10 16:12:29.805129 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.805108 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7736e29d-d5bb-411d-9b38-52775e16f935-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wsq8m\" (UID: \"7736e29d-d5bb-411d-9b38-52775e16f935\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" Sep 10 16:12:29.814159 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.814134 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q2hk\" (UniqueName: \"kubernetes.io/projected/7736e29d-d5bb-411d-9b38-52775e16f935-kube-api-access-8q2hk\") pod \"payload-processing-5b54b7fbb7-wsq8m\" (UID: \"7736e29d-d5bb-411d-9b38-52775e16f935\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" Sep 10 16:12:29.925134 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:29.925100 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" Sep 10 16:12:30.094901 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:30.094865 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" event={"ID":"cc09cf37-3789-40b6-9dc7-c9b1aa093248","Type":"ContainerStarted","Data":"d7546a96f6b750efb7b0cf7716aeb58962a50a6d3b027a5c88bdc6ffe207c149"} Sep 10 16:12:30.197122 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:30.197096 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wsq8m"] Sep 10 16:12:30.199164 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:12:30.199143 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7736e29d_d5bb_411d_9b38_52775e16f935.slice/crio-0d199bb50dd8d1f357ed937b18e10cc908ad2379acacf21a617abd1d1a902c6b WatchSource:0}: Error finding container 0d199bb50dd8d1f357ed937b18e10cc908ad2379acacf21a617abd1d1a902c6b: Status 404 returned error can't find the container with id 0d199bb50dd8d1f357ed937b18e10cc908ad2379acacf21a617abd1d1a902c6b Sep 10 16:12:31.104388 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:31.104298 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" event={"ID":"7736e29d-d5bb-411d-9b38-52775e16f935","Type":"ContainerStarted","Data":"0d199bb50dd8d1f357ed937b18e10cc908ad2379acacf21a617abd1d1a902c6b"} Sep 10 16:12:32.114266 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:32.114223 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" event={"ID":"cc09cf37-3789-40b6-9dc7-c9b1aa093248","Type":"ContainerStarted","Data":"d0ae68ec53de8802b9c8bc3360eb2034905d7d1632577eeb2ad0115456ad4fe9"} Sep 10 16:12:32.114666 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:32.114542 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:32.156334 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:32.140773 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" podStartSLOduration=0.855944448 podStartE2EDuration="3.140752481s" totalImagesPullingTime="2.284808033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:12:32.138032328 +0000 UTC m=+587.937420675" watchObservedRunningTime="2026-09-10 16:12:32.140752481 +0000 UTC m=+587.940140821" Sep 10 16:12:33.120553 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:33.120513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" event={"ID":"7736e29d-d5bb-411d-9b38-52775e16f935","Type":"ContainerStarted","Data":"f62ff373e1d1740808d85766ab6b99c01fb9fa77d43837eeedaa71aa4d61ce40"} Sep 10 16:12:33.121030 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:33.120655 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" Sep 10 16:12:33.137757 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:33.137702 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" podStartSLOduration=1.820123012 podStartE2EDuration="4.137682714s" totalImagesPullingTime="2.317559702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:12:33.136699715 +0000 UTC m=+588.936088037" watchObservedRunningTime="2026-09-10 16:12:33.137682714 +0000 UTC m=+588.937071037" Sep 10 16:12:38.125748 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:38.125718 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b958dd778-9d42b" Sep 10 16:12:39.150982 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:39.150945 2556 generic.go:356] "Generic (PLEG): container finished" podID="a03b952c-88c7-4a86-8b67-a5de38d56066" containerID="afe424ae6f3dea879b4c985958abd4af26018b2fd2a68af50f287e368588f3b4" exitCode=0 Sep 10 16:12:39.151545 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:39.151021 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" event={"ID":"a03b952c-88c7-4a86-8b67-a5de38d56066","Type":"ContainerDied","Data":"afe424ae6f3dea879b4c985958abd4af26018b2fd2a68af50f287e368588f3b4"} Sep 10 16:12:39.151613 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:39.151556 2556 scope.go:117] "RemoveContainer" containerID="afe424ae6f3dea879b4c985958abd4af26018b2fd2a68af50f287e368588f3b4" Sep 10 16:12:39.152739 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:39.152709 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 16:12:39.152844 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:39.152773 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 16:12:39.152844 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:39.152807 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 16:12:40.163723 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:40.163680 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" event={"ID":"a03b952c-88c7-4a86-8b67-a5de38d56066","Type":"ContainerStarted","Data":"8daeb2e41da2c7bd0e0be2b36e54c6fc8454a23589b07d083842d6b09ceaa864"} Sep 10 16:12:40.590006 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:40.589966 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:12:40.591209 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:40.591183 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-plkw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Sep 10 16:12:40.591273 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:40.591234 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" podUID="a03b952c-88c7-4a86-8b67-a5de38d56066" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Sep 10 16:12:41.589752 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:41.589710 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-plkw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Sep 10 16:12:41.590142 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:41.589769 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" podUID="a03b952c-88c7-4a86-8b67-a5de38d56066" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Sep 10 16:12:42.589469 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:42.589432 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-plkw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Sep 10 16:12:42.589643 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:42.589490 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" podUID="a03b952c-88c7-4a86-8b67-a5de38d56066" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Sep 10 16:12:42.686860 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:42.686827 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:12:43.589512 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:43.589474 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-plkw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Sep 10 16:12:43.589684 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:43.589528 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" podUID="a03b952c-88c7-4a86-8b67-a5de38d56066" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Sep 10 16:12:44.126364 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:44.126329 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-wsq8m" Sep 10 16:12:44.590037 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:44.589999 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-plkw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Sep 10 16:12:44.590217 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:44.590061 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" podUID="a03b952c-88c7-4a86-8b67-a5de38d56066" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Sep 10 16:12:45.769866 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:45.769831 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:12:45.771120 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:12:45.771097 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-plkw6" Sep 10 16:13:22.332869 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.332780 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz"] Sep 10 16:13:22.336263 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.336242 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.339156 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.339116 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 16:13:22.339285 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.339211 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kf6s8\"" Sep 10 16:13:22.339285 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.339249 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 16:13:22.339431 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.339351 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 10 16:13:22.345582 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.345563 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz"] Sep 10 16:13:22.481984 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.481948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.482134 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.481992 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.482134 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.482081 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.482134 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.482121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb4mh\" (UniqueName: \"kubernetes.io/projected/b8f8efa9-6722-4329-917e-0d0334e50860-kube-api-access-hb4mh\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.482273 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.482159 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8f8efa9-6722-4329-917e-0d0334e50860-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.482273 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.482182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.583700 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.583624 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.583700 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.583664 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.583700 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.583682 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb4mh\" (UniqueName: \"kubernetes.io/projected/b8f8efa9-6722-4329-917e-0d0334e50860-kube-api-access-hb4mh\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.583937 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.583713 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8f8efa9-6722-4329-917e-0d0334e50860-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.583937 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.583738 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.583937 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.583831 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.584086 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.584039 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.584086 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.584073 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.584194 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.584111 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.586009 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.585987 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8f8efa9-6722-4329-917e-0d0334e50860-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.586258 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.586241 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8f8efa9-6722-4329-917e-0d0334e50860-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.592939 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.592918 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb4mh\" (UniqueName: \"kubernetes.io/projected/b8f8efa9-6722-4329-917e-0d0334e50860-kube-api-access-hb4mh\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz\" (UID: \"b8f8efa9-6722-4329-917e-0d0334e50860\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.646582 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.646554 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:22.917952 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.917926 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz"] Sep 10 16:13:22.920459 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:13:22.920430 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f8efa9_6722_4329_917e_0d0334e50860.slice/crio-7570ad9743f6fcdd376b10c3ccec3fb39725fe2afd0439f26283d4e60eb6c9ac WatchSource:0}: Error finding container 7570ad9743f6fcdd376b10c3ccec3fb39725fe2afd0439f26283d4e60eb6c9ac: Status 404 returned error can't find the container with id 7570ad9743f6fcdd376b10c3ccec3fb39725fe2afd0439f26283d4e60eb6c9ac Sep 10 16:13:22.921677 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:22.921659 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 16:13:23.361951 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:23.361916 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" event={"ID":"b8f8efa9-6722-4329-917e-0d0334e50860","Type":"ContainerStarted","Data":"7570ad9743f6fcdd376b10c3ccec3fb39725fe2afd0439f26283d4e60eb6c9ac"} Sep 10 16:13:24.369057 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:24.369016 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" event={"ID":"b8f8efa9-6722-4329-917e-0d0334e50860","Type":"ContainerStarted","Data":"96393cdd4af6a18e80457ad9c86b96d15dbf4b8066f8877447d9ecc6d68ca0db"} Sep 10 16:13:24.386284 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:24.386213 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" podStartSLOduration=1.392879848 podStartE2EDuration="2.386191539s" totalImagesPullingTime="993.311691ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:13:24.385048565 +0000 UTC m=+640.184436887" watchObservedRunningTime="2026-09-10 16:13:24.386191539 +0000 UTC m=+640.185579862" Sep 10 16:13:32.647452 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:32.647411 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:32.647930 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:32.647501 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:32.659797 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:32.659771 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:13:33.421521 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:13:33.421491 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz" Sep 10 16:17:49.423661 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:49.423631 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d4dc9b4c8-9gplw_5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3/manager/0.log" Sep 10 16:17:49.534223 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:49.534195 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tr9p2_703c0e7f-1029-4511-978e-c676c7d1d1bb/server/0.log" Sep 10 16:17:49.658595 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:49.658542 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ccb5l_210470c3-d3c4-47ec-9800-478e43e12e5e/manager/0.log" Sep 10 16:17:50.025349 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:50.025293 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-qws7n_8d1ce0f9-72d1-40fc-bd4e-e152876c88ed/copy-manifests/0.log" Sep 10 16:17:50.032364 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:50.032339 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-qws7n_8d1ce0f9-72d1-40fc-bd4e-e152876c88ed/manager/0.log" Sep 10 16:17:50.391962 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:50.391892 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b958dd778-9d42b_cc09cf37-3789-40b6-9dc7-c9b1aa093248/maas-api/0.log" Sep 10 16:17:50.610064 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:50.610036 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-49mmz_0b0bd93d-ba9c-4002-98aa-367ec9954592/postgres/0.log" Sep 10 16:17:51.886828 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:51.886796 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-qwjz5_64e9abcb-d155-4c39-baa7-3b6bf3022069/manager/0.log" Sep 10 16:17:52.490393 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:52.490359 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h_77464713-70bf-4c4e-a25d-0f2778a70a12/istio-proxy/0.log" Sep 10 16:17:52.619366 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:52.619331 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gv4bj_ed5582be-e38d-46ca-8de9-7e85bdcb6305/discovery/0.log" Sep 10 16:17:52.861021 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:52.860942 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5468b79cc4-7rnsb_697c0074-3d43-4e8d-b054-392f1ff5e2ec/kube-auth-proxy/0.log" Sep 10 16:17:52.982824 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:52.982793 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-plkw6_a03b952c-88c7-4a86-8b67-a5de38d56066/istio-proxy/1.log" Sep 10 16:17:53.209407 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:53.209329 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wsq8m_7736e29d-d5bb-411d-9b38-52775e16f935/payload-processing/0.log" Sep 10 16:17:53.916478 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:17:53.916450 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-7vczz_b8f8efa9-6722-4329-917e-0d0334e50860/main/0.log" Sep 10 16:18:03.010602 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:03.010566 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wd54m_d651ea1e-c120-4cdc-8d53-b2c3014cb09f/global-pull-secret-syncer/0.log" Sep 10 16:18:03.160406 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:03.160375 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cxhhn_16abdb67-53a9-4a09-a6b8-7ca139d5555b/konnectivity-agent/0.log" Sep 10 16:18:03.242827 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:03.242800 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-80.ec2.internal_d2e82bddfbf53f2d90204713bbd4554d/haproxy/0.log" Sep 10 16:18:07.796408 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:07.796380 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-qwjz5_64e9abcb-d155-4c39-baa7-3b6bf3022069/manager/0.log" Sep 10 16:18:09.812402 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:09.812377 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8hfx_f5c9385b-d679-4983-81a9-47c30ca80af5/node-exporter/0.log" Sep 10 16:18:09.828774 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:09.828749 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8hfx_f5c9385b-d679-4983-81a9-47c30ca80af5/kube-rbac-proxy/0.log" Sep 10 16:18:09.847339 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:09.847300 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8hfx_f5c9385b-d679-4983-81a9-47c30ca80af5/init-textfile/0.log" Sep 10 16:18:13.219241 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.219203 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz"] Sep 10 16:18:13.222509 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.222488 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.224703 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.224682 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfcr8\"/\"kube-root-ca.crt\"" Sep 10 16:18:13.225292 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.225270 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfcr8\"/\"openshift-service-ca.crt\"" Sep 10 16:18:13.225405 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.225330 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lfcr8\"/\"default-dockercfg-c9bm4\"" Sep 10 16:18:13.231201 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.231180 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz"] Sep 10 16:18:13.306810 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.306784 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-sys\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.306971 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.306820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9fwn\" (UniqueName: \"kubernetes.io/projected/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-kube-api-access-x9fwn\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.306971 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.306847 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-proc\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.306971 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.306902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-podres\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.307088 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.306991 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-lib-modules\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.407656 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.407626 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9fwn\" (UniqueName: \"kubernetes.io/projected/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-kube-api-access-x9fwn\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.407784 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.407666 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-proc\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.407784 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.407681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-podres\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.407784 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.407758 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-proc\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.407885 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.407790 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-podres\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.407885 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.407798 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-lib-modules\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.407885 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.407857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-sys\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.407975 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.407928 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-sys\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.407975 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.407937 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-lib-modules\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.415499 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.415480 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9fwn\" (UniqueName: \"kubernetes.io/projected/90576e7a-4d4d-47f4-9402-d3d7ad158ec6-kube-api-access-x9fwn\") pod \"perf-node-gather-daemonset-hfxhz\" (UID: \"90576e7a-4d4d-47f4-9402-d3d7ad158ec6\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.533195 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.533166 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:13.805438 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:13.805364 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz"] Sep 10 16:18:13.808664 ip-10-0-135-80 kubenswrapper[2556]: W0910 16:18:13.808635 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod90576e7a_4d4d_47f4_9402_d3d7ad158ec6.slice/crio-418645c6660f3d3318dec867c828cdb5baf235c3e2fdd0eecec5c9d0aeec522e WatchSource:0}: Error finding container 418645c6660f3d3318dec867c828cdb5baf235c3e2fdd0eecec5c9d0aeec522e: Status 404 returned error can't find the container with id 418645c6660f3d3318dec867c828cdb5baf235c3e2fdd0eecec5c9d0aeec522e Sep 10 16:18:14.638328 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:14.638266 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" event={"ID":"90576e7a-4d4d-47f4-9402-d3d7ad158ec6","Type":"ContainerStarted","Data":"6d0626b2805a4fd54e6bcb2c8eac92dd249592ecf5673f48002d1cb9ac19c14b"} Sep 10 16:18:14.638742 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:14.638354 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" event={"ID":"90576e7a-4d4d-47f4-9402-d3d7ad158ec6","Type":"ContainerStarted","Data":"418645c6660f3d3318dec867c828cdb5baf235c3e2fdd0eecec5c9d0aeec522e"} Sep 10 16:18:14.638742 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:14.638383 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:14.655974 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:14.655926 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" podStartSLOduration=1.655910706 podStartE2EDuration="1.655910706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:18:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:18:14.654186486 +0000 UTC m=+930.453574808" watchObservedRunningTime="2026-09-10 16:18:14.655910706 +0000 UTC m=+930.455299027" Sep 10 16:18:14.979355 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:14.979255 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t92md_05e2242e-492b-4358-8d86-e14a214ba5a0/dns/0.log" Sep 10 16:18:14.997449 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:14.997428 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t92md_05e2242e-492b-4358-8d86-e14a214ba5a0/kube-rbac-proxy/0.log" Sep 10 16:18:15.116325 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:15.116289 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w765k_16470165-f773-4358-9757-6070c156d07e/dns-node-resolver/0.log" Sep 10 16:18:15.679533 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:15.679503 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lwff8_216c8761-0aa5-4127-9c0e-ea65047bdefb/node-ca/0.log" Sep 10 16:18:16.589060 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:16.589023 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h_77464713-70bf-4c4e-a25d-0f2778a70a12/istio-proxy/0.log" Sep 10 16:18:16.652001 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:16.651967 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gv4bj_ed5582be-e38d-46ca-8de9-7e85bdcb6305/discovery/0.log" Sep 10 16:18:16.693995 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:16.693965 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5468b79cc4-7rnsb_697c0074-3d43-4e8d-b054-392f1ff5e2ec/kube-auth-proxy/0.log" Sep 10 16:18:16.720639 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:16.720616 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-plkw6_a03b952c-88c7-4a86-8b67-a5de38d56066/istio-proxy/1.log" Sep 10 16:18:16.721502 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:16.721467 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-plkw6_a03b952c-88c7-4a86-8b67-a5de38d56066/istio-proxy/0.log" Sep 10 16:18:16.769565 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:16.769543 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wsq8m_7736e29d-d5bb-411d-9b38-52775e16f935/payload-processing/0.log" Sep 10 16:18:17.517116 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:17.517070 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tdbnf_ac0843a0-3970-488d-bff6-a0a66d7bddb3/serve-healthcheck-canary/0.log" Sep 10 16:18:17.988037 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:17.987998 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-skhvl_e3e8743a-479c-4888-b402-d6aeb605871a/insights-operator/0.log" Sep 10 16:18:17.988444 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:17.988045 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-skhvl_e3e8743a-479c-4888-b402-d6aeb605871a/insights-operator/1.log" Sep 10 16:18:18.099690 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:18.099658 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pzp6b_0b1d85c8-461a-4bf3-a076-e40679ceffd2/kube-rbac-proxy/0.log" Sep 10 16:18:18.119583 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:18.119553 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pzp6b_0b1d85c8-461a-4bf3-a076-e40679ceffd2/exporter/0.log" Sep 10 16:18:18.168006 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:18.167981 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pzp6b_0b1d85c8-461a-4bf3-a076-e40679ceffd2/extractor/0.log" Sep 10 16:18:20.606274 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:20.606241 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d4dc9b4c8-9gplw_5d8f8f2a-1d30-4f98-a35e-7ed9a30223f3/manager/0.log" Sep 10 16:18:20.625534 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:20.625507 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tr9p2_703c0e7f-1029-4511-978e-c676c7d1d1bb/server/0.log" Sep 10 16:18:20.652973 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:20.652922 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-hfxhz" Sep 10 16:18:20.697323 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:20.697292 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ccb5l_210470c3-d3c4-47ec-9800-478e43e12e5e/manager/0.log" Sep 10 16:18:20.868366 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:20.868269 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-qws7n_8d1ce0f9-72d1-40fc-bd4e-e152876c88ed/manager/0.log" Sep 10 16:18:20.887125 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:20.887100 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-qws7n_8d1ce0f9-72d1-40fc-bd4e-e152876c88ed/copy-manifests/0.log" Sep 10 16:18:23.962085 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:23.962053 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h_77464713-70bf-4c4e-a25d-0f2778a70a12/istio-proxy/0.log" Sep 10 16:18:24.015143 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:24.015104 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gv4bj_ed5582be-e38d-46ca-8de9-7e85bdcb6305/discovery/0.log" Sep 10 16:18:24.044534 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:24.044511 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5468b79cc4-7rnsb_697c0074-3d43-4e8d-b054-392f1ff5e2ec/kube-auth-proxy/0.log" Sep 10 16:18:24.063460 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:24.063438 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-plkw6_a03b952c-88c7-4a86-8b67-a5de38d56066/istio-proxy/1.log" Sep 10 16:18:24.064204 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:24.064171 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-plkw6_a03b952c-88c7-4a86-8b67-a5de38d56066/istio-proxy/0.log" Sep 10 16:18:24.090896 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:24.090872 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wsq8m_7736e29d-d5bb-411d-9b38-52775e16f935/payload-processing/0.log" Sep 10 16:18:25.298270 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:25.298226 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qht9h_77464713-70bf-4c4e-a25d-0f2778a70a12/istio-proxy/0.log" Sep 10 16:18:25.355505 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:25.355474 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gv4bj_ed5582be-e38d-46ca-8de9-7e85bdcb6305/discovery/0.log" Sep 10 16:18:25.388130 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:25.388095 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5468b79cc4-7rnsb_697c0074-3d43-4e8d-b054-392f1ff5e2ec/kube-auth-proxy/0.log" Sep 10 16:18:25.413647 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:25.413624 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-plkw6_a03b952c-88c7-4a86-8b67-a5de38d56066/istio-proxy/1.log" Sep 10 16:18:25.414418 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:25.414395 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-plkw6_a03b952c-88c7-4a86-8b67-a5de38d56066/istio-proxy/0.log" Sep 10 16:18:25.441954 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:25.441929 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wsq8m_7736e29d-d5bb-411d-9b38-52775e16f935/payload-processing/0.log" Sep 10 16:18:27.322614 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:27.322586 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-zgpkq_1df34404-694b-4634-95b1-1fa4195568a5/migrator/0.log" Sep 10 16:18:27.347177 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:27.347153 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-zgpkq_1df34404-694b-4634-95b1-1fa4195568a5/graceful-termination/0.log" Sep 10 16:18:27.691599 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:27.691515 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-nl8gn_554d1b9b-4837-4114-a33c-98db1f43e749/kube-storage-version-migrator-operator/1.log" Sep 10 16:18:27.693445 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:27.693413 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-nl8gn_554d1b9b-4837-4114-a33c-98db1f43e749/kube-storage-version-migrator-operator/0.log" Sep 10 16:18:28.782598 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:28.782565 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9w99_1f650bc2-5f43-4a32-9e3d-48fb84687f8b/kube-multus-additional-cni-plugins/0.log" Sep 10 16:18:28.800228 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:28.800194 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9w99_1f650bc2-5f43-4a32-9e3d-48fb84687f8b/egress-router-binary-copy/0.log" Sep 10 16:18:28.833300 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:28.833273 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9w99_1f650bc2-5f43-4a32-9e3d-48fb84687f8b/cni-plugins/0.log" Sep 10 16:18:28.852161 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:28.852136 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9w99_1f650bc2-5f43-4a32-9e3d-48fb84687f8b/bond-cni-plugin/0.log" Sep 10 16:18:28.870168 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:28.870146 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9w99_1f650bc2-5f43-4a32-9e3d-48fb84687f8b/routeoverride-cni/0.log" Sep 10 16:18:28.888203 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:28.888179 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9w99_1f650bc2-5f43-4a32-9e3d-48fb84687f8b/whereabouts-cni-bincopy/0.log" Sep 10 16:18:28.906026 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:28.906008 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9w99_1f650bc2-5f43-4a32-9e3d-48fb84687f8b/whereabouts-cni/0.log" Sep 10 16:18:29.155944 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:29.155898 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ckhkh_272e68f6-e885-42a2-9154-c94d2384e419/kube-multus/0.log" Sep 10 16:18:29.174660 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:29.174636 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2gr6r_117f519b-c0a5-4892-ad17-5d8ec8bd5f9b/network-metrics-daemon/0.log" Sep 10 16:18:29.191379 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:29.191359 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2gr6r_117f519b-c0a5-4892-ad17-5d8ec8bd5f9b/kube-rbac-proxy/0.log" Sep 10 16:18:30.519614 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:30.519582 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xntds_be74c874-a20b-4dec-88f7-d74e27aadc0d/ovn-controller/0.log" Sep 10 16:18:30.536472 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:30.536449 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xntds_be74c874-a20b-4dec-88f7-d74e27aadc0d/ovn-acl-logging/0.log" Sep 10 16:18:30.562013 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:30.561989 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xntds_be74c874-a20b-4dec-88f7-d74e27aadc0d/kube-rbac-proxy-node/0.log" Sep 10 16:18:30.582925 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:30.582893 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xntds_be74c874-a20b-4dec-88f7-d74e27aadc0d/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 16:18:30.600355 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:30.600305 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xntds_be74c874-a20b-4dec-88f7-d74e27aadc0d/northd/0.log" Sep 10 16:18:30.620407 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:30.620377 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xntds_be74c874-a20b-4dec-88f7-d74e27aadc0d/nbdb/0.log" Sep 10 16:18:30.640423 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:30.640393 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xntds_be74c874-a20b-4dec-88f7-d74e27aadc0d/sbdb/0.log" Sep 10 16:18:30.693394 ip-10-0-135-80 kubenswrapper[2556]: I0910 16:18:30.693367 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xntds_be74c874-a20b-4dec-88f7-d74e27aadc0d/ovnkube-controller/0.log"