Sep 18 13:01:51.854770 ip-10-0-140-175 systemd[1]: Starting Kubernetes Kubelet... Sep 18 13:01:54.996444 ip-10-0-140-175 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:01:54.996444 ip-10-0-140-175 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 13:01:54.996444 ip-10-0-140-175 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:01:54.996444 ip-10-0-140-175 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 13:01:54.996444 ip-10-0-140-175 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:01:54.997335 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:54.996541 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 13:01:55.000960 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000921 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:01:55.000960 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000954 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:01:55.000960 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000960 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:01:55.000960 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000966 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:01:55.000960 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000971 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:01:55.000960 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000975 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000980 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000984 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000988 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000992 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000995 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.000999 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001003 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001007 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001011 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001015 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001018 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001022 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001050 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001055 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001059 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001063 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001067 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001071 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001075 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:01:55.001311 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001079 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001083 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001086 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001090 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001094 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001098 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001103 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001107 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001111 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001115 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001119 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001127 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001134 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001141 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001146 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001151 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001155 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001159 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001164 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001168 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:01:55.002121 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001172 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001180 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001185 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001190 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001195 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001200 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001207 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001213 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001218 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001223 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001227 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001233 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001238 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001242 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001247 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001252 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001257 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001261 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001265 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:01:55.002920 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001270 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001274 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001279 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001284 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001288 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001294 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001298 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001303 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001307 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001312 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001316 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001320 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001324 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001329 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001333 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001337 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001341 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001345 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001349 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001353 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:01:55.003387 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001358 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001363 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001367 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001371 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001375 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001379 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001383 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001388 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001392 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001396 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001400 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001404 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001409 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001413 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:01:55.003911 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.001436 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:01:55.004674 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004654 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:01:55.004674 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004673 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004680 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004685 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004690 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004694 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004699 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004704 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004709 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004714 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004718 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004722 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004726 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004730 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004734 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004738 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004743 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004747 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004751 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004756 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004760 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:01:55.004788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004765 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004769 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004773 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004778 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004782 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004786 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004790 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004796 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004800 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004805 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004812 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004818 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004824 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004828 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004832 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004836 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004840 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004845 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004849 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:01:55.005660 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004853 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004857 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004862 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004866 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004870 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004874 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004878 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004882 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004886 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004890 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004894 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004899 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004903 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004908 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004912 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004918 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004922 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004926 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004930 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004934 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:01:55.006500 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004938 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004945 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004951 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004955 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004961 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004965 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004970 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004974 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004979 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004983 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004987 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004994 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.004998 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005002 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005007 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005011 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005016 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005020 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005025 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:01:55.007377 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005029 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005034 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005038 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005042 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005048 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005053 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005059 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005065 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005071 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005076 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005082 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005087 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005091 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005095 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005099 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005103 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005108 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005113 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005117 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:01:55.008119 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005121 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005845 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005856 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005861 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005866 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005871 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005875 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005880 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005885 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005889 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005894 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005899 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005904 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005908 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005913 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005917 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005922 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005929 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005933 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005938 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:01:55.008683 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005943 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005948 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005955 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005961 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005966 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005971 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005975 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005980 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005985 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005989 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005993 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.005998 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006001 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006005 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006010 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006014 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006018 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006022 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006026 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:01:55.009185 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006030 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006035 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006039 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006044 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006051 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006057 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006061 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006066 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006070 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006074 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006078 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006084 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006088 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006092 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006099 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006103 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006108 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006112 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006117 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006121 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:01:55.009687 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006125 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006129 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006133 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006137 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006141 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006145 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006149 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006154 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006158 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006162 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006166 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006170 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006174 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006178 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006182 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006186 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006190 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006195 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006201 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006205 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:01:55.010204 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006209 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006213 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006218 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006222 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006229 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006234 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006240 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006245 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006250 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006254 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006258 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006262 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006266 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006271 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006275 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006279 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006283 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006288 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006292 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006296 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:01:55.010904 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.006300 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006399 2561 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006465 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006476 2561 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006483 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006489 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006494 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006501 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006508 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006512 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006517 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006522 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006527 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006532 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006542 2561 flags.go:64] FLAG: --cgroup-root="" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006547 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006552 2561 flags.go:64] FLAG: --client-ca-file="" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006558 2561 flags.go:64] FLAG: --cloud-provider="external" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006563 2561 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006571 2561 flags.go:64] FLAG: --cluster-domain="" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006576 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006582 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006587 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006592 2561 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 13:01:55.011484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006598 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006603 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006608 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006613 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006618 2561 flags.go:64] FLAG: --contention-profiling="false" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006623 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006628 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006633 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006637 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006644 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006649 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006654 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006658 2561 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006663 2561 flags.go:64] FLAG: --enable-server="true" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006668 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006675 2561 flags.go:64] FLAG: --event-burst="100" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006680 2561 flags.go:64] FLAG: --event-qps="50" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006685 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006689 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006694 2561 flags.go:64] FLAG: --eviction-hard="" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006700 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006705 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006712 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006717 2561 flags.go:64] FLAG: --eviction-soft="" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006722 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 13:01:55.012169 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006726 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006733 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006738 2561 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006743 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006747 2561 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006753 2561 flags.go:64] FLAG: --feature-gates="" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006759 2561 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006764 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006769 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006774 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006779 2561 flags.go:64] FLAG: --healthz-port="10248" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006791 2561 flags.go:64] FLAG: --help="false" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006797 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006802 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006808 2561 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006812 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006818 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006823 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006828 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006833 2561 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006838 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006842 2561 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006847 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006852 2561 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 13:01:55.012816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006857 2561 flags.go:64] FLAG: --kube-reserved="" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006862 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006866 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006871 2561 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006876 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006883 2561 flags.go:64] FLAG: --lock-file="" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006888 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006893 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006898 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006907 2561 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006913 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006918 2561 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006922 2561 flags.go:64] FLAG: --logging-format="text" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006927 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006933 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006938 2561 flags.go:64] FLAG: --manifest-url="" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006942 2561 flags.go:64] FLAG: --manifest-url-header="" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006949 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006954 2561 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006961 2561 flags.go:64] FLAG: --max-pods="110" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006966 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006971 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006976 2561 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006981 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006986 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 13:01:55.013415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006991 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.006996 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007008 2561 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007014 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007019 2561 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007024 2561 flags.go:64] FLAG: --pod-cidr="" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007029 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007038 2561 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007043 2561 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007048 2561 flags.go:64] FLAG: --pods-per-core="0" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007053 2561 flags.go:64] FLAG: --port="10250" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007058 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007062 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-088fe327bd71fddde" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007070 2561 flags.go:64] FLAG: --qos-reserved="" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007075 2561 flags.go:64] FLAG: --read-only-port="10255" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007079 2561 flags.go:64] FLAG: --register-node="true" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007085 2561 flags.go:64] FLAG: --register-with-taints="" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007090 2561 flags.go:64] FLAG: --registry-burst="10" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007096 2561 flags.go:64] FLAG: --registry-qps="5" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007101 2561 flags.go:64] FLAG: --reserved-cpus="" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007105 2561 flags.go:64] FLAG: --reserved-memory="" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007111 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007116 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007121 2561 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007125 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 13:01:55.014054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007130 2561 flags.go:64] FLAG: --runonce="false" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007135 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007140 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007145 2561 flags.go:64] FLAG: --seccomp-default="false" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007150 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007155 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007160 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007165 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007170 2561 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007174 2561 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007179 2561 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007184 2561 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007188 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007193 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007198 2561 flags.go:64] FLAG: --system-cgroups="" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007203 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007212 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007217 2561 flags.go:64] FLAG: --tls-cert-file="" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007221 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007228 2561 flags.go:64] FLAG: --tls-min-version="" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007236 2561 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007240 2561 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007245 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007251 2561 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007256 2561 flags.go:64] FLAG: --v="2" Sep 18 13:01:55.014790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007262 2561 flags.go:64] FLAG: --version="false" Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007269 2561 flags.go:64] FLAG: --vmodule="" Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007276 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.007281 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007489 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007497 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007502 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007510 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007518 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007523 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007527 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007531 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007536 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007540 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007544 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007549 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007553 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007557 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007562 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007566 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007570 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:01:55.015489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007574 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007578 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007583 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007587 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007591 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007595 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007602 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007606 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007610 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007616 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007620 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007624 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007629 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007642 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007646 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007651 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007655 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007659 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007663 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:01:55.016011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007668 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007672 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007676 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007680 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007684 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007688 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007692 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007697 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007701 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007705 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007710 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007714 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007718 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007722 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007727 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007731 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007735 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007741 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007747 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007753 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:01:55.016517 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007758 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007763 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007769 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007773 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007778 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007783 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007787 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007792 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007796 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007800 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007804 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007809 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007815 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007820 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007824 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007828 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007833 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007837 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007841 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:01:55.017026 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007845 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007849 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007853 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007857 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007861 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007866 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007870 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007874 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007878 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007882 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007886 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007891 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007896 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007901 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007905 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007911 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007915 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007920 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007924 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007928 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:01:55.017509 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007932 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007937 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007942 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.007946 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.008479 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.016814 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.016834 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.016856 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.016863 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016923 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016930 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016934 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016939 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016943 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:01:55.018001 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016946 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016950 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016953 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016956 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016958 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016961 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016965 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016968 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016971 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016974 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016977 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016980 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016983 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016985 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016988 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016991 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016994 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016996 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.016999 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017001 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:01:55.018382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017004 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017007 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017010 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017012 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017017 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017019 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017022 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017025 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017028 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017030 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017033 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017036 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017039 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017041 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017044 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017047 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017049 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017052 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017054 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017057 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:01:55.018891 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017059 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017062 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017065 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017067 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017070 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017072 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017075 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017077 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017080 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017082 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017085 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017087 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017090 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017092 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017095 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017098 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017101 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017106 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017109 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017113 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:01:55.019382 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017115 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017118 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017121 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017124 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017126 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017129 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017131 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017134 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017137 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017140 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017142 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017145 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017147 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017150 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017152 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017155 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017157 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017160 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017163 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017166 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:01:55.019900 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017168 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017171 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017173 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017176 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017178 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017181 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017184 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017187 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017190 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017193 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017197 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017200 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017202 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017205 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.017210 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:01:55.020389 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017326 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017332 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017335 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017338 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017341 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017344 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017346 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017369 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017373 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017376 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017379 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017382 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017385 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017388 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017391 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017394 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017397 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017400 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017402 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017405 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:01:55.020812 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017408 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017411 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017413 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017416 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017432 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017435 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017438 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017441 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017445 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017447 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017450 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017453 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017456 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017459 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017462 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017465 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017467 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017470 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017473 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017475 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:01:55.021296 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017478 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017480 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017483 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017486 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017488 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017491 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017495 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017498 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017501 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017504 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017506 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017509 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017512 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017514 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017517 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017520 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017524 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017528 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017531 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:01:55.021802 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017535 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017538 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017541 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017544 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017547 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017550 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017552 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017555 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017558 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017560 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017562 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017565 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017568 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017583 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017587 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017591 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017594 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017597 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017600 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:01:55.022265 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017603 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017606 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017609 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017612 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017615 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017617 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017620 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017623 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017625 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017628 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017631 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017633 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017636 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017639 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017642 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017645 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017648 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017650 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017653 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017655 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:01:55.022831 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:55.017658 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:01:55.023327 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.017663 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:01:55.023327 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.017795 2561 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 13:01:55.023327 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.020005 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 13:01:55.023327 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.020841 2561 server.go:1019] "Starting client certificate rotation" Sep 18 13:01:55.023327 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.020944 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 13:01:55.023327 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.020987 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 13:01:55.023327 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.023136 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 13:01:55.024305 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.024286 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 13:01:55.031069 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.031043 2561 log.go:25] "Validated CRI v1 runtime API" Sep 18 13:01:55.036377 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.036357 2561 log.go:25] "Validated CRI v1 image API" Sep 18 13:01:55.037263 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.037247 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 13:01:55.039619 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.039597 2561 fs.go:135] Filesystem UUIDs: map[32b152e9-14d7-4c73-bc82-6d76e3423d1f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f656af21-5153-45d8-b2e1-ecb39e16445c:/dev/nvme0n1p3] Sep 18 13:01:55.039681 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.039619 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 13:01:55.044180 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.044071 2561 manager.go:216] Machine: {Timestamp:2026-09-18 13:01:55.043577534 +0000 UTC m=+1.786112031 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102436 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d8775916e4a983f35e7a91f27d797 SystemUUID:ec2d8775-916e-4a98-3f35-e7a91f27d797 BootID:18b3d032-03c6-4e1d-8e95-e8b458f4e0f1 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ed:7e:da:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ed:7e:da:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:1b:22:7a:27:96 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 13:01:55.044180 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.044177 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 13:01:55.044290 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.044263 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 13:01:55.045893 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.045865 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 13:01:55.046043 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.045896 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-175.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 13:01:55.047118 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.047105 2561 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 13:01:55.047195 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.047120 2561 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 13:01:55.047195 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.047128 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 13:01:55.047195 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.047140 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 13:01:55.048597 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.048586 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 13:01:55.053274 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.053259 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 18 13:01:55.053404 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.053394 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 13:01:55.053445 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.053442 2561 kubelet.go:486] "Attempting to sync node with API server" Sep 18 13:01:55.053482 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.053454 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 13:01:55.053482 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.053471 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 13:01:55.053482 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.053480 2561 kubelet.go:398] "Adding apiserver pod source" Sep 18 13:01:55.053563 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.053490 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 13:01:55.053887 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.053873 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 13:01:55.053943 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.053893 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 13:01:55.055799 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.055779 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 13:01:55.057681 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.057657 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 13:01:55.058428 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.058404 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 13:01:55.058463 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.058451 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 13:01:55.058640 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.058606 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 13:01:55.058669 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.058665 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 13:01:55.058697 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.058675 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 13:01:55.058697 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.058685 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 13:01:55.058697 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.058694 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 13:01:55.058790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.058700 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 13:01:55.059110 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.059100 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 13:01:55.059141 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.059110 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 13:01:55.059141 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.059117 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 13:01:55.059141 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.059122 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 13:01:55.059141 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.059137 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 13:01:55.059245 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.059146 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 13:01:55.059245 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.059173 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 13:01:55.059245 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.059180 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 13:01:55.063197 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.063181 2561 server.go:1268] "Started kubelet" Sep 18 13:01:55.063606 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.063583 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 13:01:55.063660 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.063595 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 13:01:55.063660 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.063644 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 13:01:55.063935 ip-10-0-140-175 systemd[1]: Started Kubernetes Kubelet. Sep 18 13:01:55.064535 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.064039 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 13:01:55.064535 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.064380 2561 server.go:310] "Adding debug handlers to kubelet server" Sep 18 13:01:55.095795 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.095762 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-175.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 13:01:55.096759 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.096718 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 13:01:55.096896 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.096756 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 13:01:55.096896 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.096885 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 13:01:55.104109 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.103234 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-175.ec2.internal.18d66be0c5e27397 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-175.ec2.internal,UID:ip-10-0-140-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-175.ec2.internal,},FirstTimestamp:2026-09-18 13:01:55.063149463 +0000 UTC m=+1.805683959,LastTimestamp:2026-09-18 13:01:55.063149463 +0000 UTC m=+1.805683959,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-175.ec2.internal,}" Sep 18 13:01:55.108859 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.108832 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 13:01:55.108859 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.108851 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 13:01:55.109247 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.109225 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:55.109488 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.109473 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 13:01:55.109571 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.109491 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 13:01:55.109571 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.109476 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 13:01:55.109670 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.109603 2561 reconstruct.go:97] "Volume reconstruction finished" Sep 18 13:01:55.109670 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.109612 2561 reconciler.go:29] "Reconciler: start to sync state" Sep 18 13:01:55.109858 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.109842 2561 factory.go:55] Registering systemd factory Sep 18 13:01:55.109920 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.109864 2561 factory.go:223] Registration of the systemd container factory successfully Sep 18 13:01:55.110092 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.110076 2561 factory.go:153] Registering CRI-O factory Sep 18 13:01:55.110157 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.110095 2561 factory.go:223] Registration of the crio container factory successfully Sep 18 13:01:55.110210 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.110157 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 13:01:55.110210 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.110177 2561 factory.go:103] Registering Raw factory Sep 18 13:01:55.110210 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.110193 2561 manager.go:1196] Started watching for new ooms in manager Sep 18 13:01:55.110902 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.110880 2561 manager.go:349] Starting recovery of all containers Sep 18 13:01:55.111760 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.111738 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 13:01:55.111845 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.111815 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 13:01:55.119882 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.119854 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5pf4v" Sep 18 13:01:55.121517 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.121501 2561 manager.go:354] Recovery completed Sep 18 13:01:55.126160 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.126144 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:01:55.128712 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.128691 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:01:55.128786 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.128724 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:01:55.128786 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.128736 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:01:55.129275 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.129255 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5pf4v" Sep 18 13:01:55.129488 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.129470 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 13:01:55.129488 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.129487 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 13:01:55.129602 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.129496 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:01:55.129602 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.129505 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 18 13:01:55.130395 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.130378 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:01:55.130484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.130410 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:01:55.130484 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.130465 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:01:55.132407 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.132393 2561 policy_none.go:49] "None policy: Start" Sep 18 13:01:55.132480 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.132410 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 13:01:55.132480 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.132435 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 13:01:55.134388 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.134377 2561 policy_none.go:47] "Start" Sep 18 13:01:55.203383 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.203200 2561 manager.go:337] "Starting Device Plugin manager" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.203463 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.203478 2561 server.go:87] "Starting device plugin registration server" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.203731 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.203750 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.203844 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.203942 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.203953 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.204602 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.204655 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.206263 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.207686 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.207733 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.207754 2561 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.207857 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 13:01:55.210371 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.210265 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:01:55.304060 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.303980 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:01:55.305146 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.305128 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:01:55.305219 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.305168 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:01:55.305219 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.305185 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:01:55.305219 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.305208 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.308414 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.308392 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal"] Sep 18 13:01:55.308486 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.308473 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:01:55.309384 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.309362 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:01:55.309519 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.309394 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:01:55.309519 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.309404 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:01:55.310717 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.310698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e059f1f83a415f77fc02eae7ddcd67e-config\") pod \"kube-apiserver-proxy-ip-10-0-140-175.ec2.internal\" (UID: \"5e059f1f83a415f77fc02eae7ddcd67e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.311840 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.311827 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:01:55.312003 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.311983 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.312111 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.312019 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:01:55.312694 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.312678 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:01:55.312755 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.312695 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:01:55.312755 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.312712 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:01:55.312755 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.312715 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:01:55.312755 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.312727 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:01:55.312875 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.312729 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:01:55.315120 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.315101 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.315184 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.315136 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:01:55.315909 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.315894 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:01:55.316006 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.315924 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:01:55.316006 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.315943 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:01:55.316315 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.316304 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.316358 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.316320 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-175.ec2.internal\": node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:55.337359 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.337330 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-175.ec2.internal\" not found" node="ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.341820 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.341800 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-175.ec2.internal\" not found" node="ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.353785 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.353756 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:55.411271 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.411242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e059f1f83a415f77fc02eae7ddcd67e-config\") pod \"kube-apiserver-proxy-ip-10-0-140-175.ec2.internal\" (UID: \"5e059f1f83a415f77fc02eae7ddcd67e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.411415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.411284 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5dda3305eb3a2fe9f458bc416b0e414b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"5dda3305eb3a2fe9f458bc416b0e414b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.411415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.411305 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dda3305eb3a2fe9f458bc416b0e414b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"5dda3305eb3a2fe9f458bc416b0e414b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.411415 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.411348 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e059f1f83a415f77fc02eae7ddcd67e-config\") pod \"kube-apiserver-proxy-ip-10-0-140-175.ec2.internal\" (UID: \"5e059f1f83a415f77fc02eae7ddcd67e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.454461 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.454412 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:55.511772 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.511738 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5dda3305eb3a2fe9f458bc416b0e414b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"5dda3305eb3a2fe9f458bc416b0e414b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.511851 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.511784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dda3305eb3a2fe9f458bc416b0e414b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"5dda3305eb3a2fe9f458bc416b0e414b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.511851 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.511830 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dda3305eb3a2fe9f458bc416b0e414b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"5dda3305eb3a2fe9f458bc416b0e414b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.511851 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.511836 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5dda3305eb3a2fe9f458bc416b0e414b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"5dda3305eb3a2fe9f458bc416b0e414b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.555537 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.555463 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:55.640576 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.640542 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.646383 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:55.646084 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" Sep 18 13:01:55.656571 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.656544 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:55.757293 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.757248 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:55.858255 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.858177 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:55.959058 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:55.959019 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:56.020616 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.020578 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 13:01:56.021120 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.020765 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 13:01:56.059849 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:56.059819 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:56.076217 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.076185 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:01:56.134152 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.134046 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 12:56:55 +0000 UTC" deadline="2028-02-13 12:35:41.447330105 +0000 UTC" Sep 18 13:01:56.134152 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.134103 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12311h33m45.313236466s" Sep 18 13:01:56.160235 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:56.160200 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:56.237223 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:56.237183 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dda3305eb3a2fe9f458bc416b0e414b.slice/crio-6d7b155c6199824743a62d428ca39866fdc716c768423d6db276a101c5f75b6b WatchSource:0}: Error finding container 6d7b155c6199824743a62d428ca39866fdc716c768423d6db276a101c5f75b6b: Status 404 returned error can't find the container with id 6d7b155c6199824743a62d428ca39866fdc716c768423d6db276a101c5f75b6b Sep 18 13:01:56.242033 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.242016 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:01:56.261204 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:56.261172 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found" Sep 18 13:01:56.269368 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.269349 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:01:56.270858 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.270842 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:01:56.310267 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.310234 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" Sep 18 13:01:56.330403 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.330374 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 13:01:56.331269 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.331252 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" Sep 18 13:01:56.353297 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:56.353273 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 13:01:56.500406 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:56.500376 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e059f1f83a415f77fc02eae7ddcd67e.slice/crio-0476701bac7ac94762ca08543acbbc4fa503090e890bce1d1b9d58d80cf34ce7 WatchSource:0}: Error finding container 0476701bac7ac94762ca08543acbbc4fa503090e890bce1d1b9d58d80cf34ce7: Status 404 returned error can't find the container with id 0476701bac7ac94762ca08543acbbc4fa503090e890bce1d1b9d58d80cf34ce7 Sep 18 13:01:57.054870 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.054840 2561 apiserver.go:52] "Watching apiserver" Sep 18 13:01:57.065716 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.064033 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 13:01:57.065716 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.064900 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nmf97","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf","openshift-cluster-node-tuning-operator/tuned-xn5fg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal","openshift-multus/multus-additional-cni-plugins-8wvj7","openshift-multus/multus-cfhtp","openshift-network-diagnostics/network-check-target-h2ng6","openshift-network-operator/iptables-alerter-7cmvk","kube-system/konnectivity-agent-zmhtx","kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal","openshift-dns/node-resolver-hwv6b","openshift-image-registry/node-ca-95476","openshift-multus/network-metrics-daemon-7c88g","openshift-ovn-kubernetes/ovnkube-node-48w7v"] Sep 18 13:01:57.068043 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.067680 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:01:57.068043 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.067781 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:01:57.069938 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.069914 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.072269 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.072248 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.073375 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.073330 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 13:01:57.073488 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.073344 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 13:01:57.074008 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.073986 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 13:01:57.074229 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.074212 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hbkw6\"" Sep 18 13:01:57.074711 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.074539 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:57.074711 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.074672 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:01:57.075981 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.075729 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 13:01:57.075981 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.075807 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kgsqf\"" Sep 18 13:01:57.076126 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.076100 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:01:57.077762 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.077289 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.079772 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.079720 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.082178 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.082161 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:01:57.082265 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.082222 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:01:57.084440 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.084375 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7cmvk" Sep 18 13:01:57.085633 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.085101 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pntt7\"" Sep 18 13:01:57.085633 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.085112 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 13:01:57.085633 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.085380 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 13:01:57.085633 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.085471 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 13:01:57.085633 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.085489 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 13:01:57.086112 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.085700 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 13:01:57.086112 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.085761 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pqbnk\"" Sep 18 13:01:57.086216 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.086170 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 13:01:57.087472 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.086813 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:01:57.089838 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.089411 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.092297 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.091882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hwv6b" Sep 18 13:01:57.093230 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.093188 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:01:57.093230 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.093188 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 13:01:57.093644 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.093624 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x522l\"" Sep 18 13:01:57.096768 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.096745 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-95476" Sep 18 13:01:57.098066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.098045 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 13:01:57.098158 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.098142 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 13:01:57.098491 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.098473 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jq7wb\"" Sep 18 13:01:57.100185 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.100167 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 13:01:57.100704 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.100684 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 13:01:57.101553 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.101533 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 13:01:57.102855 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.102351 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 13:01:57.102925 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.102861 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 13:01:57.103224 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.103089 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z8dgq\"" Sep 18 13:01:57.104448 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.103413 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 13:01:57.107040 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.105701 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 13:01:57.107040 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.106014 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 13:01:57.107040 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.106355 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vz7dh\"" Sep 18 13:01:57.110448 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.109583 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 13:01:57.110448 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.110204 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 13:01:57.110448 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.110275 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 13:01:57.110914 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.110847 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 13:01:57.113928 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.111225 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wg2hd\"" Sep 18 13:01:57.113928 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.111441 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 13:01:57.113928 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.112392 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 13:01:57.121819 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.121781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58wxx\" (UniqueName: \"kubernetes.io/projected/38472031-4be9-473d-a762-a8c20568aef3-kube-api-access-58wxx\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.121924 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.121835 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-etc-kubernetes\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.121924 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.121911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-device-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.122030 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.121942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-sys-fs\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.122030 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.121976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a26ddaa8-9c44-4369-a802-95c146b2c5cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.122030 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fdaa4511-33c6-4236-9a81-47862ffdd919-iptables-alerter-script\") pod \"iptables-alerter-7cmvk\" (UID: \"fdaa4511-33c6-4236-9a81-47862ffdd919\") " pod="openshift-network-operator/iptables-alerter-7cmvk" Sep 18 13:01:57.122181 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdaa4511-33c6-4236-9a81-47862ffdd919-host-slash\") pod \"iptables-alerter-7cmvk\" (UID: \"fdaa4511-33c6-4236-9a81-47862ffdd919\") " pod="openshift-network-operator/iptables-alerter-7cmvk" Sep 18 13:01:57.122181 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122082 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-sysctl-d\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.122181 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-cni-binary-copy\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.122323 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-socket-dir-parent\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.122323 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122237 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-sysctl-conf\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.122323 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-host\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.122323 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122313 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38472031-4be9-473d-a762-a8c20568aef3-tmp\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.122530 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122365 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:57.122530 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122398 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-run-netns\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.122530 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122456 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:01:57.122670 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a26ddaa8-9c44-4369-a802-95c146b2c5cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.122670 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122623 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n55vn\" (UniqueName: \"kubernetes.io/projected/7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5-kube-api-access-n55vn\") pod \"node-ca-95476\" (UID: \"7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5\") " pod="openshift-image-registry/node-ca-95476" Sep 18 13:01:57.122758 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122744 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-systemd\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.122823 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122806 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80376bf1-90a3-498f-bc55-c13bfea95e76-agent-certs\") pod \"konnectivity-agent-zmhtx\" (UID: \"80376bf1-90a3-498f-bc55-c13bfea95e76\") " pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:01:57.122888 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/32c6c241-bea2-43fc-80f1-5c1a697090e6-ovnkube-config\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.122935 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knzwd\" (UniqueName: \"kubernetes.io/projected/799efce0-1a62-4455-8935-c9d4aa52ce16-kube-api-access-knzwd\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:01:57.122982 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122966 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfpm6\" (UniqueName: \"kubernetes.io/projected/12797ea5-273c-4e45-b151-3059bee176f6-kube-api-access-zfpm6\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.123030 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.122997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-slash\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.123030 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123024 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-etc-openvswitch\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.123132 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123082 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-node-log\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.123132 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-cni-netd\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.123340 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8446e348-a097-43b3-beb8-d08622222f3b-kubelet-config\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:57.123406 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-daemon-config\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.123483 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123414 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-systemd-units\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.123483 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-run-netns\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.123582 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-run-ovn\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.123582 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123542 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjffq\" (UniqueName: \"kubernetes.io/projected/32c6c241-bea2-43fc-80f1-5c1a697090e6-kube-api-access-zjffq\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.123582 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123573 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-sysconfig\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.123722 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gpxq\" (UniqueName: \"kubernetes.io/projected/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-kube-api-access-4gpxq\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.123722 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-registration-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.123722 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a26ddaa8-9c44-4369-a802-95c146b2c5cf-cnibin\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.123722 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123710 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a26ddaa8-9c44-4369-a802-95c146b2c5cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.123909 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123741 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csflf\" (UniqueName: \"kubernetes.io/projected/a26ddaa8-9c44-4369-a802-95c146b2c5cf-kube-api-access-csflf\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.123909 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chztj\" (UniqueName: \"kubernetes.io/projected/fdaa4511-33c6-4236-9a81-47862ffdd919-kube-api-access-chztj\") pod \"iptables-alerter-7cmvk\" (UID: \"fdaa4511-33c6-4236-9a81-47862ffdd919\") " pod="openshift-network-operator/iptables-alerter-7cmvk" Sep 18 13:01:57.123909 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnf5f\" (UniqueName: \"kubernetes.io/projected/a9ecbc08-3b20-43af-9dc6-baf00289115f-kube-api-access-vnf5f\") pod \"node-resolver-hwv6b\" (UID: \"a9ecbc08-3b20-43af-9dc6-baf00289115f\") " pod="openshift-dns/node-resolver-hwv6b" Sep 18 13:01:57.123909 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-hostroot\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.124163 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123909 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-run-multus-certs\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.124163 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-run-ovn-kubernetes\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.124163 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.123971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.124163 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124002 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38472031-4be9-473d-a762-a8c20568aef3-etc-tuned\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.124163 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-cnibin\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.124163 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-var-lib-kubelet\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.124163 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124109 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nv8d\" (UniqueName: \"kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d\") pod \"network-check-target-h2ng6\" (UID: \"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d\") " pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:01:57.124514 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124157 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a26ddaa8-9c44-4369-a802-95c146b2c5cf-system-cni-dir\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.124514 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124206 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9ecbc08-3b20-43af-9dc6-baf00289115f-tmp-dir\") pod \"node-resolver-hwv6b\" (UID: \"a9ecbc08-3b20-43af-9dc6-baf00289115f\") " pod="openshift-dns/node-resolver-hwv6b" Sep 18 13:01:57.124514 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-sys\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.124514 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124286 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-var-lib-kubelet\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.124514 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124334 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-var-lib-cni-bin\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.124514 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124368 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/32c6c241-bea2-43fc-80f1-5c1a697090e6-ovnkube-script-lib\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.124514 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124399 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.125010 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.124984 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5-serviceca\") pod \"node-ca-95476\" (UID: \"7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5\") " pod="openshift-image-registry/node-ca-95476" Sep 18 13:01:57.125083 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8446e348-a097-43b3-beb8-d08622222f3b-dbus\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:57.125083 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-var-lib-cni-multus\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.125170 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125087 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80376bf1-90a3-498f-bc55-c13bfea95e76-konnectivity-ca\") pod \"konnectivity-agent-zmhtx\" (UID: \"80376bf1-90a3-498f-bc55-c13bfea95e76\") " pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:01:57.125170 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-kubelet\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.125170 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-log-socket\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.125305 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125179 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-cni-dir\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.125305 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/32c6c241-bea2-43fc-80f1-5c1a697090e6-ovn-node-metrics-cert\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.125305 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125232 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-kubernetes\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.125305 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-run\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.125305 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125281 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-lib-modules\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.125584 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-system-cni-dir\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.125584 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-conf-dir\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.125584 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-run-systemd\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.125584 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125451 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-cni-bin\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.125584 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.125584 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125506 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5-host\") pod \"node-ca-95476\" (UID: \"7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5\") " pod="openshift-image-registry/node-ca-95476" Sep 18 13:01:57.125584 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125533 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-run-k8s-cni-cncf-io\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.125584 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-var-lib-openvswitch\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.125584 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125584 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-socket-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.125968 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125612 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a26ddaa8-9c44-4369-a802-95c146b2c5cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.125968 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-modprobe-d\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.125968 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125687 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-run-openvswitch\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.125968 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/32c6c241-bea2-43fc-80f1-5c1a697090e6-env-overrides\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.125968 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.125740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9ecbc08-3b20-43af-9dc6-baf00289115f-hosts-file\") pod \"node-resolver-hwv6b\" (UID: \"a9ecbc08-3b20-43af-9dc6-baf00289115f\") " pod="openshift-dns/node-resolver-hwv6b" Sep 18 13:01:57.138552 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.138504 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 13:01:57.199378 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.199347 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k87jr" Sep 18 13:01:57.213857 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.213753 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" event={"ID":"5e059f1f83a415f77fc02eae7ddcd67e","Type":"ContainerStarted","Data":"0476701bac7ac94762ca08543acbbc4fa503090e890bce1d1b9d58d80cf34ce7"} Sep 18 13:01:57.215200 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.215160 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" event={"ID":"5dda3305eb3a2fe9f458bc416b0e414b","Type":"ContainerStarted","Data":"6d7b155c6199824743a62d428ca39866fdc716c768423d6db276a101c5f75b6b"} Sep 18 13:01:57.215713 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.215694 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k87jr" Sep 18 13:01:57.226454 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-kubernetes\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.226454 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226326 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-run\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.226454 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226352 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-lib-modules\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.226454 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-system-cni-dir\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.226454 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226379 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-kubernetes\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.226454 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-conf-dir\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.226454 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-run-systemd\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.226454 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226461 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-cni-bin\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226463 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-conf-dir\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5-host\") pod \"node-ca-95476\" (UID: \"7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5\") " pod="openshift-image-registry/node-ca-95476" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226511 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-system-cni-dir\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226548 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-run\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226551 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-cni-bin\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-run-k8s-cni-cncf-io\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226579 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-run-systemd\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226585 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-lib-modules\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226601 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-run-k8s-cni-cncf-io\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-var-lib-openvswitch\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226640 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5-host\") pod \"node-ca-95476\" (UID: \"7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5\") " pod="openshift-image-registry/node-ca-95476" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-socket-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226649 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-var-lib-openvswitch\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226657 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226692 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a26ddaa8-9c44-4369-a802-95c146b2c5cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-modprobe-d\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.226967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226759 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-socket-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226809 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-modprobe-d\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-run-openvswitch\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/32c6c241-bea2-43fc-80f1-5c1a697090e6-env-overrides\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226867 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9ecbc08-3b20-43af-9dc6-baf00289115f-hosts-file\") pod \"node-resolver-hwv6b\" (UID: \"a9ecbc08-3b20-43af-9dc6-baf00289115f\") " pod="openshift-dns/node-resolver-hwv6b" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58wxx\" (UniqueName: \"kubernetes.io/projected/38472031-4be9-473d-a762-a8c20568aef3-kube-api-access-58wxx\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-etc-kubernetes\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-device-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226966 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-sys-fs\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226968 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9ecbc08-3b20-43af-9dc6-baf00289115f-hosts-file\") pod \"node-resolver-hwv6b\" (UID: \"a9ecbc08-3b20-43af-9dc6-baf00289115f\") " pod="openshift-dns/node-resolver-hwv6b" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.226991 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a26ddaa8-9c44-4369-a802-95c146b2c5cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fdaa4511-33c6-4236-9a81-47862ffdd919-iptables-alerter-script\") pod \"iptables-alerter-7cmvk\" (UID: \"fdaa4511-33c6-4236-9a81-47862ffdd919\") " pod="openshift-network-operator/iptables-alerter-7cmvk" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227022 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-run-openvswitch\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227041 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdaa4511-33c6-4236-9a81-47862ffdd919-host-slash\") pod \"iptables-alerter-7cmvk\" (UID: \"fdaa4511-33c6-4236-9a81-47862ffdd919\") " pod="openshift-network-operator/iptables-alerter-7cmvk" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227066 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-sysctl-d\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227081 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-device-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-cni-binary-copy\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.227814 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-socket-dir-parent\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-sysctl-conf\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-host\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38472031-4be9-473d-a762-a8c20568aef3-tmp\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227240 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-run-netns\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227316 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/32c6c241-bea2-43fc-80f1-5c1a697090e6-env-overrides\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227327 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a26ddaa8-9c44-4369-a802-95c146b2c5cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227358 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a26ddaa8-9c44-4369-a802-95c146b2c5cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n55vn\" (UniqueName: \"kubernetes.io/projected/7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5-kube-api-access-n55vn\") pod \"node-ca-95476\" (UID: \"7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5\") " pod="openshift-image-registry/node-ca-95476" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-systemd\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227416 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-etc-kubernetes\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227440 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-socket-dir-parent\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227477 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-systemd\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227488 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-host\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227498 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-sys-fs\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.227524 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:01:57.228585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227539 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-run-netns\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.227598 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret podName:8446e348-a097-43b3-beb8-d08622222f3b nodeName:}" failed. No retries permitted until 2026-09-18 13:01:57.727577363 +0000 UTC m=+4.470111865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret") pod "global-pull-secret-syncer-nmf97" (UID: "8446e348-a097-43b3-beb8-d08622222f3b") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.227623 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227624 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-sysctl-conf\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.227673 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs podName:799efce0-1a62-4455-8935-c9d4aa52ce16 nodeName:}" failed. No retries permitted until 2026-09-18 13:01:57.727656606 +0000 UTC m=+4.470191096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs") pod "network-metrics-daemon-7c88g" (UID: "799efce0-1a62-4455-8935-c9d4aa52ce16") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227671 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdaa4511-33c6-4236-9a81-47862ffdd919-host-slash\") pod \"iptables-alerter-7cmvk\" (UID: \"fdaa4511-33c6-4236-9a81-47862ffdd919\") " pod="openshift-network-operator/iptables-alerter-7cmvk" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227825 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a26ddaa8-9c44-4369-a802-95c146b2c5cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.227957 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a26ddaa8-9c44-4369-a802-95c146b2c5cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228077 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-sysctl-d\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228097 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80376bf1-90a3-498f-bc55-c13bfea95e76-agent-certs\") pod \"konnectivity-agent-zmhtx\" (UID: \"80376bf1-90a3-498f-bc55-c13bfea95e76\") " pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/32c6c241-bea2-43fc-80f1-5c1a697090e6-ovnkube-config\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228157 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fdaa4511-33c6-4236-9a81-47862ffdd919-iptables-alerter-script\") pod \"iptables-alerter-7cmvk\" (UID: \"fdaa4511-33c6-4236-9a81-47862ffdd919\") " pod="openshift-network-operator/iptables-alerter-7cmvk" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knzwd\" (UniqueName: \"kubernetes.io/projected/799efce0-1a62-4455-8935-c9d4aa52ce16-kube-api-access-knzwd\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfpm6\" (UniqueName: \"kubernetes.io/projected/12797ea5-273c-4e45-b151-3059bee176f6-kube-api-access-zfpm6\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-slash\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.229499 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-etc-openvswitch\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-node-log\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-cni-netd\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8446e348-a097-43b3-beb8-d08622222f3b-kubelet-config\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-daemon-config\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228409 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-slash\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228413 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-systemd-units\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228463 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-systemd-units\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-run-netns\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228497 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-run-ovn\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228518 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-cni-binary-copy\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjffq\" (UniqueName: \"kubernetes.io/projected/32c6c241-bea2-43fc-80f1-5c1a697090e6-kube-api-access-zjffq\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228523 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-etc-openvswitch\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228549 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-node-log\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-sysconfig\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gpxq\" (UniqueName: \"kubernetes.io/projected/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-kube-api-access-4gpxq\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228594 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8446e348-a097-43b3-beb8-d08622222f3b-kubelet-config\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:57.230235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-registration-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228626 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a26ddaa8-9c44-4369-a802-95c146b2c5cf-cnibin\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228644 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-etc-sysconfig\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a26ddaa8-9c44-4369-a802-95c146b2c5cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228670 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csflf\" (UniqueName: \"kubernetes.io/projected/a26ddaa8-9c44-4369-a802-95c146b2c5cf-kube-api-access-csflf\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228689 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-cni-netd\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228695 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chztj\" (UniqueName: \"kubernetes.io/projected/fdaa4511-33c6-4236-9a81-47862ffdd919-kube-api-access-chztj\") pod \"iptables-alerter-7cmvk\" (UID: \"fdaa4511-33c6-4236-9a81-47862ffdd919\") " pod="openshift-network-operator/iptables-alerter-7cmvk" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnf5f\" (UniqueName: \"kubernetes.io/projected/a9ecbc08-3b20-43af-9dc6-baf00289115f-kube-api-access-vnf5f\") pod \"node-resolver-hwv6b\" (UID: \"a9ecbc08-3b20-43af-9dc6-baf00289115f\") " pod="openshift-dns/node-resolver-hwv6b" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228725 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-run-netns\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-hostroot\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-run-multus-certs\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-run-ovn-kubernetes\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38472031-4be9-473d-a762-a8c20568aef3-etc-tuned\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-cnibin\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-var-lib-kubelet\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nv8d\" (UniqueName: \"kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d\") pod \"network-check-target-h2ng6\" (UID: \"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d\") " pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:01:57.231066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228908 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a26ddaa8-9c44-4369-a802-95c146b2c5cf-system-cni-dir\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228928 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9ecbc08-3b20-43af-9dc6-baf00289115f-tmp-dir\") pod \"node-resolver-hwv6b\" (UID: \"a9ecbc08-3b20-43af-9dc6-baf00289115f\") " pod="openshift-dns/node-resolver-hwv6b" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-sys\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-var-lib-kubelet\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.228989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-var-lib-cni-bin\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229005 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/32c6c241-bea2-43fc-80f1-5c1a697090e6-ovnkube-config\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/32c6c241-bea2-43fc-80f1-5c1a697090e6-ovnkube-script-lib\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229046 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229066 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-run-ovn\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229123 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229137 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-cnibin\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229190 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-var-lib-kubelet\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229197 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-registration-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229234 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a26ddaa8-9c44-4369-a802-95c146b2c5cf-system-cni-dir\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229393 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a26ddaa8-9c44-4369-a802-95c146b2c5cf-cnibin\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229486 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9ecbc08-3b20-43af-9dc6-baf00289115f-tmp-dir\") pod \"node-resolver-hwv6b\" (UID: \"a9ecbc08-3b20-43af-9dc6-baf00289115f\") " pod="openshift-dns/node-resolver-hwv6b" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229531 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5-serviceca\") pod \"node-ca-95476\" (UID: \"7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5\") " pod="openshift-image-registry/node-ca-95476" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229579 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-sys\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.231945 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229622 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38472031-4be9-473d-a762-a8c20568aef3-var-lib-kubelet\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229655 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-var-lib-cni-bin\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229878 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a26ddaa8-9c44-4369-a802-95c146b2c5cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230121 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/32c6c241-bea2-43fc-80f1-5c1a697090e6-ovnkube-script-lib\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230194 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12797ea5-273c-4e45-b151-3059bee176f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230377 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-hostroot\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230441 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-run-multus-certs\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230489 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-run-ovn-kubernetes\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.229072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5-serviceca\") pod \"node-ca-95476\" (UID: \"7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5\") " pod="openshift-image-registry/node-ca-95476" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8446e348-a097-43b3-beb8-d08622222f3b-dbus\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230727 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-var-lib-cni-multus\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80376bf1-90a3-498f-bc55-c13bfea95e76-konnectivity-ca\") pod \"konnectivity-agent-zmhtx\" (UID: \"80376bf1-90a3-498f-bc55-c13bfea95e76\") " pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230776 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-kubelet\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-log-socket\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230831 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-cni-dir\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/32c6c241-bea2-43fc-80f1-5c1a697090e6-ovn-node-metrics-cert\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.230889 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-daemon-config\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.231340 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8446e348-a097-43b3-beb8-d08622222f3b-dbus\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:57.232822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.231380 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80376bf1-90a3-498f-bc55-c13bfea95e76-konnectivity-ca\") pod \"konnectivity-agent-zmhtx\" (UID: \"80376bf1-90a3-498f-bc55-c13bfea95e76\") " pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:01:57.233651 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.231404 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-host-var-lib-cni-multus\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.233651 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.231462 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-log-socket\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.233651 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.231508 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c6c241-bea2-43fc-80f1-5c1a697090e6-host-kubelet\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.233651 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.231555 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-multus-cni-dir\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.233651 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.232666 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80376bf1-90a3-498f-bc55-c13bfea95e76-agent-certs\") pod \"konnectivity-agent-zmhtx\" (UID: \"80376bf1-90a3-498f-bc55-c13bfea95e76\") " pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:01:57.233893 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.233730 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38472031-4be9-473d-a762-a8c20568aef3-tmp\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.235951 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.235907 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38472031-4be9-473d-a762-a8c20568aef3-etc-tuned\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.238933 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.238887 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/32c6c241-bea2-43fc-80f1-5c1a697090e6-ovn-node-metrics-cert\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.255088 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.254994 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:01:57.255088 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.255030 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:01:57.255088 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.255045 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2nv8d for pod openshift-network-diagnostics/network-check-target-h2ng6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:01:57.255343 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.255141 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d podName:9599a6a9-dd9b-4c0e-b9d8-39edd51d060d nodeName:}" failed. No retries permitted until 2026-09-18 13:01:57.755097889 +0000 UTC m=+4.497632385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2nv8d" (UniqueName: "kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d") pod "network-check-target-h2ng6" (UID: "9599a6a9-dd9b-4c0e-b9d8-39edd51d060d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:01:57.258710 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.258629 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knzwd\" (UniqueName: \"kubernetes.io/projected/799efce0-1a62-4455-8935-c9d4aa52ce16-kube-api-access-knzwd\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:01:57.261545 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.261239 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gpxq\" (UniqueName: \"kubernetes.io/projected/2e62b6ab-6359-4efc-8725-4e335eaf3e3a-kube-api-access-4gpxq\") pod \"multus-cfhtp\" (UID: \"2e62b6ab-6359-4efc-8725-4e335eaf3e3a\") " pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.262080 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.262062 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n55vn\" (UniqueName: \"kubernetes.io/projected/7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5-kube-api-access-n55vn\") pod \"node-ca-95476\" (UID: \"7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5\") " pod="openshift-image-registry/node-ca-95476" Sep 18 13:01:57.270601 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.270571 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfpm6\" (UniqueName: \"kubernetes.io/projected/12797ea5-273c-4e45-b151-3059bee176f6-kube-api-access-zfpm6\") pod \"aws-ebs-csi-driver-node-ktrhf\" (UID: \"12797ea5-273c-4e45-b151-3059bee176f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.272560 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.272535 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58wxx\" (UniqueName: \"kubernetes.io/projected/38472031-4be9-473d-a762-a8c20568aef3-kube-api-access-58wxx\") pod \"tuned-xn5fg\" (UID: \"38472031-4be9-473d-a762-a8c20568aef3\") " pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.274648 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.274597 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chztj\" (UniqueName: \"kubernetes.io/projected/fdaa4511-33c6-4236-9a81-47862ffdd919-kube-api-access-chztj\") pod \"iptables-alerter-7cmvk\" (UID: \"fdaa4511-33c6-4236-9a81-47862ffdd919\") " pod="openshift-network-operator/iptables-alerter-7cmvk" Sep 18 13:01:57.275299 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.274903 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjffq\" (UniqueName: \"kubernetes.io/projected/32c6c241-bea2-43fc-80f1-5c1a697090e6-kube-api-access-zjffq\") pod \"ovnkube-node-48w7v\" (UID: \"32c6c241-bea2-43fc-80f1-5c1a697090e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.276248 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.276225 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csflf\" (UniqueName: \"kubernetes.io/projected/a26ddaa8-9c44-4369-a802-95c146b2c5cf-kube-api-access-csflf\") pod \"multus-additional-cni-plugins-8wvj7\" (UID: \"a26ddaa8-9c44-4369-a802-95c146b2c5cf\") " pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.280379 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.280333 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnf5f\" (UniqueName: \"kubernetes.io/projected/a9ecbc08-3b20-43af-9dc6-baf00289115f-kube-api-access-vnf5f\") pod \"node-resolver-hwv6b\" (UID: \"a9ecbc08-3b20-43af-9dc6-baf00289115f\") " pod="openshift-dns/node-resolver-hwv6b" Sep 18 13:01:57.377219 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.377140 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:01:57.384342 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.384311 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" Sep 18 13:01:57.397623 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.397590 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" Sep 18 13:01:57.409133 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.409106 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" Sep 18 13:01:57.416962 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.416938 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cfhtp" Sep 18 13:01:57.429764 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.429735 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7cmvk" Sep 18 13:01:57.438497 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.438472 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:01:57.445388 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.445367 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:01:57.455126 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.455100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hwv6b" Sep 18 13:01:57.461926 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.461901 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-95476" Sep 18 13:01:57.734687 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.734598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:57.734687 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.734643 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:01:57.734915 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.734758 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:01:57.734915 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.734763 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:01:57.734915 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.734841 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs podName:799efce0-1a62-4455-8935-c9d4aa52ce16 nodeName:}" failed. No retries permitted until 2026-09-18 13:01:58.734820224 +0000 UTC m=+5.477354711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs") pod "network-metrics-daemon-7c88g" (UID: "799efce0-1a62-4455-8935-c9d4aa52ce16") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:01:57.734915 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.734858 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret podName:8446e348-a097-43b3-beb8-d08622222f3b nodeName:}" failed. No retries permitted until 2026-09-18 13:01:58.7348499 +0000 UTC m=+5.477384387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret") pod "global-pull-secret-syncer-nmf97" (UID: "8446e348-a097-43b3-beb8-d08622222f3b") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:01:57.835675 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:57.835636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nv8d\" (UniqueName: \"kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d\") pod \"network-check-target-h2ng6\" (UID: \"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d\") " pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:01:57.835870 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.835791 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:01:57.835870 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.835812 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:01:57.835870 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.835824 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2nv8d for pod openshift-network-diagnostics/network-check-target-h2ng6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:01:57.836023 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:57.835889 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d podName:9599a6a9-dd9b-4c0e-b9d8-39edd51d060d nodeName:}" failed. No retries permitted until 2026-09-18 13:01:58.835869662 +0000 UTC m=+5.578404146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nv8d" (UniqueName: "kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d") pod "network-check-target-h2ng6" (UID: "9599a6a9-dd9b-4c0e-b9d8-39edd51d060d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:01:58.208328 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:58.208300 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:01:58.208978 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:58.208466 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:01:58.212654 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:58.212627 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e62b6ab_6359_4efc_8725_4e335eaf3e3a.slice/crio-a675dad8f495f4e4e58b6bfbcbeae6dbb6aa382c55d2794befe9542f7a5a6447 WatchSource:0}: Error finding container a675dad8f495f4e4e58b6bfbcbeae6dbb6aa382c55d2794befe9542f7a5a6447: Status 404 returned error can't find the container with id a675dad8f495f4e4e58b6bfbcbeae6dbb6aa382c55d2794befe9542f7a5a6447 Sep 18 13:01:58.217595 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:58.217564 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cfhtp" event={"ID":"2e62b6ab-6359-4efc-8725-4e335eaf3e3a","Type":"ContainerStarted","Data":"a675dad8f495f4e4e58b6bfbcbeae6dbb6aa382c55d2794befe9542f7a5a6447"} Sep 18 13:01:58.218717 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:58.218693 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 12:56:57 +0000 UTC" deadline="2028-02-26 14:19:16.084608478 +0000 UTC" Sep 18 13:01:58.218769 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:58.218717 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12625h17m17.865893842s" Sep 18 13:01:58.233686 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:58.233662 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38472031_4be9_473d_a762_a8c20568aef3.slice/crio-78abd1b569c6779db88133720eee56476f23d480f0ce4a87dadfa9038226e67f WatchSource:0}: Error finding container 78abd1b569c6779db88133720eee56476f23d480f0ce4a87dadfa9038226e67f: Status 404 returned error can't find the container with id 78abd1b569c6779db88133720eee56476f23d480f0ce4a87dadfa9038226e67f Sep 18 13:01:58.234559 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:58.234526 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdaa4511_33c6_4236_9a81_47862ffdd919.slice/crio-acf1fa56b2cc0fde3dc70da331de80732838973dd65d6e29d72a8df0fcc7f6b2 WatchSource:0}: Error finding container acf1fa56b2cc0fde3dc70da331de80732838973dd65d6e29d72a8df0fcc7f6b2: Status 404 returned error can't find the container with id acf1fa56b2cc0fde3dc70da331de80732838973dd65d6e29d72a8df0fcc7f6b2 Sep 18 13:01:58.237189 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:58.237163 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12797ea5_273c_4e45_b151_3059bee176f6.slice/crio-6abccdb047cc5db84e30c4bc7e46c8307434d0d18621546b0c2749ee6b837c66 WatchSource:0}: Error finding container 6abccdb047cc5db84e30c4bc7e46c8307434d0d18621546b0c2749ee6b837c66: Status 404 returned error can't find the container with id 6abccdb047cc5db84e30c4bc7e46c8307434d0d18621546b0c2749ee6b837c66 Sep 18 13:01:58.238859 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:58.238795 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c6c241_bea2_43fc_80f1_5c1a697090e6.slice/crio-b7be1ab4dd2d2ddd93c7d26175680042fd73fb1d1208d437aa6154da801c10af WatchSource:0}: Error finding container b7be1ab4dd2d2ddd93c7d26175680042fd73fb1d1208d437aa6154da801c10af: Status 404 returned error can't find the container with id b7be1ab4dd2d2ddd93c7d26175680042fd73fb1d1208d437aa6154da801c10af Sep 18 13:01:58.239327 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:58.239303 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80376bf1_90a3_498f_bc55_c13bfea95e76.slice/crio-bd7de4da77a9b9fce00391580ccc08d5f89c2503e164f4b36c917e034284f277 WatchSource:0}: Error finding container bd7de4da77a9b9fce00391580ccc08d5f89c2503e164f4b36c917e034284f277: Status 404 returned error can't find the container with id bd7de4da77a9b9fce00391580ccc08d5f89c2503e164f4b36c917e034284f277 Sep 18 13:01:58.240205 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:58.240182 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26ddaa8_9c44_4369_a802_95c146b2c5cf.slice/crio-5b959d98a514430be714f8bc4ca1a04bdb3d0030ce2775143f025bf5640572cc WatchSource:0}: Error finding container 5b959d98a514430be714f8bc4ca1a04bdb3d0030ce2775143f025bf5640572cc: Status 404 returned error can't find the container with id 5b959d98a514430be714f8bc4ca1a04bdb3d0030ce2775143f025bf5640572cc Sep 18 13:01:58.240899 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:58.240878 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8cff11_d0f2_4f7f_8db3_4fc07e6d99e5.slice/crio-09f6d1c94cf104e1d46beed9613138f668d9dacc01077d8ff848ce82dffce366 WatchSource:0}: Error finding container 09f6d1c94cf104e1d46beed9613138f668d9dacc01077d8ff848ce82dffce366: Status 404 returned error can't find the container with id 09f6d1c94cf104e1d46beed9613138f668d9dacc01077d8ff848ce82dffce366 Sep 18 13:01:58.241840 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:01:58.241819 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ecbc08_3b20_43af_9dc6_baf00289115f.slice/crio-e49ad94b94ba737a4528daa8090517c8362bf328fe62fb7bb7610c5decaea98a WatchSource:0}: Error finding container e49ad94b94ba737a4528daa8090517c8362bf328fe62fb7bb7610c5decaea98a: Status 404 returned error can't find the container with id e49ad94b94ba737a4528daa8090517c8362bf328fe62fb7bb7610c5decaea98a Sep 18 13:01:58.740967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:58.740882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:58.740967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:58.740936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:01:58.741185 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:58.741085 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:01:58.741185 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:58.741149 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs podName:799efce0-1a62-4455-8935-c9d4aa52ce16 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:00.741132391 +0000 UTC m=+7.483666880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs") pod "network-metrics-daemon-7c88g" (UID: "799efce0-1a62-4455-8935-c9d4aa52ce16") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:01:58.741454 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:58.741414 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:01:58.741541 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:58.741508 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret podName:8446e348-a097-43b3-beb8-d08622222f3b nodeName:}" failed. No retries permitted until 2026-09-18 13:02:00.741486141 +0000 UTC m=+7.484020648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret") pod "global-pull-secret-syncer-nmf97" (UID: "8446e348-a097-43b3-beb8-d08622222f3b") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:01:58.842086 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:58.842043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nv8d\" (UniqueName: \"kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d\") pod \"network-check-target-h2ng6\" (UID: \"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d\") " pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:01:58.842274 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:58.842254 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:01:58.842356 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:58.842283 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:01:58.842356 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:58.842297 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2nv8d for pod openshift-network-diagnostics/network-check-target-h2ng6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:01:58.842495 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:58.842392 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d podName:9599a6a9-dd9b-4c0e-b9d8-39edd51d060d nodeName:}" failed. No retries permitted until 2026-09-18 13:02:00.842351608 +0000 UTC m=+7.584886093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nv8d" (UniqueName: "kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d") pod "network-check-target-h2ng6" (UID: "9599a6a9-dd9b-4c0e-b9d8-39edd51d060d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:01:59.214173 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.213948 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:01:59.214173 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:59.214091 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:01:59.214815 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.214574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:01:59.214815 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:01:59.214667 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:01:59.218877 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.218831 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 12:56:57 +0000 UTC" deadline="2028-03-12 10:13:02.708974106 +0000 UTC" Sep 18 13:01:59.218877 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.218867 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12981h11m3.490111734s" Sep 18 13:01:59.238746 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.238708 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmhtx" event={"ID":"80376bf1-90a3-498f-bc55-c13bfea95e76","Type":"ContainerStarted","Data":"bd7de4da77a9b9fce00391580ccc08d5f89c2503e164f4b36c917e034284f277"} Sep 18 13:01:59.252183 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.252086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hwv6b" event={"ID":"a9ecbc08-3b20-43af-9dc6-baf00289115f","Type":"ContainerStarted","Data":"e49ad94b94ba737a4528daa8090517c8362bf328fe62fb7bb7610c5decaea98a"} Sep 18 13:01:59.267592 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.267541 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-95476" event={"ID":"7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5","Type":"ContainerStarted","Data":"09f6d1c94cf104e1d46beed9613138f668d9dacc01077d8ff848ce82dffce366"} Sep 18 13:01:59.278462 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.278353 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" event={"ID":"a26ddaa8-9c44-4369-a802-95c146b2c5cf","Type":"ContainerStarted","Data":"5b959d98a514430be714f8bc4ca1a04bdb3d0030ce2775143f025bf5640572cc"} Sep 18 13:01:59.282103 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.282065 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" event={"ID":"32c6c241-bea2-43fc-80f1-5c1a697090e6","Type":"ContainerStarted","Data":"b7be1ab4dd2d2ddd93c7d26175680042fd73fb1d1208d437aa6154da801c10af"} Sep 18 13:01:59.291347 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.291304 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7cmvk" event={"ID":"fdaa4511-33c6-4236-9a81-47862ffdd919","Type":"ContainerStarted","Data":"acf1fa56b2cc0fde3dc70da331de80732838973dd65d6e29d72a8df0fcc7f6b2"} Sep 18 13:01:59.302712 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.302675 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" event={"ID":"12797ea5-273c-4e45-b151-3059bee176f6","Type":"ContainerStarted","Data":"6abccdb047cc5db84e30c4bc7e46c8307434d0d18621546b0c2749ee6b837c66"} Sep 18 13:01:59.307228 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.307192 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" event={"ID":"38472031-4be9-473d-a762-a8c20568aef3","Type":"ContainerStarted","Data":"78abd1b569c6779db88133720eee56476f23d480f0ce4a87dadfa9038226e67f"} Sep 18 13:01:59.322817 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.322764 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" event={"ID":"5e059f1f83a415f77fc02eae7ddcd67e","Type":"ContainerStarted","Data":"d0f5191b3ee69040027400b666c01adb7bf12b572422f1d9299799961bc0e8a6"} Sep 18 13:01:59.344032 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.343386 2561 generic.go:356] "Generic (PLEG): container finished" podID="5dda3305eb3a2fe9f458bc416b0e414b" containerID="01594e4ff016e064e70ab64fe244b8202c0cbaba045227f58934546accf6e3f4" exitCode=0 Sep 18 13:01:59.344032 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.343458 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" event={"ID":"5dda3305eb3a2fe9f458bc416b0e414b","Type":"ContainerDied","Data":"01594e4ff016e064e70ab64fe244b8202c0cbaba045227f58934546accf6e3f4"} Sep 18 13:01:59.350652 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:01:59.350591 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" podStartSLOduration=3.350572305 podStartE2EDuration="3.350572305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:01:59.350466097 +0000 UTC m=+6.093000626" watchObservedRunningTime="2026-09-18 13:01:59.350572305 +0000 UTC m=+6.093106810" Sep 18 13:02:00.208517 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:00.208473 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:00.208710 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:00.208619 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:00.362621 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:00.362581 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" event={"ID":"5dda3305eb3a2fe9f458bc416b0e414b","Type":"ContainerStarted","Data":"66ef50a5fee40198023b9219c7c4cf69ca0b2018eba5fab3fba684b82b700aeb"} Sep 18 13:02:00.389710 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:00.388736 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" podStartSLOduration=4.388712337 podStartE2EDuration="4.388712337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:00.387609259 +0000 UTC m=+7.130143785" watchObservedRunningTime="2026-09-18 13:02:00.388712337 +0000 UTC m=+7.131246845" Sep 18 13:02:00.762387 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:00.761571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:00.762387 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:00.761626 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:00.762387 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:00.761798 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:00.762387 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:00.761864 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs podName:799efce0-1a62-4455-8935-c9d4aa52ce16 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:04.761844408 +0000 UTC m=+11.504378905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs") pod "network-metrics-daemon-7c88g" (UID: "799efce0-1a62-4455-8935-c9d4aa52ce16") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:00.762387 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:00.762286 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:00.762387 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:00.762351 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret podName:8446e348-a097-43b3-beb8-d08622222f3b nodeName:}" failed. No retries permitted until 2026-09-18 13:02:04.762334755 +0000 UTC m=+11.504869245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret") pod "global-pull-secret-syncer-nmf97" (UID: "8446e348-a097-43b3-beb8-d08622222f3b") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:00.863176 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:00.862529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nv8d\" (UniqueName: \"kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d\") pod \"network-check-target-h2ng6\" (UID: \"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d\") " pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:00.863176 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:00.862703 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:02:00.863176 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:00.862727 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:02:00.863176 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:00.862740 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2nv8d for pod openshift-network-diagnostics/network-check-target-h2ng6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:00.863176 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:00.862806 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d podName:9599a6a9-dd9b-4c0e-b9d8-39edd51d060d nodeName:}" failed. No retries permitted until 2026-09-18 13:02:04.862779767 +0000 UTC m=+11.605314253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nv8d" (UniqueName: "kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d") pod "network-check-target-h2ng6" (UID: "9599a6a9-dd9b-4c0e-b9d8-39edd51d060d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:01.210873 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:01.210778 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:01.211040 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:01.210932 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:01.211406 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:01.211387 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:01.211528 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:01.211507 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:02.208875 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:02.208838 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:02.209365 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:02.208999 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:03.208527 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:03.208493 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:03.208706 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:03.208496 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:03.208706 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:03.208637 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:03.208829 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:03.208699 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:04.208023 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:04.207981 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:04.208438 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:04.208143 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:04.796866 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:04.796813 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:04.797060 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:04.796877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:04.797060 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:04.797011 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:04.797060 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:04.797039 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:04.797215 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:04.797109 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs podName:799efce0-1a62-4455-8935-c9d4aa52ce16 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:12.797090041 +0000 UTC m=+19.539624538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs") pod "network-metrics-daemon-7c88g" (UID: "799efce0-1a62-4455-8935-c9d4aa52ce16") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:04.797215 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:04.797128 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret podName:8446e348-a097-43b3-beb8-d08622222f3b nodeName:}" failed. No retries permitted until 2026-09-18 13:02:12.79711933 +0000 UTC m=+19.539653816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret") pod "global-pull-secret-syncer-nmf97" (UID: "8446e348-a097-43b3-beb8-d08622222f3b") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:04.898341 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:04.898294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nv8d\" (UniqueName: \"kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d\") pod \"network-check-target-h2ng6\" (UID: \"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d\") " pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:04.898596 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:04.898474 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:02:04.898596 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:04.898500 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:02:04.898596 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:04.898515 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2nv8d for pod openshift-network-diagnostics/network-check-target-h2ng6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:04.898596 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:04.898575 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d podName:9599a6a9-dd9b-4c0e-b9d8-39edd51d060d nodeName:}" failed. No retries permitted until 2026-09-18 13:02:12.898558135 +0000 UTC m=+19.641092618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nv8d" (UniqueName: "kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d") pod "network-check-target-h2ng6" (UID: "9599a6a9-dd9b-4c0e-b9d8-39edd51d060d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:05.210368 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:05.209690 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:05.210368 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:05.209840 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:05.210368 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:05.210192 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:05.210368 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:05.210278 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:06.208355 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:06.208315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:06.208815 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:06.208772 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:07.209009 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:07.208523 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:07.209009 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:07.208654 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:07.209009 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:07.208961 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:07.209569 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:07.209065 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:08.208517 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:08.208487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:08.208664 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:08.208599 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:09.209003 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:09.208962 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:09.209597 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:09.209018 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:09.209597 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:09.209091 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:09.209597 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:09.209235 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:10.208076 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:10.208040 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:10.208260 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:10.208198 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:11.208131 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:11.208090 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:11.208616 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:11.208232 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:11.208616 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:11.208270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:11.208616 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:11.208388 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:12.207969 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:12.207925 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:12.208225 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:12.208081 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:12.857913 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:12.857864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:12.857913 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:12.857921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:12.858182 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:12.858034 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:12.858182 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:12.858058 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:12.858182 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:12.858111 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret podName:8446e348-a097-43b3-beb8-d08622222f3b nodeName:}" failed. No retries permitted until 2026-09-18 13:02:28.858090098 +0000 UTC m=+35.600624587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret") pod "global-pull-secret-syncer-nmf97" (UID: "8446e348-a097-43b3-beb8-d08622222f3b") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:12.858182 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:12.858133 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs podName:799efce0-1a62-4455-8935-c9d4aa52ce16 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:28.858122767 +0000 UTC m=+35.600657250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs") pod "network-metrics-daemon-7c88g" (UID: "799efce0-1a62-4455-8935-c9d4aa52ce16") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:12.958916 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:12.958879 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nv8d\" (UniqueName: \"kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d\") pod \"network-check-target-h2ng6\" (UID: \"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d\") " pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:12.959088 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:12.959041 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:02:12.959088 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:12.959073 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:02:12.959088 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:12.959088 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2nv8d for pod openshift-network-diagnostics/network-check-target-h2ng6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:12.959212 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:12.959156 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d podName:9599a6a9-dd9b-4c0e-b9d8-39edd51d060d nodeName:}" failed. No retries permitted until 2026-09-18 13:02:28.959137418 +0000 UTC m=+35.701671906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nv8d" (UniqueName: "kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d") pod "network-check-target-h2ng6" (UID: "9599a6a9-dd9b-4c0e-b9d8-39edd51d060d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:13.208366 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:13.208286 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:13.208798 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:13.208286 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:13.208798 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:13.208452 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:13.208798 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:13.208533 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:14.208271 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:14.208236 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:14.208452 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:14.208380 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:15.209267 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:15.209235 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:15.209740 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:15.209318 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:15.209740 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:15.209402 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:15.209740 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:15.209516 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:16.208388 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.208195 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:16.208388 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:16.208340 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:16.399051 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.398802 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmhtx" event={"ID":"80376bf1-90a3-498f-bc55-c13bfea95e76","Type":"ContainerStarted","Data":"d13eb52768b0c73d0e1dc9aa4d6f91410b591bc50e8d0e6e50ab09201ccee184"} Sep 18 13:02:16.400668 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.400637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hwv6b" event={"ID":"a9ecbc08-3b20-43af-9dc6-baf00289115f","Type":"ContainerStarted","Data":"ea07191f48be52f85cf5f2b79dbc0fc9b36d0626b3adf19b99b8eff66bec4c75"} Sep 18 13:02:16.402180 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.402150 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-95476" event={"ID":"7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5","Type":"ContainerStarted","Data":"8aeedf9071f701a6ebd987aa656b250062d473c24d9d5bb8ee5a893ed89fbf55"} Sep 18 13:02:16.403849 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.403823 2561 generic.go:356] "Generic (PLEG): container finished" podID="a26ddaa8-9c44-4369-a802-95c146b2c5cf" containerID="44578936d200ec2a74957d96794e47132db07917482c2444882c84d36f0cae07" exitCode=0 Sep 18 13:02:16.403955 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.403904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" event={"ID":"a26ddaa8-9c44-4369-a802-95c146b2c5cf","Type":"ContainerDied","Data":"44578936d200ec2a74957d96794e47132db07917482c2444882c84d36f0cae07"} Sep 18 13:02:16.405790 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.405762 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48w7v_32c6c241-bea2-43fc-80f1-5c1a697090e6/ovn-acl-logging/0.log" Sep 18 13:02:16.406285 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.406243 2561 generic.go:356] "Generic (PLEG): container finished" podID="32c6c241-bea2-43fc-80f1-5c1a697090e6" containerID="38e9935bbf6f5e8b755b4b4b3bcc56065039ea8b11507790238471159afc599c" exitCode=1 Sep 18 13:02:16.406384 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.406317 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" event={"ID":"32c6c241-bea2-43fc-80f1-5c1a697090e6","Type":"ContainerDied","Data":"38e9935bbf6f5e8b755b4b4b3bcc56065039ea8b11507790238471159afc599c"} Sep 18 13:02:16.406455 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.406405 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" event={"ID":"32c6c241-bea2-43fc-80f1-5c1a697090e6","Type":"ContainerStarted","Data":"1da60e7aea0ec30612825446c5c29f0a71bcdd9fd895997bda44df795282ebde"} Sep 18 13:02:16.408236 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.408204 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cfhtp" event={"ID":"2e62b6ab-6359-4efc-8725-4e335eaf3e3a","Type":"ContainerStarted","Data":"ce9db35fea4be8d5bb20d8fa7fd0f30e30a31e0f2443749f42fa0e3b61c5546a"} Sep 18 13:02:16.409716 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.409697 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" event={"ID":"12797ea5-273c-4e45-b151-3059bee176f6","Type":"ContainerStarted","Data":"4a4097a8f2c76e20beaac0bd2710323f28ab88411202a2e0041f66217134bb48"} Sep 18 13:02:16.411255 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.411228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" event={"ID":"38472031-4be9-473d-a762-a8c20568aef3","Type":"ContainerStarted","Data":"3091f8cf8b6c71bd667a0ec4789e4b8506b9c3c26bad11ef9aa86f9dfd93c268"} Sep 18 13:02:16.447209 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.447160 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zmhtx" podStartSLOduration=4.009790002 podStartE2EDuration="21.447144848s" totalImagesPullingTime="17.437354846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:16.445449444 +0000 UTC m=+23.187983943" watchObservedRunningTime="2026-09-18 13:02:16.447144848 +0000 UTC m=+23.189679363" Sep 18 13:02:16.503994 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.503943 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-95476" podStartSLOduration=3.791535784 podStartE2EDuration="21.503926843s" totalImagesPullingTime="17.712391059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:16.502204356 +0000 UTC m=+23.244738860" watchObservedRunningTime="2026-09-18 13:02:16.503926843 +0000 UTC m=+23.246461373" Sep 18 13:02:16.560088 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.560047 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xn5fg" podStartSLOduration=3.837577346 podStartE2EDuration="21.56003197s" totalImagesPullingTime="17.722454624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:16.559791183 +0000 UTC m=+23.302325689" watchObservedRunningTime="2026-09-18 13:02:16.56003197 +0000 UTC m=+23.302566475" Sep 18 13:02:16.758050 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.757991 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cfhtp" podStartSLOduration=3.98411727 podStartE2EDuration="21.757975028s" totalImagesPullingTime="17.773857758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:16.757589168 +0000 UTC m=+23.500123690" watchObservedRunningTime="2026-09-18 13:02:16.757975028 +0000 UTC m=+23.500509533" Sep 18 13:02:16.792105 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:16.792050 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hwv6b" podStartSLOduration=4.079167115 podStartE2EDuration="21.792036182s" totalImagesPullingTime="17.712869067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:16.791894188 +0000 UTC m=+23.534428692" watchObservedRunningTime="2026-09-18 13:02:16.792036182 +0000 UTC m=+23.534570686" Sep 18 13:02:17.209007 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:17.208968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:17.209227 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:17.208968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:17.209227 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:17.209117 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:17.209227 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:17.209175 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:17.417547 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:17.416520 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48w7v_32c6c241-bea2-43fc-80f1-5c1a697090e6/ovn-acl-logging/0.log" Sep 18 13:02:17.417547 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:17.417076 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" event={"ID":"32c6c241-bea2-43fc-80f1-5c1a697090e6","Type":"ContainerStarted","Data":"38dc2b379fd7bcc6ae6ff2caf423492d5312d4e5b5afe14e8ea6ebe553b3bb91"} Sep 18 13:02:17.417547 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:17.417160 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" event={"ID":"32c6c241-bea2-43fc-80f1-5c1a697090e6","Type":"ContainerStarted","Data":"2d872fe899e6b41ff9b6f5897ea11df66a41a71c207fa6eec48487b600f98d4e"} Sep 18 13:02:17.417547 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:17.417206 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" event={"ID":"32c6c241-bea2-43fc-80f1-5c1a697090e6","Type":"ContainerStarted","Data":"a4e489ef6200e1af3ab424b92bc75e2766f0f67ac5b1b9a1943753b1c95ab530"} Sep 18 13:02:17.417547 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:17.417251 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" event={"ID":"32c6c241-bea2-43fc-80f1-5c1a697090e6","Type":"ContainerStarted","Data":"46fa69e384e74629045286ff061ce45bf60191e73ec95eccbd827908dcb76b2b"} Sep 18 13:02:17.419459 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:17.419431 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7cmvk" event={"ID":"fdaa4511-33c6-4236-9a81-47862ffdd919","Type":"ContainerStarted","Data":"570584b6ed725277dba9cf756570e41dac74b6b2365ddd010b5ae9baac67d774"} Sep 18 13:02:17.804953 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:17.804921 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 13:02:18.208626 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:18.208583 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:18.208816 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:18.208754 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:18.214650 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:18.214544 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T13:02:17.804942985Z","UUID":"d776987e-6a2f-445d-8af8-cbf141f58511","Handler":null,"Name":"","Endpoint":""} Sep 18 13:02:18.217688 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:18.217664 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 13:02:18.217688 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:18.217698 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 13:02:18.425159 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:18.425124 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" event={"ID":"12797ea5-273c-4e45-b151-3059bee176f6","Type":"ContainerStarted","Data":"e07c470376aaf29a76562839bbefb90e2a7094d0c76de7eb7b9f306613ccdc1f"} Sep 18 13:02:18.453140 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:18.453089 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7cmvk" podStartSLOduration=5.7336158059999995 podStartE2EDuration="23.453070891s" totalImagesPullingTime="17.719455085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:18.452588746 +0000 UTC m=+25.195123254" watchObservedRunningTime="2026-09-18 13:02:18.453070891 +0000 UTC m=+25.195605395" Sep 18 13:02:19.208411 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:19.208327 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:19.208578 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:19.208484 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:19.208578 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:19.208542 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:19.208669 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:19.208651 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:19.430134 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:19.430091 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" event={"ID":"12797ea5-273c-4e45-b151-3059bee176f6","Type":"ContainerStarted","Data":"fa1c8d3ac787ea16bdf746cb677b170d4b7693e46d41b012f828a25aeea29401"} Sep 18 13:02:19.433947 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:19.433895 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48w7v_32c6c241-bea2-43fc-80f1-5c1a697090e6/ovn-acl-logging/0.log" Sep 18 13:02:19.434392 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:19.434358 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" event={"ID":"32c6c241-bea2-43fc-80f1-5c1a697090e6","Type":"ContainerStarted","Data":"b2da4491186aca1da63b463aef46c2e58b9c973386ec2156319113b03bdf2fed"} Sep 18 13:02:19.750926 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:19.750893 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:02:20.208238 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:20.208159 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:20.208391 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:20.208291 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:20.400293 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:20.400259 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:02:20.400934 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:20.400913 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:02:20.423007 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:20.422949 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktrhf" podStartSLOduration=5.257629326 podStartE2EDuration="25.422928152s" totalImagesPullingTime="20.165298826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:19.460142871 +0000 UTC m=+26.202677376" watchObservedRunningTime="2026-09-18 13:02:20.422928152 +0000 UTC m=+27.165462656" Sep 18 13:02:20.437523 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:20.437487 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zmhtx" Sep 18 13:02:21.208589 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:21.208401 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:21.208719 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:21.208481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:21.208719 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:21.208671 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:21.208782 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:21.208761 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:21.440331 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:21.440299 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" event={"ID":"a26ddaa8-9c44-4369-a802-95c146b2c5cf","Type":"ContainerStarted","Data":"f44d832b739f6c4a88ad59b4359e94d1b59a06b2953bd6fb32a5262d63794373"} Sep 18 13:02:21.443938 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:21.443917 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48w7v_32c6c241-bea2-43fc-80f1-5c1a697090e6/ovn-acl-logging/0.log" Sep 18 13:02:21.444375 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:21.444346 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" event={"ID":"32c6c241-bea2-43fc-80f1-5c1a697090e6","Type":"ContainerStarted","Data":"eb0a5abfea36098f640e0955eb4e8ae8e742c637278bc197019494dc2b4fca0e"} Sep 18 13:02:21.444778 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:21.444759 2561 scope.go:117] "RemoveContainer" containerID="38e9935bbf6f5e8b755b4b4b3bcc56065039ea8b11507790238471159afc599c" Sep 18 13:02:22.208293 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:22.208261 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:22.208497 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:22.208372 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:22.450430 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:22.450390 2561 generic.go:356] "Generic (PLEG): container finished" podID="a26ddaa8-9c44-4369-a802-95c146b2c5cf" containerID="f44d832b739f6c4a88ad59b4359e94d1b59a06b2953bd6fb32a5262d63794373" exitCode=0 Sep 18 13:02:22.450943 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:22.450461 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" event={"ID":"a26ddaa8-9c44-4369-a802-95c146b2c5cf","Type":"ContainerDied","Data":"f44d832b739f6c4a88ad59b4359e94d1b59a06b2953bd6fb32a5262d63794373"} Sep 18 13:02:22.456243 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:22.456218 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48w7v_32c6c241-bea2-43fc-80f1-5c1a697090e6/ovn-acl-logging/0.log" Sep 18 13:02:22.456762 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:22.456735 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" event={"ID":"32c6c241-bea2-43fc-80f1-5c1a697090e6","Type":"ContainerStarted","Data":"912c1dc1af647ea1de1e1b9b084d7a13388eedcdccacc31b3711d2855e505818"} Sep 18 13:02:22.456892 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:22.456853 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 13:02:22.457495 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:22.457134 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:02:22.457495 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:22.457400 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:02:22.474331 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:22.474249 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:02:22.475288 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:22.475263 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:02:23.208347 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:23.208165 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:23.208564 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:23.208212 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:23.208564 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:23.208472 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:23.208564 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:23.208529 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:23.301219 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:23.301160 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" podStartSLOduration=10.571672835 podStartE2EDuration="28.301139364s" totalImagesPullingTime="17.729466529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:22.637296955 +0000 UTC m=+29.379831461" watchObservedRunningTime="2026-09-18 13:02:23.301139364 +0000 UTC m=+30.043673896" Sep 18 13:02:23.301662 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:23.301644 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7c88g"] Sep 18 13:02:23.301750 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:23.301741 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:23.301840 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:23.301825 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:23.315947 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:23.315871 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2ng6"] Sep 18 13:02:23.319519 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:23.319495 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nmf97"] Sep 18 13:02:23.459025 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:23.458994 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:23.459402 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:23.459066 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 13:02:23.459402 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:23.458994 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:23.459402 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:23.459105 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:23.459543 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:23.459451 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:24.463882 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:24.463845 2561 generic.go:356] "Generic (PLEG): container finished" podID="a26ddaa8-9c44-4369-a802-95c146b2c5cf" containerID="890928c44678ab20daec149f98bd582eb23eb9a90856c9d18d63538af29a9803" exitCode=0 Sep 18 13:02:24.464254 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:24.463929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" event={"ID":"a26ddaa8-9c44-4369-a802-95c146b2c5cf","Type":"ContainerDied","Data":"890928c44678ab20daec149f98bd582eb23eb9a90856c9d18d63538af29a9803"} Sep 18 13:02:24.464254 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:24.464019 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 13:02:24.755479 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:24.755380 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:02:25.208845 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:25.208816 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:25.209027 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:25.208911 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:25.209027 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:25.208926 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:25.209027 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:25.209017 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:25.209151 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:25.209041 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:25.209151 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:25.209110 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:26.471311 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:26.471225 2561 generic.go:356] "Generic (PLEG): container finished" podID="a26ddaa8-9c44-4369-a802-95c146b2c5cf" containerID="8869504a68a70e9aff7d3ebdf7992f2238194adcd3d7e469ab09aa98625d309f" exitCode=0 Sep 18 13:02:26.471311 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:26.471287 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" event={"ID":"a26ddaa8-9c44-4369-a802-95c146b2c5cf","Type":"ContainerDied","Data":"8869504a68a70e9aff7d3ebdf7992f2238194adcd3d7e469ab09aa98625d309f"} Sep 18 13:02:27.208011 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:27.207974 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:27.208198 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:27.207974 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:27.208198 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:27.208110 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:27.208198 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:27.208107 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:27.208348 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:27.208208 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:27.208348 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:27.208320 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:28.869354 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:28.869312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:28.869354 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:28.869357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:28.869961 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:28.869468 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:28.869961 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:28.869474 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:28.869961 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:28.869573 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs podName:799efce0-1a62-4455-8935-c9d4aa52ce16 nodeName:}" failed. No retries permitted until 2026-09-18 13:03:00.869529968 +0000 UTC m=+67.612064465 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs") pod "network-metrics-daemon-7c88g" (UID: "799efce0-1a62-4455-8935-c9d4aa52ce16") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:28.869961 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:28.869598 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret podName:8446e348-a097-43b3-beb8-d08622222f3b nodeName:}" failed. No retries permitted until 2026-09-18 13:03:00.869585854 +0000 UTC m=+67.612120344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret") pod "global-pull-secret-syncer-nmf97" (UID: "8446e348-a097-43b3-beb8-d08622222f3b") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:28.970383 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:28.970345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nv8d\" (UniqueName: \"kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d\") pod \"network-check-target-h2ng6\" (UID: \"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d\") " pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:28.970651 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:28.970504 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:02:28.970651 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:28.970528 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:02:28.970651 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:28.970539 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2nv8d for pod openshift-network-diagnostics/network-check-target-h2ng6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:28.970651 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:28.970596 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d podName:9599a6a9-dd9b-4c0e-b9d8-39edd51d060d nodeName:}" failed. No retries permitted until 2026-09-18 13:03:00.97058096 +0000 UTC m=+67.713115444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nv8d" (UniqueName: "kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d") pod "network-check-target-h2ng6" (UID: "9599a6a9-dd9b-4c0e-b9d8-39edd51d060d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:29.208731 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.208695 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:29.208930 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.208735 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:29.208930 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.208703 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:29.208930 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:29.208806 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmf97" podUID="8446e348-a097-43b3-beb8-d08622222f3b" Sep 18 13:02:29.208930 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:29.208867 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ng6" podUID="9599a6a9-dd9b-4c0e-b9d8-39edd51d060d" Sep 18 13:02:29.209079 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:29.208946 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7c88g" podUID="799efce0-1a62-4455-8935-c9d4aa52ce16" Sep 18 13:02:29.756984 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.756954 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeReady" Sep 18 13:02:29.757142 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.757100 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 13:02:29.809855 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.809818 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-684d889645-t46kz"] Sep 18 13:02:29.814396 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.814368 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:29.817244 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.817214 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 13:02:29.817458 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.817338 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zlqmc\"" Sep 18 13:02:29.817537 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.817466 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 13:02:29.818044 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.818023 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 13:02:29.825215 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.825195 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 13:02:29.826823 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.826798 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zvdt4"] Sep 18 13:02:29.828681 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.828662 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:29.831035 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.830910 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 13:02:29.831407 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.831385 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kdhzl\"" Sep 18 13:02:29.831905 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.831885 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 13:02:29.832927 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.832905 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qrzkg"] Sep 18 13:02:29.835177 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.835159 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-684d889645-t46kz"] Sep 18 13:02:29.835283 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.835266 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qrzkg" Sep 18 13:02:29.839821 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.839802 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 13:02:29.839953 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.839834 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sghv7\"" Sep 18 13:02:29.840157 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.840139 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 13:02:29.840252 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.840157 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 13:02:29.845027 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.845002 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zvdt4"] Sep 18 13:02:29.856652 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.856579 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qrzkg"] Sep 18 13:02:29.976548 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976507 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-trusted-ca\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976561 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-image-registry-private-configuration\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976590 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-bound-sa-token\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976647 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7117749-269a-43d0-961a-c6caf1280056-cert\") pod \"ingress-canary-qrzkg\" (UID: \"c7117749-269a-43d0-961a-c6caf1280056\") " pod="openshift-ingress-canary/ingress-canary-qrzkg" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-registry-certificates\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976779 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e709dc6-0815-4168-b914-944dfda60cc4-ca-trust-extracted\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976859 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhbf9\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-kube-api-access-mhbf9\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/508dc149-0c51-46b7-979f-f11e6ac25e34-config-volume\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976915 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/508dc149-0c51-46b7-979f-f11e6ac25e34-tmp-dir\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976954 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md75t\" (UniqueName: \"kubernetes.io/projected/508dc149-0c51-46b7-979f-f11e6ac25e34-kube-api-access-md75t\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:29.977012 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.976982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-installation-pull-secrets\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:29.977538 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:29.977064 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt9tw\" (UniqueName: \"kubernetes.io/projected/c7117749-269a-43d0-961a-c6caf1280056-kube-api-access-wt9tw\") pod \"ingress-canary-qrzkg\" (UID: \"c7117749-269a-43d0-961a-c6caf1280056\") " pod="openshift-ingress-canary/ingress-canary-qrzkg" Sep 18 13:02:30.078306 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e709dc6-0815-4168-b914-944dfda60cc4-ca-trust-extracted\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.078524 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbf9\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-kube-api-access-mhbf9\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.078524 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/508dc149-0c51-46b7-979f-f11e6ac25e34-config-volume\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:30.078524 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.078524 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/508dc149-0c51-46b7-979f-f11e6ac25e34-tmp-dir\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:30.078524 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md75t\" (UniqueName: \"kubernetes.io/projected/508dc149-0c51-46b7-979f-f11e6ac25e34-kube-api-access-md75t\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:30.078524 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078489 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-installation-pull-secrets\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.078845 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078744 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e709dc6-0815-4168-b914-944dfda60cc4-ca-trust-extracted\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.078845 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:30.078804 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:02:30.078845 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:30.078820 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684d889645-t46kz: secret "image-registry-tls" not found Sep 18 13:02:30.078845 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078837 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/508dc149-0c51-46b7-979f-f11e6ac25e34-tmp-dir\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:30.079082 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt9tw\" (UniqueName: \"kubernetes.io/projected/c7117749-269a-43d0-961a-c6caf1280056-kube-api-access-wt9tw\") pod \"ingress-canary-qrzkg\" (UID: \"c7117749-269a-43d0-961a-c6caf1280056\") " pod="openshift-ingress-canary/ingress-canary-qrzkg" Sep 18 13:02:30.079082 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:30.078880 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls podName:9e709dc6-0815-4168-b914-944dfda60cc4 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:30.578859179 +0000 UTC m=+37.321393681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls") pod "image-registry-684d889645-t46kz" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4") : secret "image-registry-tls" not found Sep 18 13:02:30.079082 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-trusted-ca\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.079082 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-image-registry-private-configuration\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.079082 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.078977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-bound-sa-token\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.079082 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.079008 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7117749-269a-43d0-961a-c6caf1280056-cert\") pod \"ingress-canary-qrzkg\" (UID: \"c7117749-269a-43d0-961a-c6caf1280056\") " pod="openshift-ingress-canary/ingress-canary-qrzkg" Sep 18 13:02:30.079082 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.079048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:30.079412 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.079110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-registry-certificates\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.079412 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.079157 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/508dc149-0c51-46b7-979f-f11e6ac25e34-config-volume\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:30.079412 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:30.079196 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:02:30.079412 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:30.079265 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls podName:508dc149-0c51-46b7-979f-f11e6ac25e34 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:30.579247569 +0000 UTC m=+37.321782074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls") pod "dns-default-zvdt4" (UID: "508dc149-0c51-46b7-979f-f11e6ac25e34") : secret "dns-default-metrics-tls" not found Sep 18 13:02:30.079809 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.079783 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-registry-certificates\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.080381 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.080352 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-trusted-ca\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.083393 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.083371 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-image-registry-private-configuration\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.083393 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.083383 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-installation-pull-secrets\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.083551 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.083380 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7117749-269a-43d0-961a-c6caf1280056-cert\") pod \"ingress-canary-qrzkg\" (UID: \"c7117749-269a-43d0-961a-c6caf1280056\") " pod="openshift-ingress-canary/ingress-canary-qrzkg" Sep 18 13:02:30.089630 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.089576 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhbf9\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-kube-api-access-mhbf9\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.089749 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.089713 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-bound-sa-token\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.090055 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.090039 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md75t\" (UniqueName: \"kubernetes.io/projected/508dc149-0c51-46b7-979f-f11e6ac25e34-kube-api-access-md75t\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:30.091327 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.091306 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt9tw\" (UniqueName: \"kubernetes.io/projected/c7117749-269a-43d0-961a-c6caf1280056-kube-api-access-wt9tw\") pod \"ingress-canary-qrzkg\" (UID: \"c7117749-269a-43d0-961a-c6caf1280056\") " pod="openshift-ingress-canary/ingress-canary-qrzkg" Sep 18 13:02:30.147604 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.147517 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qrzkg" Sep 18 13:02:30.582565 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.582530 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:30.582785 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:30.582634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:30.582785 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:30.582700 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:02:30.582785 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:30.582721 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684d889645-t46kz: secret "image-registry-tls" not found Sep 18 13:02:30.582785 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:30.582781 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:02:30.582964 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:30.582801 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls podName:9e709dc6-0815-4168-b914-944dfda60cc4 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:31.582775564 +0000 UTC m=+38.325310060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls") pod "image-registry-684d889645-t46kz" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4") : secret "image-registry-tls" not found Sep 18 13:02:30.582964 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:30.582833 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls podName:508dc149-0c51-46b7-979f-f11e6ac25e34 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:31.58281705 +0000 UTC m=+38.325351534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls") pod "dns-default-zvdt4" (UID: "508dc149-0c51-46b7-979f-f11e6ac25e34") : secret "dns-default-metrics-tls" not found Sep 18 13:02:31.208801 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.208771 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:02:31.209656 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.208774 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:02:31.209656 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.208900 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:02:31.211613 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.211590 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2m78j\"" Sep 18 13:02:31.212634 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.212614 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 13:02:31.212752 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.212717 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 13:02:31.212962 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.212948 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 13:02:31.213041 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.212983 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 13:02:31.213041 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.212984 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npxzw\"" Sep 18 13:02:31.306997 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.306717 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qrzkg"] Sep 18 13:02:31.314353 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:02:31.314325 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7117749_269a_43d0_961a_c6caf1280056.slice/crio-de0b13eb0a37511c50f6d2f91706c138ef816aabef5793584931c57b3f91545e WatchSource:0}: Error finding container de0b13eb0a37511c50f6d2f91706c138ef816aabef5793584931c57b3f91545e: Status 404 returned error can't find the container with id de0b13eb0a37511c50f6d2f91706c138ef816aabef5793584931c57b3f91545e Sep 18 13:02:31.484416 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.484379 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qrzkg" event={"ID":"c7117749-269a-43d0-961a-c6caf1280056","Type":"ContainerStarted","Data":"de0b13eb0a37511c50f6d2f91706c138ef816aabef5793584931c57b3f91545e"} Sep 18 13:02:31.487074 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.487040 2561 generic.go:356] "Generic (PLEG): container finished" podID="a26ddaa8-9c44-4369-a802-95c146b2c5cf" containerID="4a3f134d7ab79e0a4f11bab50d05d6751561ac42930274a5c24b81a76f8e9cac" exitCode=0 Sep 18 13:02:31.487176 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.487096 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" event={"ID":"a26ddaa8-9c44-4369-a802-95c146b2c5cf","Type":"ContainerDied","Data":"4a3f134d7ab79e0a4f11bab50d05d6751561ac42930274a5c24b81a76f8e9cac"} Sep 18 13:02:31.590607 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.590572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:31.590759 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.590733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:31.590892 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:31.590873 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:02:31.590966 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:31.590937 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:02:31.590966 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:31.590951 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684d889645-t46kz: secret "image-registry-tls" not found Sep 18 13:02:31.591038 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:31.590943 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls podName:508dc149-0c51-46b7-979f-f11e6ac25e34 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:33.59092183 +0000 UTC m=+40.333456319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls") pod "dns-default-zvdt4" (UID: "508dc149-0c51-46b7-979f-f11e6ac25e34") : secret "dns-default-metrics-tls" not found Sep 18 13:02:31.591038 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:31.591007 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls podName:9e709dc6-0815-4168-b914-944dfda60cc4 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:33.590990943 +0000 UTC m=+40.333525427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls") pod "image-registry-684d889645-t46kz" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4") : secret "image-registry-tls" not found Sep 18 13:02:31.845575 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.845496 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg"] Sep 18 13:02:31.848727 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.848706 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:02:31.851637 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.851616 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nt25g\"" Sep 18 13:02:31.851990 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.851972 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 18 13:02:31.852187 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.852162 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 18 13:02:31.862550 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.862524 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg"] Sep 18 13:02:31.993609 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.993571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eabe6726-cd96-4116-ab6a-35f40c2e924d-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:02:31.993609 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:31.993617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:02:32.094688 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.094651 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eabe6726-cd96-4116-ab6a-35f40c2e924d-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:02:32.094880 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.094709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:02:32.094880 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:32.094836 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 13:02:32.094994 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:32.094930 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert podName:eabe6726-cd96-4116-ab6a-35f40c2e924d nodeName:}" failed. No retries permitted until 2026-09-18 13:02:32.594908065 +0000 UTC m=+39.337442568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-nbnwg" (UID: "eabe6726-cd96-4116-ab6a-35f40c2e924d") : secret "networking-console-plugin-cert" not found Sep 18 13:02:32.095496 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.095476 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eabe6726-cd96-4116-ab6a-35f40c2e924d-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:02:32.374501 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.374464 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4"] Sep 18 13:02:32.377998 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.377973 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4" Sep 18 13:02:32.384356 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.384322 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 18 13:02:32.385474 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.385449 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lw6v6\"" Sep 18 13:02:32.385659 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.385637 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 18 13:02:32.395522 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.395488 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4"] Sep 18 13:02:32.493369 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.493335 2561 generic.go:356] "Generic (PLEG): container finished" podID="a26ddaa8-9c44-4369-a802-95c146b2c5cf" containerID="a97c0403a0e6263b0ede74687bd74ae74266146915560cb15d6a1a994df95271" exitCode=0 Sep 18 13:02:32.493557 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.493386 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" event={"ID":"a26ddaa8-9c44-4369-a802-95c146b2c5cf","Type":"ContainerDied","Data":"a97c0403a0e6263b0ede74687bd74ae74266146915560cb15d6a1a994df95271"} Sep 18 13:02:32.498260 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.498235 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2vzv\" (UniqueName: \"kubernetes.io/projected/47de0059-cc2c-4e1f-83d1-15fb8fd06481-kube-api-access-g2vzv\") pod \"migrator-76794cbd6c-k2xl4\" (UID: \"47de0059-cc2c-4e1f-83d1-15fb8fd06481\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4" Sep 18 13:02:32.599889 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.599821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:02:32.600414 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:32.600062 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 13:02:32.600414 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.600133 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2vzv\" (UniqueName: \"kubernetes.io/projected/47de0059-cc2c-4e1f-83d1-15fb8fd06481-kube-api-access-g2vzv\") pod \"migrator-76794cbd6c-k2xl4\" (UID: \"47de0059-cc2c-4e1f-83d1-15fb8fd06481\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4" Sep 18 13:02:32.600414 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:32.600145 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert podName:eabe6726-cd96-4116-ab6a-35f40c2e924d nodeName:}" failed. No retries permitted until 2026-09-18 13:02:33.600124468 +0000 UTC m=+40.342658968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-nbnwg" (UID: "eabe6726-cd96-4116-ab6a-35f40c2e924d") : secret "networking-console-plugin-cert" not found Sep 18 13:02:32.624010 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.623977 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2vzv\" (UniqueName: \"kubernetes.io/projected/47de0059-cc2c-4e1f-83d1-15fb8fd06481-kube-api-access-g2vzv\") pod \"migrator-76794cbd6c-k2xl4\" (UID: \"47de0059-cc2c-4e1f-83d1-15fb8fd06481\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4" Sep 18 13:02:32.689045 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.688946 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4" Sep 18 13:02:32.735066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.735031 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xdzmz"] Sep 18 13:02:32.745891 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.745861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:32.752703 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.751622 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 13:02:32.752703 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.751804 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7v6wx\"" Sep 18 13:02:32.752703 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.751993 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 13:02:32.752703 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.752036 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 13:02:32.752703 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.752257 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 13:02:32.768846 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.768816 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xdzmz"] Sep 18 13:02:32.903031 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.902997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0d3bf39-f387-4272-8a5f-aa92b98761d6-data-volume\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:32.903241 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.903176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0d3bf39-f387-4272-8a5f-aa92b98761d6-crio-socket\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:32.903304 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.903236 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:32.903304 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.903266 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:32.903413 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.903349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x6cb\" (UniqueName: \"kubernetes.io/projected/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-api-access-6x6cb\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:32.986488 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:32.986386 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4"] Sep 18 13:02:33.004176 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.004142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0d3bf39-f387-4272-8a5f-aa92b98761d6-crio-socket\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:33.004346 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.004203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:33.004346 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.004232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:33.004346 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.004266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x6cb\" (UniqueName: \"kubernetes.io/projected/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-api-access-6x6cb\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:33.004346 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.004298 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0d3bf39-f387-4272-8a5f-aa92b98761d6-data-volume\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:33.004587 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.004364 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:02:33.004587 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.004398 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:02:33.004587 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.004452 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0d3bf39-f387-4272-8a5f-aa92b98761d6-crio-socket\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:33.004587 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.004458 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm podName:c0d3bf39-f387-4272-8a5f-aa92b98761d6 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:33.504439235 +0000 UTC m=+40.246973735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xdzmz" (UID: "c0d3bf39-f387-4272-8a5f-aa92b98761d6") : configmap "kube-rbac-proxy" not found Sep 18 13:02:33.004587 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.004502 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls podName:c0d3bf39-f387-4272-8a5f-aa92b98761d6 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:33.504487971 +0000 UTC m=+40.247022458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xdzmz" (UID: "c0d3bf39-f387-4272-8a5f-aa92b98761d6") : secret "insights-runtime-extractor-tls" not found Sep 18 13:02:33.004846 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.004661 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0d3bf39-f387-4272-8a5f-aa92b98761d6-data-volume\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:33.027354 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.027320 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x6cb\" (UniqueName: \"kubernetes.io/projected/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-api-access-6x6cb\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:33.500504 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.500454 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" event={"ID":"a26ddaa8-9c44-4369-a802-95c146b2c5cf","Type":"ContainerStarted","Data":"5ef5ede48ebcba009a7bdda3ef688c7ff9283d659844387017cfb522f486b7c1"} Sep 18 13:02:33.508760 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.508717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:33.508760 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.508761 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:33.508998 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.508885 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:02:33.508998 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.508897 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:02:33.508998 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.508965 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls podName:c0d3bf39-f387-4272-8a5f-aa92b98761d6 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:34.508946363 +0000 UTC m=+41.251480852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xdzmz" (UID: "c0d3bf39-f387-4272-8a5f-aa92b98761d6") : secret "insights-runtime-extractor-tls" not found Sep 18 13:02:33.508998 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.508985 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm podName:c0d3bf39-f387-4272-8a5f-aa92b98761d6 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:34.508977693 +0000 UTC m=+41.251512176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xdzmz" (UID: "c0d3bf39-f387-4272-8a5f-aa92b98761d6") : configmap "kube-rbac-proxy" not found Sep 18 13:02:33.609861 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.609810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:33.610051 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.609926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:02:33.610051 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.609990 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:02:33.610051 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.610010 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684d889645-t46kz: secret "image-registry-tls" not found Sep 18 13:02:33.610051 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.610035 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 13:02:33.610051 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:33.610044 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:33.610296 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.610091 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls podName:9e709dc6-0815-4168-b914-944dfda60cc4 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:37.610072549 +0000 UTC m=+44.352607047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls") pod "image-registry-684d889645-t46kz" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4") : secret "image-registry-tls" not found Sep 18 13:02:33.610296 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.610110 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert podName:eabe6726-cd96-4116-ab6a-35f40c2e924d nodeName:}" failed. No retries permitted until 2026-09-18 13:02:35.610100251 +0000 UTC m=+42.352634735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-nbnwg" (UID: "eabe6726-cd96-4116-ab6a-35f40c2e924d") : secret "networking-console-plugin-cert" not found Sep 18 13:02:33.610497 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.610295 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:02:33.610497 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:33.610348 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls podName:508dc149-0c51-46b7-979f-f11e6ac25e34 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:37.61033466 +0000 UTC m=+44.352869142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls") pod "dns-default-zvdt4" (UID: "508dc149-0c51-46b7-979f-f11e6ac25e34") : secret "dns-default-metrics-tls" not found Sep 18 13:02:33.725022 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:02:33.724992 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47de0059_cc2c_4e1f_83d1_15fb8fd06481.slice/crio-edaa441ff43696ce2192df8c50aa7a46b60a8b0887abf707832edf825a599d34 WatchSource:0}: Error finding container edaa441ff43696ce2192df8c50aa7a46b60a8b0887abf707832edf825a599d34: Status 404 returned error can't find the container with id edaa441ff43696ce2192df8c50aa7a46b60a8b0887abf707832edf825a599d34 Sep 18 13:02:34.505260 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.504993 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qrzkg" event={"ID":"c7117749-269a-43d0-961a-c6caf1280056","Type":"ContainerStarted","Data":"3a6a4b22b5ea5922b0c1272577a62cdf6eeed3553c47ee23d073fa14fdbf9296"} Sep 18 13:02:34.506451 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.506410 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4" event={"ID":"47de0059-cc2c-4e1f-83d1-15fb8fd06481","Type":"ContainerStarted","Data":"edaa441ff43696ce2192df8c50aa7a46b60a8b0887abf707832edf825a599d34"} Sep 18 13:02:34.519218 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.519174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:34.519218 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.519219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:34.519487 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:34.519339 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:02:34.519487 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:34.519406 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls podName:c0d3bf39-f387-4272-8a5f-aa92b98761d6 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:36.519386447 +0000 UTC m=+43.261920932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xdzmz" (UID: "c0d3bf39-f387-4272-8a5f-aa92b98761d6") : secret "insights-runtime-extractor-tls" not found Sep 18 13:02:34.519487 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:34.519406 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:02:34.519487 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:34.519461 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm podName:c0d3bf39-f387-4272-8a5f-aa92b98761d6 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:36.519450727 +0000 UTC m=+43.261985226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xdzmz" (UID: "c0d3bf39-f387-4272-8a5f-aa92b98761d6") : configmap "kube-rbac-proxy" not found Sep 18 13:02:34.526710 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.526662 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8wvj7" podStartSLOduration=9.95089285 podStartE2EDuration="39.52664229s" totalImagesPullingTime="29.57574944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:33.548356575 +0000 UTC m=+40.290891083" watchObservedRunningTime="2026-09-18 13:02:34.52664229 +0000 UTC m=+41.269176800" Sep 18 13:02:34.526874 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.526812 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qrzkg" podStartSLOduration=2.867900771 podStartE2EDuration="5.526803452s" totalImagesPullingTime="2.658902681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:34.526249374 +0000 UTC m=+41.268783881" watchObservedRunningTime="2026-09-18 13:02:34.526803452 +0000 UTC m=+41.269337959" Sep 18 13:02:34.955170 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.955135 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-g556k"] Sep 18 13:02:34.958171 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.958146 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" Sep 18 13:02:34.961448 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.961407 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 18 13:02:34.961448 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.961447 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 18 13:02:34.961624 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.961413 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 18 13:02:34.962380 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.962362 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 18 13:02:34.962564 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.962454 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kg58d\"" Sep 18 13:02:34.974495 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:34.974465 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-g556k"] Sep 18 13:02:35.124270 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.124242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f7ffc286-655c-4844-afd7-0e185067e6ff-signing-key\") pod \"service-ca-55f6fc7b86-g556k\" (UID: \"f7ffc286-655c-4844-afd7-0e185067e6ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" Sep 18 13:02:35.124407 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.124306 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbqg8\" (UniqueName: \"kubernetes.io/projected/f7ffc286-655c-4844-afd7-0e185067e6ff-kube-api-access-zbqg8\") pod \"service-ca-55f6fc7b86-g556k\" (UID: \"f7ffc286-655c-4844-afd7-0e185067e6ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" Sep 18 13:02:35.124407 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.124391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f7ffc286-655c-4844-afd7-0e185067e6ff-signing-cabundle\") pod \"service-ca-55f6fc7b86-g556k\" (UID: \"f7ffc286-655c-4844-afd7-0e185067e6ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" Sep 18 13:02:35.219728 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.219639 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hwv6b_a9ecbc08-3b20-43af-9dc6-baf00289115f/dns-node-resolver/0.log" Sep 18 13:02:35.225259 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.225234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f7ffc286-655c-4844-afd7-0e185067e6ff-signing-key\") pod \"service-ca-55f6fc7b86-g556k\" (UID: \"f7ffc286-655c-4844-afd7-0e185067e6ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" Sep 18 13:02:35.225406 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.225272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbqg8\" (UniqueName: \"kubernetes.io/projected/f7ffc286-655c-4844-afd7-0e185067e6ff-kube-api-access-zbqg8\") pod \"service-ca-55f6fc7b86-g556k\" (UID: \"f7ffc286-655c-4844-afd7-0e185067e6ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" Sep 18 13:02:35.225406 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.225324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f7ffc286-655c-4844-afd7-0e185067e6ff-signing-cabundle\") pod \"service-ca-55f6fc7b86-g556k\" (UID: \"f7ffc286-655c-4844-afd7-0e185067e6ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" Sep 18 13:02:35.225963 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.225944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f7ffc286-655c-4844-afd7-0e185067e6ff-signing-cabundle\") pod \"service-ca-55f6fc7b86-g556k\" (UID: \"f7ffc286-655c-4844-afd7-0e185067e6ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" Sep 18 13:02:35.228180 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.228159 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f7ffc286-655c-4844-afd7-0e185067e6ff-signing-key\") pod \"service-ca-55f6fc7b86-g556k\" (UID: \"f7ffc286-655c-4844-afd7-0e185067e6ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" Sep 18 13:02:35.235964 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.235935 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbqg8\" (UniqueName: \"kubernetes.io/projected/f7ffc286-655c-4844-afd7-0e185067e6ff-kube-api-access-zbqg8\") pod \"service-ca-55f6fc7b86-g556k\" (UID: \"f7ffc286-655c-4844-afd7-0e185067e6ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" Sep 18 13:02:35.266914 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.266875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" Sep 18 13:02:35.510900 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.510792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4" event={"ID":"47de0059-cc2c-4e1f-83d1-15fb8fd06481","Type":"ContainerStarted","Data":"4224d28670edb8a7d4a88de3a4148e3a9332da78fee35d37d1a4ecd2d686f34b"} Sep 18 13:02:35.511344 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.510899 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4" event={"ID":"47de0059-cc2c-4e1f-83d1-15fb8fd06481","Type":"ContainerStarted","Data":"c3341f511f98d9762f2dd4d9b1ff628b87cdb2383c310cc9833781d53bf1d9aa"} Sep 18 13:02:35.535854 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.535795 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k2xl4" podStartSLOduration=2.264780144 podStartE2EDuration="3.535777708s" totalImagesPullingTime="1.270997564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:35.532694109 +0000 UTC m=+42.275228613" watchObservedRunningTime="2026-09-18 13:02:35.535777708 +0000 UTC m=+42.278312246" Sep 18 13:02:35.540080 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.540044 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-g556k"] Sep 18 13:02:35.542875 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:02:35.542844 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ffc286_655c_4844_afd7_0e185067e6ff.slice/crio-bff6f7b7699f7f2b03e2a0606d6dd29bb44c49b3c53e4dc64ef361d4c8b6ee1a WatchSource:0}: Error finding container bff6f7b7699f7f2b03e2a0606d6dd29bb44c49b3c53e4dc64ef361d4c8b6ee1a: Status 404 returned error can't find the container with id bff6f7b7699f7f2b03e2a0606d6dd29bb44c49b3c53e4dc64ef361d4c8b6ee1a Sep 18 13:02:35.628504 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:35.628466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:02:35.628659 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:35.628635 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 13:02:35.628733 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:35.628719 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert podName:eabe6726-cd96-4116-ab6a-35f40c2e924d nodeName:}" failed. No retries permitted until 2026-09-18 13:02:39.62869825 +0000 UTC m=+46.371232740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-nbnwg" (UID: "eabe6726-cd96-4116-ab6a-35f40c2e924d") : secret "networking-console-plugin-cert" not found Sep 18 13:02:36.016406 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:36.016383 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-95476_7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5/node-ca/0.log" Sep 18 13:02:36.515029 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:36.514990 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" event={"ID":"f7ffc286-655c-4844-afd7-0e185067e6ff","Type":"ContainerStarted","Data":"bff6f7b7699f7f2b03e2a0606d6dd29bb44c49b3c53e4dc64ef361d4c8b6ee1a"} Sep 18 13:02:36.535912 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:36.535864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:36.535912 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:36.535914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:36.536158 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:36.536055 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:02:36.536158 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:36.536124 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls podName:c0d3bf39-f387-4272-8a5f-aa92b98761d6 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:40.536105136 +0000 UTC m=+47.278639620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xdzmz" (UID: "c0d3bf39-f387-4272-8a5f-aa92b98761d6") : secret "insights-runtime-extractor-tls" not found Sep 18 13:02:36.536398 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:36.536374 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0d3bf39-f387-4272-8a5f-aa92b98761d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:36.819537 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:36.819505 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qrzkg_c7117749-269a-43d0-961a-c6caf1280056/serve-healthcheck-canary/0.log" Sep 18 13:02:37.018535 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:37.018498 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-k2xl4_47de0059-cc2c-4e1f-83d1-15fb8fd06481/migrator/0.log" Sep 18 13:02:37.221011 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:37.220914 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-k2xl4_47de0059-cc2c-4e1f-83d1-15fb8fd06481/graceful-termination/0.log" Sep 18 13:02:37.645028 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:37.644990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:37.645478 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:37.645103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:37.645478 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:37.645161 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:02:37.645478 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:37.645183 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684d889645-t46kz: secret "image-registry-tls" not found Sep 18 13:02:37.645478 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:37.645235 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:02:37.645478 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:37.645252 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls podName:9e709dc6-0815-4168-b914-944dfda60cc4 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:45.645233496 +0000 UTC m=+52.387767980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls") pod "image-registry-684d889645-t46kz" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4") : secret "image-registry-tls" not found Sep 18 13:02:37.645478 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:37.645281 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls podName:508dc149-0c51-46b7-979f-f11e6ac25e34 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:45.645266018 +0000 UTC m=+52.387800500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls") pod "dns-default-zvdt4" (UID: "508dc149-0c51-46b7-979f-f11e6ac25e34") : secret "dns-default-metrics-tls" not found Sep 18 13:02:38.522280 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:38.522245 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" event={"ID":"f7ffc286-655c-4844-afd7-0e185067e6ff","Type":"ContainerStarted","Data":"aaa59cdffee7930060ad6235f8fa36faf27d2186e414118fdf46514f2e5c60f3"} Sep 18 13:02:38.541057 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:38.540881 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-g556k" podStartSLOduration=2.061591352 podStartE2EDuration="4.540863234s" totalImagesPullingTime="2.479271882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:38.539737837 +0000 UTC m=+45.282272333" watchObservedRunningTime="2026-09-18 13:02:38.540863234 +0000 UTC m=+45.283397739" Sep 18 13:02:39.659266 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:39.659047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:02:39.659841 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:39.659297 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 13:02:39.659841 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:39.659366 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert podName:eabe6726-cd96-4116-ab6a-35f40c2e924d nodeName:}" failed. No retries permitted until 2026-09-18 13:02:47.659347252 +0000 UTC m=+54.401881735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-nbnwg" (UID: "eabe6726-cd96-4116-ab6a-35f40c2e924d") : secret "networking-console-plugin-cert" not found Sep 18 13:02:40.566762 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:40.566717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:40.566945 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:40.566881 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:02:40.566983 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:40.566967 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls podName:c0d3bf39-f387-4272-8a5f-aa92b98761d6 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:48.566951028 +0000 UTC m=+55.309485511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xdzmz" (UID: "c0d3bf39-f387-4272-8a5f-aa92b98761d6") : secret "insights-runtime-extractor-tls" not found Sep 18 13:02:45.713823 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:45.713780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:45.714390 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:45.713876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:45.716355 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:45.716317 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/508dc149-0c51-46b7-979f-f11e6ac25e34-metrics-tls\") pod \"dns-default-zvdt4\" (UID: \"508dc149-0c51-46b7-979f-f11e6ac25e34\") " pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:45.716479 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:45.716374 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls\") pod \"image-registry-684d889645-t46kz\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:45.726397 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:45.726369 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:45.739560 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:45.739527 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:46.081754 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:46.081715 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-684d889645-t46kz"] Sep 18 13:02:46.088711 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:46.088687 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zvdt4"] Sep 18 13:02:46.090856 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:02:46.090830 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508dc149_0c51_46b7_979f_f11e6ac25e34.slice/crio-63cec94b6ec6dba69902b22bf213b76d48c40c9181aee23654c5ee1038b6db61 WatchSource:0}: Error finding container 63cec94b6ec6dba69902b22bf213b76d48c40c9181aee23654c5ee1038b6db61: Status 404 returned error can't find the container with id 63cec94b6ec6dba69902b22bf213b76d48c40c9181aee23654c5ee1038b6db61 Sep 18 13:02:46.091310 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:02:46.091282 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e709dc6_0815_4168_b914_944dfda60cc4.slice/crio-d4b17186428647389bb2c44852bfbff7d328e7fa76d5d435a0c5457be93bc9d0 WatchSource:0}: Error finding container d4b17186428647389bb2c44852bfbff7d328e7fa76d5d435a0c5457be93bc9d0: Status 404 returned error can't find the container with id d4b17186428647389bb2c44852bfbff7d328e7fa76d5d435a0c5457be93bc9d0 Sep 18 13:02:46.546841 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:46.546805 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684d889645-t46kz" event={"ID":"9e709dc6-0815-4168-b914-944dfda60cc4","Type":"ContainerStarted","Data":"446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee"} Sep 18 13:02:46.547042 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:46.546864 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684d889645-t46kz" event={"ID":"9e709dc6-0815-4168-b914-944dfda60cc4","Type":"ContainerStarted","Data":"d4b17186428647389bb2c44852bfbff7d328e7fa76d5d435a0c5457be93bc9d0"} Sep 18 13:02:46.547042 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:46.546927 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:02:46.548245 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:46.548219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zvdt4" event={"ID":"508dc149-0c51-46b7-979f-f11e6ac25e34","Type":"ContainerStarted","Data":"63cec94b6ec6dba69902b22bf213b76d48c40c9181aee23654c5ee1038b6db61"} Sep 18 13:02:46.597633 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:46.597572 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-684d889645-t46kz" podStartSLOduration=41.597555246 podStartE2EDuration="41.597555246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:02:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:46.597230356 +0000 UTC m=+53.339764861" watchObservedRunningTime="2026-09-18 13:02:46.597555246 +0000 UTC m=+53.340089804" Sep 18 13:02:47.731858 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:47.731815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:02:47.732329 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:47.731912 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 13:02:47.732329 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:02:47.731977 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert podName:eabe6726-cd96-4116-ab6a-35f40c2e924d nodeName:}" failed. No retries permitted until 2026-09-18 13:03:03.731959875 +0000 UTC m=+70.474494366 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-nbnwg" (UID: "eabe6726-cd96-4116-ab6a-35f40c2e924d") : secret "networking-console-plugin-cert" not found Sep 18 13:02:48.639949 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:48.639920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:48.642218 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:48.642186 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0d3bf39-f387-4272-8a5f-aa92b98761d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xdzmz\" (UID: \"c0d3bf39-f387-4272-8a5f-aa92b98761d6\") " pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:48.663490 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:48.663457 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xdzmz" Sep 18 13:02:48.972037 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:48.972004 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xdzmz"] Sep 18 13:02:48.975333 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:02:48.975302 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d3bf39_f387_4272_8a5f_aa92b98761d6.slice/crio-40972a102aefff9225a7936eca23810edc4f50e5f7dd64478b5052fbf9c4bf74 WatchSource:0}: Error finding container 40972a102aefff9225a7936eca23810edc4f50e5f7dd64478b5052fbf9c4bf74: Status 404 returned error can't find the container with id 40972a102aefff9225a7936eca23810edc4f50e5f7dd64478b5052fbf9c4bf74 Sep 18 13:02:49.563464 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:49.563403 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zvdt4" event={"ID":"508dc149-0c51-46b7-979f-f11e6ac25e34","Type":"ContainerStarted","Data":"4c967181a2064e5b51878afa53e9098239a1d299c846b311b45c221b27eb1864"} Sep 18 13:02:49.563666 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:49.563483 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zvdt4" event={"ID":"508dc149-0c51-46b7-979f-f11e6ac25e34","Type":"ContainerStarted","Data":"88f9c0f6b8778c0f2e6880db0039a73ce0ace1d29f23a9189c6becfc6ef27384"} Sep 18 13:02:49.563666 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:49.563546 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zvdt4" Sep 18 13:02:49.565074 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:49.565052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xdzmz" event={"ID":"c0d3bf39-f387-4272-8a5f-aa92b98761d6","Type":"ContainerStarted","Data":"00b8d61bd34851b13f83896ac7a9f0527e0f5447c844fee56760dc770d646f2b"} Sep 18 13:02:49.565179 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:49.565101 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xdzmz" event={"ID":"c0d3bf39-f387-4272-8a5f-aa92b98761d6","Type":"ContainerStarted","Data":"40972a102aefff9225a7936eca23810edc4f50e5f7dd64478b5052fbf9c4bf74"} Sep 18 13:02:49.591309 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:49.591260 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zvdt4" podStartSLOduration=18.181960425 podStartE2EDuration="20.591244033s" totalImagesPullingTime="2.409283608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:49.591214413 +0000 UTC m=+56.333748918" watchObservedRunningTime="2026-09-18 13:02:49.591244033 +0000 UTC m=+56.333778535" Sep 18 13:02:50.570560 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:50.570465 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xdzmz" event={"ID":"c0d3bf39-f387-4272-8a5f-aa92b98761d6","Type":"ContainerStarted","Data":"733a26da2f72cc3062189e6f797bcda2098fc6b73414237e422c12c7d0606d32"} Sep 18 13:02:52.578895 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:52.578859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xdzmz" event={"ID":"c0d3bf39-f387-4272-8a5f-aa92b98761d6","Type":"ContainerStarted","Data":"d146c16c988a75c31eab35cf22324879bc8c7f01edfbe7be3f62cd1d36f0b3af"} Sep 18 13:02:52.606125 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:52.606073 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xdzmz" podStartSLOduration=17.989043524 podStartE2EDuration="20.606055372s" totalImagesPullingTime="2.617011848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:52.604900033 +0000 UTC m=+59.347434551" watchObservedRunningTime="2026-09-18 13:02:52.606055372 +0000 UTC m=+59.348589878" Sep 18 13:02:55.477257 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:55.477224 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48w7v" Sep 18 13:02:59.572468 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:02:59.572411 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zvdt4" Sep 18 13:03:00.929089 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:00.929050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:03:00.929089 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:00.929087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:03:00.934969 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:00.934949 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 13:03:00.935728 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:00.935715 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 13:03:00.942460 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:00.942416 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8446e348-a097-43b3-beb8-d08622222f3b-original-pull-secret\") pod \"global-pull-secret-syncer-nmf97\" (UID: \"8446e348-a097-43b3-beb8-d08622222f3b\") " pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:03:00.942581 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:00.942494 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799efce0-1a62-4455-8935-c9d4aa52ce16-metrics-certs\") pod \"network-metrics-daemon-7c88g\" (UID: \"799efce0-1a62-4455-8935-c9d4aa52ce16\") " pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:03:01.030263 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.030223 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nv8d\" (UniqueName: \"kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d\") pod \"network-check-target-h2ng6\" (UID: \"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d\") " pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:03:01.033504 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.033485 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 13:03:01.043600 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.043580 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 13:03:01.053363 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.053333 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nv8d\" (UniqueName: \"kubernetes.io/projected/9599a6a9-dd9b-4c0e-b9d8-39edd51d060d-kube-api-access-2nv8d\") pod \"network-check-target-h2ng6\" (UID: \"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d\") " pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:03:01.223681 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.223601 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2m78j\"" Sep 18 13:03:01.226829 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.226809 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmf97" Sep 18 13:03:01.230919 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.230898 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:03:01.235133 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.235115 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npxzw\"" Sep 18 13:03:01.243080 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.243043 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7c88g" Sep 18 13:03:01.507074 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.506991 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2ng6"] Sep 18 13:03:01.510243 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:03:01.510215 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9599a6a9_dd9b_4c0e_b9d8_39edd51d060d.slice/crio-455ab746d99df4512705076b50e17c4f806da36299a5d71f702091e3f34564cc WatchSource:0}: Error finding container 455ab746d99df4512705076b50e17c4f806da36299a5d71f702091e3f34564cc: Status 404 returned error can't find the container with id 455ab746d99df4512705076b50e17c4f806da36299a5d71f702091e3f34564cc Sep 18 13:03:01.519034 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.519001 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nmf97"] Sep 18 13:03:01.523773 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:03:01.523748 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8446e348_a097_43b3_beb8_d08622222f3b.slice/crio-f3daaf6e26df4e75115549fce048728a1a80226c5f16e5738b6e9c746cfd6e2a WatchSource:0}: Error finding container f3daaf6e26df4e75115549fce048728a1a80226c5f16e5738b6e9c746cfd6e2a: Status 404 returned error can't find the container with id f3daaf6e26df4e75115549fce048728a1a80226c5f16e5738b6e9c746cfd6e2a Sep 18 13:03:01.549479 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.549446 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7c88g"] Sep 18 13:03:01.552123 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:03:01.552092 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799efce0_1a62_4455_8935_c9d4aa52ce16.slice/crio-dd699abd891bd0ffed20181af1a19d65396448659c902c1a0879d68986cd95e2 WatchSource:0}: Error finding container dd699abd891bd0ffed20181af1a19d65396448659c902c1a0879d68986cd95e2: Status 404 returned error can't find the container with id dd699abd891bd0ffed20181af1a19d65396448659c902c1a0879d68986cd95e2 Sep 18 13:03:01.611586 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.611545 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7c88g" event={"ID":"799efce0-1a62-4455-8935-c9d4aa52ce16","Type":"ContainerStarted","Data":"dd699abd891bd0ffed20181af1a19d65396448659c902c1a0879d68986cd95e2"} Sep 18 13:03:01.612765 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.612734 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2ng6" event={"ID":"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d","Type":"ContainerStarted","Data":"455ab746d99df4512705076b50e17c4f806da36299a5d71f702091e3f34564cc"} Sep 18 13:03:01.613826 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:01.613804 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nmf97" event={"ID":"8446e348-a097-43b3-beb8-d08622222f3b","Type":"ContainerStarted","Data":"f3daaf6e26df4e75115549fce048728a1a80226c5f16e5738b6e9c746cfd6e2a"} Sep 18 13:03:03.624227 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:03.624164 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7c88g" event={"ID":"799efce0-1a62-4455-8935-c9d4aa52ce16","Type":"ContainerStarted","Data":"04b079930cf4a1e4aa4409e5042c45fbac3ff395617705d7637fb533ceca69d2"} Sep 18 13:03:03.624724 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:03.624259 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7c88g" event={"ID":"799efce0-1a62-4455-8935-c9d4aa52ce16","Type":"ContainerStarted","Data":"d69753939b9bbca5755f1c2f66d92ef3c61dfd9faa0818666f21adf5657523c0"} Sep 18 13:03:03.675265 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:03.675188 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7c88g" podStartSLOduration=67.59057403 podStartE2EDuration="1m8.675164976s" totalImagesPullingTime="1.084590946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:03:03.674603809 +0000 UTC m=+70.417138315" watchObservedRunningTime="2026-09-18 13:03:03.675164976 +0000 UTC m=+70.417699483" Sep 18 13:03:03.750750 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:03.750705 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:03:03.753765 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:03.753735 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eabe6726-cd96-4116-ab6a-35f40c2e924d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-nbnwg\" (UID: \"eabe6726-cd96-4116-ab6a-35f40c2e924d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:03:03.963652 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:03.963572 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nt25g\"" Sep 18 13:03:03.971176 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:03.971144 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" Sep 18 13:03:05.732721 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:05.732674 2561 patch_prober.go:28] interesting pod/image-registry-684d889645-t46kz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 13:03:05.733156 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:05.732746 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:03:06.606919 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:06.606840 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg"] Sep 18 13:03:06.609921 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:03:06.609895 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeabe6726_cd96_4116_ab6a_35f40c2e924d.slice/crio-a679bc4e4b3b472bb6083d5193c0017f25a499c5a723f25dbbb3016101b5fdae WatchSource:0}: Error finding container a679bc4e4b3b472bb6083d5193c0017f25a499c5a723f25dbbb3016101b5fdae: Status 404 returned error can't find the container with id a679bc4e4b3b472bb6083d5193c0017f25a499c5a723f25dbbb3016101b5fdae Sep 18 13:03:06.637669 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:06.637628 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2ng6" event={"ID":"9599a6a9-dd9b-4c0e-b9d8-39edd51d060d","Type":"ContainerStarted","Data":"3fb37a4f947691ebf0ef4b437bb087f04eba5f633a2cbd7005041c56ccd7bba6"} Sep 18 13:03:06.637877 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:06.637705 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:03:06.638937 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:06.638908 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" event={"ID":"eabe6726-cd96-4116-ab6a-35f40c2e924d","Type":"ContainerStarted","Data":"a679bc4e4b3b472bb6083d5193c0017f25a499c5a723f25dbbb3016101b5fdae"} Sep 18 13:03:06.640187 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:06.640165 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nmf97" event={"ID":"8446e348-a097-43b3-beb8-d08622222f3b","Type":"ContainerStarted","Data":"63305700b1895ca8203598b0dd75c26533c68e67fdccf9917c101cfb8e67e917"} Sep 18 13:03:06.716344 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:06.716286 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nmf97" podStartSLOduration=66.908509028 podStartE2EDuration="1m11.716268266s" totalImagesPullingTime="4.807759238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:03:06.716070765 +0000 UTC m=+73.458605269" watchObservedRunningTime="2026-09-18 13:03:06.716268266 +0000 UTC m=+73.458802924" Sep 18 13:03:06.716592 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:06.716561 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h2ng6" podStartSLOduration=66.902820818 podStartE2EDuration="1m11.716546245s" totalImagesPullingTime="4.813725427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:03:06.68526662 +0000 UTC m=+73.427801130" watchObservedRunningTime="2026-09-18 13:03:06.716546245 +0000 UTC m=+73.459080751" Sep 18 13:03:07.557305 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:07.557268 2561 patch_prober.go:28] interesting pod/image-registry-684d889645-t46kz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 13:03:07.557753 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:07.557345 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:03:08.648564 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:08.648525 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" event={"ID":"eabe6726-cd96-4116-ab6a-35f40c2e924d","Type":"ContainerStarted","Data":"b7c9bdee517f3d6a13c3a353c262e419250bc6d7f98f6b6524b77d7ef1179db6"} Sep 18 13:03:08.672791 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:08.672733 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-nbnwg" podStartSLOduration=36.233023505 podStartE2EDuration="37.672714132s" totalImagesPullingTime="1.439690627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:03:08.672284764 +0000 UTC m=+75.414819268" watchObservedRunningTime="2026-09-18 13:03:08.672714132 +0000 UTC m=+75.415248668" Sep 18 13:03:15.731199 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:15.731160 2561 patch_prober.go:28] interesting pod/image-registry-684d889645-t46kz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 13:03:15.731616 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:15.731219 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:03:17.555791 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:17.555752 2561 patch_prober.go:28] interesting pod/image-registry-684d889645-t46kz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 13:03:17.556243 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:17.555808 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:03:25.730561 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:25.730524 2561 patch_prober.go:28] interesting pod/image-registry-684d889645-t46kz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 13:03:25.730965 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:25.730582 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:03:25.730965 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:25.730623 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:03:25.731107 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:25.731079 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee"} pod="openshift-image-registry/image-registry-684d889645-t46kz" containerMessage="Container registry failed liveness probe, will be restarted" Sep 18 13:03:25.734750 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:25.734719 2561 patch_prober.go:28] interesting pod/image-registry-684d889645-t46kz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 13:03:25.734898 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:25.734771 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:03:35.735352 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:35.735315 2561 patch_prober.go:28] interesting pod/image-registry-684d889645-t46kz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 13:03:35.735749 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:35.735371 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:03:37.645956 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:37.645925 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h2ng6" Sep 18 13:03:45.735519 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:45.735486 2561 patch_prober.go:28] interesting pod/image-registry-684d889645-t46kz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 13:03:45.735900 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:45.735541 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:03:50.749382 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:50.749330 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" containerID="cri-o://446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee" gracePeriod=30 Sep 18 13:03:51.788335 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:51.788299 2561 generic.go:356] "Generic (PLEG): container finished" podID="9e709dc6-0815-4168-b914-944dfda60cc4" containerID="446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee" exitCode=0 Sep 18 13:03:51.788770 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:51.788353 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684d889645-t46kz" event={"ID":"9e709dc6-0815-4168-b914-944dfda60cc4","Type":"ContainerDied","Data":"446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee"} Sep 18 13:03:51.788770 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:51.788397 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684d889645-t46kz" event={"ID":"9e709dc6-0815-4168-b914-944dfda60cc4","Type":"ContainerStarted","Data":"ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de"} Sep 18 13:03:51.788770 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:51.788579 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:03:58.384925 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:58.384898 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zvdt4_508dc149-0c51-46b7-979f-f11e6ac25e34/dns/0.log" Sep 18 13:03:58.585653 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:58.585625 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zvdt4_508dc149-0c51-46b7-979f-f11e6ac25e34/kube-rbac-proxy/0.log" Sep 18 13:03:59.184770 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:59.184743 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hwv6b_a9ecbc08-3b20-43af-9dc6-baf00289115f/dns-node-resolver/0.log" Sep 18 13:03:59.385352 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:59.385310 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-684d889645-t46kz_9e709dc6-0815-4168-b914-944dfda60cc4/registry/0.log" Sep 18 13:03:59.589631 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:03:59.589603 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-684d889645-t46kz_9e709dc6-0815-4168-b914-944dfda60cc4/registry/1.log" Sep 18 13:04:00.185603 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:00.185572 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-95476_7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5/node-ca/0.log" Sep 18 13:04:00.987394 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:00.987366 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qrzkg_c7117749-269a-43d0-961a-c6caf1280056/serve-healthcheck-canary/0.log" Sep 18 13:04:05.730966 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:05.730931 2561 patch_prober.go:28] interesting pod/image-registry-684d889645-t46kz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 13:04:05.731347 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:05.730988 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:04:09.915359 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.915322 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw"] Sep 18 13:04:09.920269 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.920239 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8"] Sep 18 13:04:09.920500 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.920354 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:09.923279 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.923257 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:09.932436 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.932397 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 13:04:09.944906 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.944873 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 13:04:09.946416 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.946306 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 18 13:04:09.946416 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.946325 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 13:04:09.946416 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.946331 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 18 13:04:09.946416 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.946380 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 18 13:04:09.946722 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.946488 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 18 13:04:09.946722 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.946686 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 18 13:04:09.971841 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:09.971803 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw"] Sep 18 13:04:10.010408 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.010360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-hub\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.010408 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.010405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/80694f68-a149-4d6a-b721-ead0a48c072d-klusterlet-config\") pod \"klusterlet-addon-workmgr-795c68d96b-bmcrw\" (UID: \"80694f68-a149-4d6a-b721-ead0a48c072d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:10.010687 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.010456 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.010687 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.010524 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/971c01be-f639-4d84-b9e5-270b01b163f3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.010687 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.010557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phfwr\" (UniqueName: \"kubernetes.io/projected/80694f68-a149-4d6a-b721-ead0a48c072d-kube-api-access-phfwr\") pod \"klusterlet-addon-workmgr-795c68d96b-bmcrw\" (UID: \"80694f68-a149-4d6a-b721-ead0a48c072d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:10.010687 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.010597 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-ca\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.010687 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.010613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80694f68-a149-4d6a-b721-ead0a48c072d-tmp\") pod \"klusterlet-addon-workmgr-795c68d96b-bmcrw\" (UID: \"80694f68-a149-4d6a-b721-ead0a48c072d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:10.010902 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.010682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.010902 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.010719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt7dp\" (UniqueName: \"kubernetes.io/projected/971c01be-f639-4d84-b9e5-270b01b163f3-kube-api-access-xt7dp\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.024695 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.024659 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-684d889645-t46kz"] Sep 18 13:04:10.028670 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.028641 2561 patch_prober.go:28] interesting pod/image-registry-684d889645-t46kz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 13:04:10.028806 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.028693 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:04:10.099345 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.099310 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8"] Sep 18 13:04:10.111810 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.111773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-hub\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.111810 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.111815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/80694f68-a149-4d6a-b721-ead0a48c072d-klusterlet-config\") pod \"klusterlet-addon-workmgr-795c68d96b-bmcrw\" (UID: \"80694f68-a149-4d6a-b721-ead0a48c072d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:10.112044 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.111842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.112044 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.111871 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/971c01be-f639-4d84-b9e5-270b01b163f3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.112044 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.111983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phfwr\" (UniqueName: \"kubernetes.io/projected/80694f68-a149-4d6a-b721-ead0a48c072d-kube-api-access-phfwr\") pod \"klusterlet-addon-workmgr-795c68d96b-bmcrw\" (UID: \"80694f68-a149-4d6a-b721-ead0a48c072d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:10.112198 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.112047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-ca\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.112198 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.112073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80694f68-a149-4d6a-b721-ead0a48c072d-tmp\") pod \"klusterlet-addon-workmgr-795c68d96b-bmcrw\" (UID: \"80694f68-a149-4d6a-b721-ead0a48c072d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:10.112198 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.112101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.112198 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.112128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt7dp\" (UniqueName: \"kubernetes.io/projected/971c01be-f639-4d84-b9e5-270b01b163f3-kube-api-access-xt7dp\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.112622 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.112595 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80694f68-a149-4d6a-b721-ead0a48c072d-tmp\") pod \"klusterlet-addon-workmgr-795c68d96b-bmcrw\" (UID: \"80694f68-a149-4d6a-b721-ead0a48c072d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:10.112622 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.112618 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/971c01be-f639-4d84-b9e5-270b01b163f3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.114710 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.114686 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/80694f68-a149-4d6a-b721-ead0a48c072d-klusterlet-config\") pod \"klusterlet-addon-workmgr-795c68d96b-bmcrw\" (UID: \"80694f68-a149-4d6a-b721-ead0a48c072d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:10.114710 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.114705 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-ca\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.114896 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.114749 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.114896 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.114865 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-hub\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.114896 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.114892 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/971c01be-f639-4d84-b9e5-270b01b163f3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.149268 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.149240 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt7dp\" (UniqueName: \"kubernetes.io/projected/971c01be-f639-4d84-b9e5-270b01b163f3-kube-api-access-xt7dp\") pod \"cluster-proxy-proxy-agent-5b79758c6c-hdlc8\" (UID: \"971c01be-f639-4d84-b9e5-270b01b163f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.217691 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.217608 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phfwr\" (UniqueName: \"kubernetes.io/projected/80694f68-a149-4d6a-b721-ead0a48c072d-kube-api-access-phfwr\") pod \"klusterlet-addon-workmgr-795c68d96b-bmcrw\" (UID: \"80694f68-a149-4d6a-b721-ead0a48c072d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:10.231297 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.231259 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:10.245463 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.245436 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" Sep 18 13:04:10.297302 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.296320 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-576c75d5fb-2j894"] Sep 18 13:04:10.300696 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.300325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.413757 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.413712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c9b3f02-862c-4817-be06-d1471e0f068b-image-registry-private-configuration\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.413757 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.413766 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c9b3f02-862c-4817-be06-d1471e0f068b-registry-tls\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.413976 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.413820 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c9b3f02-862c-4817-be06-d1471e0f068b-ca-trust-extracted\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.413976 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.413850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c9b3f02-862c-4817-be06-d1471e0f068b-registry-certificates\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.413976 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.413866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c9b3f02-862c-4817-be06-d1471e0f068b-trusted-ca\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.413976 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.413887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kjsg\" (UniqueName: \"kubernetes.io/projected/0c9b3f02-862c-4817-be06-d1471e0f068b-kube-api-access-4kjsg\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.413976 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.413945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c9b3f02-862c-4817-be06-d1471e0f068b-installation-pull-secrets\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.413976 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.413973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c9b3f02-862c-4817-be06-d1471e0f068b-bound-sa-token\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.468915 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.468830 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-576c75d5fb-2j894"] Sep 18 13:04:10.515271 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.515228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c9b3f02-862c-4817-be06-d1471e0f068b-registry-certificates\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.515271 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.515272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c9b3f02-862c-4817-be06-d1471e0f068b-trusted-ca\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.515526 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.515315 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kjsg\" (UniqueName: \"kubernetes.io/projected/0c9b3f02-862c-4817-be06-d1471e0f068b-kube-api-access-4kjsg\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.515526 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.515355 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c9b3f02-862c-4817-be06-d1471e0f068b-installation-pull-secrets\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.515526 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.515377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c9b3f02-862c-4817-be06-d1471e0f068b-bound-sa-token\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.515526 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.515413 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c9b3f02-862c-4817-be06-d1471e0f068b-image-registry-private-configuration\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.515526 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.515496 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c9b3f02-862c-4817-be06-d1471e0f068b-registry-tls\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.515777 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.515561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c9b3f02-862c-4817-be06-d1471e0f068b-ca-trust-extracted\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.516011 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.515977 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c9b3f02-862c-4817-be06-d1471e0f068b-ca-trust-extracted\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.516140 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.516066 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c9b3f02-862c-4817-be06-d1471e0f068b-registry-certificates\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.516615 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.516596 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c9b3f02-862c-4817-be06-d1471e0f068b-trusted-ca\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.517912 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.517890 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c9b3f02-862c-4817-be06-d1471e0f068b-registry-tls\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.518189 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.518173 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c9b3f02-862c-4817-be06-d1471e0f068b-installation-pull-secrets\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.518275 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.518259 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c9b3f02-862c-4817-be06-d1471e0f068b-image-registry-private-configuration\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.529954 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.529926 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw"] Sep 18 13:04:10.533305 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:04:10.533273 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80694f68_a149_4d6a_b721_ead0a48c072d.slice/crio-83d1336ddacee0b3a631f04f6bf9a3bea8a53ef523b16ae1a8675bf4cc0ea96e WatchSource:0}: Error finding container 83d1336ddacee0b3a631f04f6bf9a3bea8a53ef523b16ae1a8675bf4cc0ea96e: Status 404 returned error can't find the container with id 83d1336ddacee0b3a631f04f6bf9a3bea8a53ef523b16ae1a8675bf4cc0ea96e Sep 18 13:04:10.533734 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.533710 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kjsg\" (UniqueName: \"kubernetes.io/projected/0c9b3f02-862c-4817-be06-d1471e0f068b-kube-api-access-4kjsg\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.535473 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.535450 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c9b3f02-862c-4817-be06-d1471e0f068b-bound-sa-token\") pod \"image-registry-576c75d5fb-2j894\" (UID: \"0c9b3f02-862c-4817-be06-d1471e0f068b\") " pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.561943 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.561908 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8"] Sep 18 13:04:10.567266 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:04:10.567226 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod971c01be_f639_4d84_b9e5_270b01b163f3.slice/crio-e1e5c6cc848b67988a97292357fee54a999f35b718035e376adc50d4a58b5d69 WatchSource:0}: Error finding container e1e5c6cc848b67988a97292357fee54a999f35b718035e376adc50d4a58b5d69: Status 404 returned error can't find the container with id e1e5c6cc848b67988a97292357fee54a999f35b718035e376adc50d4a58b5d69 Sep 18 13:04:10.613750 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.613717 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:10.851483 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.851447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" event={"ID":"80694f68-a149-4d6a-b721-ead0a48c072d","Type":"ContainerStarted","Data":"83d1336ddacee0b3a631f04f6bf9a3bea8a53ef523b16ae1a8675bf4cc0ea96e"} Sep 18 13:04:10.852632 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.852603 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" event={"ID":"971c01be-f639-4d84-b9e5-270b01b163f3","Type":"ContainerStarted","Data":"e1e5c6cc848b67988a97292357fee54a999f35b718035e376adc50d4a58b5d69"} Sep 18 13:04:10.913136 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:10.913101 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-576c75d5fb-2j894"] Sep 18 13:04:10.916569 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:04:10.916542 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c9b3f02_862c_4817_be06_d1471e0f068b.slice/crio-44e225ff370f2a07260d892d3a936e3ec72073623569e1f6f19b97f985ef6978 WatchSource:0}: Error finding container 44e225ff370f2a07260d892d3a936e3ec72073623569e1f6f19b97f985ef6978: Status 404 returned error can't find the container with id 44e225ff370f2a07260d892d3a936e3ec72073623569e1f6f19b97f985ef6978 Sep 18 13:04:11.858698 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:11.858602 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576c75d5fb-2j894" event={"ID":"0c9b3f02-862c-4817-be06-d1471e0f068b","Type":"ContainerStarted","Data":"e5f4438cb4051cc6e05bb7e46412f37ac2eb0b3d766af6ead05732e95383e2a4"} Sep 18 13:04:11.858698 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:11.858661 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576c75d5fb-2j894" event={"ID":"0c9b3f02-862c-4817-be06-d1471e0f068b","Type":"ContainerStarted","Data":"44e225ff370f2a07260d892d3a936e3ec72073623569e1f6f19b97f985ef6978"} Sep 18 13:04:11.858963 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:11.858886 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:11.900907 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:11.900851 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-576c75d5fb-2j894" podStartSLOduration=1.900829024 podStartE2EDuration="1.900829024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:04:11.899732004 +0000 UTC m=+138.642266534" watchObservedRunningTime="2026-09-18 13:04:11.900829024 +0000 UTC m=+138.643363529" Sep 18 13:04:16.882757 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:16.882716 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" event={"ID":"80694f68-a149-4d6a-b721-ead0a48c072d","Type":"ContainerStarted","Data":"c84cc4ded13bfb5a6bd8381bba513f047f0927d52d33b539856ef8956f5bf2d5"} Sep 18 13:04:16.883243 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:16.882820 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:16.885045 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:16.885018 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" Sep 18 13:04:16.885411 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:16.885390 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" event={"ID":"971c01be-f639-4d84-b9e5-270b01b163f3","Type":"ContainerStarted","Data":"23beaecb7280cfce000d884f5acafee8b1f8b75017b34c3bc51122fe47bf6a97"} Sep 18 13:04:16.885505 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:16.885446 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" event={"ID":"971c01be-f639-4d84-b9e5-270b01b163f3","Type":"ContainerStarted","Data":"972be754d13829624823d95023613b92965d97341ab647ecb9a5b493b3b9fcc8"} Sep 18 13:04:16.885505 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:16.885461 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" event={"ID":"971c01be-f639-4d84-b9e5-270b01b163f3","Type":"ContainerStarted","Data":"090014493eab24b5c53429fc9dd457b969a9905eeb6b16ced05076ed403fc44f"} Sep 18 13:04:16.899417 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:16.899353 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-795c68d96b-bmcrw" podStartSLOduration=2.108033801 podStartE2EDuration="7.899332132s" totalImagesPullingTime="5.791298331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:04:16.898361429 +0000 UTC m=+143.640895934" watchObservedRunningTime="2026-09-18 13:04:16.899332132 +0000 UTC m=+143.641866651" Sep 18 13:04:16.919328 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:16.919274 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79758c6c-hdlc8" podStartSLOduration=2.164224134 podStartE2EDuration="7.919254899s" totalImagesPullingTime="5.755030765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:04:16.918197496 +0000 UTC m=+143.660732003" watchObservedRunningTime="2026-09-18 13:04:16.919254899 +0000 UTC m=+143.661789403" Sep 18 13:04:18.827732 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.827692 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jzvv2"] Sep 18 13:04:18.831119 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.831098 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.837236 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.837096 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 13:04:18.837236 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.837204 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 13:04:18.837236 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.837211 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 13:04:18.837555 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.837539 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 13:04:18.837896 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.837870 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 13:04:18.837896 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.837875 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 13:04:18.838226 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.838208 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wlt4p\"" Sep 18 13:04:18.885189 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.885140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvmbb\" (UniqueName: \"kubernetes.io/projected/ea5a9675-e137-4583-8b60-f73093dc0215-kube-api-access-wvmbb\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.885392 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.885203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.885392 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.885283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-tls\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.885392 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.885313 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-textfile\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.885392 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.885344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea5a9675-e137-4583-8b60-f73093dc0215-sys\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.885392 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.885369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea5a9675-e137-4583-8b60-f73093dc0215-metrics-client-ca\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.885663 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.885395 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea5a9675-e137-4583-8b60-f73093dc0215-root\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.885663 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.885416 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-wtmp\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.885663 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.885487 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.986786 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.986736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-tls\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.986786 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.986783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-textfile\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.986816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea5a9675-e137-4583-8b60-f73093dc0215-sys\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.986849 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea5a9675-e137-4583-8b60-f73093dc0215-metrics-client-ca\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.986876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea5a9675-e137-4583-8b60-f73093dc0215-root\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.986897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-wtmp\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.986920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.986953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvmbb\" (UniqueName: \"kubernetes.io/projected/ea5a9675-e137-4583-8b60-f73093dc0215-kube-api-access-wvmbb\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.987009 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987374 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.987202 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-wtmp\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987374 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.987215 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-textfile\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987374 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.987264 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea5a9675-e137-4583-8b60-f73093dc0215-sys\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987645 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.987459 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea5a9675-e137-4583-8b60-f73093dc0215-root\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987645 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.987593 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.987804 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.987776 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea5a9675-e137-4583-8b60-f73093dc0215-metrics-client-ca\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.989594 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.989573 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.989782 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.989766 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea5a9675-e137-4583-8b60-f73093dc0215-node-exporter-tls\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:18.996855 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:18.996828 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvmbb\" (UniqueName: \"kubernetes.io/projected/ea5a9675-e137-4583-8b60-f73093dc0215-kube-api-access-wvmbb\") pod \"node-exporter-jzvv2\" (UID: \"ea5a9675-e137-4583-8b60-f73093dc0215\") " pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:19.143553 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:19.143449 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jzvv2" Sep 18 13:04:19.155200 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:04:19.155166 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5a9675_e137_4583_8b60_f73093dc0215.slice/crio-0d22857964cbd1ab1e6837e2729da2d02cf3fd72330f745787dd1fef840ef0ba WatchSource:0}: Error finding container 0d22857964cbd1ab1e6837e2729da2d02cf3fd72330f745787dd1fef840ef0ba: Status 404 returned error can't find the container with id 0d22857964cbd1ab1e6837e2729da2d02cf3fd72330f745787dd1fef840ef0ba Sep 18 13:04:19.897929 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:19.897887 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzvv2" event={"ID":"ea5a9675-e137-4583-8b60-f73093dc0215","Type":"ContainerStarted","Data":"0d22857964cbd1ab1e6837e2729da2d02cf3fd72330f745787dd1fef840ef0ba"} Sep 18 13:04:20.029439 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:20.029388 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:04:20.902926 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:20.902886 2561 generic.go:356] "Generic (PLEG): container finished" podID="ea5a9675-e137-4583-8b60-f73093dc0215" containerID="b33f009dacc40e08cf0fcee60ceeaefb27634f53fc64095381b5aa7b8fd6d9c2" exitCode=0 Sep 18 13:04:20.903347 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:20.902934 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzvv2" event={"ID":"ea5a9675-e137-4583-8b60-f73093dc0215","Type":"ContainerDied","Data":"b33f009dacc40e08cf0fcee60ceeaefb27634f53fc64095381b5aa7b8fd6d9c2"} Sep 18 13:04:21.908789 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:21.908752 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzvv2" event={"ID":"ea5a9675-e137-4583-8b60-f73093dc0215","Type":"ContainerStarted","Data":"e10870ecbd732df9192755994fbc765d1aa827221eaca27b768b7deadf1dfd8b"} Sep 18 13:04:21.909234 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:21.908812 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzvv2" event={"ID":"ea5a9675-e137-4583-8b60-f73093dc0215","Type":"ContainerStarted","Data":"37d40a05326bd4b68ac227937a60553562e07a98ba1e4869a19f899b41aee643"} Sep 18 13:04:23.711618 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.711554 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jzvv2" podStartSLOduration=4.592242304 podStartE2EDuration="5.711529041s" totalImagesPullingTime="1.05510097s" totalInitContainerRuntime="64.185767ms" isStatefulPod=true podCreationTimestamp="2026-09-18 13:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:04:21.937037606 +0000 UTC m=+148.679572120" watchObservedRunningTime="2026-09-18 13:04:23.711529041 +0000 UTC m=+150.454063549" Sep 18 13:04:23.712329 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.712312 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw"] Sep 18 13:04:23.715661 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.715640 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" Sep 18 13:04:23.721668 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.721633 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2cfaa1e-3958-4615-9326-e9565a3c7543-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-tl8fw\" (UID: \"d2cfaa1e-3958-4615-9326-e9565a3c7543\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" Sep 18 13:04:23.721820 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.721714 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhrlw\" (UniqueName: \"kubernetes.io/projected/d2cfaa1e-3958-4615-9326-e9565a3c7543-kube-api-access-jhrlw\") pod \"monitoring-plugin-5984459ff8-tl8fw\" (UID: \"d2cfaa1e-3958-4615-9326-e9565a3c7543\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" Sep 18 13:04:23.729132 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.729109 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 13:04:23.731707 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.731688 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cl5cw\"" Sep 18 13:04:23.741284 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.741257 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw"] Sep 18 13:04:23.823046 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.823002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrlw\" (UniqueName: \"kubernetes.io/projected/d2cfaa1e-3958-4615-9326-e9565a3c7543-kube-api-access-jhrlw\") pod \"monitoring-plugin-5984459ff8-tl8fw\" (UID: \"d2cfaa1e-3958-4615-9326-e9565a3c7543\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" Sep 18 13:04:23.823259 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.823067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2cfaa1e-3958-4615-9326-e9565a3c7543-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-tl8fw\" (UID: \"d2cfaa1e-3958-4615-9326-e9565a3c7543\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" Sep 18 13:04:23.825688 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.825662 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2cfaa1e-3958-4615-9326-e9565a3c7543-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-tl8fw\" (UID: \"d2cfaa1e-3958-4615-9326-e9565a3c7543\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" Sep 18 13:04:23.846841 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:23.846813 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhrlw\" (UniqueName: \"kubernetes.io/projected/d2cfaa1e-3958-4615-9326-e9565a3c7543-kube-api-access-jhrlw\") pod \"monitoring-plugin-5984459ff8-tl8fw\" (UID: \"d2cfaa1e-3958-4615-9326-e9565a3c7543\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" Sep 18 13:04:24.024150 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:24.024116 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" Sep 18 13:04:24.377317 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:24.377236 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw"] Sep 18 13:04:24.380782 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:04:24.380755 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2cfaa1e_3958_4615_9326_e9565a3c7543.slice/crio-0d76e8cedbb950dd8fc27cd4d95799db2fafddc530076660c120a9b79728c1f3 WatchSource:0}: Error finding container 0d76e8cedbb950dd8fc27cd4d95799db2fafddc530076660c120a9b79728c1f3: Status 404 returned error can't find the container with id 0d76e8cedbb950dd8fc27cd4d95799db2fafddc530076660c120a9b79728c1f3 Sep 18 13:04:24.920749 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:24.920710 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" event={"ID":"d2cfaa1e-3958-4615-9326-e9565a3c7543","Type":"ContainerStarted","Data":"0d76e8cedbb950dd8fc27cd4d95799db2fafddc530076660c120a9b79728c1f3"} Sep 18 13:04:25.578611 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.578574 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6ff5c94764-lkpmg"] Sep 18 13:04:25.582735 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.582703 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.594125 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.594096 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 18 13:04:25.594273 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.594152 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 18 13:04:25.594273 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.594096 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 18 13:04:25.594416 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.594268 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-boqnqghgp97ic\"" Sep 18 13:04:25.622460 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.622402 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 18 13:04:25.622649 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.622508 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jqqc5\"" Sep 18 13:04:25.623220 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.623196 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 18 13:04:25.638202 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.638168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.638394 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.638213 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.638394 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.638244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c6d557b-26fd-4d24-be99-e5d24bdba53d-metrics-client-ca\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.638394 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.638361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jslkx\" (UniqueName: \"kubernetes.io/projected/8c6d557b-26fd-4d24-be99-e5d24bdba53d-kube-api-access-jslkx\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.638578 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.638409 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.638578 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.638479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-grpc-tls\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.638578 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.638510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-tls\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.638729 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.638575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.739583 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.739540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.739775 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.739597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.739775 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.739616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c6d557b-26fd-4d24-be99-e5d24bdba53d-metrics-client-ca\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.739775 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.739668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jslkx\" (UniqueName: \"kubernetes.io/projected/8c6d557b-26fd-4d24-be99-e5d24bdba53d-kube-api-access-jslkx\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.739775 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.739702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.739775 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.739734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-grpc-tls\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.739775 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.739763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-tls\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.740045 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.739795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.740532 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.740472 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c6d557b-26fd-4d24-be99-e5d24bdba53d-metrics-client-ca\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.742931 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.742862 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.743056 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.743033 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.743677 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.743625 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.743677 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.743646 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.743848 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.743752 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-thanos-querier-tls\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.744840 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.744818 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c6d557b-26fd-4d24-be99-e5d24bdba53d-secret-grpc-tls\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.750280 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.750250 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ff5c94764-lkpmg"] Sep 18 13:04:25.755252 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.755184 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jslkx\" (UniqueName: \"kubernetes.io/projected/8c6d557b-26fd-4d24-be99-e5d24bdba53d-kube-api-access-jslkx\") pod \"thanos-querier-6ff5c94764-lkpmg\" (UID: \"8c6d557b-26fd-4d24-be99-e5d24bdba53d\") " pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:25.894756 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:25.894722 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:26.220568 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:26.220484 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ff5c94764-lkpmg"] Sep 18 13:04:26.223905 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:04:26.223873 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6d557b_26fd_4d24_be99_e5d24bdba53d.slice/crio-c9030968903df5ae78897285d6bb36c04c5ccca01bd835acc7090d9796f88f89 WatchSource:0}: Error finding container c9030968903df5ae78897285d6bb36c04c5ccca01bd835acc7090d9796f88f89: Status 404 returned error can't find the container with id c9030968903df5ae78897285d6bb36c04c5ccca01bd835acc7090d9796f88f89 Sep 18 13:04:26.933735 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:26.933704 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" event={"ID":"d2cfaa1e-3958-4615-9326-e9565a3c7543","Type":"ContainerStarted","Data":"3fb7944b473e26bdbd017906748d94a5fd939696c1fb9871f3b1ac6d721baba3"} Sep 18 13:04:26.933924 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:26.933782 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" Sep 18 13:04:26.935128 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:26.935103 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" event={"ID":"8c6d557b-26fd-4d24-be99-e5d24bdba53d","Type":"ContainerStarted","Data":"c9030968903df5ae78897285d6bb36c04c5ccca01bd835acc7090d9796f88f89"} Sep 18 13:04:26.939018 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:26.938994 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" Sep 18 13:04:26.963965 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:26.963915 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-tl8fw" podStartSLOduration=2.472208753 podStartE2EDuration="3.963899437s" totalImagesPullingTime="1.491690684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:04:26.962260104 +0000 UTC m=+153.704794608" watchObservedRunningTime="2026-09-18 13:04:26.963899437 +0000 UTC m=+153.706433942" Sep 18 13:04:28.945457 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:28.945401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" event={"ID":"8c6d557b-26fd-4d24-be99-e5d24bdba53d","Type":"ContainerStarted","Data":"ebf161d140e6e3f1c43535f9263792c19a281e661544e3afd314dc63e53691e5"} Sep 18 13:04:28.945868 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:28.945509 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" event={"ID":"8c6d557b-26fd-4d24-be99-e5d24bdba53d","Type":"ContainerStarted","Data":"f237e06366a0e322f953e98cfd2ff97bb819af495a141c4edf3abe48b79ec586"} Sep 18 13:04:28.945868 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:28.945558 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" event={"ID":"8c6d557b-26fd-4d24-be99-e5d24bdba53d","Type":"ContainerStarted","Data":"80a19318c72b962eeaf7507bc0520c27614694e826952704f9bbafb433909569"} Sep 18 13:04:29.952831 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:29.952788 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" event={"ID":"8c6d557b-26fd-4d24-be99-e5d24bdba53d","Type":"ContainerStarted","Data":"98dae39b90584768f6b726642c8e7cdbb5a93d76d6fbcb1ff0246fbcc07d069c"} Sep 18 13:04:29.953231 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:29.952852 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" event={"ID":"8c6d557b-26fd-4d24-be99-e5d24bdba53d","Type":"ContainerStarted","Data":"8fd6a77e0b185a8000873bbfd2b1eb098fa79ccb84411c25f922cc4c132068f7"} Sep 18 13:04:29.953231 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:29.952878 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" event={"ID":"8c6d557b-26fd-4d24-be99-e5d24bdba53d","Type":"ContainerStarted","Data":"d92c15ac46f14ca1e92382c831eccb6ecf23427eb968a37e8686e3d3fd1cefa0"} Sep 18 13:04:29.953231 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:29.952948 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:30.051734 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:30.051675 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" podStartSLOduration=2.211721462 podStartE2EDuration="5.051655929s" totalImagesPullingTime="2.839934467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:04:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:04:30.050566759 +0000 UTC m=+156.793101265" watchObservedRunningTime="2026-09-18 13:04:30.051655929 +0000 UTC m=+156.794190472" Sep 18 13:04:32.869699 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:32.869669 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-576c75d5fb-2j894" Sep 18 13:04:35.042870 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.042804 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-684d889645-t46kz" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" containerID="cri-o://ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de" gracePeriod=30 Sep 18 13:04:35.309456 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.309408 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:04:35.427147 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.427105 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-bound-sa-token\") pod \"9e709dc6-0815-4168-b914-944dfda60cc4\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " Sep 18 13:04:35.427147 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.427166 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls\") pod \"9e709dc6-0815-4168-b914-944dfda60cc4\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " Sep 18 13:04:35.427412 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.427197 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhbf9\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-kube-api-access-mhbf9\") pod \"9e709dc6-0815-4168-b914-944dfda60cc4\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " Sep 18 13:04:35.427412 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.427231 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-registry-certificates\") pod \"9e709dc6-0815-4168-b914-944dfda60cc4\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " Sep 18 13:04:35.427412 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.427266 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-image-registry-private-configuration\") pod \"9e709dc6-0815-4168-b914-944dfda60cc4\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " Sep 18 13:04:35.427412 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.427292 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-trusted-ca\") pod \"9e709dc6-0815-4168-b914-944dfda60cc4\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " Sep 18 13:04:35.427412 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.427354 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-installation-pull-secrets\") pod \"9e709dc6-0815-4168-b914-944dfda60cc4\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " Sep 18 13:04:35.427412 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.427383 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e709dc6-0815-4168-b914-944dfda60cc4-ca-trust-extracted\") pod \"9e709dc6-0815-4168-b914-944dfda60cc4\" (UID: \"9e709dc6-0815-4168-b914-944dfda60cc4\") " Sep 18 13:04:35.427844 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.427807 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9e709dc6-0815-4168-b914-944dfda60cc4" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:04:35.427937 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.427844 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9e709dc6-0815-4168-b914-944dfda60cc4" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:04:35.429897 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.429854 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-kube-api-access-mhbf9" (OuterVolumeSpecName: "kube-api-access-mhbf9") pod "9e709dc6-0815-4168-b914-944dfda60cc4" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4"). InnerVolumeSpecName "kube-api-access-mhbf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:04:35.430033 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.430006 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9e709dc6-0815-4168-b914-944dfda60cc4" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:04:35.430095 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.430050 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9e709dc6-0815-4168-b914-944dfda60cc4" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:04:35.430153 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.430122 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9e709dc6-0815-4168-b914-944dfda60cc4" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:04:35.430199 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.430151 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9e709dc6-0815-4168-b914-944dfda60cc4" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:04:35.439045 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.439002 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e709dc6-0815-4168-b914-944dfda60cc4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9e709dc6-0815-4168-b914-944dfda60cc4" (UID: "9e709dc6-0815-4168-b914-944dfda60cc4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:04:35.528405 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.528363 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-registry-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:04:35.528405 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.528397 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhbf9\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-kube-api-access-mhbf9\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:04:35.528405 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.528409 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-registry-certificates\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:04:35.528642 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.528445 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-image-registry-private-configuration\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:04:35.528642 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.528454 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e709dc6-0815-4168-b914-944dfda60cc4-trusted-ca\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:04:35.528642 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.528462 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e709dc6-0815-4168-b914-944dfda60cc4-installation-pull-secrets\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:04:35.528642 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.528470 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e709dc6-0815-4168-b914-944dfda60cc4-ca-trust-extracted\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:04:35.528642 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.528479 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e709dc6-0815-4168-b914-944dfda60cc4-bound-sa-token\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:04:35.963747 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.963717 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6ff5c94764-lkpmg" Sep 18 13:04:35.977259 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.977228 2561 generic.go:356] "Generic (PLEG): container finished" podID="9e709dc6-0815-4168-b914-944dfda60cc4" containerID="ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de" exitCode=0 Sep 18 13:04:35.977443 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.977283 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684d889645-t46kz" Sep 18 13:04:35.977443 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.977306 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684d889645-t46kz" event={"ID":"9e709dc6-0815-4168-b914-944dfda60cc4","Type":"ContainerDied","Data":"ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de"} Sep 18 13:04:35.977443 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.977354 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684d889645-t46kz" event={"ID":"9e709dc6-0815-4168-b914-944dfda60cc4","Type":"ContainerDied","Data":"d4b17186428647389bb2c44852bfbff7d328e7fa76d5d435a0c5457be93bc9d0"} Sep 18 13:04:35.977443 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.977374 2561 scope.go:117] "RemoveContainer" containerID="ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de" Sep 18 13:04:35.986074 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.986056 2561 scope.go:117] "RemoveContainer" containerID="446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee" Sep 18 13:04:35.994040 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.994020 2561 scope.go:117] "RemoveContainer" containerID="ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de" Sep 18 13:04:35.994372 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:04:35.994351 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de\": container with ID starting with ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de not found: ID does not exist" containerID="ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de" Sep 18 13:04:35.994431 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.994382 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de"} err="failed to get container status \"ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de\": rpc error: code = NotFound desc = could not find container \"ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de\": container with ID starting with ca3a182139be49876ec00766e873deaf199d765286b3959ca05b9647ec2f91de not found: ID does not exist" Sep 18 13:04:35.994431 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.994400 2561 scope.go:117] "RemoveContainer" containerID="446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee" Sep 18 13:04:35.994736 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:04:35.994714 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee\": container with ID starting with 446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee not found: ID does not exist" containerID="446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee" Sep 18 13:04:35.994801 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:35.994741 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee"} err="failed to get container status \"446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee\": rpc error: code = NotFound desc = could not find container \"446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee\": container with ID starting with 446ddd23758403271684b0cdc71dec476de63b9399eece3f2ec9385170d05dee not found: ID does not exist" Sep 18 13:04:36.067154 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:36.067118 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-684d889645-t46kz"] Sep 18 13:04:36.074451 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:36.074408 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-684d889645-t46kz"] Sep 18 13:04:37.213532 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:04:37.213500 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" path="/var/lib/kubelet/pods/9e709dc6-0815-4168-b914-944dfda60cc4/volumes" Sep 18 13:06:55.115317 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:06:55.115291 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48w7v_32c6c241-bea2-43fc-80f1-5c1a697090e6/ovn-acl-logging/0.log" Sep 18 13:06:55.124853 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:06:55.124821 2561 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 13:06:55.134578 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:06:55.134551 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48w7v_32c6c241-bea2-43fc-80f1-5c1a697090e6/ovn-acl-logging/0.log" Sep 18 13:09:01.394270 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.394234 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg"] Sep 18 13:09:01.394738 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.394528 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" Sep 18 13:09:01.394738 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.394540 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" Sep 18 13:09:01.394738 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.394552 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" Sep 18 13:09:01.394738 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.394558 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" Sep 18 13:09:01.394738 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.394601 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" Sep 18 13:09:01.394738 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.394609 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e709dc6-0815-4168-b914-944dfda60cc4" containerName="registry" Sep 18 13:09:01.397460 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.397441 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.400919 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.400893 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 13:09:01.401061 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.400928 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rbf7n\"" Sep 18 13:09:01.401061 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.400978 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 13:09:01.401179 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.401070 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 13:09:01.401299 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.401281 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 13:09:01.419206 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.419177 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg"] Sep 18 13:09:01.426933 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.426883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2fecc2a6-b709-4a4a-b14d-d4922852faf7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.427079 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.426945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2fecc2a6-b709-4a4a-b14d-d4922852faf7-manifests\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.427079 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.427010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fecc2a6-b709-4a4a-b14d-d4922852faf7-webhook-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.427154 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.427079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28sjn\" (UniqueName: \"kubernetes.io/projected/2fecc2a6-b709-4a4a-b14d-d4922852faf7-kube-api-access-28sjn\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.427154 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.427115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fecc2a6-b709-4a4a-b14d-d4922852faf7-tmp\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.528481 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.528444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28sjn\" (UniqueName: \"kubernetes.io/projected/2fecc2a6-b709-4a4a-b14d-d4922852faf7-kube-api-access-28sjn\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.528481 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.528487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fecc2a6-b709-4a4a-b14d-d4922852faf7-tmp\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.528705 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.528508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2fecc2a6-b709-4a4a-b14d-d4922852faf7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.528705 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.528525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2fecc2a6-b709-4a4a-b14d-d4922852faf7-manifests\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.528705 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.528597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fecc2a6-b709-4a4a-b14d-d4922852faf7-webhook-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.529023 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.528999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2fecc2a6-b709-4a4a-b14d-d4922852faf7-manifests\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.530905 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.530866 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fecc2a6-b709-4a4a-b14d-d4922852faf7-tmp\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.531109 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.531092 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2fecc2a6-b709-4a4a-b14d-d4922852faf7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.531149 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.531117 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fecc2a6-b709-4a4a-b14d-d4922852faf7-webhook-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.538446 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.538394 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28sjn\" (UniqueName: \"kubernetes.io/projected/2fecc2a6-b709-4a4a-b14d-d4922852faf7-kube-api-access-28sjn\") pod \"opendatahub-operator-controller-manager-57ff796844-tt5tg\" (UID: \"2fecc2a6-b709-4a4a-b14d-d4922852faf7\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.710456 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.710338 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:01.987117 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.987041 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg"] Sep 18 13:09:01.991148 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:09:01.991106 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fecc2a6_b709_4a4a_b14d_d4922852faf7.slice/crio-3e9b1033e5fcc52f0c921b1dc5722e2e063fd277bc1c519eedc515510cd5eedb WatchSource:0}: Error finding container 3e9b1033e5fcc52f0c921b1dc5722e2e063fd277bc1c519eedc515510cd5eedb: Status 404 returned error can't find the container with id 3e9b1033e5fcc52f0c921b1dc5722e2e063fd277bc1c519eedc515510cd5eedb Sep 18 13:09:01.992954 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:01.992933 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:09:02.940134 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:02.940090 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" event={"ID":"2fecc2a6-b709-4a4a-b14d-d4922852faf7","Type":"ContainerStarted","Data":"3e9b1033e5fcc52f0c921b1dc5722e2e063fd277bc1c519eedc515510cd5eedb"} Sep 18 13:09:05.958348 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:05.958314 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" event={"ID":"2fecc2a6-b709-4a4a-b14d-d4922852faf7","Type":"ContainerStarted","Data":"5787fa4e4ae7799a196da974351518b225df97015bbcb9bbf7ce98cde65b4a5d"} Sep 18 13:09:06.963849 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:06.963810 2561 generic.go:356] "Generic (PLEG): container finished" podID="2fecc2a6-b709-4a4a-b14d-d4922852faf7" containerID="5787fa4e4ae7799a196da974351518b225df97015bbcb9bbf7ce98cde65b4a5d" exitCode=0 Sep 18 13:09:06.964301 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:06.963902 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" event={"ID":"2fecc2a6-b709-4a4a-b14d-d4922852faf7","Type":"ContainerDied","Data":"5787fa4e4ae7799a196da974351518b225df97015bbcb9bbf7ce98cde65b4a5d"} Sep 18 13:09:07.969591 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:07.969558 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" event={"ID":"2fecc2a6-b709-4a4a-b14d-d4922852faf7","Type":"ContainerStarted","Data":"1faacc3006cf2d65ce44f0d4e1c2ad746ebb5fff66d2dd8fe453f8f5ad5cba81"} Sep 18 13:09:07.970018 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:07.969669 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:08.017887 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:08.017831 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" podStartSLOduration=2.371547008 podStartE2EDuration="7.017815614s" totalImagesPullingTime="3.596237542s" totalInitContainerRuntime="1.050031064s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:09:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:09:08.017682332 +0000 UTC m=+434.760216851" watchObservedRunningTime="2026-09-18 13:09:08.017815614 +0000 UTC m=+434.760350119" Sep 18 13:09:18.975283 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:18.975249 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-tt5tg" Sep 18 13:09:21.021209 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.021175 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx"] Sep 18 13:09:21.033643 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.033611 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" Sep 18 13:09:21.038503 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.038467 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 18 13:09:21.038503 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.038509 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 18 13:09:21.038740 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.038608 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mc2zm\"" Sep 18 13:09:21.039657 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.039625 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 13:09:21.039657 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.039649 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 13:09:21.055586 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.055542 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx"] Sep 18 13:09:21.184487 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.184445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlnw7\" (UniqueName: \"kubernetes.io/projected/0663b7a3-f6a3-4dc2-83ae-8de9580d7803-kube-api-access-tlnw7\") pod \"kube-auth-proxy-5d8fbc8c5d-xbxpx\" (UID: \"0663b7a3-f6a3-4dc2-83ae-8de9580d7803\") " pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" Sep 18 13:09:21.184675 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.184552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0663b7a3-f6a3-4dc2-83ae-8de9580d7803-tmp\") pod \"kube-auth-proxy-5d8fbc8c5d-xbxpx\" (UID: \"0663b7a3-f6a3-4dc2-83ae-8de9580d7803\") " pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" Sep 18 13:09:21.184675 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.184604 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0663b7a3-f6a3-4dc2-83ae-8de9580d7803-tls-certs\") pod \"kube-auth-proxy-5d8fbc8c5d-xbxpx\" (UID: \"0663b7a3-f6a3-4dc2-83ae-8de9580d7803\") " pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" Sep 18 13:09:21.285042 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.284948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0663b7a3-f6a3-4dc2-83ae-8de9580d7803-tmp\") pod \"kube-auth-proxy-5d8fbc8c5d-xbxpx\" (UID: \"0663b7a3-f6a3-4dc2-83ae-8de9580d7803\") " pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" Sep 18 13:09:21.285189 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.285108 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0663b7a3-f6a3-4dc2-83ae-8de9580d7803-tls-certs\") pod \"kube-auth-proxy-5d8fbc8c5d-xbxpx\" (UID: \"0663b7a3-f6a3-4dc2-83ae-8de9580d7803\") " pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" Sep 18 13:09:21.285254 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.285187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlnw7\" (UniqueName: \"kubernetes.io/projected/0663b7a3-f6a3-4dc2-83ae-8de9580d7803-kube-api-access-tlnw7\") pod \"kube-auth-proxy-5d8fbc8c5d-xbxpx\" (UID: \"0663b7a3-f6a3-4dc2-83ae-8de9580d7803\") " pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" Sep 18 13:09:21.287336 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.287314 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0663b7a3-f6a3-4dc2-83ae-8de9580d7803-tmp\") pod \"kube-auth-proxy-5d8fbc8c5d-xbxpx\" (UID: \"0663b7a3-f6a3-4dc2-83ae-8de9580d7803\") " pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" Sep 18 13:09:21.287501 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.287485 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0663b7a3-f6a3-4dc2-83ae-8de9580d7803-tls-certs\") pod \"kube-auth-proxy-5d8fbc8c5d-xbxpx\" (UID: \"0663b7a3-f6a3-4dc2-83ae-8de9580d7803\") " pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" Sep 18 13:09:21.297972 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.297940 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlnw7\" (UniqueName: \"kubernetes.io/projected/0663b7a3-f6a3-4dc2-83ae-8de9580d7803-kube-api-access-tlnw7\") pod \"kube-auth-proxy-5d8fbc8c5d-xbxpx\" (UID: \"0663b7a3-f6a3-4dc2-83ae-8de9580d7803\") " pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" Sep 18 13:09:21.343623 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.343588 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" Sep 18 13:09:21.615511 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:21.615409 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx"] Sep 18 13:09:21.619546 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:09:21.619518 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0663b7a3_f6a3_4dc2_83ae_8de9580d7803.slice/crio-53821cc68e63ee4154a038d902f3aa7c3c2915c12a27a549f750bb5bd6638347 WatchSource:0}: Error finding container 53821cc68e63ee4154a038d902f3aa7c3c2915c12a27a549f750bb5bd6638347: Status 404 returned error can't find the container with id 53821cc68e63ee4154a038d902f3aa7c3c2915c12a27a549f750bb5bd6638347 Sep 18 13:09:22.020270 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.020238 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" event={"ID":"0663b7a3-f6a3-4dc2-83ae-8de9580d7803","Type":"ContainerStarted","Data":"53821cc68e63ee4154a038d902f3aa7c3c2915c12a27a549f750bb5bd6638347"} Sep 18 13:09:22.656210 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.655983 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww"] Sep 18 13:09:22.659684 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.659645 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.663096 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.662770 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wjbfr\"" Sep 18 13:09:22.663246 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.663101 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 18 13:09:22.663445 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.663396 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 18 13:09:22.663580 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.663547 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 18 13:09:22.663774 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.663755 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 18 13:09:22.683232 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.683167 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww"] Sep 18 13:09:22.797673 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.797633 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.797862 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.797680 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.797862 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.797717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jqcz\" (UniqueName: \"kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-kube-api-access-6jqcz\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.797862 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.797754 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fef95e55-1e36-4b44-971c-1f9bc995c599-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.797862 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.797781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.798109 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.797888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.798109 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.797934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.899062 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.899017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.899360 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.899095 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.899360 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.899135 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jqcz\" (UniqueName: \"kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-kube-api-access-6jqcz\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.899360 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.899187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fef95e55-1e36-4b44-971c-1f9bc995c599-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.899360 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.899220 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.899360 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.899332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.899757 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.899364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.900151 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.900102 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.902236 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.902185 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.902236 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.902217 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.902620 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.902593 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.902967 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.902948 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fef95e55-1e36-4b44-971c-1f9bc995c599-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.908541 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.908474 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.909000 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.908961 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jqcz\" (UniqueName: \"kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-kube-api-access-6jqcz\") pod \"istiod-openshift-gateway-7b7995d5cd-k4mww\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:22.973853 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:22.973814 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:23.263969 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:23.263939 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww"] Sep 18 13:09:24.558881 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:09:24.558848 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef95e55_1e36_4b44_971c_1f9bc995c599.slice/crio-b8d84d9d6a0b1321f33560a95d8cbb39c70d789283d8860e7599557b504b906e WatchSource:0}: Error finding container b8d84d9d6a0b1321f33560a95d8cbb39c70d789283d8860e7599557b504b906e: Status 404 returned error can't find the container with id b8d84d9d6a0b1321f33560a95d8cbb39c70d789283d8860e7599557b504b906e Sep 18 13:09:25.035821 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:25.035784 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" event={"ID":"fef95e55-1e36-4b44-971c-1f9bc995c599","Type":"ContainerStarted","Data":"b8d84d9d6a0b1321f33560a95d8cbb39c70d789283d8860e7599557b504b906e"} Sep 18 13:09:25.037151 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:25.037127 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" event={"ID":"0663b7a3-f6a3-4dc2-83ae-8de9580d7803","Type":"ContainerStarted","Data":"e1f40cc725e7e9af3f2372cb9dd98fef175280b05b47b5c5f2c33be37bf5b0bb"} Sep 18 13:09:25.053544 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:25.053484 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d8fbc8c5d-xbxpx" podStartSLOduration=2.057710508 podStartE2EDuration="5.053465744s" totalImagesPullingTime="2.995755236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:09:25.052236741 +0000 UTC m=+451.794771246" watchObservedRunningTime="2026-09-18 13:09:25.053465744 +0000 UTC m=+451.796000249" Sep 18 13:09:27.034585 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:27.034547 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 18 13:09:27.034816 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:27.034627 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 18 13:09:28.057085 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:28.057043 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" event={"ID":"fef95e55-1e36-4b44-971c-1f9bc995c599","Type":"ContainerStarted","Data":"345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a"} Sep 18 13:09:28.057562 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:28.057207 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:28.059026 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:28.058996 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-k4mww container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 18 13:09:28.059143 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:28.059059 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" podUID="fef95e55-1e36-4b44-971c-1f9bc995c599" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:09:28.103052 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:28.102995 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" podStartSLOduration=3.629703396 podStartE2EDuration="6.102977213s" totalImagesPullingTime="2.473273817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:09:28.10108261 +0000 UTC m=+454.843617131" watchObservedRunningTime="2026-09-18 13:09:28.102977213 +0000 UTC m=+454.845511719" Sep 18 13:09:29.061384 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:29.061357 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:42.840837 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.840795 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c28qj"] Sep 18 13:09:42.844400 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.844366 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" Sep 18 13:09:42.845482 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.845451 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc"] Sep 18 13:09:42.848270 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.848244 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7hbs2\"" Sep 18 13:09:42.848444 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.848411 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" Sep 18 13:09:42.848729 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.848696 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 18 13:09:42.853304 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.853283 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 18 13:09:42.853552 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.853537 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-l7xt4\"" Sep 18 13:09:42.863292 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.863269 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c28qj"] Sep 18 13:09:42.871303 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.871272 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64pn\" (UniqueName: \"kubernetes.io/projected/0d1249b6-6f3a-4a25-a484-adacac0d6236-kube-api-access-s64pn\") pod \"kserve-controller-manager-d6f4b65b8-c28qj\" (UID: \"0d1249b6-6f3a-4a25-a484-adacac0d6236\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" Sep 18 13:09:42.871470 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.871320 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1249b6-6f3a-4a25-a484-adacac0d6236-cert\") pod \"kserve-controller-manager-d6f4b65b8-c28qj\" (UID: \"0d1249b6-6f3a-4a25-a484-adacac0d6236\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" Sep 18 13:09:42.871470 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.871359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da40978f-bbfb-41a3-ac94-f56d5690095f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8hwzc\" (UID: \"da40978f-bbfb-41a3-ac94-f56d5690095f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" Sep 18 13:09:42.871470 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.871454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmwpf\" (UniqueName: \"kubernetes.io/projected/da40978f-bbfb-41a3-ac94-f56d5690095f-kube-api-access-gmwpf\") pod \"llmisvc-controller-manager-777c6bd7d5-8hwzc\" (UID: \"da40978f-bbfb-41a3-ac94-f56d5690095f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" Sep 18 13:09:42.873935 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.873909 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc"] Sep 18 13:09:42.972233 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.972199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da40978f-bbfb-41a3-ac94-f56d5690095f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8hwzc\" (UID: \"da40978f-bbfb-41a3-ac94-f56d5690095f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" Sep 18 13:09:42.972453 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.972266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmwpf\" (UniqueName: \"kubernetes.io/projected/da40978f-bbfb-41a3-ac94-f56d5690095f-kube-api-access-gmwpf\") pod \"llmisvc-controller-manager-777c6bd7d5-8hwzc\" (UID: \"da40978f-bbfb-41a3-ac94-f56d5690095f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" Sep 18 13:09:42.972453 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.972328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s64pn\" (UniqueName: \"kubernetes.io/projected/0d1249b6-6f3a-4a25-a484-adacac0d6236-kube-api-access-s64pn\") pod \"kserve-controller-manager-d6f4b65b8-c28qj\" (UID: \"0d1249b6-6f3a-4a25-a484-adacac0d6236\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" Sep 18 13:09:42.972453 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.972375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1249b6-6f3a-4a25-a484-adacac0d6236-cert\") pod \"kserve-controller-manager-d6f4b65b8-c28qj\" (UID: \"0d1249b6-6f3a-4a25-a484-adacac0d6236\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" Sep 18 13:09:42.972658 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:09:42.972515 2561 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 18 13:09:42.972784 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:09:42.972757 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d1249b6-6f3a-4a25-a484-adacac0d6236-cert podName:0d1249b6-6f3a-4a25-a484-adacac0d6236 nodeName:}" failed. No retries permitted until 2026-09-18 13:09:43.472728393 +0000 UTC m=+470.215262876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0d1249b6-6f3a-4a25-a484-adacac0d6236-cert") pod "kserve-controller-manager-d6f4b65b8-c28qj" (UID: "0d1249b6-6f3a-4a25-a484-adacac0d6236") : secret "kserve-webhook-server-cert" not found Sep 18 13:09:42.974889 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.974867 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da40978f-bbfb-41a3-ac94-f56d5690095f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8hwzc\" (UID: \"da40978f-bbfb-41a3-ac94-f56d5690095f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" Sep 18 13:09:42.994638 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.994606 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64pn\" (UniqueName: \"kubernetes.io/projected/0d1249b6-6f3a-4a25-a484-adacac0d6236-kube-api-access-s64pn\") pod \"kserve-controller-manager-d6f4b65b8-c28qj\" (UID: \"0d1249b6-6f3a-4a25-a484-adacac0d6236\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" Sep 18 13:09:42.994775 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:42.994661 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmwpf\" (UniqueName: \"kubernetes.io/projected/da40978f-bbfb-41a3-ac94-f56d5690095f-kube-api-access-gmwpf\") pod \"llmisvc-controller-manager-777c6bd7d5-8hwzc\" (UID: \"da40978f-bbfb-41a3-ac94-f56d5690095f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" Sep 18 13:09:43.163279 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:43.163190 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" Sep 18 13:09:43.476708 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:43.476607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1249b6-6f3a-4a25-a484-adacac0d6236-cert\") pod \"kserve-controller-manager-d6f4b65b8-c28qj\" (UID: \"0d1249b6-6f3a-4a25-a484-adacac0d6236\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" Sep 18 13:09:43.479019 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:43.478999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1249b6-6f3a-4a25-a484-adacac0d6236-cert\") pod \"kserve-controller-manager-d6f4b65b8-c28qj\" (UID: \"0d1249b6-6f3a-4a25-a484-adacac0d6236\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" Sep 18 13:09:43.487284 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:43.487255 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc"] Sep 18 13:09:43.498959 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:09:43.498932 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podda40978f_bbfb_41a3_ac94_f56d5690095f.slice/crio-865d4780fe2d616f2112fb65ddbf5f90b9d29ad311a2d94b7fdfcaebb2e2a907 WatchSource:0}: Error finding container 865d4780fe2d616f2112fb65ddbf5f90b9d29ad311a2d94b7fdfcaebb2e2a907: Status 404 returned error can't find the container with id 865d4780fe2d616f2112fb65ddbf5f90b9d29ad311a2d94b7fdfcaebb2e2a907 Sep 18 13:09:43.757359 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:43.757266 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" Sep 18 13:09:44.030538 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.030505 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c28qj"] Sep 18 13:09:44.034011 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:09:44.033978 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1249b6_6f3a_4a25_a484_adacac0d6236.slice/crio-596e3bb99e1c675c4b711adcab15f03830c2a6565066c8909f4045f7ecacc150 WatchSource:0}: Error finding container 596e3bb99e1c675c4b711adcab15f03830c2a6565066c8909f4045f7ecacc150: Status 404 returned error can't find the container with id 596e3bb99e1c675c4b711adcab15f03830c2a6565066c8909f4045f7ecacc150 Sep 18 13:09:44.118805 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.118761 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" event={"ID":"da40978f-bbfb-41a3-ac94-f56d5690095f","Type":"ContainerStarted","Data":"865d4780fe2d616f2112fb65ddbf5f90b9d29ad311a2d94b7fdfcaebb2e2a907"} Sep 18 13:09:44.120247 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.120206 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" event={"ID":"0d1249b6-6f3a-4a25-a484-adacac0d6236","Type":"ContainerStarted","Data":"596e3bb99e1c675c4b711adcab15f03830c2a6565066c8909f4045f7ecacc150"} Sep 18 13:09:44.158517 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.158484 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww"] Sep 18 13:09:44.158731 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.158708 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" podUID="fef95e55-1e36-4b44-971c-1f9bc995c599" containerName="discovery" containerID="cri-o://345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a" gracePeriod=30 Sep 18 13:09:44.505779 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.505751 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:44.587776 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.587689 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jqcz\" (UniqueName: \"kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-kube-api-access-6jqcz\") pod \"fef95e55-1e36-4b44-971c-1f9bc995c599\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " Sep 18 13:09:44.587776 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.587741 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-ca-configmap\") pod \"fef95e55-1e36-4b44-971c-1f9bc995c599\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " Sep 18 13:09:44.587991 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.587784 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fef95e55-1e36-4b44-971c-1f9bc995c599-local-certs\") pod \"fef95e55-1e36-4b44-971c-1f9bc995c599\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " Sep 18 13:09:44.587991 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.587804 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-cacerts\") pod \"fef95e55-1e36-4b44-971c-1f9bc995c599\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " Sep 18 13:09:44.587991 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.587827 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-kubeconfig\") pod \"fef95e55-1e36-4b44-971c-1f9bc995c599\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " Sep 18 13:09:44.587991 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.587858 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-token\") pod \"fef95e55-1e36-4b44-971c-1f9bc995c599\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " Sep 18 13:09:44.588187 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.588011 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-dns-cert\") pod \"fef95e55-1e36-4b44-971c-1f9bc995c599\" (UID: \"fef95e55-1e36-4b44-971c-1f9bc995c599\") " Sep 18 13:09:44.588601 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.588560 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "fef95e55-1e36-4b44-971c-1f9bc995c599" (UID: "fef95e55-1e36-4b44-971c-1f9bc995c599"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:09:44.590219 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.590190 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-kube-api-access-6jqcz" (OuterVolumeSpecName: "kube-api-access-6jqcz") pod "fef95e55-1e36-4b44-971c-1f9bc995c599" (UID: "fef95e55-1e36-4b44-971c-1f9bc995c599"). InnerVolumeSpecName "kube-api-access-6jqcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:09:44.590458 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.590400 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-cacerts" (OuterVolumeSpecName: "cacerts") pod "fef95e55-1e36-4b44-971c-1f9bc995c599" (UID: "fef95e55-1e36-4b44-971c-1f9bc995c599"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:09:44.590564 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.590496 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fef95e55-1e36-4b44-971c-1f9bc995c599-local-certs" (OuterVolumeSpecName: "local-certs") pod "fef95e55-1e36-4b44-971c-1f9bc995c599" (UID: "fef95e55-1e36-4b44-971c-1f9bc995c599"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:09:44.590564 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.590497 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-token" (OuterVolumeSpecName: "istio-token") pod "fef95e55-1e36-4b44-971c-1f9bc995c599" (UID: "fef95e55-1e36-4b44-971c-1f9bc995c599"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:09:44.590564 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.590545 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "fef95e55-1e36-4b44-971c-1f9bc995c599" (UID: "fef95e55-1e36-4b44-971c-1f9bc995c599"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:09:44.590680 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.590592 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "fef95e55-1e36-4b44-971c-1f9bc995c599" (UID: "fef95e55-1e36-4b44-971c-1f9bc995c599"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:09:44.688858 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.688824 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-token\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:09:44.688858 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.688858 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-dns-cert\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:09:44.689095 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.688871 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jqcz\" (UniqueName: \"kubernetes.io/projected/fef95e55-1e36-4b44-971c-1f9bc995c599-kube-api-access-6jqcz\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:09:44.689095 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.688881 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-csr-ca-configmap\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:09:44.689095 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.688891 2561 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fef95e55-1e36-4b44-971c-1f9bc995c599-local-certs\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:09:44.689095 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.688899 2561 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-cacerts\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:09:44.689095 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:44.688906 2561 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fef95e55-1e36-4b44-971c-1f9bc995c599-istio-kubeconfig\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:09:45.129188 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:45.129145 2561 generic.go:356] "Generic (PLEG): container finished" podID="fef95e55-1e36-4b44-971c-1f9bc995c599" containerID="345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a" exitCode=0 Sep 18 13:09:45.129684 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:45.129230 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" event={"ID":"fef95e55-1e36-4b44-971c-1f9bc995c599","Type":"ContainerDied","Data":"345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a"} Sep 18 13:09:45.129684 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:45.129320 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" event={"ID":"fef95e55-1e36-4b44-971c-1f9bc995c599","Type":"ContainerDied","Data":"b8d84d9d6a0b1321f33560a95d8cbb39c70d789283d8860e7599557b504b906e"} Sep 18 13:09:45.129684 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:45.129349 2561 scope.go:117] "RemoveContainer" containerID="345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a" Sep 18 13:09:45.129684 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:45.129579 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww" Sep 18 13:09:45.141092 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:45.141066 2561 scope.go:117] "RemoveContainer" containerID="345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a" Sep 18 13:09:45.141713 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:09:45.141655 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a\": container with ID starting with 345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a not found: ID does not exist" containerID="345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a" Sep 18 13:09:45.141881 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:45.141844 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a"} err="failed to get container status \"345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a\": rpc error: code = NotFound desc = could not find container \"345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a\": container with ID starting with 345c29e45a4192fe9c1b64c0de00296853a7bf94aeb8b7b8add321e7a3c23f9a not found: ID does not exist" Sep 18 13:09:45.178199 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:45.178161 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww"] Sep 18 13:09:45.180042 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:45.180008 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k4mww"] Sep 18 13:09:45.215441 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:45.215392 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fef95e55-1e36-4b44-971c-1f9bc995c599" path="/var/lib/kubelet/pods/fef95e55-1e36-4b44-971c-1f9bc995c599/volumes" Sep 18 13:09:47.139866 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:47.139769 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" event={"ID":"da40978f-bbfb-41a3-ac94-f56d5690095f","Type":"ContainerStarted","Data":"fcf6f310ce7dd4c95970bb32534715e5c4e50d7b40e84af4de1c5d38e540af60"} Sep 18 13:09:47.140311 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:47.139896 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" Sep 18 13:09:47.141530 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:47.141493 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" event={"ID":"0d1249b6-6f3a-4a25-a484-adacac0d6236","Type":"ContainerStarted","Data":"df9976ecc289293eb93e6fef36f282e51b6b51a919e0305be5dc10336be2af12"} Sep 18 13:09:47.141660 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:47.141646 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" Sep 18 13:09:47.168320 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:47.168264 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" podStartSLOduration=1.886243055 podStartE2EDuration="5.168247273s" totalImagesPullingTime="3.282004218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:09:47.167978765 +0000 UTC m=+473.910513271" watchObservedRunningTime="2026-09-18 13:09:47.168247273 +0000 UTC m=+473.910781798" Sep 18 13:09:47.211571 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:09:47.211520 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" podStartSLOduration=2.462589363 podStartE2EDuration="5.211504138s" totalImagesPullingTime="2.748914775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:09:47.209988128 +0000 UTC m=+473.952522659" watchObservedRunningTime="2026-09-18 13:09:47.211504138 +0000 UTC m=+473.954038643" Sep 18 13:10:18.147769 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:18.147732 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hwzc" Sep 18 13:10:18.151014 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:18.150990 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c28qj" Sep 18 13:10:53.410205 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.410111 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7"] Sep 18 13:10:53.410767 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.410597 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fef95e55-1e36-4b44-971c-1f9bc995c599" containerName="discovery" Sep 18 13:10:53.410767 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.410617 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fef95e55-1e36-4b44-971c-1f9bc995c599" containerName="discovery" Sep 18 13:10:53.410767 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.410692 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fef95e55-1e36-4b44-971c-1f9bc995c599" containerName="discovery" Sep 18 13:10:53.413612 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.413590 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:10:53.419076 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.419051 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bd8l9\"" Sep 18 13:10:53.419973 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.419955 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 18 13:10:53.420056 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.420035 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 18 13:10:53.441082 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.441047 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7"] Sep 18 13:10:53.443710 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.443683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs2lv\" (UniqueName: \"kubernetes.io/projected/32ccdf0c-0934-4160-bc0a-76330bb9d32b-kube-api-access-gs2lv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" (UID: \"32ccdf0c-0934-4160-bc0a-76330bb9d32b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:10:53.443881 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.443731 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32ccdf0c-0934-4160-bc0a-76330bb9d32b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" (UID: \"32ccdf0c-0934-4160-bc0a-76330bb9d32b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:10:53.545042 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.544995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32ccdf0c-0934-4160-bc0a-76330bb9d32b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" (UID: \"32ccdf0c-0934-4160-bc0a-76330bb9d32b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:10:53.545228 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.545073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs2lv\" (UniqueName: \"kubernetes.io/projected/32ccdf0c-0934-4160-bc0a-76330bb9d32b-kube-api-access-gs2lv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" (UID: \"32ccdf0c-0934-4160-bc0a-76330bb9d32b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:10:53.545409 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.545388 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32ccdf0c-0934-4160-bc0a-76330bb9d32b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" (UID: \"32ccdf0c-0934-4160-bc0a-76330bb9d32b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:10:53.562993 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.562965 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs2lv\" (UniqueName: \"kubernetes.io/projected/32ccdf0c-0934-4160-bc0a-76330bb9d32b-kube-api-access-gs2lv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" (UID: \"32ccdf0c-0934-4160-bc0a-76330bb9d32b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:10:53.723021 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:53.722920 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:10:54.003860 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:54.003822 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7"] Sep 18 13:10:54.006654 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:10:54.006623 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ccdf0c_0934_4160_bc0a_76330bb9d32b.slice/crio-15c7dc1550265f9f512eaeebeac01d7de630d273fb022ff2e20f395a80054dcf WatchSource:0}: Error finding container 15c7dc1550265f9f512eaeebeac01d7de630d273fb022ff2e20f395a80054dcf: Status 404 returned error can't find the container with id 15c7dc1550265f9f512eaeebeac01d7de630d273fb022ff2e20f395a80054dcf Sep 18 13:10:54.409089 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:54.409054 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" event={"ID":"32ccdf0c-0934-4160-bc0a-76330bb9d32b","Type":"ContainerStarted","Data":"15c7dc1550265f9f512eaeebeac01d7de630d273fb022ff2e20f395a80054dcf"} Sep 18 13:10:55.446901 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:55.446849 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp"] Sep 18 13:10:55.450620 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:55.450591 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:10:55.453772 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:55.453709 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sg4np\"" Sep 18 13:10:55.467529 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:55.467454 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp"] Sep 18 13:10:55.561671 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:55.561572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxf27\" (UniqueName: \"kubernetes.io/projected/04d11c66-5378-405b-9e9c-766179b0f291-kube-api-access-xxf27\") pod \"limitador-operator-controller-manager-74495c69f8-b8bpp\" (UID: \"04d11c66-5378-405b-9e9c-766179b0f291\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:10:55.663064 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:55.662979 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxf27\" (UniqueName: \"kubernetes.io/projected/04d11c66-5378-405b-9e9c-766179b0f291-kube-api-access-xxf27\") pod \"limitador-operator-controller-manager-74495c69f8-b8bpp\" (UID: \"04d11c66-5378-405b-9e9c-766179b0f291\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:10:55.674481 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:55.674397 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxf27\" (UniqueName: \"kubernetes.io/projected/04d11c66-5378-405b-9e9c-766179b0f291-kube-api-access-xxf27\") pod \"limitador-operator-controller-manager-74495c69f8-b8bpp\" (UID: \"04d11c66-5378-405b-9e9c-766179b0f291\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:10:55.764630 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:55.764543 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:10:56.824580 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:56.824543 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp"] Sep 18 13:10:56.827151 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:10:56.827117 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d11c66_5378_405b_9e9c_766179b0f291.slice/crio-f297992b86824478dc2405f60971c90d80e8ba8ec8bfa240c260c51ba3772f13 WatchSource:0}: Error finding container f297992b86824478dc2405f60971c90d80e8ba8ec8bfa240c260c51ba3772f13: Status 404 returned error can't find the container with id f297992b86824478dc2405f60971c90d80e8ba8ec8bfa240c260c51ba3772f13 Sep 18 13:10:57.426112 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:57.426066 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" event={"ID":"04d11c66-5378-405b-9e9c-766179b0f291","Type":"ContainerStarted","Data":"f297992b86824478dc2405f60971c90d80e8ba8ec8bfa240c260c51ba3772f13"} Sep 18 13:10:57.496437 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:57.496392 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm"] Sep 18 13:10:57.500091 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:57.500066 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm" Sep 18 13:10:57.506087 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:57.506061 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-js68g\"" Sep 18 13:10:57.506402 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:57.506381 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 18 13:10:57.541100 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:57.541052 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm"] Sep 18 13:10:57.578158 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:57.578101 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42l47\" (UniqueName: \"kubernetes.io/projected/48d568d6-1ac1-4eb0-9e7c-645638239fe1-kube-api-access-42l47\") pod \"dns-operator-controller-manager-7b84cd7c9c-cd9wm\" (UID: \"48d568d6-1ac1-4eb0-9e7c-645638239fe1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm" Sep 18 13:10:57.679080 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:57.678979 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42l47\" (UniqueName: \"kubernetes.io/projected/48d568d6-1ac1-4eb0-9e7c-645638239fe1-kube-api-access-42l47\") pod \"dns-operator-controller-manager-7b84cd7c9c-cd9wm\" (UID: \"48d568d6-1ac1-4eb0-9e7c-645638239fe1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm" Sep 18 13:10:57.696198 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:57.696159 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42l47\" (UniqueName: \"kubernetes.io/projected/48d568d6-1ac1-4eb0-9e7c-645638239fe1-kube-api-access-42l47\") pod \"dns-operator-controller-manager-7b84cd7c9c-cd9wm\" (UID: \"48d568d6-1ac1-4eb0-9e7c-645638239fe1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm" Sep 18 13:10:57.812301 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:57.812270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm" Sep 18 13:10:58.899706 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:58.899527 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm"] Sep 18 13:10:58.903089 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:10:58.903047 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d568d6_1ac1_4eb0_9e7c_645638239fe1.slice/crio-df8263d4aff7893d68a82b9381f904506cc40879703c2ca1c5cd3c9029c2b4ee WatchSource:0}: Error finding container df8263d4aff7893d68a82b9381f904506cc40879703c2ca1c5cd3c9029c2b4ee: Status 404 returned error can't find the container with id df8263d4aff7893d68a82b9381f904506cc40879703c2ca1c5cd3c9029c2b4ee Sep 18 13:10:59.440054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:59.440021 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm" event={"ID":"48d568d6-1ac1-4eb0-9e7c-645638239fe1","Type":"ContainerStarted","Data":"df8263d4aff7893d68a82b9381f904506cc40879703c2ca1c5cd3c9029c2b4ee"} Sep 18 13:10:59.441937 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:59.441908 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" event={"ID":"32ccdf0c-0934-4160-bc0a-76330bb9d32b","Type":"ContainerStarted","Data":"6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae"} Sep 18 13:10:59.442091 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:59.442027 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:10:59.466253 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:10:59.466198 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" podStartSLOduration=1.768229341 podStartE2EDuration="6.46617902s" totalImagesPullingTime="4.697949679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:10:59.463542478 +0000 UTC m=+546.206076984" watchObservedRunningTime="2026-09-18 13:10:59.46617902 +0000 UTC m=+546.208713525" Sep 18 13:11:00.202168 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.202129 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-52pnx"] Sep 18 13:11:00.205474 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.205447 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-52pnx" Sep 18 13:11:00.211942 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.211902 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5gngs\"" Sep 18 13:11:00.222146 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.222117 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-52pnx"] Sep 18 13:11:00.302314 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.302282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7w4j\" (UniqueName: \"kubernetes.io/projected/a4536ec3-8ad7-4788-848c-179a81641c6a-kube-api-access-m7w4j\") pod \"authorino-operator-76b478bd78-52pnx\" (UID: \"a4536ec3-8ad7-4788-848c-179a81641c6a\") " pod="kuadrant-system/authorino-operator-76b478bd78-52pnx" Sep 18 13:11:00.403324 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.403290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7w4j\" (UniqueName: \"kubernetes.io/projected/a4536ec3-8ad7-4788-848c-179a81641c6a-kube-api-access-m7w4j\") pod \"authorino-operator-76b478bd78-52pnx\" (UID: \"a4536ec3-8ad7-4788-848c-179a81641c6a\") " pod="kuadrant-system/authorino-operator-76b478bd78-52pnx" Sep 18 13:11:00.413785 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.413746 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7w4j\" (UniqueName: \"kubernetes.io/projected/a4536ec3-8ad7-4788-848c-179a81641c6a-kube-api-access-m7w4j\") pod \"authorino-operator-76b478bd78-52pnx\" (UID: \"a4536ec3-8ad7-4788-848c-179a81641c6a\") " pod="kuadrant-system/authorino-operator-76b478bd78-52pnx" Sep 18 13:11:00.453474 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.453365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" event={"ID":"04d11c66-5378-405b-9e9c-766179b0f291","Type":"ContainerStarted","Data":"07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0"} Sep 18 13:11:00.453709 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.453687 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:11:00.476518 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.476464 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" podStartSLOduration=2.602366707 podStartE2EDuration="5.476445125s" totalImagesPullingTime="2.874078418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:11:00.47495878 +0000 UTC m=+547.217493286" watchObservedRunningTime="2026-09-18 13:11:00.476445125 +0000 UTC m=+547.218979621" Sep 18 13:11:00.516336 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.516293 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-52pnx" Sep 18 13:11:00.893737 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:00.893703 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-52pnx"] Sep 18 13:11:00.897244 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:11:00.897212 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4536ec3_8ad7_4788_848c_179a81641c6a.slice/crio-a04ccf800718c2ae199d1cc921fa10e814cbb3e68348b8717cd528aa8c47f9ed WatchSource:0}: Error finding container a04ccf800718c2ae199d1cc921fa10e814cbb3e68348b8717cd528aa8c47f9ed: Status 404 returned error can't find the container with id a04ccf800718c2ae199d1cc921fa10e814cbb3e68348b8717cd528aa8c47f9ed Sep 18 13:11:01.459866 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.459825 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm" event={"ID":"48d568d6-1ac1-4eb0-9e7c-645638239fe1","Type":"ContainerStarted","Data":"64b2fdb6fb5682af226235486dcf1dcd7a55cffcf40181c028c65d51927c784e"} Sep 18 13:11:01.460309 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.459941 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm" Sep 18 13:11:01.461352 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.461330 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-52pnx" event={"ID":"a4536ec3-8ad7-4788-848c-179a81641c6a","Type":"ContainerStarted","Data":"a04ccf800718c2ae199d1cc921fa10e814cbb3e68348b8717cd528aa8c47f9ed"} Sep 18 13:11:01.488659 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.488607 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm" podStartSLOduration=2.717355013 podStartE2EDuration="4.488590455s" totalImagesPullingTime="1.771235442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:11:01.486998618 +0000 UTC m=+548.229533120" watchObservedRunningTime="2026-09-18 13:11:01.488590455 +0000 UTC m=+548.231124959" Sep 18 13:11:01.711698 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.711607 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g"] Sep 18 13:11:01.715282 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.715256 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" Sep 18 13:11:01.718192 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.718157 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xg9ck\"" Sep 18 13:11:01.718336 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.718157 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 18 13:11:01.718336 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.718201 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 18 13:11:01.726676 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.726649 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g"] Sep 18 13:11:01.814988 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.814950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf4nk\" (UniqueName: \"kubernetes.io/projected/eac8ba3d-801e-422e-b17d-1f5c4b0657f9-kube-api-access-wf4nk\") pod \"kuadrant-console-plugin-fbdd4f445-qzw4g\" (UID: \"eac8ba3d-801e-422e-b17d-1f5c4b0657f9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" Sep 18 13:11:01.814988 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.814992 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eac8ba3d-801e-422e-b17d-1f5c4b0657f9-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-qzw4g\" (UID: \"eac8ba3d-801e-422e-b17d-1f5c4b0657f9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" Sep 18 13:11:01.815250 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.815020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eac8ba3d-801e-422e-b17d-1f5c4b0657f9-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-qzw4g\" (UID: \"eac8ba3d-801e-422e-b17d-1f5c4b0657f9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" Sep 18 13:11:01.916043 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.916007 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eac8ba3d-801e-422e-b17d-1f5c4b0657f9-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-qzw4g\" (UID: \"eac8ba3d-801e-422e-b17d-1f5c4b0657f9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" Sep 18 13:11:01.916235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.916129 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf4nk\" (UniqueName: \"kubernetes.io/projected/eac8ba3d-801e-422e-b17d-1f5c4b0657f9-kube-api-access-wf4nk\") pod \"kuadrant-console-plugin-fbdd4f445-qzw4g\" (UID: \"eac8ba3d-801e-422e-b17d-1f5c4b0657f9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" Sep 18 13:11:01.916235 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.916177 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eac8ba3d-801e-422e-b17d-1f5c4b0657f9-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-qzw4g\" (UID: \"eac8ba3d-801e-422e-b17d-1f5c4b0657f9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" Sep 18 13:11:01.916873 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.916837 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eac8ba3d-801e-422e-b17d-1f5c4b0657f9-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-qzw4g\" (UID: \"eac8ba3d-801e-422e-b17d-1f5c4b0657f9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" Sep 18 13:11:01.919222 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.919194 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eac8ba3d-801e-422e-b17d-1f5c4b0657f9-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-qzw4g\" (UID: \"eac8ba3d-801e-422e-b17d-1f5c4b0657f9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" Sep 18 13:11:01.925172 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:01.925138 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf4nk\" (UniqueName: \"kubernetes.io/projected/eac8ba3d-801e-422e-b17d-1f5c4b0657f9-kube-api-access-wf4nk\") pod \"kuadrant-console-plugin-fbdd4f445-qzw4g\" (UID: \"eac8ba3d-801e-422e-b17d-1f5c4b0657f9\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" Sep 18 13:11:02.025633 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:02.025600 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" Sep 18 13:11:02.306343 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:02.306314 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g"] Sep 18 13:11:02.499489 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:11:02.499450 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeac8ba3d_801e_422e_b17d_1f5c4b0657f9.slice/crio-2537ce4daa2e38b3ac45e6441516b00bf59887e1a51349a3fa8f332389a12cba WatchSource:0}: Error finding container 2537ce4daa2e38b3ac45e6441516b00bf59887e1a51349a3fa8f332389a12cba: Status 404 returned error can't find the container with id 2537ce4daa2e38b3ac45e6441516b00bf59887e1a51349a3fa8f332389a12cba Sep 18 13:11:03.480160 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:03.479290 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-52pnx" event={"ID":"a4536ec3-8ad7-4788-848c-179a81641c6a","Type":"ContainerStarted","Data":"13d577eb18f443b439b79f940ad0efea39f3251c58e6dead7cfcc274091d1fc7"} Sep 18 13:11:03.480160 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:03.480095 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-52pnx" Sep 18 13:11:03.481961 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:03.481910 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" event={"ID":"eac8ba3d-801e-422e-b17d-1f5c4b0657f9","Type":"ContainerStarted","Data":"2537ce4daa2e38b3ac45e6441516b00bf59887e1a51349a3fa8f332389a12cba"} Sep 18 13:11:03.499072 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:03.498966 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-52pnx" podStartSLOduration=1.842355295 podStartE2EDuration="3.498943031s" totalImagesPullingTime="1.656587736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:11:03.498489692 +0000 UTC m=+550.241024226" watchObservedRunningTime="2026-09-18 13:11:03.498943031 +0000 UTC m=+550.241477537" Sep 18 13:11:07.505942 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:07.505854 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" event={"ID":"eac8ba3d-801e-422e-b17d-1f5c4b0657f9","Type":"ContainerStarted","Data":"ca7b90fddbce1d7e9cccc08c23ab1982a534f37ac23571443ed59e1d99c13028"} Sep 18 13:11:07.522964 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:07.522907 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qzw4g" podStartSLOduration=1.822583454 podStartE2EDuration="6.522882846s" totalImagesPullingTime="4.700299392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:11:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:11:07.522098481 +0000 UTC m=+554.264632988" watchObservedRunningTime="2026-09-18 13:11:07.522882846 +0000 UTC m=+554.265417350" Sep 18 13:11:10.455599 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:10.455564 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:11:12.470576 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.470546 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:11:12.471021 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.470954 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cd9wm" Sep 18 13:11:12.820251 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.820213 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7"] Sep 18 13:11:12.820453 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.820406 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" podUID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" containerName="manager" containerID="cri-o://6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae" gracePeriod=2 Sep 18 13:11:12.840504 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.840479 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7"] Sep 18 13:11:12.867500 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.867464 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp"] Sep 18 13:11:12.867743 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.867699 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" podUID="04d11c66-5378-405b-9e9c-766179b0f291" containerName="manager" containerID="cri-o://07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0" gracePeriod=2 Sep 18 13:11:12.872793 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:12.872756 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"32ccdf0c-0934-4160-bc0a-76330bb9d32b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\": pods \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:11:12.875899 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.875870 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp"] Sep 18 13:11:12.876155 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:12.876019 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:11:12.879188 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:12.879151 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-b8bpp\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="04d11c66-5378-405b-9e9c-766179b0f291" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:11:12.889675 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.889642 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw"] Sep 18 13:11:12.890117 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.890100 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" containerName="manager" Sep 18 13:11:12.890228 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.890119 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" containerName="manager" Sep 18 13:11:12.890228 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.890161 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d11c66-5378-405b-9e9c-766179b0f291" containerName="manager" Sep 18 13:11:12.890228 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.890171 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d11c66-5378-405b-9e9c-766179b0f291" containerName="manager" Sep 18 13:11:12.890387 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.890250 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="04d11c66-5378-405b-9e9c-766179b0f291" containerName="manager" Sep 18 13:11:12.890387 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.890267 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" containerName="manager" Sep 18 13:11:12.893680 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.893660 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:12.896336 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:12.896300 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-b8bpp\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="04d11c66-5378-405b-9e9c-766179b0f291" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:11:12.931351 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.931319 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn"] Sep 18 13:11:12.934650 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.934626 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn" Sep 18 13:11:12.946991 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.946960 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw"] Sep 18 13:11:12.987866 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:12.987830 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn"] Sep 18 13:11:13.013365 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.013327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c26930db-3b91-4700-826f-1bcf19720fac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-42wvw\" (UID: \"c26930db-3b91-4700-826f-1bcf19720fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:13.013538 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.013389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtgng\" (UniqueName: \"kubernetes.io/projected/c26930db-3b91-4700-826f-1bcf19720fac-kube-api-access-wtgng\") pod \"kuadrant-operator-controller-manager-76f8f686bf-42wvw\" (UID: \"c26930db-3b91-4700-826f-1bcf19720fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:13.013538 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.013489 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hglz\" (UniqueName: \"kubernetes.io/projected/d5edaa23-9c62-48ad-aa27-8ab7dce926cb-kube-api-access-4hglz\") pod \"limitador-operator-controller-manager-74495c69f8-vpfqn\" (UID: \"d5edaa23-9c62-48ad-aa27-8ab7dce926cb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn" Sep 18 13:11:13.020442 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:13.020382 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:11:13.022168 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.022142 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6"] Sep 18 13:11:13.022585 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:13.022554 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-b8bpp\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="04d11c66-5378-405b-9e9c-766179b0f291" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:11:13.025354 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.025337 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" Sep 18 13:11:13.040707 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.040674 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6"] Sep 18 13:11:13.057452 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:13.057384 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:11:13.059640 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:13.059602 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-b8bpp\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="04d11c66-5378-405b-9e9c-766179b0f291" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:11:13.089030 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:13.088937 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:11:13.114476 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.114447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hglz\" (UniqueName: \"kubernetes.io/projected/d5edaa23-9c62-48ad-aa27-8ab7dce926cb-kube-api-access-4hglz\") pod \"limitador-operator-controller-manager-74495c69f8-vpfqn\" (UID: \"d5edaa23-9c62-48ad-aa27-8ab7dce926cb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn" Sep 18 13:11:13.114550 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.114513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xdx\" (UniqueName: \"kubernetes.io/projected/89dfd3b5-7559-4628-a7d8-0dde726c528b-kube-api-access-v2xdx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8w8c6\" (UID: \"89dfd3b5-7559-4628-a7d8-0dde726c528b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" Sep 18 13:11:13.114599 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.114556 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89dfd3b5-7559-4628-a7d8-0dde726c528b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8w8c6\" (UID: \"89dfd3b5-7559-4628-a7d8-0dde726c528b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" Sep 18 13:11:13.114599 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.114592 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c26930db-3b91-4700-826f-1bcf19720fac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-42wvw\" (UID: \"c26930db-3b91-4700-826f-1bcf19720fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:13.114738 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.114712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtgng\" (UniqueName: \"kubernetes.io/projected/c26930db-3b91-4700-826f-1bcf19720fac-kube-api-access-wtgng\") pod \"kuadrant-operator-controller-manager-76f8f686bf-42wvw\" (UID: \"c26930db-3b91-4700-826f-1bcf19720fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:13.115008 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.114981 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c26930db-3b91-4700-826f-1bcf19720fac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-42wvw\" (UID: \"c26930db-3b91-4700-826f-1bcf19720fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:13.123881 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.123857 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:11:13.126025 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.126007 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:11:13.126395 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:13.126374 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-b8bpp\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="04d11c66-5378-405b-9e9c-766179b0f291" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:11:13.130292 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:13.130269 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:11:13.133471 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.133450 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hglz\" (UniqueName: \"kubernetes.io/projected/d5edaa23-9c62-48ad-aa27-8ab7dce926cb-kube-api-access-4hglz\") pod \"limitador-operator-controller-manager-74495c69f8-vpfqn\" (UID: \"d5edaa23-9c62-48ad-aa27-8ab7dce926cb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn" Sep 18 13:11:13.134039 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:13.134010 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-b8bpp\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="04d11c66-5378-405b-9e9c-766179b0f291" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:11:13.137522 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:13.137495 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zhcm7\" is forbidden: User \"system:node:ip-10-0-140-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-175.ec2.internal' and this object" podUID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:11:13.140470 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.140447 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtgng\" (UniqueName: \"kubernetes.io/projected/c26930db-3b91-4700-826f-1bcf19720fac-kube-api-access-wtgng\") pod \"kuadrant-operator-controller-manager-76f8f686bf-42wvw\" (UID: \"c26930db-3b91-4700-826f-1bcf19720fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:13.215231 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.215200 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs2lv\" (UniqueName: \"kubernetes.io/projected/32ccdf0c-0934-4160-bc0a-76330bb9d32b-kube-api-access-gs2lv\") pod \"32ccdf0c-0934-4160-bc0a-76330bb9d32b\" (UID: \"32ccdf0c-0934-4160-bc0a-76330bb9d32b\") " Sep 18 13:11:13.215231 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.215238 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxf27\" (UniqueName: \"kubernetes.io/projected/04d11c66-5378-405b-9e9c-766179b0f291-kube-api-access-xxf27\") pod \"04d11c66-5378-405b-9e9c-766179b0f291\" (UID: \"04d11c66-5378-405b-9e9c-766179b0f291\") " Sep 18 13:11:13.215485 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.215283 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32ccdf0c-0934-4160-bc0a-76330bb9d32b-extensions-socket-volume\") pod \"32ccdf0c-0934-4160-bc0a-76330bb9d32b\" (UID: \"32ccdf0c-0934-4160-bc0a-76330bb9d32b\") " Sep 18 13:11:13.215485 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.215416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xdx\" (UniqueName: \"kubernetes.io/projected/89dfd3b5-7559-4628-a7d8-0dde726c528b-kube-api-access-v2xdx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8w8c6\" (UID: \"89dfd3b5-7559-4628-a7d8-0dde726c528b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" Sep 18 13:11:13.215590 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.215498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89dfd3b5-7559-4628-a7d8-0dde726c528b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8w8c6\" (UID: \"89dfd3b5-7559-4628-a7d8-0dde726c528b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" Sep 18 13:11:13.215911 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.215880 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89dfd3b5-7559-4628-a7d8-0dde726c528b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8w8c6\" (UID: \"89dfd3b5-7559-4628-a7d8-0dde726c528b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" Sep 18 13:11:13.216033 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.215908 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32ccdf0c-0934-4160-bc0a-76330bb9d32b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "32ccdf0c-0934-4160-bc0a-76330bb9d32b" (UID: "32ccdf0c-0934-4160-bc0a-76330bb9d32b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:11:13.216033 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.216028 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32ccdf0c-0934-4160-bc0a-76330bb9d32b-extensions-socket-volume\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:11:13.217624 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.217597 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d11c66-5378-405b-9e9c-766179b0f291-kube-api-access-xxf27" (OuterVolumeSpecName: "kube-api-access-xxf27") pod "04d11c66-5378-405b-9e9c-766179b0f291" (UID: "04d11c66-5378-405b-9e9c-766179b0f291"). InnerVolumeSpecName "kube-api-access-xxf27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:11:13.217754 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.217739 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32ccdf0c-0934-4160-bc0a-76330bb9d32b-kube-api-access-gs2lv" (OuterVolumeSpecName: "kube-api-access-gs2lv") pod "32ccdf0c-0934-4160-bc0a-76330bb9d32b" (UID: "32ccdf0c-0934-4160-bc0a-76330bb9d32b"). InnerVolumeSpecName "kube-api-access-gs2lv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:11:13.231799 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.231775 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xdx\" (UniqueName: \"kubernetes.io/projected/89dfd3b5-7559-4628-a7d8-0dde726c528b-kube-api-access-v2xdx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8w8c6\" (UID: \"89dfd3b5-7559-4628-a7d8-0dde726c528b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" Sep 18 13:11:13.273304 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.273270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:13.280762 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.280735 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn" Sep 18 13:11:13.317015 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.316977 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs2lv\" (UniqueName: \"kubernetes.io/projected/32ccdf0c-0934-4160-bc0a-76330bb9d32b-kube-api-access-gs2lv\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:11:13.317015 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.317010 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxf27\" (UniqueName: \"kubernetes.io/projected/04d11c66-5378-405b-9e9c-766179b0f291-kube-api-access-xxf27\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:11:13.337152 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.335904 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" Sep 18 13:11:13.533698 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.533668 2561 generic.go:356] "Generic (PLEG): container finished" podID="04d11c66-5378-405b-9e9c-766179b0f291" containerID="07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0" exitCode=0 Sep 18 13:11:13.534149 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.533715 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b8bpp" Sep 18 13:11:13.534149 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.533764 2561 scope.go:117] "RemoveContainer" containerID="07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0" Sep 18 13:11:13.535758 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.535688 2561 generic.go:356] "Generic (PLEG): container finished" podID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" containerID="6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae" exitCode=0 Sep 18 13:11:13.535855 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.535769 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zhcm7" Sep 18 13:11:13.543744 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.543727 2561 scope.go:117] "RemoveContainer" containerID="07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0" Sep 18 13:11:13.544137 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:13.544104 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0\": container with ID starting with 07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0 not found: ID does not exist" containerID="07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0" Sep 18 13:11:13.544217 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.544138 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0"} err="failed to get container status \"07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0\": rpc error: code = NotFound desc = could not find container \"07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0\": container with ID starting with 07eafe11781bffb933c2c5a3a1ddcf9dde3bf95785151bbd174b4326d151fea0 not found: ID does not exist" Sep 18 13:11:13.544217 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.544164 2561 scope.go:117] "RemoveContainer" containerID="6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae" Sep 18 13:11:13.550250 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.550215 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw"] Sep 18 13:11:13.554768 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.554746 2561 scope.go:117] "RemoveContainer" containerID="6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae" Sep 18 13:11:13.555176 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:13.555150 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae\": container with ID starting with 6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae not found: ID does not exist" containerID="6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae" Sep 18 13:11:13.555276 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.555186 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae"} err="failed to get container status \"6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae\": rpc error: code = NotFound desc = could not find container \"6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae\": container with ID starting with 6e829734e7a25e438a81e370b55f1a134d8bac6c8b30336edb866407b4a98bae not found: ID does not exist" Sep 18 13:11:13.556093 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:11:13.556071 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26930db_3b91_4700_826f_1bcf19720fac.slice/crio-bce86979ccea7b21726fefabb67600950f03d96a33d362764986f336b64a66b3 WatchSource:0}: Error finding container bce86979ccea7b21726fefabb67600950f03d96a33d362764986f336b64a66b3: Status 404 returned error can't find the container with id bce86979ccea7b21726fefabb67600950f03d96a33d362764986f336b64a66b3 Sep 18 13:11:13.558588 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.558489 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn"] Sep 18 13:11:13.561523 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:11:13.561498 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5edaa23_9c62_48ad_aa27_8ab7dce926cb.slice/crio-7c9f0b60161add91b29495157457a49e1b6c4222bc0c97f194800497838efebf WatchSource:0}: Error finding container 7c9f0b60161add91b29495157457a49e1b6c4222bc0c97f194800497838efebf: Status 404 returned error can't find the container with id 7c9f0b60161add91b29495157457a49e1b6c4222bc0c97f194800497838efebf Sep 18 13:11:13.627218 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:13.627087 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6"] Sep 18 13:11:13.630037 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:11:13.630010 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89dfd3b5_7559_4628_a7d8_0dde726c528b.slice/crio-2110128faffce1630c156b6f7f8bd7def0fcf227403fa7ee6c02c1a4ac5ce1e5 WatchSource:0}: Error finding container 2110128faffce1630c156b6f7f8bd7def0fcf227403fa7ee6c02c1a4ac5ce1e5: Status 404 returned error can't find the container with id 2110128faffce1630c156b6f7f8bd7def0fcf227403fa7ee6c02c1a4ac5ce1e5 Sep 18 13:11:14.543708 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.543670 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" event={"ID":"89dfd3b5-7559-4628-a7d8-0dde726c528b","Type":"ContainerStarted","Data":"99100753243afe21cabc6aa5261b20f845ff2195a99046ac4095d4eb563941fb"} Sep 18 13:11:14.544153 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.543738 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" event={"ID":"89dfd3b5-7559-4628-a7d8-0dde726c528b","Type":"ContainerStarted","Data":"2110128faffce1630c156b6f7f8bd7def0fcf227403fa7ee6c02c1a4ac5ce1e5"} Sep 18 13:11:14.544153 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.543773 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" Sep 18 13:11:14.545498 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.545463 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn" event={"ID":"d5edaa23-9c62-48ad-aa27-8ab7dce926cb","Type":"ContainerStarted","Data":"00cc864b558745176565e920dd1e0659b9562876884ca4c0af15a28cfa14cca5"} Sep 18 13:11:14.545649 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.545519 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn" event={"ID":"d5edaa23-9c62-48ad-aa27-8ab7dce926cb","Type":"ContainerStarted","Data":"7c9f0b60161add91b29495157457a49e1b6c4222bc0c97f194800497838efebf"} Sep 18 13:11:14.545649 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.545553 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn" Sep 18 13:11:14.547234 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.547204 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" event={"ID":"c26930db-3b91-4700-826f-1bcf19720fac","Type":"ContainerStarted","Data":"d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f"} Sep 18 13:11:14.547374 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.547256 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" event={"ID":"c26930db-3b91-4700-826f-1bcf19720fac","Type":"ContainerStarted","Data":"bce86979ccea7b21726fefabb67600950f03d96a33d362764986f336b64a66b3"} Sep 18 13:11:14.547374 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.547290 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:14.577239 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.577186 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" podStartSLOduration=2.57716909 podStartE2EDuration="2.57716909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:11:14.575681071 +0000 UTC m=+561.318215576" watchObservedRunningTime="2026-09-18 13:11:14.57716909 +0000 UTC m=+561.319703907" Sep 18 13:11:14.607498 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.607404 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" podStartSLOduration=2.607384538 podStartE2EDuration="2.607384538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:11:14.606281941 +0000 UTC m=+561.348816440" watchObservedRunningTime="2026-09-18 13:11:14.607384538 +0000 UTC m=+561.349919043" Sep 18 13:11:14.630258 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:14.630206 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn" podStartSLOduration=2.630191302 podStartE2EDuration="2.630191302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:11:14.629400582 +0000 UTC m=+561.371935095" watchObservedRunningTime="2026-09-18 13:11:14.630191302 +0000 UTC m=+561.372725807" Sep 18 13:11:15.213824 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:15.213791 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d11c66-5378-405b-9e9c-766179b0f291" path="/var/lib/kubelet/pods/04d11c66-5378-405b-9e9c-766179b0f291/volumes" Sep 18 13:11:15.214154 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:15.214141 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32ccdf0c-0934-4160-bc0a-76330bb9d32b" path="/var/lib/kubelet/pods/32ccdf0c-0934-4160-bc0a-76330bb9d32b/volumes" Sep 18 13:11:15.495821 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:15.495729 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-52pnx" Sep 18 13:11:25.555905 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:25.555869 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:25.556329 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:25.555981 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8w8c6" Sep 18 13:11:25.556329 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:25.556020 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpfqn" Sep 18 13:11:25.662143 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:25.662102 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw"] Sep 18 13:11:25.662667 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:25.662632 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" podUID="c26930db-3b91-4700-826f-1bcf19720fac" containerName="manager" containerID="cri-o://d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f" gracePeriod=10 Sep 18 13:11:25.965147 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:25.965117 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:26.026767 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.026737 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtgng\" (UniqueName: \"kubernetes.io/projected/c26930db-3b91-4700-826f-1bcf19720fac-kube-api-access-wtgng\") pod \"c26930db-3b91-4700-826f-1bcf19720fac\" (UID: \"c26930db-3b91-4700-826f-1bcf19720fac\") " Sep 18 13:11:26.026963 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.026829 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c26930db-3b91-4700-826f-1bcf19720fac-extensions-socket-volume\") pod \"c26930db-3b91-4700-826f-1bcf19720fac\" (UID: \"c26930db-3b91-4700-826f-1bcf19720fac\") " Sep 18 13:11:26.027252 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.027218 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26930db-3b91-4700-826f-1bcf19720fac-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c26930db-3b91-4700-826f-1bcf19720fac" (UID: "c26930db-3b91-4700-826f-1bcf19720fac"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:11:26.028978 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.028950 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c26930db-3b91-4700-826f-1bcf19720fac-kube-api-access-wtgng" (OuterVolumeSpecName: "kube-api-access-wtgng") pod "c26930db-3b91-4700-826f-1bcf19720fac" (UID: "c26930db-3b91-4700-826f-1bcf19720fac"). InnerVolumeSpecName "kube-api-access-wtgng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:11:26.128374 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.128288 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtgng\" (UniqueName: \"kubernetes.io/projected/c26930db-3b91-4700-826f-1bcf19720fac-kube-api-access-wtgng\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:11:26.128374 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.128325 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c26930db-3b91-4700-826f-1bcf19720fac-extensions-socket-volume\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:11:26.606176 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.606140 2561 generic.go:356] "Generic (PLEG): container finished" podID="c26930db-3b91-4700-826f-1bcf19720fac" containerID="d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f" exitCode=0 Sep 18 13:11:26.606602 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.606186 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" Sep 18 13:11:26.606602 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.606196 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" event={"ID":"c26930db-3b91-4700-826f-1bcf19720fac","Type":"ContainerDied","Data":"d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f"} Sep 18 13:11:26.606602 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.606237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw" event={"ID":"c26930db-3b91-4700-826f-1bcf19720fac","Type":"ContainerDied","Data":"bce86979ccea7b21726fefabb67600950f03d96a33d362764986f336b64a66b3"} Sep 18 13:11:26.606602 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.606259 2561 scope.go:117] "RemoveContainer" containerID="d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f" Sep 18 13:11:26.615772 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.615750 2561 scope.go:117] "RemoveContainer" containerID="d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f" Sep 18 13:11:26.616056 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:11:26.616035 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f\": container with ID starting with d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f not found: ID does not exist" containerID="d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f" Sep 18 13:11:26.616091 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.616067 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f"} err="failed to get container status \"d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f\": rpc error: code = NotFound desc = could not find container \"d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f\": container with ID starting with d739e96d7b01f5aaced9c49324d730f112ea78e9445cc7c95becd99179aaf59f not found: ID does not exist" Sep 18 13:11:26.637462 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.637405 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw"] Sep 18 13:11:26.651741 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:26.651708 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-42wvw"] Sep 18 13:11:27.213943 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:27.213912 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c26930db-3b91-4700-826f-1bcf19720fac" path="/var/lib/kubelet/pods/c26930db-3b91-4700-826f-1bcf19720fac/volumes" Sep 18 13:11:45.264085 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.264050 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-cb7mp"] Sep 18 13:11:45.264547 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.264529 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c26930db-3b91-4700-826f-1bcf19720fac" containerName="manager" Sep 18 13:11:45.264592 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.264550 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26930db-3b91-4700-826f-1bcf19720fac" containerName="manager" Sep 18 13:11:45.264654 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.264644 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c26930db-3b91-4700-826f-1bcf19720fac" containerName="manager" Sep 18 13:11:45.267715 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.267693 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:11:45.271008 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.270986 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 18 13:11:45.294147 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.294109 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6c7dabe4-aa19-4f9f-9228-92309a57b67e-config-file\") pod \"limitador-limitador-8588749977-cb7mp\" (UID: \"6c7dabe4-aa19-4f9f-9228-92309a57b67e\") " pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:11:45.294311 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.294166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzpk\" (UniqueName: \"kubernetes.io/projected/6c7dabe4-aa19-4f9f-9228-92309a57b67e-kube-api-access-tmzpk\") pod \"limitador-limitador-8588749977-cb7mp\" (UID: \"6c7dabe4-aa19-4f9f-9228-92309a57b67e\") " pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:11:45.307210 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.307176 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-cb7mp"] Sep 18 13:11:45.364205 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.364163 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-cb7mp"] Sep 18 13:11:45.394960 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.394919 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6c7dabe4-aa19-4f9f-9228-92309a57b67e-config-file\") pod \"limitador-limitador-8588749977-cb7mp\" (UID: \"6c7dabe4-aa19-4f9f-9228-92309a57b67e\") " pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:11:45.394960 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.394967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzpk\" (UniqueName: \"kubernetes.io/projected/6c7dabe4-aa19-4f9f-9228-92309a57b67e-kube-api-access-tmzpk\") pod \"limitador-limitador-8588749977-cb7mp\" (UID: \"6c7dabe4-aa19-4f9f-9228-92309a57b67e\") " pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:11:45.395628 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.395603 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6c7dabe4-aa19-4f9f-9228-92309a57b67e-config-file\") pod \"limitador-limitador-8588749977-cb7mp\" (UID: \"6c7dabe4-aa19-4f9f-9228-92309a57b67e\") " pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:11:45.413676 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.413642 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzpk\" (UniqueName: \"kubernetes.io/projected/6c7dabe4-aa19-4f9f-9228-92309a57b67e-kube-api-access-tmzpk\") pod \"limitador-limitador-8588749977-cb7mp\" (UID: \"6c7dabe4-aa19-4f9f-9228-92309a57b67e\") " pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:11:45.578533 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.578500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:11:45.903988 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:45.903956 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-cb7mp"] Sep 18 13:11:45.904646 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:11:45.904619 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7dabe4_aa19_4f9f_9228_92309a57b67e.slice/crio-183b8fba07a6c499e4a2c6598ad95b7648222d09f10d9680d24d4421de27474a WatchSource:0}: Error finding container 183b8fba07a6c499e4a2c6598ad95b7648222d09f10d9680d24d4421de27474a: Status 404 returned error can't find the container with id 183b8fba07a6c499e4a2c6598ad95b7648222d09f10d9680d24d4421de27474a Sep 18 13:11:46.365067 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:46.365031 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rtnld"] Sep 18 13:11:46.369476 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:46.369454 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" Sep 18 13:11:46.385069 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:46.385039 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vxwj2\"" Sep 18 13:11:46.404328 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:46.404288 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn8h7\" (UniqueName: \"kubernetes.io/projected/0ec5bfc0-0060-49ae-b7da-c17cf34c15b9-kube-api-access-fn8h7\") pod \"authorino-7bcfd8f9cd-rtnld\" (UID: \"0ec5bfc0-0060-49ae-b7da-c17cf34c15b9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" Sep 18 13:11:46.410720 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:46.410684 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rtnld"] Sep 18 13:11:46.505118 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:46.505077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8h7\" (UniqueName: \"kubernetes.io/projected/0ec5bfc0-0060-49ae-b7da-c17cf34c15b9-kube-api-access-fn8h7\") pod \"authorino-7bcfd8f9cd-rtnld\" (UID: \"0ec5bfc0-0060-49ae-b7da-c17cf34c15b9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" Sep 18 13:11:46.530667 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:46.530630 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn8h7\" (UniqueName: \"kubernetes.io/projected/0ec5bfc0-0060-49ae-b7da-c17cf34c15b9-kube-api-access-fn8h7\") pod \"authorino-7bcfd8f9cd-rtnld\" (UID: \"0ec5bfc0-0060-49ae-b7da-c17cf34c15b9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" Sep 18 13:11:46.679449 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:46.679336 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" Sep 18 13:11:46.706866 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:46.706818 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" event={"ID":"6c7dabe4-aa19-4f9f-9228-92309a57b67e","Type":"ContainerStarted","Data":"183b8fba07a6c499e4a2c6598ad95b7648222d09f10d9680d24d4421de27474a"} Sep 18 13:11:46.977236 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:46.977135 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rtnld"] Sep 18 13:11:46.997062 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:11:46.997031 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ec5bfc0_0060_49ae_b7da_c17cf34c15b9.slice/crio-e5243a32a1285fc7b132e30979409d090f18fb2486eb80c4f456b719f3395ce6 WatchSource:0}: Error finding container e5243a32a1285fc7b132e30979409d090f18fb2486eb80c4f456b719f3395ce6: Status 404 returned error can't find the container with id e5243a32a1285fc7b132e30979409d090f18fb2486eb80c4f456b719f3395ce6 Sep 18 13:11:47.712866 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:47.712825 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" event={"ID":"6c7dabe4-aa19-4f9f-9228-92309a57b67e","Type":"ContainerStarted","Data":"1a283106cbb883a82fdbc126c247e4eacee63a19eb1e4f7395ce3a6024f953b7"} Sep 18 13:11:47.713341 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:47.712893 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:11:47.714093 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:47.714064 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" event={"ID":"0ec5bfc0-0060-49ae-b7da-c17cf34c15b9","Type":"ContainerStarted","Data":"e5243a32a1285fc7b132e30979409d090f18fb2486eb80c4f456b719f3395ce6"} Sep 18 13:11:47.739786 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:47.739729 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" podStartSLOduration=1.586177095 podStartE2EDuration="2.739712347s" totalImagesPullingTime="1.153535252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:11:47.738813548 +0000 UTC m=+594.481348067" watchObservedRunningTime="2026-09-18 13:11:47.739712347 +0000 UTC m=+594.482246851" Sep 18 13:11:50.257147 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:50.257111 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rtnld"] Sep 18 13:11:55.157440 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:55.157383 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48w7v_32c6c241-bea2-43fc-80f1-5c1a697090e6/ovn-acl-logging/0.log" Sep 18 13:11:55.162085 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:55.162060 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48w7v_32c6c241-bea2-43fc-80f1-5c1a697090e6/ovn-acl-logging/0.log" Sep 18 13:11:58.720082 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:11:58.720049 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:12:00.237837 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:00.237797 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-cb7mp"] Sep 18 13:12:00.238311 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:00.238026 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" podUID="6c7dabe4-aa19-4f9f-9228-92309a57b67e" containerName="limitador" containerID="cri-o://1a283106cbb883a82fdbc126c247e4eacee63a19eb1e4f7395ce3a6024f953b7" gracePeriod=30 Sep 18 13:12:00.777245 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:00.777209 2561 generic.go:356] "Generic (PLEG): container finished" podID="6c7dabe4-aa19-4f9f-9228-92309a57b67e" containerID="1a283106cbb883a82fdbc126c247e4eacee63a19eb1e4f7395ce3a6024f953b7" exitCode=0 Sep 18 13:12:00.777433 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:00.777282 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" event={"ID":"6c7dabe4-aa19-4f9f-9228-92309a57b67e","Type":"ContainerDied","Data":"1a283106cbb883a82fdbc126c247e4eacee63a19eb1e4f7395ce3a6024f953b7"} Sep 18 13:12:01.199269 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.199240 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:12:01.327984 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.327877 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6c7dabe4-aa19-4f9f-9228-92309a57b67e-config-file\") pod \"6c7dabe4-aa19-4f9f-9228-92309a57b67e\" (UID: \"6c7dabe4-aa19-4f9f-9228-92309a57b67e\") " Sep 18 13:12:01.327984 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.327948 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmzpk\" (UniqueName: \"kubernetes.io/projected/6c7dabe4-aa19-4f9f-9228-92309a57b67e-kube-api-access-tmzpk\") pod \"6c7dabe4-aa19-4f9f-9228-92309a57b67e\" (UID: \"6c7dabe4-aa19-4f9f-9228-92309a57b67e\") " Sep 18 13:12:01.328393 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.328314 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c7dabe4-aa19-4f9f-9228-92309a57b67e-config-file" (OuterVolumeSpecName: "config-file") pod "6c7dabe4-aa19-4f9f-9228-92309a57b67e" (UID: "6c7dabe4-aa19-4f9f-9228-92309a57b67e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:12:01.330040 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.330016 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c7dabe4-aa19-4f9f-9228-92309a57b67e-kube-api-access-tmzpk" (OuterVolumeSpecName: "kube-api-access-tmzpk") pod "6c7dabe4-aa19-4f9f-9228-92309a57b67e" (UID: "6c7dabe4-aa19-4f9f-9228-92309a57b67e"). InnerVolumeSpecName "kube-api-access-tmzpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:12:01.429188 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.429144 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6c7dabe4-aa19-4f9f-9228-92309a57b67e-config-file\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:12:01.429188 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.429180 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmzpk\" (UniqueName: \"kubernetes.io/projected/6c7dabe4-aa19-4f9f-9228-92309a57b67e-kube-api-access-tmzpk\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:12:01.782887 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.782859 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" Sep 18 13:12:01.783071 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.782862 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-cb7mp" event={"ID":"6c7dabe4-aa19-4f9f-9228-92309a57b67e","Type":"ContainerDied","Data":"183b8fba07a6c499e4a2c6598ad95b7648222d09f10d9680d24d4421de27474a"} Sep 18 13:12:01.783071 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.783006 2561 scope.go:117] "RemoveContainer" containerID="1a283106cbb883a82fdbc126c247e4eacee63a19eb1e4f7395ce3a6024f953b7" Sep 18 13:12:01.821320 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.821282 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-cb7mp"] Sep 18 13:12:01.825009 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:01.824976 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-cb7mp"] Sep 18 13:12:03.213748 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:03.213716 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c7dabe4-aa19-4f9f-9228-92309a57b67e" path="/var/lib/kubelet/pods/6c7dabe4-aa19-4f9f-9228-92309a57b67e/volumes" Sep 18 13:12:05.805668 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:05.805626 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" event={"ID":"0ec5bfc0-0060-49ae-b7da-c17cf34c15b9","Type":"ContainerStarted","Data":"e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd"} Sep 18 13:12:05.806159 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:05.805725 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" podUID="0ec5bfc0-0060-49ae-b7da-c17cf34c15b9" containerName="authorino" containerID="cri-o://e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd" gracePeriod=30 Sep 18 13:12:05.852906 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:05.852847 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" podStartSLOduration=1.495418285 podStartE2EDuration="19.85282927s" totalImagesPullingTime="18.357410985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:12:05.852224746 +0000 UTC m=+612.594759252" watchObservedRunningTime="2026-09-18 13:12:05.85282927 +0000 UTC m=+612.595363775" Sep 18 13:12:06.055195 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.055167 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" Sep 18 13:12:06.170642 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.170538 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn8h7\" (UniqueName: \"kubernetes.io/projected/0ec5bfc0-0060-49ae-b7da-c17cf34c15b9-kube-api-access-fn8h7\") pod \"0ec5bfc0-0060-49ae-b7da-c17cf34c15b9\" (UID: \"0ec5bfc0-0060-49ae-b7da-c17cf34c15b9\") " Sep 18 13:12:06.172706 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.172678 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec5bfc0-0060-49ae-b7da-c17cf34c15b9-kube-api-access-fn8h7" (OuterVolumeSpecName: "kube-api-access-fn8h7") pod "0ec5bfc0-0060-49ae-b7da-c17cf34c15b9" (UID: "0ec5bfc0-0060-49ae-b7da-c17cf34c15b9"). InnerVolumeSpecName "kube-api-access-fn8h7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:12:06.271809 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.271768 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn8h7\" (UniqueName: \"kubernetes.io/projected/0ec5bfc0-0060-49ae-b7da-c17cf34c15b9-kube-api-access-fn8h7\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:12:06.812834 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.812793 2561 generic.go:356] "Generic (PLEG): container finished" podID="0ec5bfc0-0060-49ae-b7da-c17cf34c15b9" containerID="e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd" exitCode=0 Sep 18 13:12:06.812834 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.812838 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" Sep 18 13:12:06.813328 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.812874 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" event={"ID":"0ec5bfc0-0060-49ae-b7da-c17cf34c15b9","Type":"ContainerDied","Data":"e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd"} Sep 18 13:12:06.813328 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.812912 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-rtnld" event={"ID":"0ec5bfc0-0060-49ae-b7da-c17cf34c15b9","Type":"ContainerDied","Data":"e5243a32a1285fc7b132e30979409d090f18fb2486eb80c4f456b719f3395ce6"} Sep 18 13:12:06.813328 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.812928 2561 scope.go:117] "RemoveContainer" containerID="e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd" Sep 18 13:12:06.821910 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.821888 2561 scope.go:117] "RemoveContainer" containerID="e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd" Sep 18 13:12:06.822248 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:12:06.822228 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd\": container with ID starting with e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd not found: ID does not exist" containerID="e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd" Sep 18 13:12:06.822297 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.822259 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd"} err="failed to get container status \"e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd\": rpc error: code = NotFound desc = could not find container \"e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd\": container with ID starting with e48907e5e82ecc1a727ff61a742d96f554ed759e113a888c3e620ab621c229dd not found: ID does not exist" Sep 18 13:12:06.858754 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.858716 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rtnld"] Sep 18 13:12:06.864876 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.864845 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-rtnld"] Sep 18 13:12:06.879896 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.879859 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx"] Sep 18 13:12:06.880227 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.880213 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c7dabe4-aa19-4f9f-9228-92309a57b67e" containerName="limitador" Sep 18 13:12:06.880227 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.880226 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c7dabe4-aa19-4f9f-9228-92309a57b67e" containerName="limitador" Sep 18 13:12:06.880357 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.880235 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec5bfc0-0060-49ae-b7da-c17cf34c15b9" containerName="authorino" Sep 18 13:12:06.880357 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.880241 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec5bfc0-0060-49ae-b7da-c17cf34c15b9" containerName="authorino" Sep 18 13:12:06.880357 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.880289 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ec5bfc0-0060-49ae-b7da-c17cf34c15b9" containerName="authorino" Sep 18 13:12:06.880357 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.880297 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c7dabe4-aa19-4f9f-9228-92309a57b67e" containerName="limitador" Sep 18 13:12:06.884611 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.884587 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" Sep 18 13:12:06.888054 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.888026 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 18 13:12:06.888179 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.888149 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-f4vbz\"" Sep 18 13:12:06.888527 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.888509 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 18 13:12:06.888738 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.888720 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 18 13:12:06.916008 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.915971 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx"] Sep 18 13:12:06.976355 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.976321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdcbz\" (UniqueName: \"kubernetes.io/projected/7849d568-0e56-4b99-8f9c-120852c76ae8-kube-api-access-bdcbz\") pod \"postgres-69fb4594cf-t4bkx\" (UID: \"7849d568-0e56-4b99-8f9c-120852c76ae8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" Sep 18 13:12:06.976557 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:06.976378 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7849d568-0e56-4b99-8f9c-120852c76ae8-data\") pod \"postgres-69fb4594cf-t4bkx\" (UID: \"7849d568-0e56-4b99-8f9c-120852c76ae8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" Sep 18 13:12:07.077862 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:07.077767 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdcbz\" (UniqueName: \"kubernetes.io/projected/7849d568-0e56-4b99-8f9c-120852c76ae8-kube-api-access-bdcbz\") pod \"postgres-69fb4594cf-t4bkx\" (UID: \"7849d568-0e56-4b99-8f9c-120852c76ae8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" Sep 18 13:12:07.077862 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:07.077834 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7849d568-0e56-4b99-8f9c-120852c76ae8-data\") pod \"postgres-69fb4594cf-t4bkx\" (UID: \"7849d568-0e56-4b99-8f9c-120852c76ae8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" Sep 18 13:12:07.078191 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:07.078175 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7849d568-0e56-4b99-8f9c-120852c76ae8-data\") pod \"postgres-69fb4594cf-t4bkx\" (UID: \"7849d568-0e56-4b99-8f9c-120852c76ae8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" Sep 18 13:12:07.091667 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:07.091627 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdcbz\" (UniqueName: \"kubernetes.io/projected/7849d568-0e56-4b99-8f9c-120852c76ae8-kube-api-access-bdcbz\") pod \"postgres-69fb4594cf-t4bkx\" (UID: \"7849d568-0e56-4b99-8f9c-120852c76ae8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" Sep 18 13:12:07.194845 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:07.194810 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" Sep 18 13:12:07.215774 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:07.215740 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ec5bfc0-0060-49ae-b7da-c17cf34c15b9" path="/var/lib/kubelet/pods/0ec5bfc0-0060-49ae-b7da-c17cf34c15b9/volumes" Sep 18 13:12:07.475118 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:07.475036 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx"] Sep 18 13:12:07.478114 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:12:07.478081 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7849d568_0e56_4b99_8f9c_120852c76ae8.slice/crio-39033d49d6baa546fe260c71d17ec67ea194f52a6993abb87cb44347aafff905 WatchSource:0}: Error finding container 39033d49d6baa546fe260c71d17ec67ea194f52a6993abb87cb44347aafff905: Status 404 returned error can't find the container with id 39033d49d6baa546fe260c71d17ec67ea194f52a6993abb87cb44347aafff905 Sep 18 13:12:07.820170 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:07.820128 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" event={"ID":"7849d568-0e56-4b99-8f9c-120852c76ae8","Type":"ContainerStarted","Data":"39033d49d6baa546fe260c71d17ec67ea194f52a6993abb87cb44347aafff905"} Sep 18 13:12:12.850608 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:12.850574 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" event={"ID":"7849d568-0e56-4b99-8f9c-120852c76ae8","Type":"ContainerStarted","Data":"bad9c9cc0f37983f789033372d190eb3bb4270871f2de0f99703ecded0c69ada"} Sep 18 13:12:12.851015 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:12.850686 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" Sep 18 13:12:12.880896 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:12.880841 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" podStartSLOduration=1.869123393 podStartE2EDuration="6.880826125s" totalImagesPullingTime="5.011702732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:12:12.880670832 +0000 UTC m=+619.623205337" watchObservedRunningTime="2026-09-18 13:12:12.880826125 +0000 UTC m=+619.623360629" Sep 18 13:12:18.883982 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:18.883942 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t4bkx" Sep 18 13:12:19.496563 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.496523 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-pz62v"] Sep 18 13:12:19.502624 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.502593 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-pz62v" Sep 18 13:12:19.506416 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.506392 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vxwj2\"" Sep 18 13:12:19.510568 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.510543 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-pz62v"] Sep 18 13:12:19.589512 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.589473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fccbz\" (UniqueName: \"kubernetes.io/projected/f1b659d8-6539-46fc-81b5-69b470644659-kube-api-access-fccbz\") pod \"authorino-557f876f69-pz62v\" (UID: \"f1b659d8-6539-46fc-81b5-69b470644659\") " pod="kuadrant-system/authorino-557f876f69-pz62v" Sep 18 13:12:19.608994 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.608955 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-pz62v"] Sep 18 13:12:19.609225 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:12:19.609206 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fccbz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-pz62v" podUID="f1b659d8-6539-46fc-81b5-69b470644659" Sep 18 13:12:19.646868 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.646830 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-kgfpg"] Sep 18 13:12:19.651048 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.651028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-kgfpg" Sep 18 13:12:19.654334 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.654310 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 18 13:12:19.663756 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.663729 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-kgfpg"] Sep 18 13:12:19.690819 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.690786 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fccbz\" (UniqueName: \"kubernetes.io/projected/f1b659d8-6539-46fc-81b5-69b470644659-kube-api-access-fccbz\") pod \"authorino-557f876f69-pz62v\" (UID: \"f1b659d8-6539-46fc-81b5-69b470644659\") " pod="kuadrant-system/authorino-557f876f69-pz62v" Sep 18 13:12:19.699320 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.699282 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fccbz\" (UniqueName: \"kubernetes.io/projected/f1b659d8-6539-46fc-81b5-69b470644659-kube-api-access-fccbz\") pod \"authorino-557f876f69-pz62v\" (UID: \"f1b659d8-6539-46fc-81b5-69b470644659\") " pod="kuadrant-system/authorino-557f876f69-pz62v" Sep 18 13:12:19.746851 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.746758 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-kgfpg"] Sep 18 13:12:19.747056 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:12:19.747036 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bv7hm tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-kgfpg" podUID="7be6167a-d71f-4a7e-96af-16ab2d4fdcdb" Sep 18 13:12:19.791557 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.791514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv7hm\" (UniqueName: \"kubernetes.io/projected/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-kube-api-access-bv7hm\") pod \"authorino-6d4dfc649f-kgfpg\" (UID: \"7be6167a-d71f-4a7e-96af-16ab2d4fdcdb\") " pod="kuadrant-system/authorino-6d4dfc649f-kgfpg" Sep 18 13:12:19.791557 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.791563 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-tls-cert\") pod \"authorino-6d4dfc649f-kgfpg\" (UID: \"7be6167a-d71f-4a7e-96af-16ab2d4fdcdb\") " pod="kuadrant-system/authorino-6d4dfc649f-kgfpg" Sep 18 13:12:19.882773 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.882740 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-kgfpg" Sep 18 13:12:19.882942 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.882740 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-pz62v" Sep 18 13:12:19.890942 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.890911 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-kgfpg" Sep 18 13:12:19.892688 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.892664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-tls-cert\") pod \"authorino-6d4dfc649f-kgfpg\" (UID: \"7be6167a-d71f-4a7e-96af-16ab2d4fdcdb\") " pod="kuadrant-system/authorino-6d4dfc649f-kgfpg" Sep 18 13:12:19.892796 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.892782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7hm\" (UniqueName: \"kubernetes.io/projected/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-kube-api-access-bv7hm\") pod \"authorino-6d4dfc649f-kgfpg\" (UID: \"7be6167a-d71f-4a7e-96af-16ab2d4fdcdb\") " pod="kuadrant-system/authorino-6d4dfc649f-kgfpg" Sep 18 13:12:19.894003 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.893981 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-pz62v" Sep 18 13:12:19.895554 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.895528 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-tls-cert\") pod \"authorino-6d4dfc649f-kgfpg\" (UID: \"7be6167a-d71f-4a7e-96af-16ab2d4fdcdb\") " pod="kuadrant-system/authorino-6d4dfc649f-kgfpg" Sep 18 13:12:19.903994 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.903973 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv7hm\" (UniqueName: \"kubernetes.io/projected/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-kube-api-access-bv7hm\") pod \"authorino-6d4dfc649f-kgfpg\" (UID: \"7be6167a-d71f-4a7e-96af-16ab2d4fdcdb\") " pod="kuadrant-system/authorino-6d4dfc649f-kgfpg" Sep 18 13:12:19.993278 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.993240 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fccbz\" (UniqueName: \"kubernetes.io/projected/f1b659d8-6539-46fc-81b5-69b470644659-kube-api-access-fccbz\") pod \"f1b659d8-6539-46fc-81b5-69b470644659\" (UID: \"f1b659d8-6539-46fc-81b5-69b470644659\") " Sep 18 13:12:19.993502 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.993347 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv7hm\" (UniqueName: \"kubernetes.io/projected/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-kube-api-access-bv7hm\") pod \"7be6167a-d71f-4a7e-96af-16ab2d4fdcdb\" (UID: \"7be6167a-d71f-4a7e-96af-16ab2d4fdcdb\") " Sep 18 13:12:19.993502 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.993376 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-tls-cert\") pod \"7be6167a-d71f-4a7e-96af-16ab2d4fdcdb\" (UID: \"7be6167a-d71f-4a7e-96af-16ab2d4fdcdb\") " Sep 18 13:12:19.995571 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.995530 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-kube-api-access-bv7hm" (OuterVolumeSpecName: "kube-api-access-bv7hm") pod "7be6167a-d71f-4a7e-96af-16ab2d4fdcdb" (UID: "7be6167a-d71f-4a7e-96af-16ab2d4fdcdb"). InnerVolumeSpecName "kube-api-access-bv7hm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:12:19.995689 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.995576 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1b659d8-6539-46fc-81b5-69b470644659-kube-api-access-fccbz" (OuterVolumeSpecName: "kube-api-access-fccbz") pod "f1b659d8-6539-46fc-81b5-69b470644659" (UID: "f1b659d8-6539-46fc-81b5-69b470644659"). InnerVolumeSpecName "kube-api-access-fccbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:12:19.995689 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:19.995643 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7be6167a-d71f-4a7e-96af-16ab2d4fdcdb" (UID: "7be6167a-d71f-4a7e-96af-16ab2d4fdcdb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:12:20.094159 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:20.094129 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fccbz\" (UniqueName: \"kubernetes.io/projected/f1b659d8-6539-46fc-81b5-69b470644659-kube-api-access-fccbz\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:12:20.094159 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:20.094156 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv7hm\" (UniqueName: \"kubernetes.io/projected/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-kube-api-access-bv7hm\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:12:20.094159 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:20.094165 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb-tls-cert\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:12:20.887279 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:20.887250 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-kgfpg" Sep 18 13:12:20.887492 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:20.887250 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-pz62v" Sep 18 13:12:20.924267 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:20.924188 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-kgfpg"] Sep 18 13:12:20.927061 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:20.927028 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-kgfpg"] Sep 18 13:12:20.955673 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:20.955637 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-pz62v"] Sep 18 13:12:20.958659 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:20.958628 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-pz62v"] Sep 18 13:12:21.214601 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:21.214516 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7be6167a-d71f-4a7e-96af-16ab2d4fdcdb" path="/var/lib/kubelet/pods/7be6167a-d71f-4a7e-96af-16ab2d4fdcdb/volumes" Sep 18 13:12:21.214758 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:21.214746 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1b659d8-6539-46fc-81b5-69b470644659" path="/var/lib/kubelet/pods/f1b659d8-6539-46fc-81b5-69b470644659/volumes" Sep 18 13:12:26.574468 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.574430 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qxl4q"] Sep 18 13:12:26.578451 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.578416 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:26.582448 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.582409 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 18 13:12:26.582448 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.582413 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 18 13:12:26.609938 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.609620 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bhdvf\"" Sep 18 13:12:26.610640 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.610614 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 18 13:12:26.612648 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.612622 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qxl4q"] Sep 18 13:12:26.753290 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.753243 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzvb8\" (UniqueName: \"kubernetes.io/projected/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-kube-api-access-nzvb8\") pod \"maas-controller-75dc6cbdf-qxl4q\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:26.753541 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.753304 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-webhook-cert\") pod \"maas-controller-75dc6cbdf-qxl4q\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:26.753541 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.753328 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-metrics-certs\") pod \"maas-controller-75dc6cbdf-qxl4q\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:26.784408 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.784371 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56f7c6b9dc-9jd5v"] Sep 18 13:12:26.787963 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.787943 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:26.799887 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.799856 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f7c6b9dc-9jd5v"] Sep 18 13:12:26.854436 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.854330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzvb8\" (UniqueName: \"kubernetes.io/projected/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-kube-api-access-nzvb8\") pod \"maas-controller-75dc6cbdf-qxl4q\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:26.854436 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.854384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-webhook-cert\") pod \"maas-controller-75dc6cbdf-qxl4q\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:26.854436 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.854412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-metrics-certs\") pod \"maas-controller-75dc6cbdf-qxl4q\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:26.854696 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:12:26.854518 2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 18 13:12:26.854696 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:12:26.854619 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-webhook-cert podName:bb0cc1f5-7575-4320-b3a7-c79b23f5cba5 nodeName:}" failed. No retries permitted until 2026-09-18 13:12:27.3545952 +0000 UTC m=+634.097129702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-webhook-cert") pod "maas-controller-75dc6cbdf-qxl4q" (UID: "bb0cc1f5-7575-4320-b3a7-c79b23f5cba5") : secret "maas-controller-webhook-cert" not found Sep 18 13:12:26.856977 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.856947 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-metrics-certs\") pod \"maas-controller-75dc6cbdf-qxl4q\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:26.864463 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.864413 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzvb8\" (UniqueName: \"kubernetes.io/projected/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-kube-api-access-nzvb8\") pod \"maas-controller-75dc6cbdf-qxl4q\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:26.955813 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.955773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-metrics-certs\") pod \"maas-controller-56f7c6b9dc-9jd5v\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:26.955813 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.955814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwlvt\" (UniqueName: \"kubernetes.io/projected/f4e2152e-c21f-4fcb-8432-45fefec0d98d-kube-api-access-wwlvt\") pod \"maas-controller-56f7c6b9dc-9jd5v\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:26.956027 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:26.955849 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-webhook-cert\") pod \"maas-controller-56f7c6b9dc-9jd5v\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:27.056340 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.056304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-webhook-cert\") pod \"maas-controller-56f7c6b9dc-9jd5v\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:27.056556 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.056394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-metrics-certs\") pod \"maas-controller-56f7c6b9dc-9jd5v\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:27.056624 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.056563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwlvt\" (UniqueName: \"kubernetes.io/projected/f4e2152e-c21f-4fcb-8432-45fefec0d98d-kube-api-access-wwlvt\") pod \"maas-controller-56f7c6b9dc-9jd5v\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:27.058868 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.058837 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-metrics-certs\") pod \"maas-controller-56f7c6b9dc-9jd5v\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:27.058868 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.058860 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-webhook-cert\") pod \"maas-controller-56f7c6b9dc-9jd5v\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:27.065412 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.065387 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwlvt\" (UniqueName: \"kubernetes.io/projected/f4e2152e-c21f-4fcb-8432-45fefec0d98d-kube-api-access-wwlvt\") pod \"maas-controller-56f7c6b9dc-9jd5v\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:27.100537 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.100495 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:27.360560 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.360472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-webhook-cert\") pod \"maas-controller-75dc6cbdf-qxl4q\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:27.362829 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.362808 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-webhook-cert\") pod \"maas-controller-75dc6cbdf-qxl4q\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:27.375323 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.375297 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f7c6b9dc-9jd5v"] Sep 18 13:12:27.377773 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:12:27.377746 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e2152e_c21f_4fcb_8432_45fefec0d98d.slice/crio-b7872b8cdee2769bf80273df60465fba0a7d5eac3a4c670220df8bdee618852c WatchSource:0}: Error finding container b7872b8cdee2769bf80273df60465fba0a7d5eac3a4c670220df8bdee618852c: Status 404 returned error can't find the container with id b7872b8cdee2769bf80273df60465fba0a7d5eac3a4c670220df8bdee618852c Sep 18 13:12:27.490279 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.490230 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:27.761496 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.761467 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qxl4q"] Sep 18 13:12:27.764194 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:12:27.764170 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb0cc1f5_7575_4320_b3a7_c79b23f5cba5.slice/crio-9084072b01fc82ec663d5df8770e426185e7db7572e20b565ffad2e8ceecc33f WatchSource:0}: Error finding container 9084072b01fc82ec663d5df8770e426185e7db7572e20b565ffad2e8ceecc33f: Status 404 returned error can't find the container with id 9084072b01fc82ec663d5df8770e426185e7db7572e20b565ffad2e8ceecc33f Sep 18 13:12:27.935882 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.935845 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" event={"ID":"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5","Type":"ContainerStarted","Data":"9084072b01fc82ec663d5df8770e426185e7db7572e20b565ffad2e8ceecc33f"} Sep 18 13:12:27.937234 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:27.937206 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" event={"ID":"f4e2152e-c21f-4fcb-8432-45fefec0d98d","Type":"ContainerStarted","Data":"b7872b8cdee2769bf80273df60465fba0a7d5eac3a4c670220df8bdee618852c"} Sep 18 13:12:30.957741 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:30.957691 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" event={"ID":"f4e2152e-c21f-4fcb-8432-45fefec0d98d","Type":"ContainerStarted","Data":"2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da"} Sep 18 13:12:30.958204 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:30.957769 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:30.959451 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:30.959404 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" event={"ID":"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5","Type":"ContainerStarted","Data":"03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879"} Sep 18 13:12:30.959571 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:30.959539 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:30.985211 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:30.985155 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" podStartSLOduration=2.3971209829999998 podStartE2EDuration="4.985139089s" totalImagesPullingTime="2.588018106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:12:30.983522466 +0000 UTC m=+637.726056972" watchObservedRunningTime="2026-09-18 13:12:30.985139089 +0000 UTC m=+637.727673593" Sep 18 13:12:31.020133 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:31.020067 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" podStartSLOduration=2.808400347 podStartE2EDuration="5.020046968s" totalImagesPullingTime="2.211646621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:12:31.016416384 +0000 UTC m=+637.758950890" watchObservedRunningTime="2026-09-18 13:12:31.020046968 +0000 UTC m=+637.762581517" Sep 18 13:12:41.965793 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:41.965749 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:12:41.968333 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:41.965886 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:42.047893 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.047852 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qxl4q"] Sep 18 13:12:42.048176 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.048146 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" podUID="bb0cc1f5-7575-4320-b3a7-c79b23f5cba5" containerName="manager" containerID="cri-o://03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879" gracePeriod=30 Sep 18 13:12:42.292643 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.292615 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:42.383514 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.383473 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-webhook-cert\") pod \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " Sep 18 13:12:42.383702 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.383527 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzvb8\" (UniqueName: \"kubernetes.io/projected/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-kube-api-access-nzvb8\") pod \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " Sep 18 13:12:42.383702 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.383547 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-metrics-certs\") pod \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\" (UID: \"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5\") " Sep 18 13:12:42.385894 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.385857 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bb0cc1f5-7575-4320-b3a7-c79b23f5cba5" (UID: "bb0cc1f5-7575-4320-b3a7-c79b23f5cba5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:12:42.385894 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.385876 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bb0cc1f5-7575-4320-b3a7-c79b23f5cba5" (UID: "bb0cc1f5-7575-4320-b3a7-c79b23f5cba5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:12:42.386066 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.385938 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-kube-api-access-nzvb8" (OuterVolumeSpecName: "kube-api-access-nzvb8") pod "bb0cc1f5-7575-4320-b3a7-c79b23f5cba5" (UID: "bb0cc1f5-7575-4320-b3a7-c79b23f5cba5"). InnerVolumeSpecName "kube-api-access-nzvb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:12:42.484739 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.484707 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-webhook-cert\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:12:42.484739 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.484736 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzvb8\" (UniqueName: \"kubernetes.io/projected/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-kube-api-access-nzvb8\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:12:42.484943 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:42.484749 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5-metrics-certs\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:12:43.014775 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:43.014739 2561 generic.go:356] "Generic (PLEG): container finished" podID="bb0cc1f5-7575-4320-b3a7-c79b23f5cba5" containerID="03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879" exitCode=0 Sep 18 13:12:43.015205 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:43.014787 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" Sep 18 13:12:43.015205 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:43.014826 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" event={"ID":"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5","Type":"ContainerDied","Data":"03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879"} Sep 18 13:12:43.015205 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:43.014886 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-qxl4q" event={"ID":"bb0cc1f5-7575-4320-b3a7-c79b23f5cba5","Type":"ContainerDied","Data":"9084072b01fc82ec663d5df8770e426185e7db7572e20b565ffad2e8ceecc33f"} Sep 18 13:12:43.015205 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:43.014916 2561 scope.go:117] "RemoveContainer" containerID="03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879" Sep 18 13:12:43.024081 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:43.024063 2561 scope.go:117] "RemoveContainer" containerID="03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879" Sep 18 13:12:43.024399 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:12:43.024379 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879\": container with ID starting with 03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879 not found: ID does not exist" containerID="03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879" Sep 18 13:12:43.024475 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:43.024409 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879"} err="failed to get container status \"03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879\": rpc error: code = NotFound desc = could not find container \"03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879\": container with ID starting with 03244122e924421741153a518fe1ff98dc52800a4f8fe1a0228f586fce7dd879 not found: ID does not exist" Sep 18 13:12:43.036228 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:43.036196 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qxl4q"] Sep 18 13:12:43.039996 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:43.039966 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qxl4q"] Sep 18 13:12:43.214455 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:12:43.214406 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb0cc1f5-7575-4320-b3a7-c79b23f5cba5" path="/var/lib/kubelet/pods/bb0cc1f5-7575-4320-b3a7-c79b23f5cba5/volumes" Sep 18 13:13:01.760642 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.760602 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk"] Sep 18 13:13:01.761046 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.760995 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0cc1f5-7575-4320-b3a7-c79b23f5cba5" containerName="manager" Sep 18 13:13:01.761046 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.761006 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0cc1f5-7575-4320-b3a7-c79b23f5cba5" containerName="manager" Sep 18 13:13:01.761117 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.761066 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb0cc1f5-7575-4320-b3a7-c79b23f5cba5" containerName="manager" Sep 18 13:13:01.788211 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.788181 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk"] Sep 18 13:13:01.788407 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.788317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:01.791205 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.791179 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 18 13:13:01.792023 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.792004 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cr6pc\"" Sep 18 13:13:01.792123 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.792052 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 18 13:13:01.866986 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.866938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/352a364d-9b58-4068-9988-3fa1ca131d55-metrics-certs\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:01.866986 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.866989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/352a364d-9b58-4068-9988-3fa1ca131d55-maas-api-tls\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:01.867253 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.867073 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/352a364d-9b58-4068-9988-3fa1ca131d55-openshift-service-ca\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:01.867253 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.867117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9x9w\" (UniqueName: \"kubernetes.io/projected/352a364d-9b58-4068-9988-3fa1ca131d55-kube-api-access-h9x9w\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:01.967697 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.967663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/352a364d-9b58-4068-9988-3fa1ca131d55-maas-api-tls\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:01.967887 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.967751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/352a364d-9b58-4068-9988-3fa1ca131d55-openshift-service-ca\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:01.967887 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.967772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9x9w\" (UniqueName: \"kubernetes.io/projected/352a364d-9b58-4068-9988-3fa1ca131d55-kube-api-access-h9x9w\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:01.967887 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.967801 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/352a364d-9b58-4068-9988-3fa1ca131d55-metrics-certs\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:01.968053 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:13:01.967896 2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found Sep 18 13:13:01.968053 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:13:01.967991 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352a364d-9b58-4068-9988-3fa1ca131d55-metrics-certs podName:352a364d-9b58-4068-9988-3fa1ca131d55 nodeName:}" failed. No retries permitted until 2026-09-18 13:13:02.467960685 +0000 UTC m=+669.210495183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/352a364d-9b58-4068-9988-3fa1ca131d55-metrics-certs") pod "maas-api-59f6566bbc-vh7zk" (UID: "352a364d-9b58-4068-9988-3fa1ca131d55") : secret "maas-api-metrics-tls" not found Sep 18 13:13:01.968486 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.968469 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/352a364d-9b58-4068-9988-3fa1ca131d55-openshift-service-ca\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:01.970273 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.970250 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/352a364d-9b58-4068-9988-3fa1ca131d55-maas-api-tls\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:01.977214 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:01.977177 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9x9w\" (UniqueName: \"kubernetes.io/projected/352a364d-9b58-4068-9988-3fa1ca131d55-kube-api-access-h9x9w\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:02.472654 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.472616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/352a364d-9b58-4068-9988-3fa1ca131d55-metrics-certs\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:02.475463 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.475396 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/352a364d-9b58-4068-9988-3fa1ca131d55-metrics-certs\") pod \"maas-api-59f6566bbc-vh7zk\" (UID: \"352a364d-9b58-4068-9988-3fa1ca131d55\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:02.698696 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.698661 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:02.706810 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.706777 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r"] Sep 18 13:13:02.710961 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.710939 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:13:02.714556 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.714525 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 18 13:13:02.714722 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.714700 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xw7sg\"" Sep 18 13:13:02.734179 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.734152 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r"] Sep 18 13:13:02.776401 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.776344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87830672-c5a1-4258-82f4-3ddd475d8452-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8p72r\" (UID: \"87830672-c5a1-4258-82f4-3ddd475d8452\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:13:02.776856 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.776565 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv8rj\" (UniqueName: \"kubernetes.io/projected/87830672-c5a1-4258-82f4-3ddd475d8452-kube-api-access-dv8rj\") pod \"payload-pre-processing-59fbc47bf8-8p72r\" (UID: \"87830672-c5a1-4258-82f4-3ddd475d8452\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:13:02.877857 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.877820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv8rj\" (UniqueName: \"kubernetes.io/projected/87830672-c5a1-4258-82f4-3ddd475d8452-kube-api-access-dv8rj\") pod \"payload-pre-processing-59fbc47bf8-8p72r\" (UID: \"87830672-c5a1-4258-82f4-3ddd475d8452\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:13:02.878056 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.877901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87830672-c5a1-4258-82f4-3ddd475d8452-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8p72r\" (UID: \"87830672-c5a1-4258-82f4-3ddd475d8452\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:13:02.878801 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.878773 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87830672-c5a1-4258-82f4-3ddd475d8452-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8p72r\" (UID: \"87830672-c5a1-4258-82f4-3ddd475d8452\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:13:02.900129 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.897773 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv8rj\" (UniqueName: \"kubernetes.io/projected/87830672-c5a1-4258-82f4-3ddd475d8452-kube-api-access-dv8rj\") pod \"payload-pre-processing-59fbc47bf8-8p72r\" (UID: \"87830672-c5a1-4258-82f4-3ddd475d8452\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:13:02.991237 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:02.991120 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk"] Sep 18 13:13:02.993794 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:13:02.993764 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352a364d_9b58_4068_9988_3fa1ca131d55.slice/crio-552eaf1cc11063b81e88a7bc60032f7a02a1e86ced91de667b4d887228ec78a6 WatchSource:0}: Error finding container 552eaf1cc11063b81e88a7bc60032f7a02a1e86ced91de667b4d887228ec78a6: Status 404 returned error can't find the container with id 552eaf1cc11063b81e88a7bc60032f7a02a1e86ced91de667b4d887228ec78a6 Sep 18 13:13:03.035937 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:03.035894 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:13:03.118758 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:03.118725 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" event={"ID":"352a364d-9b58-4068-9988-3fa1ca131d55","Type":"ContainerStarted","Data":"552eaf1cc11063b81e88a7bc60032f7a02a1e86ced91de667b4d887228ec78a6"} Sep 18 13:13:03.310407 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:03.310381 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r"] Sep 18 13:13:03.312885 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:13:03.312852 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87830672_c5a1_4258_82f4_3ddd475d8452.slice/crio-21b115fbeaa6f948b5c63b1912e492e00e48ec43867bc375faddb81d930ef0e0 WatchSource:0}: Error finding container 21b115fbeaa6f948b5c63b1912e492e00e48ec43867bc375faddb81d930ef0e0: Status 404 returned error can't find the container with id 21b115fbeaa6f948b5c63b1912e492e00e48ec43867bc375faddb81d930ef0e0 Sep 18 13:13:04.128614 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:04.128573 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" event={"ID":"87830672-c5a1-4258-82f4-3ddd475d8452","Type":"ContainerStarted","Data":"21b115fbeaa6f948b5c63b1912e492e00e48ec43867bc375faddb81d930ef0e0"} Sep 18 13:13:05.137553 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:05.137495 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" event={"ID":"352a364d-9b58-4068-9988-3fa1ca131d55","Type":"ContainerStarted","Data":"afc1580bad1d75c8245e145450d78a0f1c47e21f8529bbdec51f5fe8d4c8e3c9"} Sep 18 13:13:05.138004 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:05.137678 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:05.167770 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:05.167708 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" podStartSLOduration=2.579305388 podStartE2EDuration="4.167688454s" totalImagesPullingTime="1.588383066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:13:05.166582839 +0000 UTC m=+671.909117345" watchObservedRunningTime="2026-09-18 13:13:05.167688454 +0000 UTC m=+671.910222959" Sep 18 13:13:06.143880 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:06.143838 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" event={"ID":"87830672-c5a1-4258-82f4-3ddd475d8452","Type":"ContainerStarted","Data":"3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985"} Sep 18 13:13:06.144335 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:06.143900 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:13:06.165454 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:06.165386 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" podStartSLOduration=1.825487678 podStartE2EDuration="4.165368285s" totalImagesPullingTime="2.339880607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:13:06.163096439 +0000 UTC m=+672.905630945" watchObservedRunningTime="2026-09-18 13:13:06.165368285 +0000 UTC m=+672.907902794" Sep 18 13:13:11.150101 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:11.150070 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-vh7zk" Sep 18 13:13:17.150737 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:17.150702 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:13:20.246049 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.246008 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk"] Sep 18 13:13:20.249822 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.249798 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.257020 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.256996 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 18 13:13:20.257201 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.257182 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w9t5d\"" Sep 18 13:13:20.257267 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.257182 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 18 13:13:20.258402 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.258388 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 18 13:13:20.294979 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.294945 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk"] Sep 18 13:13:20.340260 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.340220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef84e26-9b8b-4188-9b4e-0a336f81e104-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.340260 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.340264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.340546 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.340285 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.340546 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.340387 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k78gx\" (UniqueName: \"kubernetes.io/projected/6ef84e26-9b8b-4188-9b4e-0a336f81e104-kube-api-access-k78gx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.340546 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.340461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.340546 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.340484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.441711 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.441668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef84e26-9b8b-4188-9b4e-0a336f81e104-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.441920 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.441722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.441920 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.441750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.441920 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.441811 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k78gx\" (UniqueName: \"kubernetes.io/projected/6ef84e26-9b8b-4188-9b4e-0a336f81e104-kube-api-access-k78gx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.441920 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.441846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.441920 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.441873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.442285 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.442248 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.442366 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.442304 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.442406 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.442378 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.444081 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.444061 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef84e26-9b8b-4188-9b4e-0a336f81e104-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.444342 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.444326 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef84e26-9b8b-4188-9b4e-0a336f81e104-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.450714 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.450692 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k78gx\" (UniqueName: \"kubernetes.io/projected/6ef84e26-9b8b-4188-9b4e-0a336f81e104-kube-api-access-k78gx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk\" (UID: \"6ef84e26-9b8b-4188-9b4e-0a336f81e104\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.560389 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.560348 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:20.845832 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:20.845738 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk"] Sep 18 13:13:20.848788 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:13:20.848756 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef84e26_9b8b_4188_9b4e_0a336f81e104.slice/crio-b731228fc94d50bab04d9c616e4ef7cdcacb720d88add6621d5e5d2390ddc94c WatchSource:0}: Error finding container b731228fc94d50bab04d9c616e4ef7cdcacb720d88add6621d5e5d2390ddc94c: Status 404 returned error can't find the container with id b731228fc94d50bab04d9c616e4ef7cdcacb720d88add6621d5e5d2390ddc94c Sep 18 13:13:21.216701 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:21.216604 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" event={"ID":"6ef84e26-9b8b-4188-9b4e-0a336f81e104","Type":"ContainerStarted","Data":"b731228fc94d50bab04d9c616e4ef7cdcacb720d88add6621d5e5d2390ddc94c"} Sep 18 13:13:22.222834 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:22.222801 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" event={"ID":"6ef84e26-9b8b-4188-9b4e-0a336f81e104","Type":"ContainerStarted","Data":"c012c61792423a9557c7ffe3d0ad9fc02249bf29ee75e2b27ed56b0d726d8a7d"} Sep 18 13:13:22.248802 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:22.248747 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" podStartSLOduration=1.092249908 podStartE2EDuration="2.248730064s" totalImagesPullingTime="1.156480156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:13:22.247240481 +0000 UTC m=+688.989774985" watchObservedRunningTime="2026-09-18 13:13:22.248730064 +0000 UTC m=+688.991264568" Sep 18 13:13:26.038727 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.038691 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7"] Sep 18 13:13:26.042374 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.042345 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.045082 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.045060 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 18 13:13:26.052644 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.052616 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7"] Sep 18 13:13:26.092574 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.092533 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.092574 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.092573 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66400845-3bab-4a86-bd55-a7bf16f20544-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.092839 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.092639 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.092839 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.092699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.092839 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.092767 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8x5t\" (UniqueName: \"kubernetes.io/projected/66400845-3bab-4a86-bd55-a7bf16f20544-kube-api-access-g8x5t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.092839 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.092818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.193837 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.193791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.193837 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.193835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66400845-3bab-4a86-bd55-a7bf16f20544-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.194083 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.193871 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.194083 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.193901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.194083 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.193928 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8x5t\" (UniqueName: \"kubernetes.io/projected/66400845-3bab-4a86-bd55-a7bf16f20544-kube-api-access-g8x5t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.194263 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.194232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.194500 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.194471 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.194630 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.194565 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.194630 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.194607 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.196797 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.196776 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66400845-3bab-4a86-bd55-a7bf16f20544-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.197191 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.197170 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66400845-3bab-4a86-bd55-a7bf16f20544-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.203329 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.203307 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8x5t\" (UniqueName: \"kubernetes.io/projected/66400845-3bab-4a86-bd55-a7bf16f20544-kube-api-access-g8x5t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-td2v7\" (UID: \"66400845-3bab-4a86-bd55-a7bf16f20544\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.353153 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.353054 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:26.640383 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:26.640355 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7"] Sep 18 13:13:26.642707 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:13:26.642673 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66400845_3bab_4a86_bd55_a7bf16f20544.slice/crio-13889e984eed923f5e6aa76afae57e0facb86b16b6f457e9772ca97df61d5844 WatchSource:0}: Error finding container 13889e984eed923f5e6aa76afae57e0facb86b16b6f457e9772ca97df61d5844: Status 404 returned error can't find the container with id 13889e984eed923f5e6aa76afae57e0facb86b16b6f457e9772ca97df61d5844 Sep 18 13:13:27.249188 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:27.249152 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" event={"ID":"66400845-3bab-4a86-bd55-a7bf16f20544","Type":"ContainerStarted","Data":"9c08407e44e0d9ce4aa200062db4619d500040619bdb4c5da1570639346467de"} Sep 18 13:13:27.249697 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:27.249215 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" event={"ID":"66400845-3bab-4a86-bd55-a7bf16f20544","Type":"ContainerStarted","Data":"13889e984eed923f5e6aa76afae57e0facb86b16b6f457e9772ca97df61d5844"} Sep 18 13:13:27.268614 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:27.268555 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" podStartSLOduration=1.093845191 podStartE2EDuration="1.268537523s" totalImagesPullingTime="174.692332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:13:27.267495211 +0000 UTC m=+694.010029707" watchObservedRunningTime="2026-09-18 13:13:27.268537523 +0000 UTC m=+694.011072028" Sep 18 13:13:30.561222 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:30.561184 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:30.561708 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:30.561249 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:30.574227 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:30.574198 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:31.280022 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:31.279987 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vhthk" Sep 18 13:13:36.353789 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:36.353757 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:36.354166 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:36.353841 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:36.366184 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:36.366156 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:37.316878 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:37.316848 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-td2v7" Sep 18 13:13:50.145271 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.145234 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl"] Sep 18 13:13:50.148538 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.148512 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.151277 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.151256 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 18 13:13:50.161920 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.161893 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl"] Sep 18 13:13:50.305320 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.305282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.305563 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.305353 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.305563 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.305505 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/646f0811-9a66-40fe-bec9-ab69b9a6953c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.305563 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.305541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.305692 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.305565 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvg7s\" (UniqueName: \"kubernetes.io/projected/646f0811-9a66-40fe-bec9-ab69b9a6953c-kube-api-access-fvg7s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.305692 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.305644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.406868 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.406762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.406868 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.406847 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.407106 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.406883 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/646f0811-9a66-40fe-bec9-ab69b9a6953c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.407106 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.406914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.407106 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.406937 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvg7s\" (UniqueName: \"kubernetes.io/projected/646f0811-9a66-40fe-bec9-ab69b9a6953c-kube-api-access-fvg7s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.407106 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.406989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.407311 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.407174 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.407311 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.407256 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.407397 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.407371 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.409239 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.409209 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/646f0811-9a66-40fe-bec9-ab69b9a6953c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.409494 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.409470 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/646f0811-9a66-40fe-bec9-ab69b9a6953c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.415277 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.415254 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvg7s\" (UniqueName: \"kubernetes.io/projected/646f0811-9a66-40fe-bec9-ab69b9a6953c-kube-api-access-fvg7s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl\" (UID: \"646f0811-9a66-40fe-bec9-ab69b9a6953c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.459649 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.459614 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:13:50.739408 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:50.739382 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl"] Sep 18 13:13:50.741970 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:13:50.741939 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646f0811_9a66_40fe_bec9_ab69b9a6953c.slice/crio-2dc1dc578f9df4edc79511088a48c86669fd2efd9c204ad108d3605f4432e5c2 WatchSource:0}: Error finding container 2dc1dc578f9df4edc79511088a48c86669fd2efd9c204ad108d3605f4432e5c2: Status 404 returned error can't find the container with id 2dc1dc578f9df4edc79511088a48c86669fd2efd9c204ad108d3605f4432e5c2 Sep 18 13:13:51.372793 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:51.372759 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" event={"ID":"646f0811-9a66-40fe-bec9-ab69b9a6953c","Type":"ContainerStarted","Data":"1295e0ba634ff9455293fc4e077290b74fe2ba68059e8ed8906acb62ad382c6c"} Sep 18 13:13:51.373218 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:51.372815 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" event={"ID":"646f0811-9a66-40fe-bec9-ab69b9a6953c","Type":"ContainerStarted","Data":"2dc1dc578f9df4edc79511088a48c86669fd2efd9c204ad108d3605f4432e5c2"} Sep 18 13:13:51.393059 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:13:51.393002 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" podStartSLOduration=1.214007863 podStartE2EDuration="1.39298522s" totalImagesPullingTime="178.977357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:13:51.392267474 +0000 UTC m=+718.134801979" watchObservedRunningTime="2026-09-18 13:13:51.39298522 +0000 UTC m=+718.135519724" Sep 18 13:14:00.460504 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:14:00.460465 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:14:00.460987 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:14:00.460533 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:14:00.473166 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:14:00.473135 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:14:01.438968 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:14:01.438937 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh2dhl" Sep 18 13:15:37.121611 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.121575 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cd9bf59c4-bhr7r"] Sep 18 13:15:37.125051 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.125028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd9bf59c4-bhr7r" Sep 18 13:15:37.127898 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.127872 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 18 13:15:37.128613 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.128594 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vxwj2\"" Sep 18 13:15:37.133007 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.132984 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cd9bf59c4-bhr7r"] Sep 18 13:15:37.223934 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.223881 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41c1fa09-fa19-447c-bd34-2187de6bb8b4-tls-cert\") pod \"authorino-7cd9bf59c4-bhr7r\" (UID: \"41c1fa09-fa19-447c-bd34-2187de6bb8b4\") " pod="kuadrant-system/authorino-7cd9bf59c4-bhr7r" Sep 18 13:15:37.224119 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.224046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwf2n\" (UniqueName: \"kubernetes.io/projected/41c1fa09-fa19-447c-bd34-2187de6bb8b4-kube-api-access-pwf2n\") pod \"authorino-7cd9bf59c4-bhr7r\" (UID: \"41c1fa09-fa19-447c-bd34-2187de6bb8b4\") " pod="kuadrant-system/authorino-7cd9bf59c4-bhr7r" Sep 18 13:15:37.325221 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.325171 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwf2n\" (UniqueName: \"kubernetes.io/projected/41c1fa09-fa19-447c-bd34-2187de6bb8b4-kube-api-access-pwf2n\") pod \"authorino-7cd9bf59c4-bhr7r\" (UID: \"41c1fa09-fa19-447c-bd34-2187de6bb8b4\") " pod="kuadrant-system/authorino-7cd9bf59c4-bhr7r" Sep 18 13:15:37.325221 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.325223 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41c1fa09-fa19-447c-bd34-2187de6bb8b4-tls-cert\") pod \"authorino-7cd9bf59c4-bhr7r\" (UID: \"41c1fa09-fa19-447c-bd34-2187de6bb8b4\") " pod="kuadrant-system/authorino-7cd9bf59c4-bhr7r" Sep 18 13:15:37.327879 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.327853 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41c1fa09-fa19-447c-bd34-2187de6bb8b4-tls-cert\") pod \"authorino-7cd9bf59c4-bhr7r\" (UID: \"41c1fa09-fa19-447c-bd34-2187de6bb8b4\") " pod="kuadrant-system/authorino-7cd9bf59c4-bhr7r" Sep 18 13:15:37.334320 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.334293 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwf2n\" (UniqueName: \"kubernetes.io/projected/41c1fa09-fa19-447c-bd34-2187de6bb8b4-kube-api-access-pwf2n\") pod \"authorino-7cd9bf59c4-bhr7r\" (UID: \"41c1fa09-fa19-447c-bd34-2187de6bb8b4\") " pod="kuadrant-system/authorino-7cd9bf59c4-bhr7r" Sep 18 13:15:37.435232 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.435151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd9bf59c4-bhr7r" Sep 18 13:15:37.708359 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.708328 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cd9bf59c4-bhr7r"] Sep 18 13:15:37.710175 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:15:37.710148 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41c1fa09_fa19_447c_bd34_2187de6bb8b4.slice/crio-a33135e48f3a7031709d422bd21b767c6256252fd50cbdf6a206966e8779f31d WatchSource:0}: Error finding container a33135e48f3a7031709d422bd21b767c6256252fd50cbdf6a206966e8779f31d: Status 404 returned error can't find the container with id a33135e48f3a7031709d422bd21b767c6256252fd50cbdf6a206966e8779f31d Sep 18 13:15:37.711577 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.711555 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:15:37.886729 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:37.886691 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cd9bf59c4-bhr7r" event={"ID":"41c1fa09-fa19-447c-bd34-2187de6bb8b4","Type":"ContainerStarted","Data":"a33135e48f3a7031709d422bd21b767c6256252fd50cbdf6a206966e8779f31d"} Sep 18 13:15:38.894517 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:38.894477 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cd9bf59c4-bhr7r" event={"ID":"41c1fa09-fa19-447c-bd34-2187de6bb8b4","Type":"ContainerStarted","Data":"d34aa6079c79ab1793c0c18d62b6030d4acc298ed7c80b8f8d6c2407f2683199"} Sep 18 13:15:38.914291 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:38.914226 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7cd9bf59c4-bhr7r" podStartSLOduration=1.2004336389999999 podStartE2EDuration="1.914202899s" totalImagesPullingTime="713.76926ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:38.912281533 +0000 UTC m=+825.654816038" watchObservedRunningTime="2026-09-18 13:15:38.914202899 +0000 UTC m=+825.656737406" Sep 18 13:15:39.457757 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.457709 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r"] Sep 18 13:15:39.458008 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.457981 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" podUID="87830672-c5a1-4258-82f4-3ddd475d8452" containerName="payload-pre-processing" containerID="cri-o://3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985" gracePeriod=30 Sep 18 13:15:39.526314 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.526279 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56f7c6b9dc-9jd5v"] Sep 18 13:15:39.526566 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.526540 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" podUID="f4e2152e-c21f-4fcb-8432-45fefec0d98d" containerName="manager" containerID="cri-o://2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da" gracePeriod=30 Sep 18 13:15:39.726309 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.726277 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:15:39.808536 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.808501 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:15:39.852387 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.852356 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87830672-c5a1-4258-82f4-3ddd475d8452-plugins-config-volume\") pod \"87830672-c5a1-4258-82f4-3ddd475d8452\" (UID: \"87830672-c5a1-4258-82f4-3ddd475d8452\") " Sep 18 13:15:39.852617 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.852483 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv8rj\" (UniqueName: \"kubernetes.io/projected/87830672-c5a1-4258-82f4-3ddd475d8452-kube-api-access-dv8rj\") pod \"87830672-c5a1-4258-82f4-3ddd475d8452\" (UID: \"87830672-c5a1-4258-82f4-3ddd475d8452\") " Sep 18 13:15:39.852949 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.852909 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87830672-c5a1-4258-82f4-3ddd475d8452-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "87830672-c5a1-4258-82f4-3ddd475d8452" (UID: "87830672-c5a1-4258-82f4-3ddd475d8452"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:15:39.853179 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.853157 2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87830672-c5a1-4258-82f4-3ddd475d8452-plugins-config-volume\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:15:39.854809 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.854780 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87830672-c5a1-4258-82f4-3ddd475d8452-kube-api-access-dv8rj" (OuterVolumeSpecName: "kube-api-access-dv8rj") pod "87830672-c5a1-4258-82f4-3ddd475d8452" (UID: "87830672-c5a1-4258-82f4-3ddd475d8452"). InnerVolumeSpecName "kube-api-access-dv8rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:15:39.902605 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.902572 2561 generic.go:356] "Generic (PLEG): container finished" podID="f4e2152e-c21f-4fcb-8432-45fefec0d98d" containerID="2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da" exitCode=0 Sep 18 13:15:39.903045 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.902636 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" Sep 18 13:15:39.903045 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.902650 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" event={"ID":"f4e2152e-c21f-4fcb-8432-45fefec0d98d","Type":"ContainerDied","Data":"2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da"} Sep 18 13:15:39.903045 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.902706 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7c6b9dc-9jd5v" event={"ID":"f4e2152e-c21f-4fcb-8432-45fefec0d98d","Type":"ContainerDied","Data":"b7872b8cdee2769bf80273df60465fba0a7d5eac3a4c670220df8bdee618852c"} Sep 18 13:15:39.903045 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.902739 2561 scope.go:117] "RemoveContainer" containerID="2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da" Sep 18 13:15:39.904078 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.904056 2561 generic.go:356] "Generic (PLEG): container finished" podID="87830672-c5a1-4258-82f4-3ddd475d8452" containerID="3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985" exitCode=0 Sep 18 13:15:39.904214 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.904090 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" event={"ID":"87830672-c5a1-4258-82f4-3ddd475d8452","Type":"ContainerDied","Data":"3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985"} Sep 18 13:15:39.904214 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.904110 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" Sep 18 13:15:39.904214 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.904136 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r" event={"ID":"87830672-c5a1-4258-82f4-3ddd475d8452","Type":"ContainerDied","Data":"21b115fbeaa6f948b5c63b1912e492e00e48ec43867bc375faddb81d930ef0e0"} Sep 18 13:15:39.912355 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.912334 2561 scope.go:117] "RemoveContainer" containerID="2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da" Sep 18 13:15:39.912720 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:15:39.912699 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da\": container with ID starting with 2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da not found: ID does not exist" containerID="2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da" Sep 18 13:15:39.912804 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.912735 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da"} err="failed to get container status \"2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da\": rpc error: code = NotFound desc = could not find container \"2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da\": container with ID starting with 2155cd4652134345a28ae9b77c66cd57886c37ad9871215e628448f08f4623da not found: ID does not exist" Sep 18 13:15:39.912804 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.912760 2561 scope.go:117] "RemoveContainer" containerID="3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985" Sep 18 13:15:39.921402 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.921374 2561 scope.go:117] "RemoveContainer" containerID="3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985" Sep 18 13:15:39.921846 ip-10-0-140-175 kubenswrapper[2561]: E0918 13:15:39.921822 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985\": container with ID starting with 3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985 not found: ID does not exist" containerID="3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985" Sep 18 13:15:39.921951 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.921854 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985"} err="failed to get container status \"3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985\": rpc error: code = NotFound desc = could not find container \"3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985\": container with ID starting with 3a10cb29b06afa0f7fcc799c212cbc081b9ead9969754c2295ee9ccd12ed3985 not found: ID does not exist" Sep 18 13:15:39.939612 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.939572 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r"] Sep 18 13:15:39.947955 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.947918 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8p72r"] Sep 18 13:15:39.954061 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.954038 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwlvt\" (UniqueName: \"kubernetes.io/projected/f4e2152e-c21f-4fcb-8432-45fefec0d98d-kube-api-access-wwlvt\") pod \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " Sep 18 13:15:39.954187 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.954114 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-metrics-certs\") pod \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " Sep 18 13:15:39.954187 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.954160 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-webhook-cert\") pod \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\" (UID: \"f4e2152e-c21f-4fcb-8432-45fefec0d98d\") " Sep 18 13:15:39.954448 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.954402 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv8rj\" (UniqueName: \"kubernetes.io/projected/87830672-c5a1-4258-82f4-3ddd475d8452-kube-api-access-dv8rj\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:15:39.956285 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.956251 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f4e2152e-c21f-4fcb-8432-45fefec0d98d" (UID: "f4e2152e-c21f-4fcb-8432-45fefec0d98d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:15:39.956285 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.956278 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f4e2152e-c21f-4fcb-8432-45fefec0d98d" (UID: "f4e2152e-c21f-4fcb-8432-45fefec0d98d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:15:39.956462 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:39.956277 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4e2152e-c21f-4fcb-8432-45fefec0d98d-kube-api-access-wwlvt" (OuterVolumeSpecName: "kube-api-access-wwlvt") pod "f4e2152e-c21f-4fcb-8432-45fefec0d98d" (UID: "f4e2152e-c21f-4fcb-8432-45fefec0d98d"). InnerVolumeSpecName "kube-api-access-wwlvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:15:40.055326 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.055287 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwlvt\" (UniqueName: \"kubernetes.io/projected/f4e2152e-c21f-4fcb-8432-45fefec0d98d-kube-api-access-wwlvt\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:15:40.055326 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.055324 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-metrics-certs\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:15:40.055326 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.055334 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4e2152e-c21f-4fcb-8432-45fefec0d98d-webhook-cert\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\"" Sep 18 13:15:40.231855 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.231812 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56f7c6b9dc-9jd5v"] Sep 18 13:15:40.235332 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.235300 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56f7c6b9dc-9jd5v"] Sep 18 13:15:40.605125 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.605090 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56f7c6b9dc-rdjrw"] Sep 18 13:15:40.605494 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.605480 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4e2152e-c21f-4fcb-8432-45fefec0d98d" containerName="manager" Sep 18 13:15:40.605560 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.605495 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4e2152e-c21f-4fcb-8432-45fefec0d98d" containerName="manager" Sep 18 13:15:40.605560 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.605504 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87830672-c5a1-4258-82f4-3ddd475d8452" containerName="payload-pre-processing" Sep 18 13:15:40.605560 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.605510 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="87830672-c5a1-4258-82f4-3ddd475d8452" containerName="payload-pre-processing" Sep 18 13:15:40.605660 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.605593 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4e2152e-c21f-4fcb-8432-45fefec0d98d" containerName="manager" Sep 18 13:15:40.605660 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.605604 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="87830672-c5a1-4258-82f4-3ddd475d8452" containerName="payload-pre-processing" Sep 18 13:15:40.610095 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.610064 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:40.613107 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.613082 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 18 13:15:40.613356 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.613336 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 18 13:15:40.613948 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.613926 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bhdvf\"" Sep 18 13:15:40.614088 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.613954 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 18 13:15:40.622152 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.622121 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f7c6b9dc-rdjrw"] Sep 18 13:15:40.764488 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.764378 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06a0344d-acf6-4db4-87dc-a304c95edd9f-metrics-certs\") pod \"maas-controller-56f7c6b9dc-rdjrw\" (UID: \"06a0344d-acf6-4db4-87dc-a304c95edd9f\") " pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:40.764662 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.764482 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w672q\" (UniqueName: \"kubernetes.io/projected/06a0344d-acf6-4db4-87dc-a304c95edd9f-kube-api-access-w672q\") pod \"maas-controller-56f7c6b9dc-rdjrw\" (UID: \"06a0344d-acf6-4db4-87dc-a304c95edd9f\") " pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:40.764662 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.764570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06a0344d-acf6-4db4-87dc-a304c95edd9f-webhook-cert\") pod \"maas-controller-56f7c6b9dc-rdjrw\" (UID: \"06a0344d-acf6-4db4-87dc-a304c95edd9f\") " pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:40.865327 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.865292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06a0344d-acf6-4db4-87dc-a304c95edd9f-metrics-certs\") pod \"maas-controller-56f7c6b9dc-rdjrw\" (UID: \"06a0344d-acf6-4db4-87dc-a304c95edd9f\") " pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:40.865501 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.865362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w672q\" (UniqueName: \"kubernetes.io/projected/06a0344d-acf6-4db4-87dc-a304c95edd9f-kube-api-access-w672q\") pod \"maas-controller-56f7c6b9dc-rdjrw\" (UID: \"06a0344d-acf6-4db4-87dc-a304c95edd9f\") " pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:40.865501 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.865477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06a0344d-acf6-4db4-87dc-a304c95edd9f-webhook-cert\") pod \"maas-controller-56f7c6b9dc-rdjrw\" (UID: \"06a0344d-acf6-4db4-87dc-a304c95edd9f\") " pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:40.867900 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.867870 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06a0344d-acf6-4db4-87dc-a304c95edd9f-metrics-certs\") pod \"maas-controller-56f7c6b9dc-rdjrw\" (UID: \"06a0344d-acf6-4db4-87dc-a304c95edd9f\") " pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:40.868026 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.868012 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06a0344d-acf6-4db4-87dc-a304c95edd9f-webhook-cert\") pod \"maas-controller-56f7c6b9dc-rdjrw\" (UID: \"06a0344d-acf6-4db4-87dc-a304c95edd9f\") " pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:40.873889 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.873865 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w672q\" (UniqueName: \"kubernetes.io/projected/06a0344d-acf6-4db4-87dc-a304c95edd9f-kube-api-access-w672q\") pod \"maas-controller-56f7c6b9dc-rdjrw\" (UID: \"06a0344d-acf6-4db4-87dc-a304c95edd9f\") " pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:40.924548 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:40.924500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:41.213162 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:15:41.213125 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a0344d_acf6_4db4_87dc_a304c95edd9f.slice/crio-a4603b857dcd6e3dfbcf8cc676f29211efe13fc3190384d1733a21e2da48d692 WatchSource:0}: Error finding container a4603b857dcd6e3dfbcf8cc676f29211efe13fc3190384d1733a21e2da48d692: Status 404 returned error can't find the container with id a4603b857dcd6e3dfbcf8cc676f29211efe13fc3190384d1733a21e2da48d692 Sep 18 13:15:41.216852 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:41.216827 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87830672-c5a1-4258-82f4-3ddd475d8452" path="/var/lib/kubelet/pods/87830672-c5a1-4258-82f4-3ddd475d8452/volumes" Sep 18 13:15:41.217325 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:41.217307 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4e2152e-c21f-4fcb-8432-45fefec0d98d" path="/var/lib/kubelet/pods/f4e2152e-c21f-4fcb-8432-45fefec0d98d/volumes" Sep 18 13:15:41.217656 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:41.217639 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f7c6b9dc-rdjrw"] Sep 18 13:15:41.919925 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:41.919827 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" event={"ID":"06a0344d-acf6-4db4-87dc-a304c95edd9f","Type":"ContainerStarted","Data":"d6829478a4c291746b65a6d57b2dd640470aff6cd7235640bdf77a296e74cd99"} Sep 18 13:15:41.919925 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:41.919901 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" event={"ID":"06a0344d-acf6-4db4-87dc-a304c95edd9f","Type":"ContainerStarted","Data":"a4603b857dcd6e3dfbcf8cc676f29211efe13fc3190384d1733a21e2da48d692"} Sep 18 13:15:41.920104 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:41.920019 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:15:41.938673 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:41.938613 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" podStartSLOduration=1.533809258 podStartE2EDuration="1.938595556s" totalImagesPullingTime="404.786298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:41.936884472 +0000 UTC m=+828.679418978" watchObservedRunningTime="2026-09-18 13:15:41.938595556 +0000 UTC m=+828.681130061" Sep 18 13:15:52.927367 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:15:52.927335 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56f7c6b9dc-rdjrw" Sep 18 13:16:55.188523 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:16:55.188450 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48w7v_32c6c241-bea2-43fc-80f1-5c1a697090e6/ovn-acl-logging/0.log" Sep 18 13:16:55.190416 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:16:55.190389 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48w7v_32c6c241-bea2-43fc-80f1-5c1a697090e6/ovn-acl-logging/0.log" Sep 18 13:18:57.124442 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:18:57.124393 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nmf97_8446e348-a097-43b3-beb8-d08622222f3b/global-pull-secret-syncer/0.log" Sep 18 13:18:57.296886 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:18:57.296852 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zmhtx_80376bf1-90a3-498f-bc55-c13bfea95e76/konnectivity-agent/0.log" Sep 18 13:18:57.362297 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:18:57.362265 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-175.ec2.internal_5e059f1f83a415f77fc02eae7ddcd67e/haproxy/0.log" Sep 18 13:19:01.480572 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:01.480539 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cd9bf59c4-bhr7r_41c1fa09-fa19-447c-bd34-2187de6bb8b4/authorino/0.log" Sep 18 13:19:01.520920 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:01.520877 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-52pnx_a4536ec3-8ad7-4788-848c-179a81641c6a/manager/0.log" Sep 18 13:19:01.553848 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:01.553823 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-cd9wm_48d568d6-1ac1-4eb0-9e7c-645638239fe1/manager/0.log" Sep 18 13:19:01.596691 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:01.596664 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-qzw4g_eac8ba3d-801e-422e-b17d-1f5c4b0657f9/kuadrant-console-plugin/0.log" Sep 18 13:19:01.641737 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:01.641702 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-8w8c6_89dfd3b5-7559-4628-a7d8-0dde726c528b/manager/0.log" Sep 18 13:19:01.737872 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:01.737782 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-vpfqn_d5edaa23-9c62-48ad-aa27-8ab7dce926cb/manager/0.log" Sep 18 13:19:03.707185 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:03.707147 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-tl8fw_d2cfaa1e-3958-4615-9326-e9565a3c7543/monitoring-plugin/0.log" Sep 18 13:19:03.851033 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:03.850998 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzvv2_ea5a9675-e137-4583-8b60-f73093dc0215/node-exporter/0.log" Sep 18 13:19:03.878448 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:03.878406 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzvv2_ea5a9675-e137-4583-8b60-f73093dc0215/kube-rbac-proxy/0.log" Sep 18 13:19:03.914794 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:03.914712 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzvv2_ea5a9675-e137-4583-8b60-f73093dc0215/init-textfile/0.log" Sep 18 13:19:04.535254 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:04.535198 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff5c94764-lkpmg_8c6d557b-26fd-4d24-be99-e5d24bdba53d/thanos-query/0.log" Sep 18 13:19:04.561524 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:04.561498 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff5c94764-lkpmg_8c6d557b-26fd-4d24-be99-e5d24bdba53d/kube-rbac-proxy-web/0.log" Sep 18 13:19:04.586015 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:04.585988 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff5c94764-lkpmg_8c6d557b-26fd-4d24-be99-e5d24bdba53d/kube-rbac-proxy/0.log" Sep 18 13:19:04.626111 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:04.626075 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff5c94764-lkpmg_8c6d557b-26fd-4d24-be99-e5d24bdba53d/prom-label-proxy/0.log" Sep 18 13:19:04.650695 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:04.650672 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff5c94764-lkpmg_8c6d557b-26fd-4d24-be99-e5d24bdba53d/kube-rbac-proxy-rules/0.log" Sep 18 13:19:04.674503 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:04.674480 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff5c94764-lkpmg_8c6d557b-26fd-4d24-be99-e5d24bdba53d/kube-rbac-proxy-metrics/0.log" Sep 18 13:19:06.002082 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:06.002051 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-nbnwg_eabe6726-cd96-4116-ab6a-35f40c2e924d/networking-console-plugin/0.log" Sep 18 13:19:07.306068 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.306028 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr"] Sep 18 13:19:07.309663 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.309637 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.312452 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.312405 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nnzqh\"/\"default-dockercfg-9hvc7\"" Sep 18 13:19:07.313241 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.313221 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nnzqh\"/\"kube-root-ca.crt\"" Sep 18 13:19:07.313310 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.313230 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nnzqh\"/\"openshift-service-ca.crt\"" Sep 18 13:19:07.318610 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.318584 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr"] Sep 18 13:19:07.380488 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.380447 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-lib-modules\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.380688 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.380508 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grpvl\" (UniqueName: \"kubernetes.io/projected/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-kube-api-access-grpvl\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.380688 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.380551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-podres\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.380688 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.380578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-proc\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.380688 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.380655 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-sys\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.481815 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.481776 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-lib-modules\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.481815 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.481822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grpvl\" (UniqueName: \"kubernetes.io/projected/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-kube-api-access-grpvl\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.482059 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.481843 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-podres\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.482059 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.481874 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-proc\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.482059 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.481906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-sys\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.482059 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.481995 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-proc\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.482059 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.481997 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-podres\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.482059 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.481995 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-lib-modules\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.482059 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.482041 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-sys\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.491467 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.491402 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grpvl\" (UniqueName: \"kubernetes.io/projected/87ca4520-fd70-4512-a9a4-05f4eed2a5cf-kube-api-access-grpvl\") pod \"perf-node-gather-daemonset-cpbfr\" (UID: \"87ca4520-fd70-4512-a9a4-05f4eed2a5cf\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.620938 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.620843 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:07.912468 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.912439 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr"] Sep 18 13:19:07.914616 ip-10-0-140-175 kubenswrapper[2561]: W0918 13:19:07.914591 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod87ca4520_fd70_4512_a9a4_05f4eed2a5cf.slice/crio-040a4d82e73cd95d90569c42dff2ca298b31fc07f6069fe0b24a8e1bd4466994 WatchSource:0}: Error finding container 040a4d82e73cd95d90569c42dff2ca298b31fc07f6069fe0b24a8e1bd4466994: Status 404 returned error can't find the container with id 040a4d82e73cd95d90569c42dff2ca298b31fc07f6069fe0b24a8e1bd4466994 Sep 18 13:19:07.955010 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:07.954786 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" event={"ID":"87ca4520-fd70-4512-a9a4-05f4eed2a5cf","Type":"ContainerStarted","Data":"040a4d82e73cd95d90569c42dff2ca298b31fc07f6069fe0b24a8e1bd4466994"} Sep 18 13:19:08.961483 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:08.961449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" event={"ID":"87ca4520-fd70-4512-a9a4-05f4eed2a5cf","Type":"ContainerStarted","Data":"d7b309c1cee8c2b48a9b1614e7dd1c86fa29529468291840763886217ecbc3af"} Sep 18 13:19:08.961895 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:08.961543 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:08.984081 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:08.984027 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" podStartSLOduration=1.984008692 podStartE2EDuration="1.984008692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:08.983071134 +0000 UTC m=+1035.725605652" watchObservedRunningTime="2026-09-18 13:19:08.984008692 +0000 UTC m=+1035.726543196" Sep 18 13:19:09.266009 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:09.265924 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zvdt4_508dc149-0c51-46b7-979f-f11e6ac25e34/dns/0.log" Sep 18 13:19:09.289435 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:09.289391 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zvdt4_508dc149-0c51-46b7-979f-f11e6ac25e34/kube-rbac-proxy/0.log" Sep 18 13:19:09.366279 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:09.366253 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hwv6b_a9ecbc08-3b20-43af-9dc6-baf00289115f/dns-node-resolver/0.log" Sep 18 13:19:09.919203 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:09.919171 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-576c75d5fb-2j894_0c9b3f02-862c-4817-be06-d1471e0f068b/registry/0.log" Sep 18 13:19:09.964244 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:09.964211 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-95476_7e8cff11-d0f2-4f7f-8db3-4fc07e6d99e5/node-ca/0.log" Sep 18 13:19:11.061686 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:11.061656 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d8fbc8c5d-xbxpx_0663b7a3-f6a3-4dc2-83ae-8de9580d7803/kube-auth-proxy/0.log" Sep 18 13:19:11.841036 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:11.841000 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qrzkg_c7117749-269a-43d0-961a-c6caf1280056/serve-healthcheck-canary/0.log" Sep 18 13:19:12.551433 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:12.551392 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xdzmz_c0d3bf39-f387-4272-8a5f-aa92b98761d6/kube-rbac-proxy/0.log" Sep 18 13:19:12.591312 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:12.591283 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xdzmz_c0d3bf39-f387-4272-8a5f-aa92b98761d6/exporter/0.log" Sep 18 13:19:12.633852 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:12.633819 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xdzmz_c0d3bf39-f387-4272-8a5f-aa92b98761d6/extractor/0.log" Sep 18 13:19:14.819646 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:14.819614 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c28qj_0d1249b6-6f3a-4a25-a484-adacac0d6236/manager/0.log" Sep 18 13:19:14.861918 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:14.861887 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8hwzc_da40978f-bbfb-41a3-ac94-f56d5690095f/manager/0.log" Sep 18 13:19:14.883602 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:14.883572 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56f7c6b9dc-rdjrw_06a0344d-acf6-4db4-87dc-a304c95edd9f/manager/0.log" Sep 18 13:19:14.977579 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:14.977550 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-cpbfr" Sep 18 13:19:15.097647 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:15.097567 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57ff796844-tt5tg_2fecc2a6-b709-4a4a-b14d-d4922852faf7/manager/0.log" Sep 18 13:19:15.118502 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:15.118479 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57ff796844-tt5tg_2fecc2a6-b709-4a4a-b14d-d4922852faf7/copy-manifests/0.log" Sep 18 13:19:17.222162 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:17.222135 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d8fbc8c5d-xbxpx_0663b7a3-f6a3-4dc2-83ae-8de9580d7803/kube-auth-proxy/0.log" Sep 18 13:19:18.335065 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:18.335038 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d8fbc8c5d-xbxpx_0663b7a3-f6a3-4dc2-83ae-8de9580d7803/kube-auth-proxy/0.log" Sep 18 13:19:21.505382 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:21.505352 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-k2xl4_47de0059-cc2c-4e1f-83d1-15fb8fd06481/migrator/0.log" Sep 18 13:19:21.532323 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:21.532292 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-k2xl4_47de0059-cc2c-4e1f-83d1-15fb8fd06481/graceful-termination/0.log" Sep 18 13:19:23.395337 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:23.395297 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8wvj7_a26ddaa8-9c44-4369-a802-95c146b2c5cf/kube-multus-additional-cni-plugins/0.log" Sep 18 13:19:23.420839 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:23.420816 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8wvj7_a26ddaa8-9c44-4369-a802-95c146b2c5cf/egress-router-binary-copy/0.log" Sep 18 13:19:23.443292 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:23.443272 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8wvj7_a26ddaa8-9c44-4369-a802-95c146b2c5cf/cni-plugins/0.log" Sep 18 13:19:23.466172 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:23.466147 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8wvj7_a26ddaa8-9c44-4369-a802-95c146b2c5cf/bond-cni-plugin/0.log" Sep 18 13:19:23.491393 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:23.491364 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8wvj7_a26ddaa8-9c44-4369-a802-95c146b2c5cf/routeoverride-cni/0.log" Sep 18 13:19:23.519556 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:23.519530 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8wvj7_a26ddaa8-9c44-4369-a802-95c146b2c5cf/whereabouts-cni-bincopy/0.log" Sep 18 13:19:23.545472 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:23.545441 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8wvj7_a26ddaa8-9c44-4369-a802-95c146b2c5cf/whereabouts-cni/0.log" Sep 18 13:19:23.754923 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:23.754831 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cfhtp_2e62b6ab-6359-4efc-8725-4e335eaf3e3a/kube-multus/0.log" Sep 18 13:19:23.776691 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:23.776661 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7c88g_799efce0-1a62-4455-8935-c9d4aa52ce16/network-metrics-daemon/0.log" Sep 18 13:19:23.800466 ip-10-0-140-175 kubenswrapper[2561]: I0918 13:19:23.800413 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7c88g_799efce0-1a62-4455-8935-c9d4aa52ce16/kube-rbac-proxy/0.log"